-- Logs begin at Tue 2022-09-27 00:37:30 UTC, end at Tue 2022-09-27 03:25:30 UTC. -- Sep 27 01:21:24.314951 n-d-859358-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 01:21:24.323447 n-d-859358-1 devstack@n-api.service[106267]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 01:21:24 2022] *** Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: nodename: n-d-859358-1 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: machine: x86_64 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: clock source: unix Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: pcre jit disabled Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: detected number of CPU cores: 4 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: current working directory: / Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: detected binary path: /usr/bin/uwsgi-core Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: your processes number limit is 47680 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: your memory page size is 4096 bytes Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: detected max file descriptor number: 2048 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: lock engine: pthread robust mutexes Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: thunder lock: enabled Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 01:21:24.326427 n-d-859358-1 devstack@n-api.service[106267]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 01:21:24.365427 n-d-859358-1 devstack@n-api.service[106267]: Python main interpreter initialized at 0x55ad030e89c0 Sep 27 01:21:24.365427 n-d-859358-1 devstack@n-api.service[106267]: python threads support enabled Sep 27 01:21:24.365427 n-d-859358-1 devstack@n-api.service[106267]: your server socket listen backlog is limited to 100 connections Sep 27 01:21:24.365427 n-d-859358-1 devstack@n-api.service[106267]: your mercy for graceful operations on workers is 90 seconds Sep 27 01:21:24.365764 n-d-859358-1 devstack@n-api.service[106267]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 01:21:24.365853 n-d-859358-1 devstack@n-api.service[106267]: *** Operational MODE: preforking *** Sep 27 01:21:24.366085 n-d-859358-1 devstack@n-api.service[106267]: *** uWSGI is running in multiple interpreter mode *** Sep 27 01:21:24.366085 n-d-859358-1 devstack@n-api.service[106267]: spawned uWSGI master process (pid: 106267) Sep 27 01:21:24.366265 n-d-859358-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 27 01:21:24.366898 n-d-859358-1 devstack@n-api.service[106267]: spawned uWSGI worker 1 (pid: 106268, cores: 1) Sep 27 01:21:24.367107 n-d-859358-1 devstack@n-api.service[106267]: spawned uWSGI worker 2 (pid: 106269, cores: 1) Sep 27 01:21:24.367270 n-d-859358-1 devstack@n-api.service[106267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 01:21:25.022439 n-d-859358-1 devstack@n-api.service[106268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 01:21:25.026595 n-d-859358-1 devstack@n-api.service[106269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 01:21:26.097698 n-d-859358-1 devstack@n-api.service[106269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:21:26.097698 n-d-859358-1 devstack@n-api.service[106269]: from cryptography.utils import int_from_bytes Sep 27 01:21:26.098384 n-d-859358-1 devstack@n-api.service[106269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:21:26.098384 n-d-859358-1 devstack@n-api.service[106269]: from cryptography.utils import int_from_bytes Sep 27 01:21:26.098531 n-d-859358-1 devstack@n-api.service[106268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:21:26.098531 n-d-859358-1 devstack@n-api.service[106268]: from cryptography.utils import int_from_bytes Sep 27 01:21:26.098922 n-d-859358-1 devstack@n-api.service[106268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:21:26.098922 n-d-859358-1 devstack@n-api.service[106268]: from cryptography.utils import int_from_bytes Sep 27 01:21:28.567980 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 01:21:28.568599 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 01:21:28.568705 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 01:21:28.568705 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 01:21:28.569137 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 01:21:28.569220 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 01:21:28.569305 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 01:21:28.569429 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 01:21:28.569520 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 01:21:28.569640 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 01:21:28.569729 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570021 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570115 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570342 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570454 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570658 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570765 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.570972 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571070 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571279 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571371 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571587 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571672 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571900 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.571996 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572218 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572344 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572524 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572634 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572783 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.572936 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573094 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573193 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-859358-1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573436 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573535 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-859358-1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573740 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.573834 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574043 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574134 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574349 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574437 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574648 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574734 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.574946 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.575037 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.575254 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.575346 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.575554 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.575744 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576054 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576194 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576360 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576484 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576661 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576821 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.576986 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577169 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577307 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577464 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577626 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577720 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.577935 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578027 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578250 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578340 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578557 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578642 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.578875 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579036 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579182 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579313 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-859358-1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579561 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579647 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-859358-1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579869 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.579953 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580173 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580262 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580482 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580613 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580866 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.580954 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.581196 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.581538 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.581915 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.582218 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.582546 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.582859 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583104 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583199 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583425 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583524 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583754 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.583849 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584055 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584145 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584358 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584445 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584672 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584769 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.584973 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585058 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585272 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585380 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585550 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585652 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585853 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.585947 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586170 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586257 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586486 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586578 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586802 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.586909 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587049 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587144 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587296 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587398 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587608 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587694 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.587913 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588007 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588213 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588307 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588515 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588607 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588816 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.588910 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589075 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589160 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589325 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589439 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589667 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589762 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.589985 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590078 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590292 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590377 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590597 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590736 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590901 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.590996 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591205 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591299 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591504 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591596 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591804 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.591888 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592107 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592206 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592410 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592510 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592720 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.592825 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593023 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593117 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593357 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593447 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593665 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593749 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.593977 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594074 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594291 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594376 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594595 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594680 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594895 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.594987 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595193 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595292 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595507 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595606 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595821 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.595915 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596122 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596213 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596369 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596454 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596690 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596776 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.596992 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597088 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597308 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597461 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597632 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597719 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.597936 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598021 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598239 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598325 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598503 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598589 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598801 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.598894 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599102 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599189 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599401 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599486 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599701 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.599786 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600002 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600085 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600305 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600392 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600600 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600684 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.600901 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601069 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601198 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601282 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601524 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601614 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601825 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.601918 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602130 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602215 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602427 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602510 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602731 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.602872 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603027 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603135 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603328 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603426 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603630 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603737 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.603928 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604022 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604230 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604325 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604535 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604645 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604831 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.604925 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605131 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605232 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605457 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605567 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605759 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.605852 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606061 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606147 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606362 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606456 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606657 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606741 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.606956 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607049 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607254 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607349 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607557 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607641 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607856 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.607951 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608152 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608238 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608451 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608544 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608748 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.608839 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609045 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609130 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609366 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609455 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609662 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609748 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.609959 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610053 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610255 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610340 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610555 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610646 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.610859 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611015 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611149 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611284 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611439 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611579 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611734 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.611868 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.612010 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.612152 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.612830 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.612948 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.613149 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.613243 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.613477 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.613568 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.613785 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.613884 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.614086 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.614174 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.614400 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:21:28.614493 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.614733 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.614820 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615062 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615147 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615386 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615478 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615693 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.615780 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616001 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616088 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616308 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616402 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616626 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616713 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.616932 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617030 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617245 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617345 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617581 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617667 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617887 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.617982 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618194 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618288 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618500 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618586 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618811 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.618897 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619124 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619209 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619439 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619538 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619750 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.619837 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620059 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620152 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620378 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620466 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620685 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.620770 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621001 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621127 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621322 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621455 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621651 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621737 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.621957 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622122 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622264 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622358 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622601 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622689 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.622915 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623026 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623226 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623330 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623538 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623625 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623842 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.623928 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624149 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624233 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624455 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624555 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624763 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.624868 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625070 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625158 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625398 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625488 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625708 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.625796 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626015 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626102 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626333 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626425 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626641 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626729 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.626947 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627032 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627252 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627344 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627580 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627711 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.627918 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.628505 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.628709 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.628806 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629015 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629110 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629318 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629421 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629639 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629736 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.629941 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630028 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630249 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630343 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630554 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630650 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630859 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.630946 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631170 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631269 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631469 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631576 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631765 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.631850 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632066 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632160 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632371 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632460 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632673 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632759 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.632979 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633114 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633281 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633395 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633608 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633695 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.633916 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634003 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634218 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634307 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634522 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634607 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634827 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.634911 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635130 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635220 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635428 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635513 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635734 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.635829 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636037 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636122 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636338 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636425 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636639 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636733 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.636944 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637030 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637245 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637381 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637570 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637674 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637875 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.637968 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638178 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638265 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638480 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638574 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638785 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.638871 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639094 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639190 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639404 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639502 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639710 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.639796 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640023 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640111 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640334 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640421 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640636 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640719 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.640940 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641026 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641240 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641352 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641562 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641648 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641860 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.641946 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642163 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642251 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642465 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642560 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642763 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.642859 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643062 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643149 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643360 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643486 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643679 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643775 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.643976 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644061 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644280 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644366 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644577 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644671 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644873 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.644958 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645169 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645260 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645490 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645597 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645792 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.645879 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646109 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646197 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646414 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646501 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646714 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.646807 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647015 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647109 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647316 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647410 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647648 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647741 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.647950 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648043 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648254 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648355 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648559 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648645 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648863 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.648956 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649178 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649265 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649505 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649594 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649819 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.649905 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650125 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650213 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650430 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650516 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650740 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.650906 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651050 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651144 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651347 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651431 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651656 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651751 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.651970 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652063 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652277 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652365 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652597 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652693 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.652906 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653000 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653211 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653296 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653538 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653638 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653841 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.653938 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654148 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654236 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654454 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654542 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654760 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.654854 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655076 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655198 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655381 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655512 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655694 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655823 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.655997 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656131 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656314 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656440 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656618 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656748 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.656930 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.657055 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.657531 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.657671 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.657845 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.657979 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658171 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658293 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658500 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658588 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658806 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.658893 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659137 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659239 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659455 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659568 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659763 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.659850 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660069 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660164 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660377 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660471 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660683 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660769 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.660982 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661077 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661288 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661393 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661634 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661729 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.661938 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662048 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662241 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662328 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662542 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662628 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662841 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.662975 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663143 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663241 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663441 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663560 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663741 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.663829 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664043 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664127 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664348 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664436 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664651 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664738 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.664963 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665051 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665268 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665375 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665592 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665680 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665890 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.665974 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666199 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666293 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666501 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666587 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666801 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.666897 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667099 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667204 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667397 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667483 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667702 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.667797 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668002 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668099 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668310 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668403 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668612 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668697 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.668913 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669021 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669212 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669300 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669538 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669626 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669841 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.669928 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670146 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670232 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670461 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670545 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670774 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.670865 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671080 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671175 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671385 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671469 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671692 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671786 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.671996 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672085 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672298 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672382 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672614 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672701 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.672917 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673003 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673220 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673315 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673547 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673666 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673849 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.673935 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.674155 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.674255 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.674462 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.674548 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.675306 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.675550 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.675644 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.675883 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.675971 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676198 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676291 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676497 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676582 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676805 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.676900 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.677119 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.677220 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.677502 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.677703 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.677831 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678036 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678146 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678348 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678453 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678664 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.678757 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679006 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679107 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679323 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679418 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679638 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679723 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.679941 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680038 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680242 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680329 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680545 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680637 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680852 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.680940 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681151 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681237 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681478 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681566 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681782 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.681876 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.682080 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.682169 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.682383 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.682476 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.682904 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683000 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683000 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683121 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683273 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683401 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683581 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683693 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683882 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.683974 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684181 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684275 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684483 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684569 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684782 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.684874 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685093 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685189 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685420 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685513 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685744 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.685831 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686055 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686155 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686358 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686444 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686660 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686746 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.686963 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687073 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687277 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687364 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687580 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687667 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687883 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.687971 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688185 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688279 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688489 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688576 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688793 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.688881 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689090 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689176 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689429 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689530 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689731 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.689818 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.690032 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.690126 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.690374 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.690959 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691183 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691271 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691491 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691576 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691787 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.691881 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692091 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692176 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692392 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692483 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692694 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692795 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.692994 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693093 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693290 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693425 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693618 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693754 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.693916 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694001 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694219 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694303 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694518 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694615 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694816 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.694901 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695115 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695199 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695416 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695512 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695717 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.695812 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696014 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696099 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696315 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696400 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696611 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696696 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.696923 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697054 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697223 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697310 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697545 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697634 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697844 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.697929 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698145 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698239 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698444 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698532 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698740 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.698835 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699045 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699132 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699348 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699432 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699648 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699747 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.699945 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700030 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700247 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700332 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700542 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700643 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700840 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.700934 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701141 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701227 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701477 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701587 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701778 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.701910 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702077 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702162 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702374 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702460 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702671 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702756 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.702965 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703058 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703263 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703349 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703566 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703659 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703863 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.703948 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704162 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704260 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704459 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704545 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704755 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.704847 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705054 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705149 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705390 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705479 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705697 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.705797 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706033 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706138 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706335 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706423 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706637 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706732 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.706962 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707049 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707263 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707357 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707563 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707658 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707877 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.707963 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708183 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708277 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708493 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708590 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708793 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.708881 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709092 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709179 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709422 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709511 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709726 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.709824 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710031 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710124 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710337 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710423 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710649 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710743 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.710954 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711041 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711255 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711343 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711556 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711642 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.711942 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712052 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712169 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712255 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712471 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712556 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712778 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.712864 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713085 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713180 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713410 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713498 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713721 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.713819 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714028 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714115 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714334 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714435 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714636 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714731 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.714939 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715026 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715246 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715330 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715543 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715638 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715851 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.715938 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716153 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716245 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716455 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716550 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716755 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.716840 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717053 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717139 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717377 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717474 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717680 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717765 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.717999 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718086 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718308 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718396 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718611 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718697 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.718919 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719006 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719223 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719311 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719533 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719619 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719838 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.719925 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720151 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720258 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720453 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720570 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720864 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.720959 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721175 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721260 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721503 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721619 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721850 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.721953 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722152 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722247 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722453 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722539 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722753 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.722847 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723069 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723155 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723371 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723457 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723674 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723769 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.723975 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724061 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724293 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724388 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724596 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724692 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724912 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.724997 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725232 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725318 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725560 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725650 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725866 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.725952 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726170 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726327 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726492 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726635 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726795 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.726944 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727115 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727261 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727527 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727615 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727837 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.727930 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728141 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728238 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728469 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728568 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728774 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.728873 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729094 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729180 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729449 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729553 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729759 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.729846 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730069 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730155 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730372 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730470 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730685 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730773 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.730998 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731089 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731312 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731411 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731629 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731715 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.731935 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732028 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732249 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732355 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732550 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732645 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732870 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.732957 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733190 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733285 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733529 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733669 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733845 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.733943 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734153 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734241 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734456 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734551 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734757 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.734844 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735077 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735166 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735379 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735467 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735687 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735784 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.735996 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736083 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736301 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736389 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736603 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736699 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736901 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.736988 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.737762 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.737860 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738071 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738172 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738382 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738468 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738689 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738789 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.738994 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739089 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739313 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739406 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739596 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739682 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.739915 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740014 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740218 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740304 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740520 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740606 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740818 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.740914 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741118 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741205 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741463 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741551 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741769 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.741866 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742083 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742168 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742386 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742474 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742689 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742784 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.742988 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743075 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743290 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743376 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743627 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743717 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.743931 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744031 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744234 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744329 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744550 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744637 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744870 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.744961 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745170 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745265 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745497 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745586 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745806 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.745896 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746109 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746206 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746411 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746498 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746715 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.746802 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747022 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747111 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747326 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747413 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747628 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747713 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.747927 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748023 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748228 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748313 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748532 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748618 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748835 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.748923 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749140 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749225 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749461 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749551 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749764 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.749853 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750065 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750153 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750385 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750547 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750688 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.750777 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751008 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751095 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751309 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751405 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751614 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751700 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.751916 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752021 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752218 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752317 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752528 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752631 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.752890 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.753528 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.754820 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755613 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755713 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755798 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755879 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755959 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.755959 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756131 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756131 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756293 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756372 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756451 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756537 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756618 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756696 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.756696 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757242 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757242 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757448 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757542 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757623 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.757749 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.758070 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.758169 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.758410 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.758747 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.758918 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.759233 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.759548 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.759817 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.759909 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760162 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760258 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760499 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760587 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760827 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.760914 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761137 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761224 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761471 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761562 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761788 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.761878 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762114 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762209 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762433 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762530 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762756 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.762844 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763088 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763183 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763404 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763505 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763716 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.763803 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764027 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764113 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764338 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764477 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764687 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.764779 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765000 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765086 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765302 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765403 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765637 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765724 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.765953 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766038 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766271 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766410 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766573 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766659 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766878 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.766978 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767189 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767283 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767496 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767589 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767802 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.767898 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768105 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768199 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768432 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768529 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768742 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.768838 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769063 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769159 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769417 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769510 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769739 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.769828 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770050 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770135 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770363 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770449 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770675 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.770761 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771187 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771283 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771500 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771586 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771832 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.771921 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772151 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772236 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772471 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772610 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772785 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.772870 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773099 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773184 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773451 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773554 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773758 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.773845 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774060 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774145 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774366 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774465 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774675 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774768 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.774972 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775068 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775287 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775383 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775592 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775692 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775892 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.775978 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.776206 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.776293 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.776511 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.776604 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777036 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777123 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777404 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777495 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777725 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.777811 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778045 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778142 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778388 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778477 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778680 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778773 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.778986 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779081 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779304 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779391 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779608 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779693 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.779907 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780002 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780219 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780305 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780526 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780611 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780827 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.780922 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781124 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781211 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781454 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781543 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781764 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.781863 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.782063 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.782410 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.782633 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.782718 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.782933 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783034 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783253 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783351 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783554 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783647 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783857 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.783946 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.784686 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.784842 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785044 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785190 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785430 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785581 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785744 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.785900 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786046 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786192 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786354 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786516 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786675 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786823 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.786966 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787109 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787270 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787424 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787574 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787729 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.787877 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788047 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788198 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788413 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788561 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788721 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.788870 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789038 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789187 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789308 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789410 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789491 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789584 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789743 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789827 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.789895 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790028 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790129 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790347 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790454 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790657 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790765 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.790966 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.791086 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.791310 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.791414 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.791624 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.791715 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792362 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792485 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792581 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792664 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792800 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.792903 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793128 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793224 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793480 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793575 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793788 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.793884 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794090 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794176 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794389 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794466 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794708 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.794784 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795016 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795107 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795325 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795401 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795744 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795846 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.795927 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796016 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796229 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796316 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796534 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796629 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796839 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.796937 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797143 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797231 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797473 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797567 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797778 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.797868 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798083 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798161 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798387 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798463 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798694 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798773 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.798998 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.799074 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.799307 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.799383 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802419 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802658 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802658 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802814 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802894 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.802972 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803047 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803127 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803205 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803284 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803362 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803449 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803530 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803660 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803749 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803838 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.803918 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804007 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804088 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804174 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804254 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804348 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804442 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804524 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804602 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804843 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.804972 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805078 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805180 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805268 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805370 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805468 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805561 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805660 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805795 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.805916 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806113 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806212 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806429 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806527 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806735 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.806833 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807049 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807153 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807353 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807459 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807675 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.807771 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808007 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808102 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808328 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808434 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808645 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808742 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.808945 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809040 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809241 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809377 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809568 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809705 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809868 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.809955 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810182 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810272 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810487 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810574 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810786 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.810875 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811085 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811173 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811388 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811501 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811689 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811795 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.811988 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812091 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812288 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812377 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812585 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812672 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812888 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.812994 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813186 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813289 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813505 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813609 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813804 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.813897 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814102 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814196 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814401 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814496 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814697 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814782 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.814999 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815094 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815318 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815419 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815622 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815709 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.815924 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816106 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816252 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816401 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816542 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816679 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816816 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.816952 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817129 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817278 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817445 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817535 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817767 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.817856 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818073 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818162 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818388 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818483 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818691 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.818779 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819008 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819098 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819321 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819448 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819630 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819729 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.819934 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820029 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820257 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820343 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820559 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820654 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820863 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.820950 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821168 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821261 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821495 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821615 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821798 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.821887 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822101 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822189 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822421 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822522 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822741 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.822830 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823039 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823139 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823359 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823465 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823666 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823761 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.823975 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824062 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824283 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824374 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824586 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824673 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.824908 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825003 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825211 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825299 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825538 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825626 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.825858 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826013 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826146 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826235 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826451 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826545 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826759 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.826855 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827061 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827149 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827366 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827459 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827674 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827774 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.827990 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828086 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828303 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828390 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828621 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828715 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.828923 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829016 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829245 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829331 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829594 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829694 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.829932 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830027 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830240 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830327 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830576 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830665 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830898 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.830984 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831230 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831315 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831537 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831631 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831839 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.831925 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:21:28.832076 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 01:21:28.832174 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 01:21:28.985080 n-d-859358-1 devstack@n-api.service[106269]: INFO dbcounter [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Registered counter for database nova_api Sep 27 01:21:28.985261 n-d-859358-1 devstack@n-api.service[106268]: INFO dbcounter [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Registered counter for database nova_api Sep 27 01:21:29.005440 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_db.sqlalchemy.engines [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.007213 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.012018 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writer thread running {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.013805 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writer thread running {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.068202 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.context [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=106269) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 01:21:29.070841 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.context [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=106268) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 01:21:29.073895 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:21:29.074555 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:21:29.075365 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:21:29.075847 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:21:29.076206 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:21:29.076945 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:21:29.077403 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:21:29.077591 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:21:29.078200 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:21:29.078649 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:21:29.079386 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:21:29.081443 n-d-859358-1 devstack@n-api.service[106269]: INFO dbcounter [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Registered counter for database nova_cell0 Sep 27 01:21:29.081584 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_concurrency.lockutils [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:21:29.083574 n-d-859358-1 devstack@n-api.service[106268]: INFO dbcounter [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Registered counter for database nova_cell0 Sep 27 01:21:29.085482 n-d-859358-1 devstack@n-api.service[106269]: INFO dbcounter [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Registered counter for database nova_cell1 Sep 27 01:21:29.089135 n-d-859358-1 devstack@n-api.service[106268]: INFO dbcounter [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Registered counter for database nova_cell1 Sep 27 01:21:29.093383 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_db.sqlalchemy.engines [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.094740 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_db.sqlalchemy.engines [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.096472 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.099619 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.101928 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writer thread running {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.103475 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writer thread running {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.104176 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writer thread running {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.241833 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writer thread running {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.247658 n-d-859358-1 devstack@n-api.service[106269]: INFO dbcounter [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Registered counter for database nova_cell0 Sep 27 01:21:29.250981 n-d-859358-1 devstack@n-api.service[106268]: INFO dbcounter [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Registered counter for database nova_cell0 Sep 27 01:21:29.256713 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_db.sqlalchemy.engines [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.259835 n-d-859358-1 devstack@n-api.service[106268]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:21:29.261203 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writer thread running {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.264141 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writer thread running {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:21:29.604699 n-d-859358-1 devstack@n-api.service[106269]: WARNING keystonemiddleware.auth_token [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:21:29.607032 n-d-859358-1 devstack@n-api.service[106268]: WARNING keystonemiddleware.auth_token [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:21:29.611950 n-d-859358-1 devstack@n-api.service[106269]: WARNING keystonemiddleware.auth_token [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:21:29.614356 n-d-859358-1 devstack@n-api.service[106268]: WARNING keystonemiddleware.auth_token [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:21:29.953501 n-d-859358-1 devstack@n-api.service[106269]: WARNING keystonemiddleware.auth_token [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:21:29.957713 n-d-859358-1 devstack@n-api.service[106268]: WARNING keystonemiddleware.auth_token [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:21:29.959513 n-d-859358-1 devstack@n-api.service[106269]: WARNING keystonemiddleware.auth_token [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:21:29.963647 n-d-859358-1 devstack@n-api.service[106268]: WARNING keystonemiddleware.auth_token [None req-3cd6963e-ef92-4996-b967-26fcd4a78090 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:21:29.965386 n-d-859358-1 devstack@n-api.service[106269]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad030e89c0 pid: 106269 (default app) Sep 27 01:21:29.967434 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:21:29.968607 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Sep 27 01:21:29.968976 n-d-859358-1 devstack@n-api.service[106268]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad030e89c0 pid: 106268 (default app) Sep 27 01:21:29.969064 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Sep 27 01:21:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:22:51.212044 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:22:51.213794 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Sep 27 01:22:51.214352 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:22:51.226393 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_api:SELECT=3 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:51.227184 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_cell0:SELECT=3 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:51.228087 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_cell1:SELECT=3 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:51.230047 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:52.117240 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-59130d7d-b01b-4cd2-9960-c5b133abeb5f admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:22:52.151058 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-59130d7d-b01b-4cd2-9960-c5b133abeb5f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929739 Sep 27 01:22:52.151814 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:22:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:22:55.045077 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:22:55.046105 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-74efee7d-4ad3-4b4b-8519-c4928bf6f485 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 27 01:22:55.046685 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:22:55.476449 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-490aaa7a-115f-4fce-909d-40dabe793dc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "disk": 1}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:22:55.525489 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-490aaa7a-115f-4fce-909d-40dabe793dc2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.472724 Sep 27 01:22:55.526054 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:22:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:22:55.543273 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_api:SELECT=3 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:55.544120 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_cell1:SELECT=3 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:55.546209 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_cell0:SELECT=3 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:55.547315 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:22:55.759278 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-fee7a95c-f392-4e99-a56e-f42c1ed4934f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:22:55.826329 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-fee7a95c-f392-4e99-a56e-f42c1ed4934f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288387 Sep 27 01:22:55.826829 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 27 01:22:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:22:58.416369 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-490aaa7a-115f-4fce-909d-40dabe793dc2 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:22:58.417318 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-490aaa7a-115f-4fce-909d-40dabe793dc2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 27 01:22:58.417869 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:22:59.290738 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-1b02add0-e9e4-4804-858d-e6db9683d2b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:22:59.338700 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-1b02add0-e9e4-4804-858d-e6db9683d2b1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.914142 Sep 27 01:22:59.352464 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-df2f80f9-336f-4c06-864e-f93491e821a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:22:59.357125 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:22:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:22:59.401175 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-df2f80f9-336f-4c06-864e-f93491e821a1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052575 Sep 27 01:22:59.424716 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 27 01:22:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:23:02.474150 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-1b02add0-e9e4-4804-858d-e6db9683d2b1 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:02.475179 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-1b02add0-e9e4-4804-858d-e6db9683d2b1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Sep 27 01:23:02.475600 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:03.052706 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-61faeeef-a78d-4bc1-82b6-3c977ccfa238 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:03.074544 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-61faeeef-a78d-4bc1-82b6-3c977ccfa238 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.591868 Sep 27 01:23:03.075952 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:03.088487 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-b6a4f173-c35a-4c64-a611-c0f67e2567e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:03.120888 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-b6a4f173-c35a-4c64-a611-c0f67e2567e9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034791 Sep 27 01:23:03.131200 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 27 01:23:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:05.787290 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-61faeeef-a78d-4bc1-82b6-3c977ccfa238 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:05.788561 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-61faeeef-a78d-4bc1-82b6-3c977ccfa238 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 27 01:23:05.788662 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:06.262368 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-793a2370-787c-4409-9062-4794669c5c4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:06.285601 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-793a2370-787c-4409-9062-4794669c5c4e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490444 Sep 27 01:23:06.286151 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:23:06.298771 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-b2c83feb-5ff1-41ee-9181-ec5bf0d6733d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:06.332442 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-b2c83feb-5ff1-41ee-9181-ec5bf0d6733d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038001 Sep 27 01:23:06.333441 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 27 01:23:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:08.993116 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-793a2370-787c-4409-9062-4794669c5c4e admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:08.994161 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-793a2370-787c-4409-9062-4794669c5c4e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 27 01:23:08.994552 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:09.513844 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:09.540790 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540056 Sep 27 01:23:09.555643 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-3175cd17-16be-462c-af95-6f7ae4c12a03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:09.561295 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:09.584119 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-3175cd17-16be-462c-af95-6f7ae4c12a03 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032644 Sep 27 01:23:09.606878 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Sep 27 01:23:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:12.190653 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:12.191687 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 27 01:23:12.192089 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:12.620831 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-68c7ed3d-185f-4827-b168-76f8a73f347d admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:12.646091 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-68c7ed3d-185f-4827-b168-76f8a73f347d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447641 Sep 27 01:23:12.646623 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:23:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:23:15.624851 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:15.626545 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dfcdb9b9-12b8-4aa0-9253-db63149f98c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Sep 27 01:23:15.627215 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:16.049087 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-a760838f-67cb-46fd-a8d4-14d988c0ac56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:16.068174 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-a760838f-67cb-46fd-a8d4-14d988c0ac56 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.434972 Sep 27 01:23:16.068836 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:16.081023 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-10751228-b739-4745-b536-e29da96ec28d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:16.108488 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-10751228-b739-4745-b536-e29da96ec28d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031100 Sep 27 01:23:16.109090 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 27 01:23:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:23:18.859584 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-a760838f-67cb-46fd-a8d4-14d988c0ac56 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:18.861124 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-a760838f-67cb-46fd-a8d4-14d988c0ac56 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Sep 27 01:23:18.861634 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:19.275034 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-58c1e275-6cbe-4425-8eb0-721854550ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:19.296277 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-58c1e275-6cbe-4425-8eb0-721854550ba1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428561 Sep 27 01:23:19.296853 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:19.309495 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-e2efe047-9c0f-4279-9d92-1e78f90f7b19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:19.331820 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-e2efe047-9c0f-4279-9d92-1e78f90f7b19 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026070 Sep 27 01:23:19.332388 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 27 01:23:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:21.909752 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-58c1e275-6cbe-4425-8eb0-721854550ba1 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:21.911344 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-58c1e275-6cbe-4425-8eb0-721854550ba1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Sep 27 01:23:21.911754 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:22.427088 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-dfa799ba-d44b-482e-97ea-747c70ad9039 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:22.449099 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-dfa799ba-d44b-482e-97ea-747c70ad9039 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.531390 Sep 27 01:23:22.460259 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:23:22.468468 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-1ed0f606-2e27-4dea-b442-44512ff787b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:22.474569 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:23:22.497796 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-1ed0f606-2e27-4dea-b442-44512ff787b6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034412 Sep 27 01:23:22.498366 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 27 01:23:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:25.125936 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-dfa799ba-d44b-482e-97ea-747c70ad9039 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:25.127687 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-dfa799ba-d44b-482e-97ea-747c70ad9039 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002263 Sep 27 01:23:25.128308 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:25.568415 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-d63abdcd-71b0-4fef-9308-ad1a63c135fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "swap": 0}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:25.588289 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-d63abdcd-71b0-4fef-9308-ad1a63c135fb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453159 Sep 27 01:23:25.596283 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:25.601268 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-77a86da1-4716-42b2-a161-e13d946f6247 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:25.625554 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-77a86da1-4716-42b2-a161-e13d946f6247 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027886 Sep 27 01:23:25.628284 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 27 01:23:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:23:28.280012 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-d63abdcd-71b0-4fef-9308-ad1a63c135fb admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:28.281191 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-d63abdcd-71b0-4fef-9308-ad1a63c135fb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Sep 27 01:23:28.282410 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:28.719349 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:28.727593 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:23:28.741997 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453660 Sep 27 01:23:28.742714 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Sep 27 01:23:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:28.754979 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-f230c736-1b23-42db-be02-9d66be54480e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:28.784900 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-f230c736-1b23-42db-be02-9d66be54480e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034085 Sep 27 01:23:28.785867 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Sep 27 01:23:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:23:48.641435 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:48.642459 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 27 01:23:48.642861 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:48.653479 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:23:49.031214 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-c4de9aae-9c52-4d03-bab2-e2ec3d5b2a1a admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:49.050754 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-c4de9aae-9c52-4d03-bab2-e2ec3d5b2a1a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401760 Sep 27 01:23:49.051295 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:23:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:23:50.353483 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:50.354497 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-388341e7-016e-433c-b50c-e47c6cc3905f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 27 01:23:50.354892 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:50.911080 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-0a4198ec-da9a-4a3a-8496-bdfe0f30a24a admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:50.916335 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.wsgi [None req-0a4198ec-da9a-4a3a-8496-bdfe0f30a24a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-0a4198ec-da9a-4a3a-8496-bdfe0f30a24a admin admin] Request method failure captured: Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Accept: application/json Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Accept-Encoding: gzip, deflate Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Connection: keep-alive Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Content-Length: 0 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Host: 10.222.0.52 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: Openstack-System-Scope: None Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: User-Agent: python-novaclient Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Auth-Token: gAAAAABjMlCm6dIYKq2xlP3KqOjxdH0rnVpzNG0VUhkjLnDpB5ZjMdKNkG_U2Glq1ZLxLYPkczLv6fTUt2CFcBK76ER1TeJ9HWWlIzlyUELOCN7AwEfgoDEkB0URBgVlc1K-F9LSQvSq8qn8qXY6yMbNw2WN1nkw2Cp-9iKkllchibb3dTMaYc4 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Id: None Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Name: None Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Identity-Status: Confirmed Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Is-Admin-Project: True Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Id: default Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Name: Default Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Name: admin Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Role: admin,reader,member Sep 27 01:23:50.919558 n-d-859358-1 devstack@n-api.service[106268]: X-Roles: admin,reader,member Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant: admin Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Name: admin Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-User: admin Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Id: default Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Name: Default Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: X-User-Name: admin Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: method: > Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: exception: Flavor 42 could not be found. Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: action_args: {'id': '42'} Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:50.921210 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:50.922267 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:50.923741 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-0a4198ec-da9a-4a3a-8496-bdfe0f30a24a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:50.924990 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-0a4198ec-da9a-4a3a-8496-bdfe0f30a24a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.406854 Sep 27 01:23:50.924990 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 27 01:23:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:50.931199 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-04c135e0-1975-4ca5-98bd-57274fa85301 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:50.955302 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-04c135e0-1975-4ca5-98bd-57274fa85301 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027930 Sep 27 01:23:50.956135 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:23:50.970715 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-77c5ff3e-224f-43f3-8eb0-1d672780d5a7 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:50.998977 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-77c5ff3e-224f-43f3-8eb0-1d672780d5a7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033883 Sep 27 01:23:50.999901 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:23:51.009860 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-5437ac6c-1cb2-47b7-a589-c57fc6a9cdfd admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:51.015227 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.wsgi [None req-5437ac6c-1cb2-47b7-a589-c57fc6a9cdfd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-5437ac6c-1cb2-47b7-a589-c57fc6a9cdfd admin admin] Request method failure captured: Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Accept: application/json Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Accept-Encoding: gzip, deflate Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Connection: keep-alive Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Content-Length: 0 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Host: 10.222.0.52 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: Openstack-System-Scope: None Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: User-Agent: python-novaclient Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Auth-Token: gAAAAABjMlCm6dIYKq2xlP3KqOjxdH0rnVpzNG0VUhkjLnDpB5ZjMdKNkG_U2Glq1ZLxLYPkczLv6fTUt2CFcBK76ER1TeJ9HWWlIzlyUELOCN7AwEfgoDEkB0URBgVlc1K-F9LSQvSq8qn8qXY6yMbNw2WN1nkw2Cp-9iKkllchibb3dTMaYc4 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Id: None Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Name: None Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Identity-Status: Confirmed Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Is-Admin-Project: True Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Id: default Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Name: Default Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Name: admin Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Role: admin,reader,member Sep 27 01:23:51.018957 n-d-859358-1 devstack@n-api.service[106269]: X-Roles: admin,reader,member Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant: admin Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Name: admin Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-User: admin Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Id: default Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Name: Default Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: X-User-Name: admin Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: method: > Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: exception: Flavor 42 could not be found. Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: action_args: {'id': '42'} Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:51.021320 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:51.023322 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:51.025646 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-5437ac6c-1cb2-47b7-a589-c57fc6a9cdfd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:51.027749 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-5437ac6c-1cb2-47b7-a589-c57fc6a9cdfd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014332 Sep 27 01:23:51.027749 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 27 01:23:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:52.221208 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-77c5ff3e-224f-43f3-8eb0-1d672780d5a7 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:52.222243 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-77c5ff3e-224f-43f3-8eb0-1d672780d5a7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 27 01:23:52.222641 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:52.740816 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-47d0f51a-2261-45be-8c24-0fe70af11e3b admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:52.745968 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.wsgi [None req-47d0f51a-2261-45be-8c24-0fe70af11e3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-47d0f51a-2261-45be-8c24-0fe70af11e3b admin admin] Request method failure captured: Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Accept: application/json Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Accept-Encoding: gzip, deflate Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Connection: keep-alive Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Content-Length: 0 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Host: 10.222.0.52 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: Openstack-System-Scope: None Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: User-Agent: python-novaclient Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Auth-Token: gAAAAABjMlCo6_mRBYR-IIUePz4G_ammAdxZqtk4JfVX_t1Lbk1heiJ4ui8Di_XrpstEEeqFNCiu_jil1wlK898xy1BvE1nIExVsBz9ufFrJmv1cow7o9pR9aBGw8dcRANe5fu7PflBEHoM3bGRwRdyk5ueF-7yhrpy0LXwLiqMqSfTUbeT-Z6w Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Id: None Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Name: None Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Identity-Status: Confirmed Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Is-Admin-Project: True Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Id: default Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Name: Default Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Name: admin Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Role: admin,reader,member Sep 27 01:23:52.747472 n-d-859358-1 devstack@n-api.service[106269]: X-Roles: admin,reader,member Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant: admin Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Name: admin Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-User: admin Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Id: default Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Name: Default Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: X-User-Name: admin Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: method: > Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: exception: Flavor 84 could not be found. Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: action_args: {'id': '84'} Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:52.749066 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:52.750021 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.751901 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-47d0f51a-2261-45be-8c24-0fe70af11e3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:52.753214 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-47d0f51a-2261-45be-8c24-0fe70af11e3b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392142 Sep 27 01:23:52.753214 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 27 01:23:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:52.759146 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-a6461cfd-470b-432a-87b7-d8ccc6658eda admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:52.774612 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-a6461cfd-470b-432a-87b7-d8ccc6658eda admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019107 Sep 27 01:23:52.775143 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:23:52.784878 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-32f27ca4-083d-4e82-b5f3-4eff73446bda admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:52.800581 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-32f27ca4-083d-4e82-b5f3-4eff73446bda admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019453 Sep 27 01:23:52.801145 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:23:52.810548 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-d2144b34-0df4-4781-af91-3b8124ead544 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:52.816109 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.wsgi [None req-d2144b34-0df4-4781-af91-3b8124ead544 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-d2144b34-0df4-4781-af91-3b8124ead544 admin admin] Request method failure captured: Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Accept: application/json Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Accept-Encoding: gzip, deflate Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Connection: keep-alive Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Content-Length: 0 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Host: 10.222.0.52 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: Openstack-System-Scope: None Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: User-Agent: python-novaclient Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Auth-Token: gAAAAABjMlCo6_mRBYR-IIUePz4G_ammAdxZqtk4JfVX_t1Lbk1heiJ4ui8Di_XrpstEEeqFNCiu_jil1wlK898xy1BvE1nIExVsBz9ufFrJmv1cow7o9pR9aBGw8dcRANe5fu7PflBEHoM3bGRwRdyk5ueF-7yhrpy0LXwLiqMqSfTUbeT-Z6w Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Id: None Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Name: None Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Identity-Status: Confirmed Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Is-Admin-Project: True Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Id: default Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Name: Default Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Name: admin Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Role: admin,reader,member Sep 27 01:23:52.817681 n-d-859358-1 devstack@n-api.service[106268]: X-Roles: admin,reader,member Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant: admin Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Name: admin Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-User: admin Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Id: default Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Name: Default Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: X-User-Name: admin Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: method: > Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: exception: Flavor 84 could not be found. Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: action_args: {'id': '84'} Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:52.819222 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:52.820176 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:52.821291 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-d2144b34-0df4-4781-af91-3b8124ead544 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:52.822399 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-d2144b34-0df4-4781-af91-3b8124ead544 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012088 Sep 27 01:23:52.822399 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 27 01:23:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:54.032951 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-32f27ca4-083d-4e82-b5f3-4eff73446bda admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:54.034258 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-32f27ca4-083d-4e82-b5f3-4eff73446bda admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Sep 27 01:23:54.034957 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:54.547899 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7865ca9c-2923-4059-a3e8-860c5e3546ea admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:54.553682 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.wsgi [None req-7865ca9c-2923-4059-a3e8-860c5e3546ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7865ca9c-2923-4059-a3e8-860c5e3546ea admin admin] Request method failure captured: Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Accept: application/json Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Accept-Encoding: gzip, deflate Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Connection: keep-alive Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Content-Length: 0 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Host: 10.222.0.52 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: Openstack-System-Scope: None Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: User-Agent: python-novaclient Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Auth-Token: gAAAAABjMlCpxlr-aUtfR5ffHCQCrwbeFoOTOAWvzNaO_GHbku6dABdZ6JrnBMFFn_58BRJaH2GnUfmmIzB7xkgZa-FKiFuFdYVCTLtEsUm-WXqldhi8yET5jqP7Qg04YJP81B6MPqVGBBhbQGqcY63OCJfE81iTrJiqTOQEanxHd5Utu5pa6Yk Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Id: None Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Domain-Name: None Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Identity-Status: Confirmed Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Is-Admin-Project: True Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Id: default Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Domain-Name: Default Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Project-Name: admin Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Role: admin,reader,member Sep 27 01:23:54.555162 n-d-859358-1 devstack@n-api.service[106268]: X-Roles: admin,reader,member Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant: admin Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-Tenant-Name: admin Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-User: admin Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Id: default Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-User-Domain-Name: Default Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: X-User-Name: admin Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: method: > Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: exception: Flavor 451 could not be found. Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: action_args: {'id': '451'} Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:54.556664 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:54.557654 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.558905 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7865ca9c-2923-4059-a3e8-860c5e3546ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:54.560184 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-7865ca9c-2923-4059-a3e8-860c5e3546ea admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385776 Sep 27 01:23:54.560184 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:23:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:54.567015 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-e2a987d1-486c-4ae0-bc12-56d818a04944 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:54.582569 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-e2a987d1-486c-4ae0-bc12-56d818a04944 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019646 Sep 27 01:23:54.583089 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:23:54.592175 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:54.606599 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017836 Sep 27 01:23:54.607109 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Sep 27 01:23:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:23:54.616567 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-16d00dd5-3cd3-4b07-802c-763f77e921e4 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:54.621390 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.wsgi [None req-16d00dd5-3cd3-4b07-802c-763f77e921e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-16d00dd5-3cd3-4b07-802c-763f77e921e4 admin admin] Request method failure captured: Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Accept: application/json Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Accept-Encoding: gzip, deflate Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Connection: keep-alive Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Content-Length: 0 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Host: 10.222.0.52 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Openstack-Api-Version: compute 2.92 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: Openstack-System-Scope: None Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: User-Agent: python-novaclient Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Auth-Token: gAAAAABjMlCpxlr-aUtfR5ffHCQCrwbeFoOTOAWvzNaO_GHbku6dABdZ6JrnBMFFn_58BRJaH2GnUfmmIzB7xkgZa-FKiFuFdYVCTLtEsUm-WXqldhi8yET5jqP7Qg04YJP81B6MPqVGBBhbQGqcY63OCJfE81iTrJiqTOQEanxHd5Utu5pa6Yk Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Id: None Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Domain-Name: None Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Identity-Status: Confirmed Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Is-Admin-Project: True Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Id: default Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Domain-Name: Default Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Project-Name: admin Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Role: admin,reader,member Sep 27 01:23:54.622906 n-d-859358-1 devstack@n-api.service[106269]: X-Roles: admin,reader,member Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2547f19f41314aab81bf4460fafcc034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2547f19f41314aab81bf4460fafcc034", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant: admin Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Id: 2547f19f41314aab81bf4460fafcc034 Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-Tenant-Name: admin Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-User: admin Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Id: default Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-User-Domain-Name: Default Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-User-Id: 105f3b011caf41d88b0cf71baced512f Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: X-User-Name: admin Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: method: > Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: exception: Flavor 451 could not be found. Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: action_args: {'id': '451'} Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:23:54.624440 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:54.626034 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: ERROR nova.api.openstack.wsgi Sep 27 01:23:54.627301 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-16d00dd5-3cd3-4b07-802c-763f77e921e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:23:54.628487 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-16d00dd5-3cd3-4b07-802c-763f77e921e4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011144 Sep 27 01:23:54.628487 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:23:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:23:55.833258 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:55.834288 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 27 01:23:55.834682 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:56.352151 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-cbe2d298-5e55-4db4-9c98-11abd9f47879 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:56.372867 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-cbe2d298-5e55-4db4-9c98-11abd9f47879 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400806 Sep 27 01:23:56.373424 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 27 01:23:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:23:57.596831 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:57.597886 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 27 01:23:57.598293 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:58.117613 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-2eaccadb-2edb-4f19-b4df-0a02ea5a5616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:58.135667 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-2eaccadb-2edb-4f19-b4df-0a02ea5a5616 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.399654 Sep 27 01:23:58.136213 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 27 01:23:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:23:59.341300 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:23:59.342344 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 27 01:23:59.342737 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:23:59.870164 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-3c10aaf9-2e46-4de0-a2ec-4c3e60edcb1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:23:59.888163 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-3c10aaf9-2e46-4de0-a2ec-4c3e60edcb1e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406631 Sep 27 01:23:59.888694 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 27 01:23:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:24:01.099186 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:24:01.100180 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 27 01:24:01.100566 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:24:01.619983 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-7548be87-15d1-42cd-ab92-0ba60a30ac0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:24:01.638501 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-7548be87-15d1-42cd-ab92-0ba60a30ac0a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402519 Sep 27 01:24:01.638976 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Sep 27 01:24:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:24:02.854304 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:24:02.855311 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 27 01:24:02.855700 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:24:03.367340 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-b49e6fda-2df4-4fca-bc1c-3dab1cdffdd0 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:24:03.387906 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-b49e6fda-2df4-4fca-bc1c-3dab1cdffdd0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397551 Sep 27 01:24:03.388437 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Sep 27 01:24:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:24:59.559884 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:24:59.560894 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-dd499769-0d87-43fd-8947-fb9064324f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 27 01:24:59.561288 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Tue Sep 27 01:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:24:59.572317 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:25:00.067472 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-ff65ad9b-0da4-4290-8dbe-1a562a82ac1a admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:25:00.087781 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-ff65ad9b-0da4-4290-8dbe-1a562a82ac1a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.519982 Sep 27 01:25:00.088326 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:24:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:25:00.109708 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_api:SELECT=14 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:25:00.113477 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-40e0a5f4-3f4c-48e6-a622-3b9fd181b648 admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:25:00.120847 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-40e0a5f4-3f4c-48e6-a622-3b9fd181b648 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013138 Sep 27 01:25:00.121386 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Sep 27 01:25:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:25:00.133275 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-9d05816a-10c7-438f-a01a-b7402ca3fc18 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:25:00.140905 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-9d05816a-10c7-438f-a01a-b7402ca3fc18 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011155 Sep 27 01:25:00.141467 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Sep 27 01:25:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:25:00.152375 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:25:00.159355 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010468 Sep 27 01:25:00.160117 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Sep 27 01:25:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:25:00.171669 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-549f860c-46fa-4aea-99a0-8b6d84e54f54 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:25:00.178683 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-549f860c-46fa-4aea-99a0-8b6d84e54f54 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010952 Sep 27 01:25:00.179189 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Sep 27 01:25:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:30:12.847742 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:30:12.848756 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Sep 27 01:30:12.849153 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:30:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:30:12.990543 n-d-859358-1 devstack@n-api.service[106269]: DEBUG dbcounter [-] [106269] Writing DB stats nova_api:SELECT=6 {{(pid=106269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:30:13.133658 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:30:13.138375 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:30:13.139825 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:30:13.140884 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:30:13.141717 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:30:13.142173 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:30:13.142623 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:30:13.182611 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-8a8e5d00-5627-47cc-9117-1de4e20c95a9 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.193252 Sep 27 01:30:13.183392 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:30:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:30:14.273417 n-d-859358-1 devstack@n-api.service[106268]: DEBUG nova.api.openstack.wsgi [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] Calling method '>' {{(pid=106268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:30:14.274412 n-d-859358-1 devstack@n-api.service[106268]: INFO nova.api.openstack.requestlog [None req-7d1a743d-6054-4e59-af2d-c645c686865a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 27 01:30:14.274806 n-d-859358-1 devstack@n-api.service[106268]: [pid: 106268|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Sep 27 01:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:30:14.465652 n-d-859358-1 devstack@n-api.service[106269]: DEBUG nova.api.openstack.wsgi [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Calling method '>' {{(pid=106269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:30:14.469065 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:30:14.469591 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:30:14.470016 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:30:14.470718 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:30:14.471156 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:30:14.471570 n-d-859358-1 devstack@n-api.service[106269]: DEBUG oslo_concurrency.lockutils [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:30:14.493790 n-d-859358-1 devstack@n-api.service[106269]: INFO nova.api.openstack.requestlog [None req-2b89f7d5-65a6-4fe3-9477-d33a14b07457 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079706 Sep 27 01:30:14.494301 n-d-859358-1 devstack@n-api.service[106269]: [pid: 106269|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:30:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:30:57.913589 n-d-859358-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 27 01:30:57.914342 n-d-859358-1 devstack@n-api.service[106267]: Tue Sep 27 01:30:57 2022 - graceful shutdown triggered... Sep 27 01:30:57.914778 n-d-859358-1 devstack@n-api.service[106269]: Gracefully killing worker 2 (pid: 106269)... Sep 27 01:30:57.915132 n-d-859358-1 devstack@n-api.service[106268]: Gracefully killing worker 1 (pid: 106268)... Sep 27 01:30:58.040694 n-d-859358-1 devstack@n-api.service[106268]: DEBUG dbcounter [-] [106268] Writing DB stats nova_api:SELECT=4 {{(pid=106268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:30:58.915410 n-d-859358-1 devstack@n-api.service[106267]: worker 1 buried after 1 seconds Sep 27 01:30:58.915410 n-d-859358-1 devstack@n-api.service[106267]: worker 2 buried after 1 seconds Sep 27 01:30:58.915410 n-d-859358-1 devstack@n-api.service[106267]: goodbye to uWSGI. Sep 27 01:30:58.917165 n-d-859358-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 27 01:30:58.917777 n-d-859358-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 27 01:30:58.920642 n-d-859358-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 01:30:58.939779 n-d-859358-1 devstack@n-api.service[128766]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 01:30:58 2022] *** Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: nodename: n-d-859358-1 Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: machine: x86_64 Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: clock source: unix Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: pcre jit disabled Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: detected number of CPU cores: 4 Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: current working directory: / Sep 27 01:30:58.960153 n-d-859358-1 devstack@n-api.service[128766]: detected binary path: /usr/bin/uwsgi-core Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: your processes number limit is 47680 Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: your memory page size is 4096 bytes Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: detected max file descriptor number: 2048 Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: lock engine: pthread robust mutexes Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: thunder lock: enabled Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 01:30:58.960941 n-d-859358-1 devstack@n-api.service[128766]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 01:30:59.002648 n-d-859358-1 devstack@n-api.service[128766]: Python main interpreter initialized at 0x556b85e8a9c0 Sep 27 01:30:59.002648 n-d-859358-1 devstack@n-api.service[128766]: python threads support enabled Sep 27 01:30:59.002648 n-d-859358-1 devstack@n-api.service[128766]: your server socket listen backlog is limited to 100 connections Sep 27 01:30:59.002648 n-d-859358-1 devstack@n-api.service[128766]: your mercy for graceful operations on workers is 90 seconds Sep 27 01:30:59.003094 n-d-859358-1 devstack@n-api.service[128766]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 01:30:59.003094 n-d-859358-1 devstack@n-api.service[128766]: *** Operational MODE: preforking *** Sep 27 01:30:59.003363 n-d-859358-1 devstack@n-api.service[128766]: *** uWSGI is running in multiple interpreter mode *** Sep 27 01:30:59.003363 n-d-859358-1 devstack@n-api.service[128766]: spawned uWSGI master process (pid: 128766) Sep 27 01:30:59.003570 n-d-859358-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 27 01:30:59.004628 n-d-859358-1 devstack@n-api.service[128766]: spawned uWSGI worker 1 (pid: 128778, cores: 1) Sep 27 01:30:59.006048 n-d-859358-1 devstack@n-api.service[128766]: spawned uWSGI worker 2 (pid: 128779, cores: 1) Sep 27 01:30:59.006048 n-d-859358-1 devstack@n-api.service[128766]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 01:30:59.669271 n-d-859358-1 devstack@n-api.service[128778]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 01:30:59.672995 n-d-859358-1 devstack@n-api.service[128779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 01:31:00.855735 n-d-859358-1 devstack@n-api.service[128778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:31:00.855735 n-d-859358-1 devstack@n-api.service[128778]: from cryptography.utils import int_from_bytes Sep 27 01:31:00.856397 n-d-859358-1 devstack@n-api.service[128778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:31:00.856397 n-d-859358-1 devstack@n-api.service[128778]: from cryptography.utils import int_from_bytes Sep 27 01:31:00.881085 n-d-859358-1 devstack@n-api.service[128779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:31:00.881085 n-d-859358-1 devstack@n-api.service[128779]: from cryptography.utils import int_from_bytes Sep 27 01:31:00.881701 n-d-859358-1 devstack@n-api.service[128779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 01:31:00.881701 n-d-859358-1 devstack@n-api.service[128779]: from cryptography.utils import int_from_bytes Sep 27 01:31:03.326525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 01:31:03.327102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 01:31:03.327244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 01:31:03.327617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 01:31:03.327872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 01:31:03.328269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.328599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.328923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.329245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.329604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.329922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.330834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.331168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.331500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.331762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.332079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.332581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-859358-1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.332915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.333233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.333583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.333935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.334255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.334557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.334869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.335386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.335850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.336164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.336543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.336823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.337140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.337485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.337812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.338123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.338453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.338772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.339186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-859358-1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.339507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.339824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.340134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.340566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.340876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.341192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.341541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.341867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.342177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.342521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.342846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.343165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.343488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.343793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.344108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.344418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.344741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.345051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.345376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.345631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.345990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.346317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.346640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.346964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.347218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.347468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.347786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.348106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.348418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.348729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.349044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.349369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.349684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.349993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.350326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.350611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.350928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.351246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.351573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.351882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.352202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.352612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.352866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.353175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.353546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.353868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.354178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.354500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.354824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.355141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.355451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.355762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.356084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.356419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.356728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.356979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.357286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.357624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.357945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.358257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.358569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.358880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.359184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.359492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.359800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.360109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.360418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.360727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.361034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.361365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.362270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.362583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.362893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.363215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.363371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 01:31:03.363818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.363909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 01:31:03.364001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.364106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 01:31:03.364204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.364436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.364551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 01:31:03.364716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 01:31:03.364829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.365807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.366969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.367968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-859358-1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.368952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.369927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.370984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.371289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.371417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.371588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.371814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.371907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.372938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.373147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.373246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.373492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.373609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.373834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.373929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.374169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.374262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.374483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.374589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.374813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.374905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-859358-1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.375149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.375268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.375482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.375576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.375802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.375901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.376116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.376222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.376435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.376535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.376762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.376855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.377722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.377844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.378011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.378114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.378330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.378430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.378657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.378758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.378983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.379074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.379316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.379404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.379639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.379736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.379959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.380060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.380279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.380376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.380592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.380686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.380915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.381051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.381208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.381298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.381547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.381680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.381804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.382115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.382326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.382431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.382705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.382809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.383060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.383199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.383312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.385367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.385487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.385570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.385660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.385746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.385820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.385915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.385999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.386913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.386996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.387068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.387146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.387232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.387306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.387385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.387499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.389058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.389156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.389248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.389324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.389467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.389582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.389687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.389779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.389862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.389942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.390087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.390316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.390468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.390618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.390698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.390877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.391003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.391188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.391342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.391500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.391609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.391822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.391917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.392156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.392257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.392463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.392556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.392745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.392851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.393054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.393147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.393383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.393502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.393707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.393801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.394020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.394112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.394332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.394434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.394645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.394739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.394971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.395071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.395264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.395358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.395574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.395674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.395885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.395984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.396195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.396293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.396505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.396609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.396812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.396911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.397119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.397221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.397453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.397562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.397764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.397866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.398081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.398199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.398391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.398483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.398702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.398798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.399011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.399113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.399320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.399411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.399646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.399801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.399953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.400043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.400242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.400348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.400550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.400641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.400862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.400954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.401174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.401278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.401536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.401635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.401798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.401892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.402117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.402270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.402426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.402527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.402734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.402838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.403054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.403156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.403356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.403457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.403664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.403757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.403968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.404059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.404275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.404374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.404579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.404671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.404885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.404990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.405189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.405286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.405517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.405609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.405831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.405934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.406134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.406232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.406437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.406544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.406737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.406830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.407055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.407146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.407363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.407465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.407671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.407770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.407975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.408094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.408303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.408412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.408631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 01:31:03.408916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.409009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.409364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.409513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.409700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.410021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.410409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.410614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.410846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.410949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.411258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.411350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.412890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.413974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.414887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.415989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.416927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.417969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.418950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.419891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.420832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.421951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.422055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.422265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.422414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.422684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.422898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.423890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.424564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.424737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.424882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.425866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.426800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.427939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.428998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.429937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.430888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.431819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.432959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.433929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.434968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.435172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.435271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.435485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.435612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.435873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.436839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.437801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.438955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.439053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.439275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.439378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.439627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.440232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.440490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.440598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.440807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.441890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.442987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.443920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.444949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.445937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.446851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.447987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.448912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.449891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.450059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.450216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.450528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.450854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.451864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.452923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.453089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.453212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.453979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.454163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.454325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.454485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.454656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.454819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.455571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.455748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.455903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.456980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.457986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.458894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.459967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.460129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.460280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.460439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.460591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.460741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.461843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.462797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.463845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.464994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.465145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.465294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.465569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.465730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.465889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.466969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.467891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.468051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.468212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.468362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.468519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.469239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.469414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.469576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.469730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.469878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.470898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.471883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.472936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.473990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.474911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.475960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.476989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.477187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.477290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.477521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.477620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.477883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.478019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.478140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.478451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.478646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.478782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.479962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.480922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.481948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.482832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.483969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.484916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.485970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.486178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.486273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.487946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.488891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.489847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.490839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.491959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.492975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.493930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.494869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.495883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.496858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.497945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.498938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.499950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.500091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.500311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.500617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.500921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.501024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.501394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.501726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.502673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.503112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.503446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.503770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.503936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.504090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.504241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.504556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.504877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.505190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.505520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.505644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.505840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.505980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.506265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.506452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.506620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.506916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.507755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.508830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.509818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.510999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.511955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.512925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.513927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.514913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.515886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.516854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.517888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.518894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.519770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.520000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.520117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.520303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.520408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.521923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.522919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.523982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.524095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.524312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.524408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.524653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.524924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.525101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.525257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.525455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.525669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.525893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.526902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.527155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.527253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.527491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.527691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.527803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.528140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.528254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.528460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.529217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.529464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.529637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.529805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.529963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.530889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.531857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.532928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.533100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.541919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.542936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.543971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.544946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.545722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.546969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.547235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.547534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.547642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.547887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.547998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.548204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.548313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.548547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.548784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.548883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.549726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.549821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.550995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.551928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.552088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.552250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.552412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.552611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.553792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.554340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.554507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.554660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.554821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.554981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.555236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.555404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.555566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.555901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.556929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.557922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.558945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.559106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.559274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.559427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.559744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.559909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.560724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.561850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.562889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.563283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.563454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.563454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.563767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.564195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.564377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.565164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.565447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.565612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.565804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.566899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.567868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.568966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.569128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.569289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.569479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.596104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.596460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.596647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.596789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.596923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.597069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.597202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.597722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.598028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.598468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.598468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.599762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.603127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.604858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.604858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.606960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.606960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.607234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.607371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.607506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.607659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.607987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.608880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.609984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.610949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.611084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.611216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.611350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.611978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.612979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.613819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.614929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.615871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.616989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.617804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.619355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.620969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.620969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.621264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.621468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.621794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.621953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.622091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.622224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.622358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.622491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.622674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.623744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.624537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.624537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.625831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.626084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.626258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.626393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.626576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.628028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.628217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.628359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.628610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.628778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.629950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.630913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.631886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.632861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.633271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.633670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.633821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.633958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.634828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.635947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.636345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.637705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.638943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.638943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.638943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.638943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.639738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.639875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.640985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.641991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.642959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.643971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.644935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.645089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.645496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.645638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.645773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.645909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.646863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.647983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.648802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.650060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.651047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.652025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.653020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.654190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.655173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.656375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.657674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.658663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.659865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.661114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.662130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 01:31:03.662130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 01:31:03.680457 n-d-859358-1 devstack@n-api.service[128778]: INFO dbcounter [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Registered counter for database nova_api Sep 27 01:31:03.701401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.709492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writer thread running {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.715922 n-d-859358-1 devstack@n-api.service[128779]: INFO dbcounter [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Registered counter for database nova_api Sep 27 01:31:03.737294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.744436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.766449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.context [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=128778) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 01:31:03.770554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:03.771038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:03.772719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:03.773486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:03.773936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:03.775938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:03.778201 n-d-859358-1 devstack@n-api.service[128778]: INFO dbcounter [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Registered counter for database nova_cell0 Sep 27 01:31:03.782241 n-d-859358-1 devstack@n-api.service[128778]: INFO dbcounter [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Registered counter for database nova_cell1 Sep 27 01:31:03.790708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.792688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.799787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writer thread running {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.801045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writer thread running {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.804926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.context [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=128779) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 01:31:03.809043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:03.809548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:03.811194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:03.811922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:03.812361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:03.814382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:03.816403 n-d-859358-1 devstack@n-api.service[128779]: INFO dbcounter [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Registered counter for database nova_cell0 Sep 27 01:31:03.820498 n-d-859358-1 devstack@n-api.service[128779]: INFO dbcounter [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Registered counter for database nova_cell1 Sep 27 01:31:03.828002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.833769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.946078 n-d-859358-1 devstack@n-api.service[128778]: INFO dbcounter [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Registered counter for database nova_cell0 Sep 27 01:31:03.953182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.957996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writer thread running {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.972376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.978098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:03.987477 n-d-859358-1 devstack@n-api.service[128779]: INFO dbcounter [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Registered counter for database nova_cell0 Sep 27 01:31:03.994317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_db.sqlalchemy.engines [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 01:31:03.999024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writer thread running {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 01:31:04.278084 n-d-859358-1 devstack@n-api.service[128778]: WARNING keystonemiddleware.auth_token [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:31:04.286297 n-d-859358-1 devstack@n-api.service[128778]: WARNING keystonemiddleware.auth_token [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:31:04.319856 n-d-859358-1 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:31:04.327139 n-d-859358-1 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:31:04.628985 n-d-859358-1 devstack@n-api.service[128778]: WARNING keystonemiddleware.auth_token [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:31:04.635041 n-d-859358-1 devstack@n-api.service[128778]: WARNING keystonemiddleware.auth_token [None req-d9a4f0b6-2fea-43e1-af27-7d4047b2ce0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:31:04.640391 n-d-859358-1 devstack@n-api.service[128778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b85e8a9c0 pid: 128778 (default app) Sep 27 01:31:04.675465 n-d-859358-1 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 01:31:04.681660 n-d-859358-1 devstack@n-api.service[128779]: WARNING keystonemiddleware.auth_token [None req-b41c4369-aba6-418d-a384-92fc70d37a28 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 01:31:04.687376 n-d-859358-1 devstack@n-api.service[128779]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b85e8a9c0 pid: 128779 (default app) Sep 27 01:31:43.983944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:43.985445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:43.988253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:43.991603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:44.910681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:44.911513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:44.912290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:44.913214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:45.714940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Calling method '.version_select at 0x7f24d7e124c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:45.726344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=128778) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 27 01:31:45.727481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:45.728101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:45.728683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:45.762749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:45.765684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:45.766182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:45.787674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:45.788389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:45.788966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:45.796719 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e86af971-ed1a-4df0-aa4c-3b7689c08349 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.825359 Sep 27 01:31:45.809977 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1208 bytes} [Tue Sep 27 01:31:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:31:46.306681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-308976c4-220b-48ae-ab46-4069c0fd20cd tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-460976312", "id": 388704869, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:46.383410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-308976c4-220b-48ae-ab46-4069c0fd20cd tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.571875 Sep 27 01:31:46.384361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2/2] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:31:45 2022] POST /compute/v2.1/flavors => generated 467 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:46.531673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '.version_select at 0x7f24d7e12dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:46.533713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.534507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.535328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.565942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:46.574517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.576742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.577623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.579006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.583236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.585931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.586745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.587198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.587628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.596212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.596918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.598059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.606722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9b20978-bd5a-446e-a85c-fc6657f079de tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.220993 Sep 27 01:31:46.608004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3/3] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 01:31:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:31:46.613946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a74206f8-f362-4db3-9b96-d8417ccaf910 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-525971775"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:46.617840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-a74206f8-f362-4db3-9b96-d8417ccaf910 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Generated uuid 64385afe-d303-4ebb-95d0-6de8e98de402 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:31:46.671873 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b049785-bfa9-4506-9d7f-521ba445f808 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.779485 Sep 27 01:31:46.673548 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1/4] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:31:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:31:46.722175 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a74206f8-f362-4db3-9b96-d8417ccaf910 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.112809 Sep 27 01:31:46.729759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4/5] 10.222.0.52 () {62 vars in 1205 bytes} [Tue Sep 27 01:31:46 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:46.730909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a74206f8-f362-4db3-9b96-d8417ccaf910 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:46.732219 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a74206f8-f362-4db3-9b96-d8417ccaf910 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001423 Sep 27 01:31:46.732841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 5/6] 10.222.0.52 () {56 vars in 886 bytes} [Tue Sep 27 01:31:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 27 01:31:46.811173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bb08fa6-2a38-4ba9-995a-1e4814d0bc2c tempest-AZAdminNegativeTestJSON-889184240 tempest-AZAdminNegativeTestJSON-889184240-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:46.813978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bb08fa6-2a38-4ba9-995a-1e4814d0bc2c tempest-AZAdminNegativeTestJSON-889184240 tempest-AZAdminNegativeTestJSON-889184240-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '70c2d358b7b94744a2ba3cc5ef9705cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb47eff9ca2492481735a34d3c19d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bb08fa6-2a38-4ba9-995a-1e4814d0bc2c tempest-AZAdminNegativeTestJSON-889184240 tempest-AZAdminNegativeTestJSON-889184240-project] Request method failure captured: Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlJ_R05DFvvXLuka1Z-KqN2o9lOsJB5KOBEad7aCjgIQLgumnT1yIrFZdz4zEZB5eSejUE4whQv4A4pmPc0cuuMRBn0sr3ubYC2LPNG5zAaYpm7hXFxqD4Knt8q5WMP_atAHiSsuB6Gsu9KBfBtQDp8SHUgtXdEyuerG3qzeGusdk3c Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6cb47eff9ca2492481735a34d3c19d86 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AZAdminNegativeTestJSON-889184240 Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:31:46.826045 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cb47eff9ca2492481735a34d3c19d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cb47eff9ca2492481735a34d3c19d86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cb47eff9ca2492481735a34d3c19d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cb47eff9ca2492481735a34d3c19d86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AZAdminNegativeTestJSON-889184240 Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6cb47eff9ca2492481735a34d3c19d86 Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-889184240 Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AZAdminNegativeTestJSON-889184240-project Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 70c2d358b7b94744a2ba3cc5ef9705cc Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AZAdminNegativeTestJSON-889184240-project Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 27 01:31:46.827135 n-d-859358-1 devstack@n-api.service[128779]: action_args: {} Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:31:46.827748 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:31:46.829283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bb08fa6-2a38-4ba9-995a-1e4814d0bc2c tempest-AZAdminNegativeTestJSON-889184240 tempest-AZAdminNegativeTestJSON-889184240-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:31:46.831708 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bb08fa6-2a38-4ba9-995a-1e4814d0bc2c tempest-AZAdminNegativeTestJSON-889184240 tempest-AZAdminNegativeTestJSON-889184240-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.156626 Sep 27 01:31:46.832280 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2/7] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:31:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 158 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:31:46.840955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b24deb39-10c2-4081-bbcb-b762dd8a320b tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:46.917167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:46.919257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.919949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.920718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:46.922705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:46.925815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:46.926609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:47.038957 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84ea52ab-7791-48e1-a7f0-b03b356a2e11 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.305249 Sep 27 01:31:47.054271 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 6/8] 10.222.0.52 () {58 vars in 1164 bytes} [Tue Sep 27 01:31:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:31:47.058990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-582efbe9-6c4b-4598-aa74-09fcc946fdc1 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-269930230"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:47.196315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b24deb39-10c2-4081-bbcb-b762dd8a320b tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/388704869/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.359256 Sep 27 01:31:47.197325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3/9] 10.222.0.52 () {62 vars in 1262 bytes} [Tue Sep 27 01:31:46 2022] POST /compute/v2.1/flavors/388704869/os-extra_specs => generated 62 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:31:47.213734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:47.221612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:47.222171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:47.223965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:47.224783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:47.226020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:47.226626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:47.297077 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c643bd9f-ca60-4dc7-a0ee-b9e4aaffab55 tempest-AZAdminV2TestJSON-446770500 tempest-AZAdminV2TestJSON-446770500-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.097313 Sep 27 01:31:47.315013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-582efbe9-6c4b-4598-aa74-09fcc946fdc1 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.258782 Sep 27 01:31:47.315548 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4/10] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:31:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:47.325000 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 7/11] 10.222.0.52 () {62 vars in 1210 bytes} [Tue Sep 27 01:31:47 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:47.330056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1c70eca-a2e0-4449-901d-bcdecda7c846 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:47.333423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c51fd92c-bcfe-4bda-ac01-af445be67798 tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:47.350297 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1c70eca-a2e0-4449-901d-bcdecda7c846 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.023870 Sep 27 01:31:47.359434 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 8/12] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Sep 27 01:31:47 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:47.369575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d0d4827-fa49-4974-9e36-d5e07303e310 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:47.389796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d0d4827-fa49-4974-9e36-d5e07303e310 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:47.391174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d0d4827-fa49-4974-9e36-d5e07303e310 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:47.391793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d0d4827-fa49-4974-9e36-d5e07303e310 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:47.401939 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c51fd92c-bcfe-4bda-ac01-af445be67798 tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/388704869" status: 202 len: 0 microversion: 2.86 time: 0.085068 Sep 27 01:31:47.402946 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 5/13] 10.222.0.52 () {60 vars in 1199 bytes} [Tue Sep 27 01:31:47 2022] DELETE /compute/v2.1/flavors/388704869 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:31:47.413067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a5a382c-0b34-40a8-8db6-d1439675fc50 tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:47.478182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a5a382c-0b34-40a8-8db6-d1439675fc50 tempest-FlavorMetadataValidation-1155680265 tempest-FlavorMetadataValidation-1155680265-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.070118 Sep 27 01:31:47.487992 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 6/14] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:31:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:31:48.450104 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d0d4827-fa49-4974-9e36-d5e07303e310 tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.086383 Sep 27 01:31:48.450888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 9/15] 10.222.0.52 () {62 vars in 1232 bytes} [Tue Sep 27 01:31:47 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:48.465368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc23a519-81ae-41c1-aeee-a05125bda59e tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:48.522921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc23a519-81ae-41c1-aeee-a05125bda59e tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:48.523680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc23a519-81ae-41c1-aeee-a05125bda59e tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:48.524267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc23a519-81ae-41c1-aeee-a05125bda59e tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:49.164846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc23a519-81ae-41c1-aeee-a05125bda59e tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.704357 Sep 27 01:31:49.181631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e84f970-ed1c-4b44-8fa7-c327fef44c1a tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:49.184631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 7/16] 10.222.0.52 () {62 vars in 1232 bytes} [Tue Sep 27 01:31:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:31:49.246978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e84f970-ed1c-4b44-8fa7-c327fef44c1a tempest-AggregatesAdminTestV241-460565283 tempest-AggregatesAdminTestV241-460565283-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.070933 Sep 27 01:31:49.247633 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 10/17] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:31:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:49.291121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bda0c557-d5b5-46d2-aed9-6e6e3598b2fb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-595692826", "name": "tempest-test_aggregate-1200653252"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:49.392002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-bda0c557-d5b5-46d2-aed9-6e6e3598b2fb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 6c017d57-9a27-4fc7-86dd-f7488eedb89f for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:31:49.489961 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bda0c557-d5b5-46d2-aed9-6e6e3598b2fb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.203136 Sep 27 01:31:49.491847 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 8/18] 10.222.0.52 () {60 vars in 1165 bytes} [Tue Sep 27 01:31:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:49.507262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3253e2ab-5b16-42cf-98ec-109f0a086199 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:49.545569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3253e2ab-5b16-42cf-98ec-109f0a086199 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.045663 Sep 27 01:31:49.546180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 11/19] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:31:49 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:49.563959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f547d6f-fe4a-475c-a0ec-96860941e2a5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:49.596262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f547d6f-fe4a-475c-a0ec-96860941e2a5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:49.596538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f547d6f-fe4a-475c-a0ec-96860941e2a5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:49.596978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f547d6f-fe4a-475c-a0ec-96860941e2a5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:49.984038 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f547d6f-fe4a-475c-a0ec-96860941e2a5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.425662 Sep 27 01:31:49.987145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 9/20] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:31:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:51.166279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-996261104", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "availability_zone": "tempest-test_az-595692826"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:51.238404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:51.239354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:51.241385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:51.243037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:51.245018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:51.245646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:52.533089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:31:52.880439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:31:52.880867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:31:52.881370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:31:52.881778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:31:52.882191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:31:52.902329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:52.903070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:52.903645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:52.904505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:52.905110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:52.905694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:52.953568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Getting quotas for project 8b07061a8f51455ca67a232506aee738. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:31:52.965033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Getting quotas for user 987474da5e5446d3a653c78326bf18fd and project 8b07061a8f51455ca67a232506aee738. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:31:52.987479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:31:52.990854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:31:53.075327 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9310e4ec-7c3b-4a09-8fd2-33ef7215b5d1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.690719 Sep 27 01:31:53.076545 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 12/21] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:31:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:31:53.088324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41e826b6-9601-4066-9d14-e5af131273cb tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:53.089126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41e826b6-9601-4066-9d14-e5af131273cb tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:31:54.775294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41e826b6-9601-4066-9d14-e5af131273cb tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:31:54.809830 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41e826b6-9601-4066-9d14-e5af131273cb tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1241 microversion: 2.1 time: 1.725119 Sep 27 01:31:54.814166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 10/22] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:31:53 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1241 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:31:55.836972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:55.838341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:31:55.868814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:55.869316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:55.869787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:55.870498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:55.870943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:55.871368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:56.136451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:31:56.178639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d53d6134-5065-4920-89a6-66b1fb2b3ab0 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1297 microversion: 2.1 time: 0.341599 Sep 27 01:31:56.178639 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 13/23] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:31:55 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1297 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:31:57.196899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:57.197660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:31:57.205298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:57.205816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:57.206257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:57.206966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:57.207424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:57.207854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:57.437899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:31:57.766348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:31:57.804283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ddc0a4e0-d0b2-4c39-b90f-9c2c6ae6bc4f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1295 microversion: 2.1 time: 0.608280 Sep 27 01:31:57.808625 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 11/24] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:31:57 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1295 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:31:58.754271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5fcfb2a9-7204-48b6-bf35-ec8f63a2a971 tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] Calling method '.version_select at 0x7f24d7238dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:59.217978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d7200940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:59.225124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:59.228367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:59.230198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:59.236547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:59.238070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:59.238742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:59.302985 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5fcfb2a9-7204-48b6-bf35-ec8f63a2a971 tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 1.994451 Sep 27 01:31:59.304403 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 14/25] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:31:57 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:31:59.317300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:31:59.318621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:31:59.321755 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cba9e98-3735-4298-8dbc-85803b9af28e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 1.434238 Sep 27 01:31:59.331976 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:31:57 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:31:59.356745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:59.357242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:59.361101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:59.362968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:31:59.365319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:31:59.370703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:31:59.871879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b784e8d9-34df-4416-8a11-b04473722dd1 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-774089329", "id": 495889598, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:31:59.942834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b784e8d9-34df-4416-8a11-b04473722dd1 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.606423 Sep 27 01:31:59.943545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 13/27] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:31:59 2022] POST /compute/v2.1/flavors => generated 426 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:31:59.965475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1322c740-9986-4323-9f93-6685fa6c4ecf tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] Calling method '.version_select at 0x7f24d72105e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:00.285849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:00.299764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82255bc6-0cb8-4825-a0fe-22f9391a9a26 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.992538 Sep 27 01:32:00.308172 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:31:59 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:00.331096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d7265430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:00.350682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:00.354353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:00.355644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:00.360380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:00.362352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:00.367233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:00.371039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1322c740-9986-4323-9f93-6685fa6c4ecf tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/b8f11bf3-51fd-4e1e-a46c-b0820e13f97a" status: 200 len: 652 microversion: 2.1 time: 0.416946 Sep 27 01:32:00.377177 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 14/29] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:31:59 2022] GET /compute/v2.1/os-networks/b8f11bf3-51fd-4e1e-a46c-b0820e13f97a => generated 652 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:00.501319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-837a532d-f8a9-45b0-a401-2c2e4e06ce7d tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.186532 Sep 27 01:32:00.505656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 16/30] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Sep 27 01:32:00 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:00.525778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1305cd0-9f7f-4e1f-b9ee-648ff699130c tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:00.599284 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1305cd0-9f7f-4e1f-b9ee-648ff699130c tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/495889598" status: 202 len: 0 microversion: 2.1 time: 0.092323 Sep 27 01:32:00.603388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:00 2022] DELETE /compute/v2.1/flavors/495889598 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:00.618736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53a6f6d3-632a-4f52-a320-21d2570b60ff tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] Calling method '.version_select at 0x7f24d7238e50>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:00.965925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1087b77a-4c33-45ac-8d15-5ffa359b57ff tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1396633929", "id": 1975041385, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:01.033810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1087b77a-4c33-45ac-8d15-5ffa359b57ff tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.655142 Sep 27 01:32:01.050378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 15/32] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:32:00 2022] POST /compute/v2.1/flavors => generated 468 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:01.056118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d72225e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:01.074489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:01.074994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:01.075446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:01.089831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:01.090664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:01.091134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:01.183274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37a0673f-6b34-4440-88b3-47f4e06037c3 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.128403 Sep 27 01:32:01.196399 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 16/33] 10.222.0.52 () {58 vars in 1145 bytes} [Tue Sep 27 01:32:01 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:01.214514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d6a9fb8-01a4-4750-9ee3-a651f705d8d9 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:01.262738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d6a9fb8-01a4-4750-9ee3-a651f705d8d9 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.064142 Sep 27 01:32:01.279053 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 17/34] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:01 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:01.743081 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53a6f6d3-632a-4f52-a320-21d2570b60ff tempest-NetworksTest-823540274 tempest-NetworksTest-823540274-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 1.137547 Sep 27 01:32:01.743735 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 18/35] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:32:00 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:01.749372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0d2ce8d-43bc-4179-811c-89d2c3e1044b tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1826749046", "id": 1819267187, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:01.772868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fa7b6f8-fdb3-42ee-9816-6a2dc22edb5f tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:01.809456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0d2ce8d-43bc-4179-811c-89d2c3e1044b tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.063468 Sep 27 01:32:01.815980 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 19/36] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:01 2022] POST /compute/v2.1/flavors => generated 417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:01.833537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:01.834552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:01.841109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fa7b6f8-fdb3-42ee-9816-6a2dc22edb5f tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] 10.222.0.52 "GET /compute/v2.1/flavors/1975041385" status: 200 len: 468 microversion: 2.61 time: 0.559513 Sep 27 01:32:01.851032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1199 bytes} [Tue Sep 27 01:32:01 2022] GET /compute/v2.1/flavors/1975041385 => generated 468 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:01.855276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:01.855787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:01.859953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:01.862651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:01.863290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:01.865457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:02.126699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-653b7cff-689a-4a23-9587-cd0f77e35753 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1126213911", "id": 698959888, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:02.170371 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-653b7cff-689a-4a23-9587-cd0f77e35753 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.317469 Sep 27 01:32:02.171304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 19/38] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:02.177311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00898935-fb84-4538-b791-8bbd0407ef27 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:02.225134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00898935-fb84-4538-b791-8bbd0407ef27 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.052032 Sep 27 01:32:02.228143 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 20/39] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:02 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:02.234377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54268019-1c3d-4aeb-98ed-14d2ac209994 tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] Action: 'update', calling method: .version_select at 0x7f24d81ca5e0>, body: {"flavor": {"description": "new"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:02.298697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54268019-1c3d-4aeb-98ed-14d2ac209994 tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1975041385" status: 200 len: 469 microversion: 2.61 time: 0.068364 Sep 27 01:32:02.299608 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 21/40] 10.222.0.52 () {62 vars in 1219 bytes} [Tue Sep 27 01:32:02 2022] PUT /compute/v2.1/flavors/1975041385 => generated 469 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:02.304731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47a8e059-6a83-4a84-aca7-621e5688d899 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:02.415064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:02.428005 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f553eaec-dccb-489a-abc2-4335172f72d9 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.610456 Sep 27 01:32:02.430202 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 20/41] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:01 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:02.434948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae4ddf05-cc85-4ea9-9ff9-b51034a94366 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:02.524015 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae4ddf05-cc85-4ea9-9ff9-b51034a94366 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1819267187" status: 202 len: 0 microversion: 2.1 time: 0.092469 Sep 27 01:32:02.524806 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:02 2022] DELETE /compute/v2.1/flavors/1819267187 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:02.529949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-40a4b15f-fbaf-468f-ac8b-6d59a4e45edd tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:02.683686 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-40a4b15f-fbaf-468f-ac8b-6d59a4e45edd tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.157501 Sep 27 01:32:02.684280 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 22/43] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:02 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:02.743233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68b609fe-b352-4938-86cf-66bfdb552340 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:02.832092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=2,nova_api:INSERT=9,nova_api:RELEASE=2,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:02.856470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47a8e059-6a83-4a84-aca7-621e5688d899 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/698959888/action" status: 200 len: 96 microversion: 2.1 time: 0.555588 Sep 27 01:32:02.860416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1197 bytes} [Tue Sep 27 01:32:02 2022] POST /compute/v2.1/flavors/698959888/action => generated 96 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:02.878346 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68b609fe-b352-4938-86cf-66bfdb552340 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.175376 Sep 27 01:32:02.880924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23f48845-d123-48b1-819b-87a42e10db4b tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:02.886193 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 23/45] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:02 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:02.908233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c715e93-4f5c-44a4-9b17-8d99f9a43bb7 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:02.980751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:03.030871 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23f48845-d123-48b1-819b-87a42e10db4b tempest-FlavorsV261TestJSON-1793731642 tempest-FlavorsV261TestJSON-1793731642-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.166892 Sep 27 01:32:03.036433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1166 bytes} [Tue Sep 27 01:32:02 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:03.052298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77bc9353-2a93-497d-af90-ad891c2cdc48 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-942779459", "id": 493229226, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:03.132315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77bc9353-2a93-497d-af90-ad891c2cdc48 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.092722 Sep 27 01:32:03.142334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:03 2022] POST /compute/v2.1/flavors => generated 425 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:03.148763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-030ea4f5-d56a-49f1-a488-7c4bc0192daa tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:03.169917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:03.188422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7c715e93-4f5c-44a4-9b17-8d99f9a43bb7 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. Sep 27 01:32:03.195935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-030ea4f5-d56a-49f1-a488-7c4bc0192daa tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1975041385" status: 202 len: 0 microversion: 2.61 time: 0.058172 Sep 27 01:32:03.200158 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 25/48] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Sep 27 01:32:03 2022] DELETE /compute/v2.1/flavors/1975041385 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:32:03.209726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d3724af-39a8-4462-a892-41e71877dfbe tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c715e93-4f5c-44a4-9b17-8d99f9a43bb7 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Request method failure captured: Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/flavors/698959888/action HTTP/1.1 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 67 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKQ8NeyPFJIeuolwAlUt0Ub1-o6qxWtLjST4pWX22nk-bEURXOoB6ApHL-qmHDmDvIi5UBCfjcBGOF39q3T2einISHdCKcB6fFglVSArGlqkE7-lUAyzcym8UVN2cHRTEH_EWbTzpXi7ea1EHERzR06FEmkOSBXSzclhtJDFz50qaY Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:03.251601 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af200bbb3424d7db3d659ae3d4f2698", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: cfceae59da5d4358869ae7f71b2ea471 Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} Sep 27 01:32:03.252981 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: exception: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '698959888', 'body': {'addTenantAccess': {'tenant': '172b46aa19dc4235a2c07822ed954fd1'}}} Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:32:03.254689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-172b46aa19dc4235a2c07822ed954fd1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi session.flush() Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 01:32:03.256504 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 01:32:03.258580 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:32:03.260428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-172b46aa19dc4235a2c07822ed954fd1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 27, 1, 32, 3, 173156), 'updated_at': None, 'flavor_id': 19, 'project_id': '172b46aa19dc4235a2c07822ed954fd1'}] Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:03.262666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:03.263803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:03.269516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:03.270742 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. Sep 27 01:32:03.270742 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:03.270742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c715e93-4f5c-44a4-9b17-8d99f9a43bb7 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project 172b46aa19dc4235a2c07822ed954fd1 combination. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:03.270742 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7c715e93-4f5c-44a4-9b17-8d99f9a43bb7 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/698959888/action" status: 409 len: 152 microversion: 2.1 time: 0.368296 Sep 27 01:32:03.270969 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d3724af-39a8-4462-a892-41e71877dfbe tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/493229226" status: 202 len: 0 microversion: 2.1 time: 0.065018 Sep 27 01:32:03.270969 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 26/49] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:03 2022] DELETE /compute/v2.1/flavors/493229226 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:03.284054 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 24/50] 10.222.0.52 () {60 vars in 1197 bytes} [Tue Sep 27 01:32:02 2022] POST /compute/v2.1/flavors/698959888/action => generated 152 bytes in 396 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:03.286194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d14b4265-dcf8-4c58-a384-451a74bce02f tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:03.322993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e85e183-3b7f-4f3a-895c-5e9386429fc2 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:03.388611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d14b4265-dcf8-4c58-a384-451a74bce02f tempest-FlavorsV261TestJSON-1765134256 tempest-FlavorsV261TestJSON-1765134256-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.117316 Sep 27 01:32:03.398369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 27/51] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:03 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:03.409253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f6f1c92-4ae5-47c9-90f0-a662e9f7add6 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:03.435994 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e85e183-3b7f-4f3a-895c-5e9386429fc2 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.146661 Sep 27 01:32:03.436671 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 25/52] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:03.577559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f6f1c92-4ae5-47c9-90f0-a662e9f7add6 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/698959888/action" status: 200 len: 21 microversion: 2.1 time: 0.177896 Sep 27 01:32:03.578168 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 28/53] 10.222.0.52 () {60 vars in 1197 bytes} [Tue Sep 27 01:32:03 2022] POST /compute/v2.1/flavors/698959888/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:03.594524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:03.595145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:03.606245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c", "tag": "5e579faf-c1ca-406f-b7a7-5a55746aabaa"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:03.629231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:03.636089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:03.636608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:03.637388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:03.640351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:03.642305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:03.655250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:03.656024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:03.657331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:03.739635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Creating event network-changed:5e579faf-c1ca-406f-b7a7-5a55746aabaa for instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c on n-h1-859358-1 Sep 27 01:32:03.748746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:32:03.750337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4b6e4b1-629b-482b-a003-955924cdeabe req-418a20ee-6f77-4117-ad8f-6446310975f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:32:03.753025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:03.758025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:03.758660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:03.762771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:03.770321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:03.772298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:03.813073 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.rpcapi [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 01:32:03.826578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] Releasing lock "compute-rpcapi-router" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:32:03.868323 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9467a9b8-acde-49bb-a5a2-bb00d7f39fd9 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414385 Sep 27 01:32:03.869593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 26/54] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:03.884308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-619bdef1-e4cf-4113-a05a-d30394839744 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1309288410", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:03.936263 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-619bdef1-e4cf-4113-a05a-d30394839744 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.063635 Sep 27 01:32:03.940206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 27/55] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:03 2022] POST /compute/v2.1/flavors => generated 507 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:03.950454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e48d0051-325e-46f7-9ebb-c3ff206c4cb9 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.001117 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e48d0051-325e-46f7-9ebb-c3ff206c4cb9 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/698959888" status: 202 len: 0 microversion: 2.1 time: 0.059540 Sep 27 01:32:04.005565 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 28/56] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:03 2022] DELETE /compute/v2.1/flavors/698959888 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:04.212598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:04.232753 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04f447ad-1492-4de7-9373-a80f8159ba05 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.642911 Sep 27 01:32:04.250072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 29/57] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:03 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:04.258687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5f8df6b-6113-4d3e-a04a-b3d11527bcd8 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.280265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5f8df6b-6113-4d3e-a04a-b3d11527bcd8 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/349ed2ec-018a-4b14-a26e-83ab50d2612e" status: 202 len: 0 microversion: 2.1 time: 0.028091 Sep 27 01:32:04.283562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 30/58] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:32:04 2022] DELETE /compute/v2.1/flavors/349ed2ec-018a-4b14-a26e-83ab50d2612e => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:04.294859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b017542a-3c02-460d-b055-f44a894301d5 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.348108 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b017542a-3c02-460d-b055-f44a894301d5 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060786 Sep 27 01:32:04.349893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:04.361986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c4bba01-be5f-4735-a9f5-aa3c4d78efb6 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.419928 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c4bba01-be5f-4735-a9f5-aa3c4d78efb6 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068275 Sep 27 01:32:04.421466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 32/60] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:04.432572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9378e7cb-4c99-4247-bba6-3b0211c8e3de tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1613818879", "id": 1045380340, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:04.478647 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9378e7cb-4c99-4247-bba6-3b0211c8e3de tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.055852 Sep 27 01:32:04.479532 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors => generated 438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:04.488862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fdf6b61-efee-4955-aab2-12a88ab327c5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-972815853", "id": "9cf2f43b-9ec3-4dc5-b03a-c1a1014f6886", "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:04.525836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fdf6b61-efee-4955-aab2-12a88ab327c5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.045143 Sep 27 01:32:04.526744 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 34/62] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors => generated 506 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:04.538465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80590bb1-9a6c-4e84-8b37-a4dba0e1ea27 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.552360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-80590bb1-9a6c-4e84-8b37-a4dba0e1ea27 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80590bb1-9a6c-4e84-8b37-a4dba0e1ea27 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Request method failure captured: Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/flavors/1045380340/os-flavor-access HTTP/1.1 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKQ8NeyPFJIeuolwAlUt0Ub1-o6qxWtLjST4pWX22nk-bEURXOoB6ApHL-qmHDmDvIi5UBCfjcBGOF39q3T2einISHdCKcB6fFglVSArGlqkE7-lUAyzcym8UVN2cHRTEH_EWbTzpXi7ea1EHERzR06FEmkOSBXSzclhtJDFz50qaY Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:04.563577 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af200bbb3424d7db3d659ae3d4f2698", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cfceae59da5d4358869ae7f71b2ea471 Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: exception: Access list not available for public flavors. Sep 27 01:32:04.564651 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'flavor_id': '1045380340'} Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 27 01:32:04.565513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:04.567062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80590bb1-9a6c-4e84-8b37-a4dba0e1ea27 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:04.567062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80590bb1-9a6c-4e84-8b37-a4dba0e1ea27 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1045380340/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035067 Sep 27 01:32:04.567062 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 35/63] 10.222.0.52 () {58 vars in 1209 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/1045380340/os-flavor-access => generated 91 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:04.569132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f341af0-995a-44f9-8e9f-2e76998905a0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.571931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2dcb6fa8-684c-4f22-9ea4-03aaf8299079 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.586130 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f341af0-995a-44f9-8e9f-2e76998905a0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.578895 Sep 27 01:32:04.587212 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 29/64] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:04.599669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2486a51-741d-4068-afd0-b76587feeb66 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.609731 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2dcb6fa8-684c-4f22-9ea4-03aaf8299079 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/9cf2f43b-9ec3-4dc5-b03a-c1a1014f6886" status: 202 len: 0 microversion: 2.1 time: 0.042012 Sep 27 01:32:04.610482 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 36/65] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:32:04 2022] DELETE /compute/v2.1/flavors/9cf2f43b-9ec3-4dc5-b03a-c1a1014f6886 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:04.644967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2486a51-741d-4068-afd0-b76587feeb66 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1045380340" status: 202 len: 0 microversion: 2.1 time: 0.056451 Sep 27 01:32:04.649245 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 30/66] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:04 2022] DELETE /compute/v2.1/flavors/1045380340 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:04.665014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc9ba733-b44f-4843-ace8-288b8ced91bb tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.708078 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc9ba733-b44f-4843-ace8-288b8ced91bb tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057288 Sep 27 01:32:04.719352 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 31/67] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:04.729981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-002201a3-2f70-4010-a4ad-934f67e74d9c tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.766923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-002201a3-2f70-4010-a4ad-934f67e74d9c tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039929 Sep 27 01:32:04.778003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 32/68] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:04.783677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75c047df-4bb8-41c5-8b4e-70e7effa5ce5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1690960584", "id": 1277078088, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:04.808191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:04.831400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75c047df-4bb8-41c5-8b4e-70e7effa5ce5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.051405 Sep 27 01:32:04.834208 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 33/69] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:04.848173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5cc34382-3b71-4163-94d7-84eb6e0f8d9e tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1541431180", "id": 1768814057, "os-flavor-access:is_public": "False"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:04.883767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5cc34382-3b71-4163-94d7-84eb6e0f8d9e tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.047533 Sep 27 01:32:04.892758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 34/70] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors => generated 439 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:04.913046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9358afbe-3127-426a-9f18-7fbf401a84e1 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:04.937093 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9358afbe-3127-426a-9f18-7fbf401a84e1 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1277078088" status: 200 len: 414 microversion: 2.1 time: 0.041465 Sep 27 01:32:04.948641 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 35/71] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:04 2022] GET /compute/v2.1/flavors/1277078088 => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:05.438492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52e2432e-4eac-4ee7-b777-be56e9bbc26d tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:05.449708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-52e2432e-4eac-4ee7-b777-be56e9bbc26d tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '61a11ed047c7422d8918b22c1b4597cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b46aa19dc4235a2c07822ed954fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:05.452395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48faf25e-3178-442d-a8a4-c3f5b5b4f15e tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1796462393", "id": 1941996725, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52e2432e-4eac-4ee7-b777-be56e9bbc26d tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Request method failure captured: Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/flavors/1768814057/action HTTP/1.1 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 67 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKMMMy0rUlD_WjhHNGEanDUtmxWDouCu4-_jK-r6N0bsvm7ZUVjSd6YrZpkK78fkWlwWm7qlCJIHH4P63XHpIBKIuBbqhlUGwR5g6coHrRmZJ9jS5x2NqpGdJxloHN5j6QKwlOzTpzA-pkIruATY-AbSEH25pLvYyEm7xFyGVzJawg Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 172b46aa19dc4235a2c07822ed954fd1 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:05.487094 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_172b46aa19dc4235a2c07822ed954fd1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 172b46aa19dc4235a2c07822ed954fd1 Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsAccessNegativeTestJSON-224209126-project Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 61a11ed047c7422d8918b22c1b4597cb Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-224209126-project Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} Sep 27 01:32:05.488588 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1768814057', 'body': {'addTenantAccess': {'tenant': '172b46aa19dc4235a2c07822ed954fd1'}}} Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:05.489370 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 27 01:32:05.490489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:05.492876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52e2432e-4eac-4ee7-b777-be56e9bbc26d tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:05.492876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52e2432e-4eac-4ee7-b777-be56e9bbc26d tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] 10.222.0.52 "POST /compute/v2.1/flavors/1768814057/action" status: 403 len: 130 microversion: 2.1 time: 0.539479 Sep 27 01:32:05.496100 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48faf25e-3178-442d-a8a4-c3f5b5b4f15e tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.883227 Sep 27 01:32:05.496689 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors/1768814057/action => generated 130 bytes in 547 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:05.508659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 37/73] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:04 2022] POST /compute/v2.1/flavors => generated 425 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:05.519005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:05.519850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:05.542295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:05.543044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:05.544304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:05.549618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:05.551142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:05.552698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:05.759739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74a0d5c4-1c55-484d-bf85-02ebf5f25d76 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:05.807427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74a0d5c4-1c55-484d-bf85-02ebf5f25d76 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5810 microversion: 2.1 time: 0.306652 Sep 27 01:32:05.828431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 37/74] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:05 2022] GET /compute/v2.1/flavors/detail => generated 5810 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:05.839285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-43eb53ea-3661-49b5-bdde-a532287fcaac tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:05.886798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-43eb53ea-3661-49b5-bdde-a532287fcaac tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1768814057" status: 202 len: 0 microversion: 2.1 time: 0.056899 Sep 27 01:32:05.892306 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 38/75] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:05 2022] DELETE /compute/v2.1/flavors/1768814057 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:05.897559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-96c641ec-cd45-4dc6-b082-6563e00ad60c tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:05.917491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-96c641ec-cd45-4dc6-b082-6563e00ad60c tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023692 Sep 27 01:32:05.937640 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1182 bytes} [Tue Sep 27 01:32:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:05.950852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3400fc0e-e2b6-4fb8-95f3-1d661abe251d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:05.992803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3400fc0e-e2b6-4fb8-95f3-1d661abe251d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1277078088" status: 202 len: 0 microversion: 2.1 time: 0.053742 Sep 27 01:32:05.993647 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 40/77] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:05 2022] DELETE /compute/v2.1/flavors/1277078088 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:06.005048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e89f5623-22b9-4384-a892-d0423e65ac84 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.008804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:06.017436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49d9287a-558c-44a1-bb76-b4acd4d74a3e tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.506984 Sep 27 01:32:06.036925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 38/78] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:05 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:06.047754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e45b16c8-54cc-4f8d-8034-772265bd1182 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1527335598", "id": 2126956575, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.061192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e89f5623-22b9-4384-a892-d0423e65ac84 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.062596 Sep 27 01:32:06.062613 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 41/79] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:05 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:06.091693 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e45b16c8-54cc-4f8d-8034-772265bd1182 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.052787 Sep 27 01:32:06.092129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e8ac004-5639-44ff-bc5d-7e15b12a0429 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.092655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 39/80] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors => generated 425 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.103147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43b956c5-64b0-47d2-a6d4-232ef1732e05 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1031117894", "id": 1968522860, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.147665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e8ac004-5639-44ff-bc5d-7e15b12a0429 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.067141 Sep 27 01:32:06.150877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43b956c5-64b0-47d2-a6d4-232ef1732e05 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.055531 Sep 27 01:32:06.153892 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 40/81] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors => generated 439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.174650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-794b9d97-5926-4c57-8462-421610e7bdc8 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.174876 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 42/82] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:06.183451 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-794b9d97-5926-4c57-8462-421610e7bdc8 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028623 Sep 27 01:32:06.185491 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1182 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:06.191206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb5a327e-0715-481c-a9ff-839ac40e1f98 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1115610289", "id": 1650327710, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.195054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd468b7d-550d-42bd-94b4-0ff8e104d9b2 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.251940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb5a327e-0715-481c-a9ff-839ac40e1f98 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.064970 Sep 27 01:32:06.257525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 42/84] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors => generated 430 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.268617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-653f323c-5b67-4fe2-818f-f124d0869db8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Action: 'create', calling method: .version_select at 0x7f24d72100d0>, body: {"keypair": {"name": "tempest-keypair-1096786391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe9aO2GeFDficfa2xssU49Z0QQMmiT8w/m7QIy43k3XJkyM7D5CmCFTuIyZdrcCW6xRmVuYh7dxuX07n3p+d2/1u1LhXEc81uoF5AYQSDIQvFGtb7xl3SuOU8kjN24Y0Q=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.319904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-653f323c-5b67-4fe2-818f-f124d0869db8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:06.328612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-653f323c-5b67-4fe2-818f-f124d0869db8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for user 2089ee58706a4b1da251c4256b9673c8 and project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:06.425616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-653f323c-5b67-4fe2-818f-f124d0869db8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166727 Sep 27 01:32:06.426967 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 43/85] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.437930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99320999-5d08-4eaa-ab17-4d28c8694570 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "1650327710"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.462180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-99320999-5d08-4eaa-ab17-4d28c8694570 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] HTTP exception thrown: Flavor 1650327710 could not be found. Sep 27 01:32:06.469251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd468b7d-550d-42bd-94b4-0ff8e104d9b2 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1968522860/action" status: 200 len: 97 microversion: 2.1 time: 0.297102 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99320999-5d08-4eaa-ab17-4d28c8694570 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Request method failure captured: Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 107 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKLOnwTc8pu4dMQo4o8yLTYl6J24Ydt4x3jcBXtW6WCCvWfjikTaPHD4r4dQ_da6YNnycJhLQn8brZLLd37YfOQgttC8MSa1vlK5d9XuLrDt58N6X7dLIac_xBC4xXKu3j8YcyKt8QQ5OU1j1UcRtk2WRFfaclJEdIE83eQncU4fCM Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 5c6eb18cd8334d1090ddbb6649610ba5 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsAdminTestJSON-1444744274 Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:06.475531 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c6eb18cd8334d1090ddbb6649610ba5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c6eb18cd8334d1090ddbb6649610ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c6eb18cd8334d1090ddbb6649610ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c6eb18cd8334d1090ddbb6649610ba5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsAdminTestJSON-1444744274 Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 5c6eb18cd8334d1090ddbb6649610ba5 Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1444744274 Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FlavorsAdminTestJSON-1444744274-project Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 613e80f5ecd440e491a90266f09fdd03 Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsAdminTestJSON-1444744274-project Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "test", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "1650327710"}} Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:06.476689 n-d-859358-1 devstack@n-api.service[128779]: exception: Flavor 1650327710 could not be found. Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '1650327710'}}} Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1650327710 could not be found. Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.477423 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1650327710 could not be found. Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:06.478534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:06.479564 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:06.479564 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:06.479564 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:06.479564 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1650327710 could not be found. Sep 27 01:32:06.479564 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.479813 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 43/86] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors/1968522860/action => generated 97 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:06.481369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99320999-5d08-4eaa-ab17-4d28c8694570 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Returning 400 to user: Flavor 1650327710 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:06.482450 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99320999-5d08-4eaa-ab17-4d28c8694570 tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.054066 Sep 27 01:32:06.484698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 44/87] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/servers => generated 81 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:32:06.496984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5816843b-1f9b-4d54-a829-701bc4b9ff80 tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.507944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef304b6b-b400-4314-a976-5932837732c6 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.509760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5816843b-1f9b-4d54-a829-701bc4b9ff80 tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '61a11ed047c7422d8918b22c1b4597cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b46aa19dc4235a2c07822ed954fd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5816843b-1f9b-4d54-a829-701bc4b9ff80 tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Request method failure captured: Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/flavors/1968522860/action HTTP/1.1 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 70 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKMMMy0rUlD_WjhHNGEanDUtmxWDouCu4-_jK-r6N0bsvm7ZUVjSd6YrZpkK78fkWlwWm7qlCJIHH4P63XHpIBKIuBbqhlUGwR5g6coHrRmZJ9jS5x2NqpGdJxloHN5j6QKwlOzTpzA-pkIruATY-AbSEH25pLvYyEm7xFyGVzJawg Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 172b46aa19dc4235a2c07822ed954fd1 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:06.516230 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/172b46aa19dc4235a2c07822ed954fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_172b46aa19dc4235a2c07822ed954fd1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 172b46aa19dc4235a2c07822ed954fd1 Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-224209126 Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsAccessNegativeTestJSON-224209126-project Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 61a11ed047c7422d8918b22c1b4597cb Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-224209126-project Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: {"removeTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} Sep 27 01:32:06.517665 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1968522860', 'body': {'removeTenantAccess': {'tenant': '172b46aa19dc4235a2c07822ed954fd1'}}} Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can( Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:06.518313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 27 01:32:06.519401 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:06.521304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5816843b-1f9b-4d54-a829-701bc4b9ff80 tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:06.522534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5816843b-1f9b-4d54-a829-701bc4b9ff80 tempest-FlavorsAccessNegativeTestJSON-224209126 tempest-FlavorsAccessNegativeTestJSON-224209126-project] 10.222.0.52 "POST /compute/v2.1/flavors/1968522860/action" status: 403 len: 133 microversion: 2.1 time: 0.043300 Sep 27 01:32:06.525661 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 44/88] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors/1968522860/action => generated 133 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:06.534984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e91d0cd-5baf-4a38-b54c-069ff0114467 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "172b46aa19dc4235a2c07822ed954fd1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.542511 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef304b6b-b400-4314-a976-5932837732c6 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1650327710" status: 202 len: 0 microversion: 2.1 time: 0.052823 Sep 27 01:32:06.543698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 45/89] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:06 2022] DELETE /compute/v2.1/flavors/1650327710 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:06.555064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-283c9020-ce86-4f15-b159-c61df0baa266 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.586332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:06.639347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-283c9020-ce86-4f15-b159-c61df0baa266 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.088872 Sep 27 01:32:06.652820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 46/90] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:06.679385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce7bb529-348d-4128-b566-4c5b1da3fb68 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-714753035", "id": 1962815035, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.728439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce7bb529-348d-4128-b566-4c5b1da3fb68 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.052927 Sep 27 01:32:06.729035 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 47/91] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:06.754172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58c59ede-1f23-4e57-989c-9aada0b24a2d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1332338512", "id": 1290187192, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:06.799161 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58c59ede-1f23-4e57-989c-9aada0b24a2d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048710 Sep 27 01:32:06.804975 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 48/92] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.827044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88d35da0-4d87-4b46-83ca-2c6333bbddcf tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.901654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88d35da0-4d87-4b46-83ca-2c6333bbddcf tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 846 microversion: 2.1 time: 0.091106 Sep 27 01:32:06.912084 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 846 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:06.917526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d78d8904-d8d0-460c-b887-a1d2e2a3868c tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.931026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d78d8904-d8d0-460c-b887-a1d2e2a3868c tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 846 microversion: 2.1 time: 0.017696 Sep 27 01:32:06.943502 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 50/94] 10.222.0.52 () {58 vars in 1177 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 846 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:06.950635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8de3c580-ae2f-4e45-8ca2-458cb379eaae tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.964957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8de3c580-ae2f-4e45-8ca2-458cb379eaae tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 846 microversion: 2.1 time: 0.019766 Sep 27 01:32:06.975557 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 51/95] 10.222.0.52 () {58 vars in 1171 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 846 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:06.980892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c371ee4f-f1a0-4434-b73e-e1a11c8d7f7a tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:06.998140 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c371ee4f-f1a0-4434-b73e-e1a11c8d7f7a tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 846 microversion: 2.1 time: 0.021054 Sep 27 01:32:07.010132 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 52/96] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Sep 27 01:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 846 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:07.017303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3f1cf5c-9abb-4848-80ae-c0e2e9dc8fea tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.046493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3f1cf5c-9abb-4848-80ae-c0e2e9dc8fea tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6225 microversion: 2.1 time: 0.034658 Sep 27 01:32:07.047496 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 53/97] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6225 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.068745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.069921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:07.081695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:07.082713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:07.084126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:07.085234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:07.092881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:07.098212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:07.293313 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e91d0cd-5baf-4a38-b54c-069ff0114467 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1968522860/action" status: 200 len: 21 microversion: 2.1 time: 0.761559 Sep 27 01:32:07.295747 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 45/98] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:06 2022] POST /compute/v2.1/flavors/1968522860/action => generated 21 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:07.308860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7054281d-f137-411b-a7f7-e8821a352c60 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.370952 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7054281d-f137-411b-a7f7-e8821a352c60 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6225 microversion: 2.1 time: 0.071774 Sep 27 01:32:07.373507 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 46/99] 10.222.0.52 () {58 vars in 1175 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6225 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.416108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64dfb949-7096-4bfc-ac3f-ee40c2c456e8 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.462964 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64dfb949-7096-4bfc-ac3f-ee40c2c456e8 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1968522860" status: 202 len: 0 microversion: 2.1 time: 0.074865 Sep 27 01:32:07.464696 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 47/100] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:07 2022] DELETE /compute/v2.1/flavors/1968522860 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:07.486441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d977544-7e11-456b-9d0a-5cdb59da89a8 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.517022 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d977544-7e11-456b-9d0a-5cdb59da89a8 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6225 microversion: 2.1 time: 0.050964 Sep 27 01:32:07.518406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 48/101] 10.222.0.52 () {58 vars in 1173 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6225 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.526144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b4ea67b-1545-41f0-a60d-22f0870a322f tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.552104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:07.555967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b4ea67b-1545-41f0-a60d-22f0870a322f tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.035957 Sep 27 01:32:07.557061 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 49/102] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.562496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eec33f5b-cda6-4d67-af3f-7260ea53bacd tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.582054 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28770641-3669-4638-a77c-13f355204386 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.517780 Sep 27 01:32:07.588246 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 54/103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.591617 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eec33f5b-cda6-4d67-af3f-7260ea53bacd tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6225 microversion: 2.1 time: 0.033276 Sep 27 01:32:07.592211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6225 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.597641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c424b5d3-464e-4610-9b8a-25b8586f804a tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-858486951", "id": 1938644085, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:07.619440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a2c00c3-3e11-4ef2-993e-9d6bddb112bb tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.643092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c424b5d3-464e-4610-9b8a-25b8586f804a tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052758 Sep 27 01:32:07.645705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 55/105] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:07.659978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6460186-0ce2-450a-84c4-2c7c26b27c11 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "072d631c40cd40f3922fcacbd3a066df"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:07.664116 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a2c00c3-3e11-4ef2-993e-9d6bddb112bb tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1290187192" status: 202 len: 0 microversion: 2.1 time: 0.044881 Sep 27 01:32:07.669433 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 51/106] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:07 2022] DELETE /compute/v2.1/flavors/1290187192 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:07.686156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d726313-8095-48ed-9c96-4fb7221d9247 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.742151 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d726313-8095-48ed-9c96-4fb7221d9247 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.068994 Sep 27 01:32:07.750085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 52/107] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.777257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2fa6c832-4f3d-4b99-8a4a-244b137e600d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.786459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=75,nova_api:DELETE=20 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:07.812942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2fa6c832-4f3d-4b99-8a4a-244b137e600d tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1962815035" status: 202 len: 0 microversion: 2.1 time: 0.045246 Sep 27 01:32:07.818153 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 53/108] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:07 2022] DELETE /compute/v2.1/flavors/1962815035 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:07.829369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4490636d-bb7a-4f15-a103-b477988d20fc tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:07.867695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4490636d-bb7a-4f15-a103-b477988d20fc tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.047859 Sep 27 01:32:07.884609 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 54/109] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:07 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:07.909933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-834abcb7-d609-43fa-b71f-1fcac3beed9f tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1369467406", "id": 1695777573, "os-flavor-access:is_public": "False"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:08.009531 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-834abcb7-d609-43fa-b71f-1fcac3beed9f tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.106353 Sep 27 01:32:08.009989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 55/110] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:07 2022] POST /compute/v2.1/flavors => generated 415 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:08.035765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12bf5165-c377-48cc-bfbf-abc235a078f5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.079776 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12bf5165-c377-48cc-bfbf-abc235a078f5 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.056370 Sep 27 01:32:08.090570 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 56/111] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:08.114617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2c0d8ba-2b5e-4a62-b35d-5e484e08296f tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.187999 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2c0d8ba-2b5e-4a62-b35d-5e484e08296f tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.089349 Sep 27 01:32:08.193408 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 57/112] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:08.209436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b6460186-0ce2-450a-84c4-2c7c26b27c11 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] HTTP exception thrown: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. Sep 27 01:32:08.222690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6a43125-94cc-434a-85ed-d0f5b8fbec47 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6460186-0ce2-450a-84c4-2c7c26b27c11 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Request method failure captured: Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/flavors/1938644085/action HTTP/1.1 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 70 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKQ8NeyPFJIeuolwAlUt0Ub1-o6qxWtLjST4pWX22nk-bEURXOoB6ApHL-qmHDmDvIi5UBCfjcBGOF39q3T2einISHdCKcB6fFglVSArGlqkE7-lUAyzcym8UVN2cHRTEH_EWbTzpXi7ea1EHERzR06FEmkOSBXSzclhtJDFz50qaY Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:08.224973 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af200bbb3424d7db3d659ae3d4f2698"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af200bbb3424d7db3d659ae3d4f2698", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2af200bbb3424d7db3d659ae3d4f2698 Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-901967450 Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cfceae59da5d4358869ae7f71b2ea471 Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: {"removeTenantAccess": {"tenant": "072d631c40cd40f3922fcacbd3a066df"}} Sep 27 01:32:08.226321 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: exception: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '1938644085', 'body': {'removeTenantAccess': {'tenant': '072d631c40cd40f3922fcacbd3a066df'}}} Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 27 01:32:08.227041 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:08.228111 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:08.229192 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:08.229192 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:08.229192 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:08.229192 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. Sep 27 01:32:08.229192 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:08.237163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6460186-0ce2-450a-84c4-2c7c26b27c11 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Returning 404 to user: Flavor access not found for 32 / 072d631c40cd40f3922fcacbd3a066df combination. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:08.238381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6460186-0ce2-450a-84c4-2c7c26b27c11 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1938644085/action" status: 404 len: 124 microversion: 2.1 time: 0.583278 Sep 27 01:32:08.246081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 56/113] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:07 2022] POST /compute/v2.1/flavors/1938644085/action => generated 124 bytes in 592 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:08.263791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4126bb63-2b8c-4244-a72c-daae76792013 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.272663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6a43125-94cc-434a-85ed-d0f5b8fbec47 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1695777573" status: 202 len: 0 microversion: 2.1 time: 0.054863 Sep 27 01:32:08.275227 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 58/114] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:08 2022] DELETE /compute/v2.1/flavors/1695777573 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:08.281963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3b0b7bbf-999f-44e9-833c-a8451e3de03f tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.333673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4126bb63-2b8c-4244-a72c-daae76792013 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1938644085" status: 202 len: 0 microversion: 2.1 time: 0.080416 Sep 27 01:32:08.339489 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 57/115] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:08 2022] DELETE /compute/v2.1/flavors/1938644085 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:08.341270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3b0b7bbf-999f-44e9-833c-a8451e3de03f tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.062354 Sep 27 01:32:08.342809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 59/116] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:08.366780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bff7450-fd1a-4811-aae1-056909262865 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.371457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f8f8332-a173-47f1-a80f-b52b48ccb26a tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1282882788", "id": 599744690, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:08.414932 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bff7450-fd1a-4811-aae1-056909262865 tempest-FlavorsAccessNegativeTestJSON-901967450 tempest-FlavorsAccessNegativeTestJSON-901967450-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.073077 Sep 27 01:32:08.430667 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f8f8332-a173-47f1-a80f-b52b48ccb26a tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.064416 Sep 27 01:32:08.431993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 58/117] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:08.443915 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 60/118] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:08 2022] POST /compute/v2.1/flavors => generated 411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:08.456426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-149f72b4-e78d-464c-8386-f9b3f0a9e5cb tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.485068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-149f72b4-e78d-464c-8386-f9b3f0a9e5cb tempest-FlavorsAdminTestJSON-1444744274 tempest-FlavorsAdminTestJSON-1444744274-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.033637 Sep 27 01:32:08.498070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 59/119] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:08.510782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b5ff6f1-34bc-4b46-ac5f-0f711c325678 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.548101 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b5ff6f1-34bc-4b46-ac5f-0f711c325678 tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/599744690" status: 202 len: 0 microversion: 2.1 time: 0.043132 Sep 27 01:32:08.559145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33f46a14-d82f-4293-b2c9-cda631e2b0ce tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.567004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 61/120] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:08 2022] DELETE /compute/v2.1/flavors/599744690 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:08.621268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:08.622915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:08.630732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33f46a14-d82f-4293-b2c9-cda631e2b0ce tempest-FlavorsAdminTestJSON-1074102011 tempest-FlavorsAdminTestJSON-1074102011-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.075525 Sep 27 01:32:08.633784 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 60/121] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:08.654821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:08.655728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:08.656350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:08.662049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:08.662049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:08.662049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:09.006640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:09.018065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9350e5d6-f9c1-4202-98c4-474de71da9bd tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.405599 Sep 27 01:32:09.025919 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 62/122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:08 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:10.052016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:10.052608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:10.064205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:10.064690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:10.080305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:10.081100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:10.082387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:10.084091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:10.455259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:10.477771 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75f4a264-1625-4015-8fc3-675073a78a35 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.425834 Sep 27 01:32:10.485822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 61/123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:10 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:10.547034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1756203469", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "2126956575", "adminPass": "***", "networks": [{"uuid": "5129a9b0-bf63-4c85-b080-ed5425322fc8"}], "security_groups": [{"name": "tempest-securitygroup--1183385619"}], "key_name": "tempest-keypair-1096786391", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:10.688096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] validate_networks() for [('5129a9b0-bf63-4c85-b080-ed5425322fc8', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:10.814921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9e7d525-d82f-4a93-9b8a-e97f5d1f1b3d tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Calling method '.version_select at 0x7f24d6f01c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:11.097977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:11.368569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9e7d525-d82f-4a93-9b8a-e97f5d1f1b3d tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 371 microversion: 2.1 time: 0.861875 Sep 27 01:32:11.369160 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 63/124] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:32:10 2022] GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 371 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:11.382688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6ed70d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:11.867995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.868584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.869019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:11.870104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.870633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.871135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:11.947889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e7ffa00-b425-46dc-ac69-b2eb19678238 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 328 microversion: 2.1 time: 0.569440 Sep 27 01:32:11.955964 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 64/125] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:11 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 328 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:11.965490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:11.966960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:11.975108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.975663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.976350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:11.977060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.977604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.978382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:11.982320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:11.984526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:11.985204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:11.985684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:11.986146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:11.996608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.997103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.997570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:11.998469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:11.998934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:11.999402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:12.034336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:12.040193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for user 2089ee58706a4b1da251c4256b9673c8 and project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:12.053390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:32:12.057048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:32:12.135136 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-206522eb-88ef-487c-b7b4-b66c63eab1a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.591995 Sep 27 01:32:12.137431 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 62/126] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:32:12.159258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01cef983-ded6-4f3d-9c96-3e649879d4fd tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:12.162230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01cef983-ded6-4f3d-9c96-3e649879d4fd tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:12.169412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:12.180239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-152a7f96-1756-4afa-87df-714f8067f644 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.230166 Sep 27 01:32:12.181961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 65/127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:11 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:12.272457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01cef983-ded6-4f3d-9c96-3e649879d4fd tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:12.282667 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01cef983-ded6-4f3d-9c96-3e649879d4fd tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1265 microversion: 2.1 time: 0.137709 Sep 27 01:32:12.285603 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 63/128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:12 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:12.435129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-357664869", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:12.518284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:12.791997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:12.793149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:12.794391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:12.794977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:12.795533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:12.805503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:12.806352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:12.806971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:12.807777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:12.808264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:12.808856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:12.833551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:12.842160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for user bf2f74ce54fe4ff4834fbe945dcbaebb and project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:12.857059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.utils [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] cores quota exceeded for 2930d7cbf95243cb885bb98561604b60, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128778) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 27 01:32:12.857947 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Request method failure captured: Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 144 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKY52Sc0qPEsKvBkQ-mzynvMpW_filri4XBaGuYKddD83Wcizbkfm8iIi4CdeXXgzlQrI33Qczrj2eJNzCEhqGkbCdbUDwOXknNgnl2hcDrX3DBx0dRzuVNkp9fK3lz_48wJ0M-QaKi2JfKWT4MynpAQnAfjJiN0ysadC-RfsRq-tM Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:12.864721 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2930d7cbf95243cb885bb98561604b60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bf2f74ce54fe4ff4834fbe945dcbaebb Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-357664869", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} Sep 27 01:32:12.866275 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-357664869', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452'}}} Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 27 01:32:12.867114 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:12.868825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.870218 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:12.871581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3166cb1-3880-4302-8995-6cafa7780f39 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.651815 Sep 27 01:32:12.877099 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 66/129] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 656 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:12.882391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6db0040>, body: {"quota_set": {"cores": 20}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:13.071458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6372023a-af23-4aa1-a34d-8f40c77030ad tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] Calling method '.version_select at 0x7f24d712bca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:13.098896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6372023a-af23-4aa1-a34d-8f40c77030ad tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.491436 Sep 27 01:32:13.107433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 64/130] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:32:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:13.114231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d8b5cc7-60f8-475b-bad2-73dfd2ed055e tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] Action: 'update', calling method: .version_select at 0x7f24d712bd30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:13.278626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.279496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.280122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.281111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.281827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.282473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.314196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=12,nova_api:DELETE=4,nova_api:UPDATE=7 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:13.364009 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-811d7c9d-2bb7-404d-8600-ed2e13f7550b tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 332 microversion: 2.1 time: 0.486035 Sep 27 01:32:13.366798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 67/131] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:12 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:13.382264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:13.383213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:13.391582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.392253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.392833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.394177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.395013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.395585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.584274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d8b5cc7-60f8-475b-bad2-73dfd2ed055e tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.466975 Sep 27 01:32:13.585530 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 65/132] 10.222.0.52 () {60 vars in 1206 bytes} [Tue Sep 27 01:32:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:13.601285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:13.602358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:13.613169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.613942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.614827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.615688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:13.616285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:13.616856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:13.686309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:13.697520 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1e7cfbec-07c4-40c2-bf0c-bcefa3fc3124 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.329143 Sep 27 01:32:13.698357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 68/133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:13 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:13.704590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e566070-a46b-445a-9f5f-fd22812e63c7 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Calling method '.version_select at 0x7f24d6db03a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:13.719179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:13.732474 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05894ca2-71db-4228-aa80-5f22d1f51e90 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1317 microversion: 2.1 time: 0.145681 Sep 27 01:32:13.743621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 66/134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:13 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:13.748687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b771b96c-c763-4248-9f22-f6c9fee264d1 tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] Calling method '.version_select at 0x7f24d6fc0820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:13.761792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b771b96c-c763-4248-9f22-f6c9fee264d1 tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016647 Sep 27 01:32:13.762429 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 67/135] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:32:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:13.782322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d661e382-186b-4b0a-b5d4-9026248e2085 tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6fd2160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:13.904164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d661e382-186b-4b0a-b5d4-9026248e2085 tempest-QuotaClassesAdminTestJSON-1048379380 tempest-QuotaClassesAdminTestJSON-1048379380-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.129012 Sep 27 01:32:13.905003 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 68/136] 10.222.0.52 () {60 vars in 1206 bytes} [Tue Sep 27 01:32:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:14.068416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e566070-a46b-445a-9f5f-fd22812e63c7 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 371 microversion: 2.1 time: 0.368723 Sep 27 01:32:14.069636 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 69/137] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:32:13 2022] GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:14.082646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6fd29d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:14.642163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.644783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.645667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.646703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.647390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.648036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.725731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:14.727968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:14.748313 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65baec25-fd1b-40f7-afde-3edfd6577f01 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 328 microversion: 2.1 time: 0.669882 Sep 27 01:32:14.750278 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 69/138] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:14 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 328 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:14.755134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.756191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.760823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.765403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.768173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.770886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.774565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:14.775314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:14.778370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=71 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:14.791966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.792426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.793101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.793803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:14.794265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:14.794681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:14.943609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:14.946574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=61 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:14.960225 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fd333a3-b285-4419-8d4d-7ef339adb21c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1323 microversion: 2.1 time: 0.202158 Sep 27 01:32:14.961031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 70/139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:14 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:14.994919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:15.004627 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf8d58f7-9c2b-4cb5-bfa4-a7f5acfc2113 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.284821 Sep 27 01:32:15.008133 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 70/140] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:14 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:15.013961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1884617841", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.123752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:15.397874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:15.398368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:15.398496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a574ca7-cb27-4ce0-a286-0c771a1e8239 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-139260395", "id": 1586346796, "os-flavor-access:is_public": "False"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.398973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:15.399486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:15.399960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:15.410141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:15.411189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:15.411789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:15.412624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:15.413231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:15.413935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:15.421631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=17 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:15.430322 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a574ca7-cb27-4ce0-a286-0c771a1e8239 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.468393 Sep 27 01:32:15.430961 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 71/141] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:14 2022] POST /compute/v2.1/flavors => generated 430 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:15.435795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:15.437955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:15.441521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for user bf2f74ce54fe4ff4834fbe945dcbaebb and project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:15.449677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92f85c82-a42f-4ecf-bdf7-282ea9cf60dc tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "49b5c13256714e42969f75e99de244d3"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.467611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.utils [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] instances quota exceeded for 2930d7cbf95243cb885bb98561604b60, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128778) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 27 01:32:15.468748 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Request method failure captured: Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 145 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKY52Sc0qPEsKvBkQ-mzynvMpW_filri4XBaGuYKddD83Wcizbkfm8iIi4CdeXXgzlQrI33Qczrj2eJNzCEhqGkbCdbUDwOXknNgnl2hcDrX3DBx0dRzuVNkp9fK3lz_48wJ0M-QaKi2JfKWT4MynpAQnAfjJiN0ysadC-RfsRq-tM Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:15.470912 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2930d7cbf95243cb885bb98561604b60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bf2f74ce54fe4ff4834fbe945dcbaebb Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1884617841", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} Sep 27 01:32:15.472003 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1884617841', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452'}}} Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 27 01:32:15.472618 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:15.474258 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.476941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d646dbd2-626c-4f4d-8857-4eeb3f3e9cc1 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.464775 Sep 27 01:32:15.479632 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 71/142] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:15.625810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-59450f62-7bce-4b1e-b313-46394be05172 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-721609206", "ram": 512, "vcpus": 1, "disk": 10, "id": 1903172769, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.650611 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-59450f62-7bce-4b1e-b313-46394be05172 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.173746 Sep 27 01:32:15.652256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 72/143] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:15 2022] POST /compute/v2.1/flavors => generated 415 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:15.657618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d92d30>, body: {"quota_set": {"instances": 10}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.744612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92f85c82-a42f-4ecf-bdf7-282ea9cf60dc tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1586346796/action" status: 200 len: 97 microversion: 2.1 time: 0.299521 Sep 27 01:32:15.745549 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 72/144] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:15 2022] POST /compute/v2.1/flavors/1586346796/action => generated 97 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:32:15.761215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96e168f8-4e6d-4c29-9136-a65711f1c53c tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:15.822774 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96e168f8-4e6d-4c29-9136-a65711f1c53c tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075936 Sep 27 01:32:15.831247 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 73/145] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:15 2022] POST /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:15.855380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:15.859655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:15.860448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:15.862401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:15.863295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:15.863825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:15.964977 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7fb27936-68d0-4d56-b3f0-374711d0d5fb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 329 microversion: 2.1 time: 0.311297 Sep 27 01:32:15.965908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 73/146] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:15 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 329 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:16.035546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8827a905-0104-4e48-8bc9-56878872be43 tempest-FlavorsAccessTestJSON-943532134 tempest-FlavorsAccessTestJSON-943532134-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.055649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=11,nova_api:UPDATE=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:16.101289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8827a905-0104-4e48-8bc9-56878872be43 tempest-FlavorsAccessTestJSON-943532134 tempest-FlavorsAccessTestJSON-943532134-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6646 microversion: 2.1 time: 0.266934 Sep 27 01:32:16.103381 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 74/147] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:15 2022] GET /compute/v2.1/flavors/detail => generated 6646 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:16.109639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e2fed63-5c2e-476f-a3cc-cb4fda4e08bb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Calling method '.version_select at 0x7f24d6f80280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.302879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7b585edf-31ac-4d26-8bc5-cbb09980659e tempest-FlavorsExtraSpecsTestJSON-105608108 tempest-FlavorsExtraSpecsTestJSON-105608108-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.314653 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7b585edf-31ac-4d26-8bc5-cbb09980659e tempest-FlavorsExtraSpecsTestJSON-105608108 tempest-FlavorsExtraSpecsTestJSON-105608108-project] 10.222.0.52 "GET /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.347933 Sep 27 01:32:16.317512 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 74/148] 10.222.0.52 () {58 vars in 1203 bytes} [Tue Sep 27 01:32:15 2022] GET /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:16.322728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.323342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:16.338944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.339649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.339973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.340680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.341375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.342092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.559925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:16.568335 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff296421-ab43-4b3b-9be2-bd00a6bc1ad8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.251831 Sep 27 01:32:16.569081 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 75/149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:16 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:16.581696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.582377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:16.590785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.590785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.590785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.591506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.591969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.592398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.610567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e2fed63-5c2e-476f-a3cc-cb4fda4e08bb tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 371 microversion: 2.1 time: 0.506244 Sep 27 01:32:16.622732 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 75/150] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:32:16 2022] GET /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 371 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:16.635854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb593b43-fe07-4f25-806e-44b629829fe3 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "49b5c13256714e42969f75e99de244d3"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:16.768389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:16.776504 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e5f2f0c-ff48-4e00-a27c-ad84534de361 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.206123 Sep 27 01:32:16.777061 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 76/151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:16 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:16.782442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06bc47a4-86b7-4899-8a9e-c0640e7cd028 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:16.821819 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06bc47a4-86b7-4899-8a9e-c0640e7cd028 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043570 Sep 27 01:32:16.822708 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 77/152] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:16 2022] POST /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:16.837064 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb593b43-fe07-4f25-806e-44b629829fe3 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1586346796/action" status: 200 len: 21 microversion: 2.1 time: 0.209507 Sep 27 01:32:16.839182 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 76/153] 10.222.0.52 () {60 vars in 1200 bytes} [Tue Sep 27 01:32:16 2022] POST /compute/v2.1/flavors/1586346796/action => generated 21 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:16.844097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6fbb790>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:16.906252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c", "name": "network-vif-plugged", "status": "completed", "tag": "5e579faf-c1ca-406f-b7a7-5a55746aabaa"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:16.917964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.918434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.919302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.931515 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] Creating event network-vif-plugged:5e579faf-c1ca-406f-b7a7-5a55746aabaa for instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c on n-h1-859358-1 Sep 27 01:32:16.937871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1eaae83e-c054-4429-9c1b-a97c1d4558bf req-fbfcc249-f2dd-452d-a232-f91bbd3e37ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113759 Sep 27 01:32:16.939113 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 78/154] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:16.946408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1015a1aa-80b5-4901-9a41-efb8f107810e tempest-FlavorsExtraSpecsTestJSON-105608108 tempest-FlavorsExtraSpecsTestJSON-105608108-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.959626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1015a1aa-80b5-4901-9a41-efb8f107810e tempest-FlavorsExtraSpecsTestJSON-105608108 tempest-FlavorsExtraSpecsTestJSON-105608108-project] 10.222.0.52 "GET /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018616 Sep 27 01:32:16.960792 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 79/155] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:32:16 2022] GET /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:16.971090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.971298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0da21399-6229-45bc-a5f9-92f594754f68 tempest-FlavorsAccessTestJSON-943532134 tempest-FlavorsAccessTestJSON-943532134-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:16.971775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.972318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.978082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:16.979136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:16.979573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:16.999760 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0da21399-6229-45bc-a5f9-92f594754f68 tempest-FlavorsAccessTestJSON-943532134 tempest-FlavorsAccessTestJSON-943532134-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.033107 Sep 27 01:32:17.000555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 80/156] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:16 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:17.005124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b890e3c5-1f7d-4d05-86ab-e2a43f24e2ca tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:17.040493 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b890e3c5-1f7d-4d05-86ab-e2a43f24e2ca tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038917 Sep 27 01:32:17.046108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 81/157] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:17 2022] POST /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.046108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8195d8d3-8bb8-4a74-8e55-dcadd06f3e3d tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.056767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a6cf372-b133-47e8-9e80-4445517d35a0 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 325 microversion: 2.1 time: 0.216475 Sep 27 01:32:17.061501 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 77/158] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:16 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:17.066931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0664c928-0b72-4143-a5ad-37dbec4f19c4 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.081283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0664c928-0b72-4143-a5ad-37dbec4f19c4 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021864 Sep 27 01:32:17.082361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 78/159] 10.222.0.52 () {58 vars in 1203 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.087439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8195d8d3-8bb8-4a74-8e55-dcadd06f3e3d tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1586346796" status: 202 len: 0 microversion: 2.1 time: 0.045022 Sep 27 01:32:17.088054 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 82/160] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:17 2022] DELETE /compute/v2.1/flavors/1586346796 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:17.095512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59123fba-4d5f-46dc-9f34-314d4a8ef4a4 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:17.098986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9c09b02-0bd0-4a34-9665-256d19b63890 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.126013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9c09b02-0bd0-4a34-9665-256d19b63890 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.030525 Sep 27 01:32:17.129387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 83/161] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:17.158114 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59123fba-4d5f-46dc-9f34-314d4a8ef4a4 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.068269 Sep 27 01:32:17.158733 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 79/162] 10.222.0.52 () {60 vars in 1265 bytes} [Tue Sep 27 01:32:17 2022] PUT /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes => generated 22 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.162126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea6c0e5d-721f-40bb-87ae-1781dca2e660 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1777832679", "id": 736571831, "os-flavor-access:is_public": "False"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:17.170113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7eb5a740-48c9-4355-9c32-4013b7ccb39a tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.194675 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea6c0e5d-721f-40bb-87ae-1781dca2e660 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.046524 Sep 27 01:32:17.202595 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7eb5a740-48c9-4355-9c32-4013b7ccb39a tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037076 Sep 27 01:32:17.203192 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 80/164] 10.222.0.52 () {58 vars in 1203 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/1903172769/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.203412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 84/164] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:17 2022] POST /compute/v2.1/flavors => generated 428 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:17.215292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-112e601a-f3a0-462f-a423-3ba21e37c1d2 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.221435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afdbd271-cdb1-4977-8872-f69ea5ec44dd tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.254456 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-112e601a-f3a0-462f-a423-3ba21e37c1d2 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/736571831/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.048757 Sep 27 01:32:17.268100 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 81/165] 10.222.0.52 () {58 vars in 1206 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/736571831/os-flavor-access => generated 21 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.273451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85d9b55b-56b4-428f-b0b8-5fcf905fa099 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.276325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afdbd271-cdb1-4977-8872-f69ea5ec44dd tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.061518 Sep 27 01:32:17.279853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 85/166] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:32:17 2022] DELETE /compute/v2.1/flavors/1903172769/os-extra_specs/hw:numa_nodes => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 27 01:32:17.281523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1548613978", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:17.307120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85d9b55b-56b4-428f-b0b8-5fcf905fa099 tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/736571831" status: 202 len: 0 microversion: 2.1 time: 0.037406 Sep 27 01:32:17.308925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 82/167] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:32:17 2022] DELETE /compute/v2.1/flavors/736571831 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:17.317669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e68185c-bcc8-4bb8-919d-e8523aaf7356 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.358653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e68185c-bcc8-4bb8-919d-e8523aaf7356 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1903172769/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.047582 Sep 27 01:32:17.363165 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 83/168] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:32:17 2022] DELETE /compute/v2.1/flavors/1903172769/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:17.369594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0785e20-33c5-418b-bc5e-350a9062f66a tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.369883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:17.416211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0785e20-33c5-418b-bc5e-350a9062f66a tempest-FlavorsAccessTestJSON-1755589760 tempest-FlavorsAccessTestJSON-1755589760-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6226 microversion: 2.1 time: 0.051433 Sep 27 01:32:17.416989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/detail => generated 6226 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:17.421614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe22a4dd-88e2-42f5-b27d-201dd3a5443d tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.429640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe22a4dd-88e2-42f5-b27d-201dd3a5443d tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1903172769/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011278 Sep 27 01:32:17.430319 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 85/170] 10.222.0.52 () {58 vars in 1203 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/1903172769/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:17.458414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76af2f48-46e4-4d76-8b8f-62e15078ba69 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.489870 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76af2f48-46e4-4d76-8b8f-62e15078ba69 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1903172769" status: 202 len: 0 microversion: 2.1 time: 0.043460 Sep 27 01:32:17.490814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 86/171] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:17 2022] DELETE /compute/v2.1/flavors/1903172769 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:32:17.504097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8bf4d2d-6265-42e6-9fd4-ae086eb47619 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.541041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8bf4d2d-6265-42e6-9fd4-ae086eb47619 tempest-FlavorsExtraSpecsTestJSON-731176210 tempest-FlavorsExtraSpecsTestJSON-731176210-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.045826 Sep 27 01:32:17.542206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 87/172] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:17.591958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.592625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:17.599155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.603197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.604089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.605022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.605841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.606574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.654754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:17.655910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:17.656587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:17.657209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:17.657824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:17.668981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.669789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.670477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.671343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.672170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.673769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.703781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:17.709856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Getting quotas for user bf2f74ce54fe4ff4834fbe945dcbaebb and project 2930d7cbf95243cb885bb98561604b60. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:17.732702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.utils [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] ram quota exceeded for 2930d7cbf95243cb885bb98561604b60, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128778) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 27 01:32:17.733573 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Request method failure captured: Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 145 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKY52Sc0qPEsKvBkQ-mzynvMpW_filri4XBaGuYKddD83Wcizbkfm8iIi4CdeXXgzlQrI33Qczrj2eJNzCEhqGkbCdbUDwOXknNgnl2hcDrX3DBx0dRzuVNkp9fK3lz_48wJ0M-QaKi2JfKWT4MynpAQnAfjJiN0ysadC-RfsRq-tM Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:17.736051 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2930d7cbf95243cb885bb98561604b60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bf2f74ce54fe4ff4834fbe945dcbaebb Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1548613978", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} Sep 27 01:32:17.737195 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1548613978', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452'}}} Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 27 01:32:17.738095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:17.739050 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.740232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5cea923-2786-49e9-a921-eaec6e641966 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.461629 Sep 27 01:32:17.745471 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 86/173] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:17 2022] POST /compute/v2.1/servers => generated 110 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:17.765014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6edcca0>, body: {"quota_set": {"ram": 51200}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:17.775823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:17.798988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d07db2f-4025-439b-8a3d-b4fdc9404af8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.209640 Sep 27 01:32:17.799970 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 88/174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:17.813484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:17.813484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:17.819657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.821958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.823016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.824320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:17.825077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:17.826055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:17.990932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:18.002879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ebc95b2-5995-4924-8c11-32111d4ff9a1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.200883 Sep 27 01:32:18.003654 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 89/175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:17 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:18.236739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:18.237520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:18.238416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:18.239555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:18.240091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:18.240671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:18.285396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:18.354023 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5bff31a8-31af-44f3-92f7-4b5509d4fc96 tempest-QuotasAdminNegativeTest-1140830982 tempest-QuotasAdminNegativeTest-1140830982-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 200 len: 329 microversion: 2.1 time: 0.607029 Sep 27 01:32:18.361844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 87/176] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:17 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 329 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:18.372160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d75dd1ca-3417-4ec1-b9cb-8a86997e3087 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Action: 'update', calling method: .version_select at 0x7f24d6fbbe50>, body: {"quota_set": {"ram": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:18.386104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d75dd1ca-3417-4ec1-b9cb-8a86997e3087 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'bf2f74ce54fe4ff4834fbe945dcbaebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2930d7cbf95243cb885bb98561604b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d75dd1ca-3417-4ec1-b9cb-8a86997e3087 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Request method failure captured: Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 HTTP/1.1 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 25 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKY52Sc0qPEsKvBkQ-mzynvMpW_filri4XBaGuYKddD83Wcizbkfm8iIi4CdeXXgzlQrI33Qczrj2eJNzCEhqGkbCdbUDwOXknNgnl2hcDrX3DBx0dRzuVNkp9fK3lz_48wJ0M-QaKi2JfKWT4MynpAQnAfjJiN0ysadC-RfsRq-tM Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:18.389045 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2930d7cbf95243cb885bb98561604b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2930d7cbf95243cb885bb98561604b60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2930d7cbf95243cb885bb98561604b60 Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-858202794 Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: bf2f74ce54fe4ff4834fbe945dcbaebb Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-QuotasAdminNegativeTest-858202794-project Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: {"quota_set": {"ram": 0}} Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 27 01:32:18.390483 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2930d7cbf95243cb885bb98561604b60', 'body': {'quota_set': {'ram': 0}}} Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 27 01:32:18.391386 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:18.392670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:18.393940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:18.393940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:18.393940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:18.393940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 27 01:32:18.393940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:18.395222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d75dd1ca-3417-4ec1-b9cb-8a86997e3087 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:18.396563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d75dd1ca-3417-4ec1-b9cb-8a86997e3087 tempest-QuotasAdminNegativeTest-858202794 tempest-QuotasAdminNegativeTest-858202794-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60" status: 403 len: 116 microversion: 2.1 time: 0.029845 Sep 27 01:32:18.397654 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 90/177] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:32:18 2022] PUT /compute/v2.1/os-quota-sets/2930d7cbf95243cb885bb98561604b60 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:18.823787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:18.824678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:18.833285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:18.834157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:18.834764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:18.835754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:18.836394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:18.836820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:19.006349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:19.016918 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8377ac57-2975-4010-a69b-ed9646afc3e7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.197900 Sep 27 01:32:19.017862 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 88/178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:18 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:19.026354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:19.027227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:19.035834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:19.036597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:19.037033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:19.037763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:19.038370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:19.038794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:19.235869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:19.254693 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8442b9e-8945-4312-bf4e-174f9d0fd1e1 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1337 microversion: 2.1 time: 0.230749 Sep 27 01:32:19.257424 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:19 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1337 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:20.040126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:20.041508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:20.048766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.049547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.050349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.051238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.052035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.052466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.182932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-154e4b9c-82d1-4250-9344-de4050e78e10 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] Action: 'create', calling method: .version_select at 0x7f24d7232670>, body: {"security_group": {"name": "tempest-securitygroup-211481618", "description": "tempest-description-173459240"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:20.192208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:20.200173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fddf60f-29b1-4558-a573-3f90e25d8655 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.163960 Sep 27 01:32:20.201244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 92/180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:20 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:20.297835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:20.298752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:20.308124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.309065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.309756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.311430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.312191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.312785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.477596 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-154e4b9c-82d1-4250-9344-de4050e78e10 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.585816 Sep 27 01:32:20.478218 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 89/181] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:32:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:20.492571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-366f3bbf-4f7b-42d6-b5e6-56f8d8fa3870 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] Action: 'create', calling method: .version_select at 0x7f24d6d498b0>, body: {"security_group": {"name": "tempest-securitygroup-1282136782", "description": "tempest-description-1915644815"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:20.553583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:20.565017 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bb8fca8-6f22-4eb3-a7bb-d3d983148f87 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1487 microversion: 2.1 time: 0.272829 Sep 27 01:32:20.565568 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 93/182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:20 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1487 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:20.591535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:20.593363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:20.600986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.601856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.602474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.603808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:20.604527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:20.605114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:20.700125 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-366f3bbf-4f7b-42d6-b5e6-56f8d8fa3870 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.210962 Sep 27 01:32:20.709707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 90/183] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:32:20 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:20.987533 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9659b7d2-8a76-4b5e-860e-fdc756978963 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1638 microversion: 2.1 time: 0.399771 Sep 27 01:32:20.988124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:20 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1638 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:21.016660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:21.017966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:21.030883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.032230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.032669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.034453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.035519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.036298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.071238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:32:21.153844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c0ede92-4d8f-4296-91ad-1c26a2d2f99c tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] Action: 'create', calling method: .version_select at 0x7f24d6db0820>, body: {"security_group": {"name": "tempest-securitygroup-733704371", "description": "tempest-description-76646355"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:21.185479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:32:21.186900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84fc0946-416a-44f2-8d7d-cee90d38c73f tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquired lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:32:21.188768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.189841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.190479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.191882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.192616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.193250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.205745 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.compute.rpcapi [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 01:32:21.206825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:32:21.263316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d95ea319-b759-48c4-8333-a1316083d4f2 None None] 10.222.0.52 "DELETE /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 204 len: 0 microversion: 2.1 time: 0.255289 Sep 27 01:32:21.265500 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 95/185] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:32:21 2022] DELETE /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:32:21.272479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:21.274797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:21.285609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.286587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.287240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.288125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.288734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.289322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.493175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:21.502064 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-204666b6-5911-49a4-9f5d-3de63f2684c0 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.235224 Sep 27 01:32:21.517478 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 96/186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:21 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:21.517478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:21.517478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:21.521601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.522272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.522849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.523714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:21.524977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:21.525583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:21.544475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c0ede92-4d8f-4296-91ad-1c26a2d2f99c tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.833626 Sep 27 01:32:21.545212 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 91/187] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:32:20 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:21.558379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-11a72a41-af94-4ae9-8f93-02e54b8069ae tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] Action: 'create', calling method: .version_select at 0x7f24d6db0e50>, body: {"security_group": {"name": "tempest-securitygroup-224707356", "description": "tempest-description-750186452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:21.695891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:21.708309 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bd6ca99-2276-458d-bdb0-676b8a7e636c tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1493 microversion: 2.1 time: 0.203695 Sep 27 01:32:21.709983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 97/188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:21 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1493 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:21.729942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-11a72a41-af94-4ae9-8f93-02e54b8069ae tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.174776 Sep 27 01:32:21.731109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 92/189] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:32:21 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:21.743292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d30674c-19cc-4d91-b7b0-4a5b78ddf10a tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] Calling method '.version_select at 0x7f24d6ea00d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:22.525126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:22.525789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:22.546074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:22.550067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:22.550872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:22.551779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:22.552397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:22.553986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:22.850705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:22.861986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4dfd275c-c0d7-40b8-b9ad-f23fb4645066 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.340519 Sep 27 01:32:22.863920 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 93/190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:22 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:23.202446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a48c1a6f-c282-425f-a206-ef8610491ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1861859744", "ram": 512, "vcpus": 1, "disk": 10, "id": 1633461853, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:23.228104 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a48c1a6f-c282-425f-a206-ef8610491ca4 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.361342 Sep 27 01:32:23.228994 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 94/191] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:22 2022] POST /compute/v2.1/flavors => generated 416 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:23.234882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:23.235889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:23.244519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:23.245224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:23.246694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:23.247665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:23.248371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:23.249705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:23.537867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:23.549034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a78419a-60cb-41dc-bf94-5aab2fb5ea94 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1493 microversion: 2.1 time: 0.318450 Sep 27 01:32:23.549741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 95/192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:23 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1493 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:23.895074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4565b491-6e94-40eb-bec8-afd5d483f56d tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:23.907391 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-4565b491-6e94-40eb-bec8-afd5d483f56d tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] HTTP exception thrown: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4565b491-6e94-40eb-bec8-afd5d483f56d tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Request method failure captured: Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKlO9Ns-QiWKxjNDHwy7S458tPBiUxqRLCzB94zm6qg2dHjLYBZg8D9FdIE4i0qImPBA2WaCE0CnOY31swpDxYGDZRjxAaJtLxeCfFNkRDRlHCiEuy5z5ZpbxOGOw7mRoAW3BJA1T-Wm3blzMwddRCFCa8IivkA6VyYRmfqH5e72Nw Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:23.909015 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdb271d5dfb74bcfa9d780457c12e264", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 59a30e6329bc447bb821eced94ac7a1c Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:23.911196 n-d-859358-1 devstack@n-api.service[128778]: exception: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'id': 'hw:cpu_thread_policy'} Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:23.911798 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4565b491-6e94-40eb-bec8-afd5d483f56d tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Returning 404 to user: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:23.912990 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4565b491-6e94-40eb-bec8-afd5d483f56d tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] 10.222.0.52 "GET /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.359975 Sep 27 01:32:23.917665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 96/193] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:32:23 2022] GET /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:23.924078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:23.928012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:23.943110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:23.944102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:23.944718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:23.946970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:23.947679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:23.948267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:24.319698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:24.333739 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6cbe9b26-b3d3-43d5-be59-2e41a4adb64c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.414819 Sep 27 01:32:24.334662 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 97/194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:23 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:24.343932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36862b74-54bc-48df-8251-97d9ed3ed5af tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.353920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-36862b74-54bc-48df-8251-97d9ed3ed5af tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '59a30e6329bc447bb821eced94ac7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb271d5dfb74bcfa9d780457c12e264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36862b74-54bc-48df-8251-97d9ed3ed5af tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Request method failure captured: Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/flavors/1633461853/os-extra_specs HTTP/1.1 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 66 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKlO9Ns-QiWKxjNDHwy7S458tPBiUxqRLCzB94zm6qg2dHjLYBZg8D9FdIE4i0qImPBA2WaCE0CnOY31swpDxYGDZRjxAaJtLxeCfFNkRDRlHCiEuy5z5ZpbxOGOw7mRoAW3BJA1T-Wm3blzMwddRCFCa8IivkA6VyYRmfqH5e72Nw Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:24.355882 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdb271d5dfb74bcfa9d780457c12e264", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 59a30e6329bc447bb821eced94ac7a1c Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 27 01:32:24.356978 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:24.357630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 27 01:32:24.359237 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.360269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36862b74-54bc-48df-8251-97d9ed3ed5af tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.360269 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36862b74-54bc-48df-8251-97d9ed3ed5af tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] 10.222.0.52 "POST /compute/v2.1/flavors/1633461853/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022143 Sep 27 01:32:24.363892 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 98/195] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:24 2022] POST /compute/v2.1/flavors/1633461853/os-extra_specs => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:24.393962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c", "name": "network-vif-deleted", "tag": "5e579faf-c1ca-406f-b7a7-5a55746aabaa"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.424564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:24.425048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:24.425544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:24.437409 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] Creating event network-vif-deleted:5e579faf-c1ca-406f-b7a7-5a55746aabaa for instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c on n-h1-859358-1 Sep 27 01:32:24.448187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9f8a4e81-4619-4e88-b1a9-7200d2cbba63 req-507ce6bb-bbc3-4997-ac65-23c41bd0b2ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062367 Sep 27 01:32:24.449118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 99/196] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:24.467270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00b2e182-fbd9-4840-8275-65ba52cbd0a6 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.516175 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00b2e182-fbd9-4840-8275-65ba52cbd0a6 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1633461853/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065577 Sep 27 01:32:24.517400 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 100/197] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:24 2022] POST /compute/v2.1/flavors/1633461853/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:24.530929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dcc6f26-a018-4e0b-ae57-5a60c7dd8152 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:24.532672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dcc6f26-a018-4e0b-ae57-5a60c7dd8152 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '59a30e6329bc447bb821eced94ac7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb271d5dfb74bcfa9d780457c12e264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dcc6f26-a018-4e0b-ae57-5a60c7dd8152 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Request method failure captured: Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKlO9Ns-QiWKxjNDHwy7S458tPBiUxqRLCzB94zm6qg2dHjLYBZg8D9FdIE4i0qImPBA2WaCE0CnOY31swpDxYGDZRjxAaJtLxeCfFNkRDRlHCiEuy5z5ZpbxOGOw7mRoAW3BJA1T-Wm3blzMwddRCFCa8IivkA6VyYRmfqH5e72Nw Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:24.534932 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdb271d5dfb74bcfa9d780457c12e264", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 59a30e6329bc447bb821eced94ac7a1c Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:24.536380 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'id': 'hw:numa_nodes'} Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:24.537122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 27 01:32:24.538497 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.539648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dcc6f26-a018-4e0b-ae57-5a60c7dd8152 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.540572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4dcc6f26-a018-4e0b-ae57-5a60c7dd8152 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016257 Sep 27 01:32:24.547058 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 101/198] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:32:24 2022] DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:24.555792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ae5244e-91df-443d-85d0-7bfd563a8d55 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.580984 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ae5244e-91df-443d-85d0-7bfd563a8d55 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1633461853/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032672 Sep 27 01:32:24.585859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 102/199] 10.222.0.52 () {60 vars in 1224 bytes} [Tue Sep 27 01:32:24 2022] POST /compute/v2.1/flavors/1633461853/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:32:24.592896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:24.593904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:24.600379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:24.601186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:24.601883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:24.602589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:24.603193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:24.603622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:24.645639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:24.646131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:24.646569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:24.647035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lazy-loading 'fault' on Instance uuid 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:32:24.743995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d30674c-19cc-4d91-b7b0-4a5b78ddf10a tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7621 microversion: 2.1 time: 3.003497 Sep 27 01:32:24.746580 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 98/200] 10.222.0.52 () {58 vars in 1191 bytes} [Tue Sep 27 01:32:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7621 bytes in 3007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:24.753978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-073ec667-ba9e-4e42-946a-c20878d59e1f tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.758240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-073ec667-ba9e-4e42-946a-c20878d59e1f tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '59a30e6329bc447bb821eced94ac7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb271d5dfb74bcfa9d780457c12e264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-073ec667-ba9e-4e42-946a-c20878d59e1f tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Request method failure captured: Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 22 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKlO9Ns-QiWKxjNDHwy7S458tPBiUxqRLCzB94zm6qg2dHjLYBZg8D9FdIE4i0qImPBA2WaCE0CnOY31swpDxYGDZRjxAaJtLxeCfFNkRDRlHCiEuy5z5ZpbxOGOw7mRoAW3BJA1T-Wm3blzMwddRCFCa8IivkA6VyYRmfqH5e72Nw Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:24.761709 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fdb271d5dfb74bcfa9d780457c12e264"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fdb271d5dfb74bcfa9d780457c12e264", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: fdb271d5dfb74bcfa9d780457c12e264 Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 59a30e6329bc447bb821eced94ac7a1c Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: {"hw:numa_nodes": "1"} Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:24.763472 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'flavor_id': '1633461853', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:24.765357 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 27 01:32:24.766589 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.770683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-073ec667-ba9e-4e42-946a-c20878d59e1f tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.772336 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-073ec667-ba9e-4e42-946a-c20878d59e1f tempest-FlavorsExtraSpecsNegativeTestJSON-328258716 tempest-FlavorsExtraSpecsNegativeTestJSON-328258716-project] 10.222.0.52 "PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024224 Sep 27 01:32:24.773403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 99/201] 10.222.0.52 () {60 vars in 1265 bytes} [Tue Sep 27 01:32:24 2022] PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:24.778424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3ce0f02-5eb6-413a-9e4c-8ff07b481cac tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] Calling method '.version_select at 0x7f24d6fd2ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:24.805963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '987474da5e5446d3a653c78326bf18fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b07061a8f51455ca67a232506aee738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:24.815729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17f2f29a-1e85-4400-a1f9-b62f8f311d9b tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 200 len: 1327 microversion: 2.1 time: 0.228223 Sep 27 01:32:24.816617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 103/202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:24 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 1327 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:24.834506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29700a2f-e532-4788-accc-ced68fbb743b tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:24.842908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-29700a2f-e532-4788-accc-ced68fbb743b tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] HTTP exception thrown: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29700a2f-e532-4788-accc-ced68fbb743b tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Request method failure captured: Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKmIWz-pMkRSZ2nGD4Z1DyksYY53uL-pQdBYPN8fCyjy9zv88CueNlVzHNrpcoYCgnnBGFVisr1Joj_u_twPWRv2JOmdFVP5nc5utAsrGIpwRaev6Xxty77UeJP9-ZSx-dh6EyeovkWL-6i0CevSpaRKV8IwHiSw28SYwJ7puQwjtk Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:24.854389 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ae2d6731e284941a10b6f8a1f4108f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1313d01d4f384888b54cbc7398b84f21 Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:24.856283 n-d-859358-1 devstack@n-api.service[128778]: exception: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'id': 'hw:cpu_thread_policy'} Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.857324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. Sep 27 01:32:24.859344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.862262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29700a2f-e532-4788-accc-ced68fbb743b tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Returning 404 to user: Flavor 1633461853 has no extra specs with key hw:cpu_thread_policy. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.863508 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29700a2f-e532-4788-accc-ced68fbb743b tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.045706 Sep 27 01:32:24.864609 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 104/203] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:32:24 2022] DELETE /compute/v2.1/flavors/1633461853/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:24.882984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c2c5815-fbda-40db-9bbc-f83ae7634132 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.886866 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3c2c5815-fbda-40db-9bbc-f83ae7634132 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c2c5815-fbda-40db-9bbc-f83ae7634132 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Request method failure captured: Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: request: PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 27 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKmIWz-pMkRSZ2nGD4Z1DyksYY53uL-pQdBYPN8fCyjy9zv88CueNlVzHNrpcoYCgnnBGFVisr1Joj_u_twPWRv2JOmdFVP5nc5utAsrGIpwRaev6Xxty77UeJP9-ZSx-dh6EyeovkWL-6i0CevSpaRKV8IwHiSw28SYwJ7puQwjtk Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:24.888487 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ae2d6731e284941a10b6f8a1f4108f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1313d01d4f384888b54cbc7398b84f21 Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: {"hw:cpu_policy": "shared"} Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:24.890251 n-d-859358-1 devstack@n-api.service[128778]: exception: Request body and URI mismatch Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.890935 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:24.892040 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:24.892040 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 27 01:32:24.892040 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.894286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c2c5815-fbda-40db-9bbc-f83ae7634132 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.895350 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c2c5815-fbda-40db-9bbc-f83ae7634132 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024727 Sep 27 01:32:24.896139 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 105/204] 10.222.0.52 () {60 vars in 1265 bytes} [Tue Sep 27 01:32:24 2022] PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:32:24.907393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22d84206-ee8c-43fe-8cbd-b6401a7c0ffa tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22d84206-ee8c-43fe-8cbd-b6401a7c0ffa tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Request method failure captured: Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: request: PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 49 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKmIWz-pMkRSZ2nGD4Z1DyksYY53uL-pQdBYPN8fCyjy9zv88CueNlVzHNrpcoYCgnnBGFVisr1Joj_u_twPWRv2JOmdFVP5nc5utAsrGIpwRaev6Xxty77UeJP9-ZSx-dh6EyeovkWL-6i0CevSpaRKV8IwHiSw28SYwJ7puQwjtk Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:24.925447 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ae2d6731e284941a10b6f8a1f4108f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ae2d6731e284941a10b6f8a1f4108f1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ae2d6731e284941a10b6f8a1f4108f1 Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1313d01d4f384888b54cbc7398b84f21 Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 27 01:32:24.926841 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'flavor_id': '1633461853', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance: Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 27 01:32:24.927508 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.928660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 27 01:32:24.929723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:24.932576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22d84206-ee8c-43fe-8cbd-b6401a7c0ffa tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:24.934398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22d84206-ee8c-43fe-8cbd-b6401a7c0ffa tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.032082 Sep 27 01:32:24.935846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 106/205] 10.222.0.52 () {60 vars in 1265 bytes} [Tue Sep 27 01:32:24 2022] PUT /compute/v2.1/flavors/1633461853/os-extra_specs/hw:numa_nodes => generated 117 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:24.953741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f27761b-0beb-49b6-b9c3-db0bfdfb2a36 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:25.001023 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f27761b-0beb-49b6-b9c3-db0bfdfb2a36 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1633461853" status: 202 len: 0 microversion: 2.1 time: 0.059711 Sep 27 01:32:25.001640 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 107/206] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:32:24 2022] DELETE /compute/v2.1/flavors/1633461853 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:25.009617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1fefb7ee-8f9b-4ad2-8990-e213de076fc6 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:25.035408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1fefb7ee-8f9b-4ad2-8990-e213de076fc6 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170 tempest-FlavorsExtraSpecsNegativeTestJSON-963054170-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.029366 Sep 27 01:32:25.036616 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:25 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:25.359618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:25.359935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:25.361531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3ce0f02-5eb6-413a-9e4c-8ff07b481cac tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.584524 Sep 27 01:32:25.362619 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 100/208] 10.222.0.52 () {58 vars in 1191 bytes} [Tue Sep 27 01:32:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:25.375812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:25.376581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:25.377198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:25.378597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:25.379223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:25.379925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:25.384090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33e33047-92f9-4203-8a07-b9a8a408c8c8 tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] Calling method '.version_select at 0x7f24d6ea0310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:25.794841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:25.812856 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9513e4d9-380a-4b24-8c66-0fefe50706a2 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.458209 Sep 27 01:32:25.817554 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 109/209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:25 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:25.843177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:25.843811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:25.856590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:25.857283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:25.858713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:25.861610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:25.862917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:25.866760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:25.907288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] HTTP exception thrown: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Request method failure captured: Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c HTTP/1.1 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-5noZiLquXcNjnt0tbtyWe-iIsCQbynhyEl1Ckl8LCyhKH1ZdpAYBL-ovejz0EuvD2aXZNqqPANTM9wnPj9KZLRgVYJDaeX8x9DLfq8tx8cFrxsY8DX6z1ghVa-7lac47ZgVHu9SZqV0cQJ41CfB_Z7Cij40_P-mmSa0iGOz8wns Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:25.916043 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8b07061a8f51455ca67a232506aee738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8b07061a8f51455ca67a232506aee738", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 987474da5e5446d3a653c78326bf18fd Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:25.917594 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c'} Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:25.918406 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:25.919837 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:25.921256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Returning 404 to user: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:25.924830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ae99bbc-5cfc-4f1d-a0b6-922ad858db83 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 404 len: 111 microversion: 2.1 time: 0.087319 Sep 27 01:32:25.925583 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 110/210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:25 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:25.935340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cdfe177-9aed-41a0-9a9e-d7194218d5ce tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:25.964266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cdfe177-9aed-41a0-9a9e-d7194218d5ce tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:25.965092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cdfe177-9aed-41a0-9a9e-d7194218d5ce tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:25.965653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cdfe177-9aed-41a0-9a9e-d7194218d5ce tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.088408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33e33047-92f9-4203-8a07-b9a8a408c8c8 tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/2b927c1b-08e1-4371-943d-ea0a07ba0a67" status: 202 len: 0 microversion: 2.1 time: 0.709304 Sep 27 01:32:26.089662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 101/211] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:32:25 2022] DELETE /compute/v2.1/os-security-groups/2b927c1b-08e1-4371-943d-ea0a07ba0a67 => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:26.100209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f9b12dd-abb6-405a-ae3f-9a31c565ff20 tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] Calling method '.version_select at 0x7f24d6ea0b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:26.170097 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7cdfe177-9aed-41a0-9a9e-d7194218d5ce tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.239642 Sep 27 01:32:26.171882 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 111/212] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:26.183419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-250d0d04-f0ae-4550-acde-25a23c0125a2 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:26.214421 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-250d0d04-f0ae-4550-acde-25a23c0125a2 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.035204 Sep 27 01:32:26.215847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 112/213] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 27 01:32:26.229683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90d4af1b-cf37-4ac5-9673-827e494b536e tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2030092049"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:26.236324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-90d4af1b-cf37-4ac5-9673-827e494b536e tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid 7f1b8c66-03a9-4c3b-b7bd-ea3dc0a0b8f3 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:26.274779 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90d4af1b-cf37-4ac5-9673-827e494b536e tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052939 Sep 27 01:32:26.277026 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 113/214] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:26.290986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-909d3add-e69b-41e6-a254-cf260b365a57 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:26.331574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-909d3add-e69b-41e6-a254-cf260b365a57 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.331992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-909d3add-e69b-41e6-a254-cf260b365a57 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.332435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-909d3add-e69b-41e6-a254-cf260b365a57 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.546169 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-909d3add-e69b-41e6-a254-cf260b365a57 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.262548 Sep 27 01:32:26.546759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 114/215] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:26.558171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a6eb49-ab9d-4843-8172-8da71781c9ff", "tag": "68a4b333-0100-4d8f-927d-e9c4b50f582a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:26.569890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.570609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.571230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.582661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] Creating event network-changed:68a4b333-0100-4d8f-927d-e9c4b50f582a for instance 11a6eb49-ab9d-4843-8172-8da71781c9ff on n-h2-859358-1 Sep 27 01:32:26.599206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fa1e79de-b682-4d01-bd84-37436066890c req-28cb3a58-67e3-45e4-93d8-2a4637d077bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044362 Sep 27 01:32:26.601941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 115/216] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:26.611063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:26.622388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.623265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.624474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.654863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-859358-1. Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 39 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:26.659888 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: {"add_host": {"host": "n-h1-859358-1"}} Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:26.661143 n-d-859358-1 devstack@n-api.service[128778]: exception: Aggregate 3 already has host n-h1-859358-1. Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-859358-1'}}} Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:32:26.661884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-859358-1-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi session.flush() Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 01:32:26.663124 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 01:32:26.664324 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:32:26.665375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-859358-1-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 27, 1, 32, 26, 642303), 'updated_at': None, 'host': 'n-h1-859358-1', 'aggregate_id': 3}] Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:26.666516 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-859358-1. Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.667638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-859358-1. Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:26.668968 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:26.678098 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-859358-1. Sep 27 01:32:26.678098 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:26.678098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-859358-1. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:26.678098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04486f35-c8f3-44e1-bced-d99aee78f2f0 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 95 microversion: 2.1 time: 0.066634 Sep 27 01:32:26.680021 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 116/217] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 95 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 27 01:32:26.686496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff0c3bf0-2ad6-4a9d-bbf9-628502d13cc6 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:26.702020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:26.708238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff0c3bf0-2ad6-4a9d-bbf9-628502d13cc6 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.708989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff0c3bf0-2ad6-4a9d-bbf9-628502d13cc6 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.709936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff0c3bf0-2ad6-4a9d-bbf9-628502d13cc6 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.755438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f9b12dd-abb6-405a-ae3f-9a31c565ff20 tempest-SecurityGroupsTestAdminJSON-214752162 tempest-SecurityGroupsTestAdminJSON-214752162-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e16933af-633f-44d7-8c89-c0fc40a450c2" status: 202 len: 0 microversion: 2.1 time: 0.660627 Sep 27 01:32:26.757042 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 102/218] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:32:26 2022] DELETE /compute/v2.1/os-security-groups/e16933af-633f-44d7-8c89-c0fc40a450c2 => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:26.767587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a420eba7-7e28-4a62-b22b-63b86dc4f041 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] Calling method '.version_select at 0x7f24d6f53940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:26.933299 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff0c3bf0-2ad6-4a9d-bbf9-628502d13cc6 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.251911 Sep 27 01:32:26.934429 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 117/219] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:26.945642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:26.946412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:26.960807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.962830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.963780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:26.966052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:26.967686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:26.969306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:27.048273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:27.251620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:27.262020 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac41e0de-4419-49ad-9bed-60bf128b2c42 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.325845 Sep 27 01:32:27.262868 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 118/220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:26 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:27.269055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-382141ce-247f-4399-947d-be18893051f5 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:27.287517 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a420eba7-7e28-4a62-b22b-63b86dc4f041 tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f7c21b72-481d-4a7b-a59f-0bf0ae5d50a2" status: 202 len: 0 microversion: 2.1 time: 0.526284 Sep 27 01:32:27.291388 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 103/221] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:32:26 2022] DELETE /compute/v2.1/os-security-groups/f7c21b72-481d-4a7b-a59f-0bf0ae5d50a2 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:27.297116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a38ae78-bad9-4861-a257-66b204f27edf tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] Calling method '.version_select at 0x7f24d6fc0f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:27.320481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-382141ce-247f-4399-947d-be18893051f5 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.056834 Sep 27 01:32:27.325564 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 119/222] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:27 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:27.331680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fbb63ee4-26de-49a2-b853-a1bae1f73a89 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850103746"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:27.339465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-fbb63ee4-26de-49a2-b853-a1bae1f73a89 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid bacbd77d-2e84-4cd9-8212-ea92d69aa0f9 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:27.395922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fbb63ee4-26de-49a2-b853-a1bae1f73a89 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067447 Sep 27 01:32:27.397401 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 120/223] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:27.407988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9454fabe-222e-4af5-924c-dfe673c61ed4 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-527220484"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:27.413920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-9454fabe-222e-4af5-924c-dfe673c61ed4 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 69f7979b-0688-4484-80e2-51eaedfdc761 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:27.470629 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9454fabe-222e-4af5-924c-dfe673c61ed4 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.070761 Sep 27 01:32:27.471105 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 121/224] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:27.836897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14d904db-2017-45ab-9bb6-9835e507302a tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:27.842666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-14d904db-2017-45ab-9bb6-9835e507302a tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14d904db-2017-45ab-9bb6-9835e507302a tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 39 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:27.852272 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: {"add_host": {"host": "n-h1-859358-1"}} Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:27.854126 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-859358-1'}}} Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:27.855011 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 27 01:32:27.855978 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:27.858728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14d904db-2017-45ab-9bb6-9835e507302a tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:27.859841 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-14d904db-2017-45ab-9bb6-9835e507302a tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.386306 Sep 27 01:32:27.862387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 122/225] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:27 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:27.885495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ad5ea7f-1dcf-452e-910b-7038064fd1f8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:27.922394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ad5ea7f-1dcf-452e-910b-7038064fd1f8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:27.922878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ad5ea7f-1dcf-452e-910b-7038064fd1f8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:27.923316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ad5ea7f-1dcf-452e-910b-7038064fd1f8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.020209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a38ae78-bad9-4861-a257-66b204f27edf tempest-SecurityGroupsTestAdminJSON-2057927514 tempest-SecurityGroupsTestAdminJSON-2057927514-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/7fb7da84-1dd6-492d-81cb-aad58bdfc390" status: 202 len: 0 microversion: 2.1 time: 0.727694 Sep 27 01:32:28.020906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 104/226] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:32:27 2022] DELETE /compute/v2.1/os-security-groups/7fb7da84-1dd6-492d-81cb-aad58bdfc390 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:32:28.036734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05de8ed0-272e-4d62-a801-0bbbf579ab08 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:28.147131 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05de8ed0-272e-4d62-a801-0bbbf579ab08 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.123783 Sep 27 01:32:28.150249 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 105/227] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:28 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:28.175868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51348f62-5658-4b13-8307-0aba61793e45 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-177138027"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.201416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-51348f62-5658-4b13-8307-0aba61793e45 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid f029ac44-26c5-4af6-839b-8e29afd27418 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:28.223387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:28.250563 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ad5ea7f-1dcf-452e-910b-7038064fd1f8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.383045 Sep 27 01:32:28.251994 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 123/228] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:27 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:28.263372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0481648c-603e-4fd6-acee-353918122d4e tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:28.269643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:28.289162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0481648c-603e-4fd6-acee-353918122d4e tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 241 microversion: 2.1 time: 0.029470 Sep 27 01:32:28.291026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51348f62-5658-4b13-8307-0aba61793e45 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.135242 Sep 27 01:32:28.292857 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 124/229] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:32:28 2022] GET /compute/v2.1/os-aggregates/5 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:28.294275 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 106/230] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:28.302640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:28.304340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:28.310683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1812565835"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.325949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.326921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.327627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.328655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.329394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.330028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.340279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=54 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:28.356529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=128779) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 27 01:32:28.362502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.363389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.364144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.387929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.391194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.392978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.417726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1812565835 could not be found. Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 58 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:28.426420 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: {"add_host": {"host": "tempest-nonexist_host-1812565835"}} Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:28.427641 n-d-859358-1 devstack@n-api.service[128779]: exception: Compute host tempest-nonexist_host-1812565835 could not be found. Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-1812565835'}}} Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1812565835' is not mapped to any cell Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.428336 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 27 01:32:28.430138 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1812565835 could not be found. Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1812565835 could not be found. Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.431219 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1812565835 could not be found. Sep 27 01:32:28.433504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.436978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1812565835 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:28.438223 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1182e965-79d3-4c54-a235-f0d194b3ba24 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 111 microversion: 2.1 time: 0.136458 Sep 27 01:32:28.439281 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 107/231] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates/6/action => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:28.454979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-160b6801-eb49-4480-bd8b-d9c295df43d0 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.475009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-160b6801-eb49-4480-bd8b-d9c295df43d0 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.475503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-160b6801-eb49-4480-bd8b-d9c295df43d0 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.475935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-160b6801-eb49-4480-bd8b-d9c295df43d0 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.628360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-160b6801-eb49-4480-bd8b-d9c295df43d0 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.187820 Sep 27 01:32:28.632081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 108/232] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:28.636823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd886cd5-8282-4a04-8c0a-7618a8b95c01 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:28.716499 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd886cd5-8282-4a04-8c0a-7618a8b95c01 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.080338 Sep 27 01:32:28.727957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:28.730191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 109/233] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:28 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:28.735948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ddf37ed9-bd0f-473c-a5f0-e073a2c8a575 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:28.739160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:28.741597 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f57be36-1efe-4d5a-81af-177635c5a1cf tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.446590 Sep 27 01:32:28.746210 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 125/234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:28 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:28.758560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e3ec0e3-f0b2-4597-86bd-efcde1b1726c tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e3ec0e3-f0b2-4597-86bd-efcde1b1726c tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 283 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:28.772296 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:28.773802 n-d-859358-1 devstack@n-api.service[128778]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:32:28.774545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:28.775281 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:28.776503 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:28.777257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:32:28.777257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.778426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e3ec0e3-f0b2-4597-86bd-efcde1b1726c tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:28.780313 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e3ec0e3-f0b2-4597-86bd-efcde1b1726c tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032423 Sep 27 01:32:28.786560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 126/235] 10.222.0.52 () {60 vars in 1165 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:28.791419 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ddf37ed9-bd0f-473c-a5f0-e073a2c8a575 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.059656 Sep 27 01:32:28.791808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab829503-8c9a-4da4-94b0-698488003454 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab829503-8c9a-4da4-94b0-698488003454 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 27 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:28.796332 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: {"aggregate": {"name": ""}} Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:28.797590 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:28.798309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:32:28.799558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.800602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab829503-8c9a-4da4-94b0-698488003454 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:28.800703 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 110/236] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:28 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:28.807309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab829503-8c9a-4da4-94b0-698488003454 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009765 Sep 27 01:32:28.807926 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 127/237] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:28.812673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ad5d793-d9aa-4c4e-bd56-f48971284505 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1792851780"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.817728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-6ad5d793-d9aa-4c4e-bd56-f48971284505 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 50acacde-da07-4ab9-95c1-b4ffb8c1c606 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:28.819330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f579fdba-68d4-409c-a57e-52023618070e tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564151943"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.822948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f579fdba-68d4-409c-a57e-52023618070e tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f579fdba-68d4-409c-a57e-52023618070e tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 60 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:28.825988 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: {"aggregate": {"name": "tempest-test_aggregate-1564151943"}} Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:28.827173 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1564151943'}}} Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:28.827944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:28.828922 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 27 01:32:28.830166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.831713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f579fdba-68d4-409c-a57e-52023618070e tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:28.832768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f579fdba-68d4-409c-a57e-52023618070e tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018275 Sep 27 01:32:28.837851 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 128/238] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:28.847914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0625b5cc-b688-4afa-ba4b-e8b892660557 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1241364257"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.851702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-0625b5cc-b688-4afa-ba4b-e8b892660557 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid d77b01a1-d9e3-4e13-ad12-2c1f9aafec9c for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:28.873900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ad5d793-d9aa-4c4e-bd56-f48971284505 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072316 Sep 27 01:32:28.881473 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 111/239] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:28.886838 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0625b5cc-b688-4afa-ba4b-e8b892660557 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042640 Sep 27 01:32:28.894386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 129/240] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:28.894573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d213ed36-cfe2-466d-84c6-aef849a53260 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.917662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d213ed36-cfe2-466d-84c6-aef849a53260 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:28.918160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d213ed36-cfe2-466d-84c6-aef849a53260 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:28.918597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d213ed36-cfe2-466d-84c6-aef849a53260 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:28.924270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1241364257"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:28.937782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid c7e06854-5ed0-4230-9f4f-09380c08ddc6 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:28.989884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1241364257 already exists. Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 60 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:28.995132 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: {"aggregate": {"name": "tempest-test_aggregate-1241364257"}} Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:28.996349 n-d-859358-1 devstack@n-api.service[128778]: exception: Aggregate tempest-test_aggregate-1241364257 already exists. Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1241364257'}}} Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 27 01:32:28.997072 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1241364257 already exists. Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:28.998284 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1241364257 already exists. Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1241364257 already exists. Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1241364257 already exists. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.003782 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5dcd8197-d2d0-4aa7-9427-a75428db3c99 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.102470 Sep 27 01:32:29.005830 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 130/241] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:29.019546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4aafac5f-816a-4e44-a6da-de364926dd1b tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.126434 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4aafac5f-816a-4e44-a6da-de364926dd1b tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.120964 Sep 27 01:32:29.127950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 131/242] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:29.138357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77d515e9-a795-4d42-a38f-b56753ca55d3 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-374015012"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:29.140741 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d213ed36-cfe2-466d-84c6-aef849a53260 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.257007 Sep 27 01:32:29.143664 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 112/243] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:28 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:29.150549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-77d515e9-a795-4d42-a38f-b56753ca55d3 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid 0c30fd00-8e30-4f45-b958-4adb1c8a65d9 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:29.157073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d88c539f-b08a-44b4-a9b6-94177c6a6727 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.190905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77d515e9-a795-4d42-a38f-b56753ca55d3 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051858 Sep 27 01:32:29.191593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 132/244] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:29.222857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d88c539f-b08a-44b4-a9b6-94177c6a6727 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 458 microversion: 2.1 time: 0.070249 Sep 27 01:32:29.223701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b632f4a-8b9f-420d-ae82-cace20c40566 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.234351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b632f4a-8b9f-420d-ae82-cace20c40566 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:29.234714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 113/245] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:32:29 2022] GET /compute/v2.1/os-aggregates => generated 458 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b632f4a-8b9f-420d-ae82-cace20c40566 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:29.236798 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 27 01:32:29.237978 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '9'} Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:29.238656 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 27 01:32:29.239635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.245777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b632f4a-8b9f-420d-ae82-cace20c40566 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.249819 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b632f4a-8b9f-420d-ae82-cace20c40566 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.045698 Sep 27 01:32:29.257591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 133/246] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:29.259710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a88a3ed-bb44-4800-8629-4c7e68893957 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:29.268751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9fc0c414-d78f-46e2-8887-ad7f252cc9e7 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.297511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a88a3ed-bb44-4800-8629-4c7e68893957 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:29.303970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a88a3ed-bb44-4800-8629-4c7e68893957 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:29.304438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a88a3ed-bb44-4800-8629-4c7e68893957 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:29.332995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9fc0c414-d78f-46e2-8887-ad7f252cc9e7 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.073656 Sep 27 01:32:29.334008 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 134/247] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:29.343812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1467e1c-e6be-43c2-ba55-6b36ce368cc8 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.367738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d1467e1c-e6be-43c2-ba55-6b36ce368cc8 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1467e1c-e6be-43c2-ba55-6b36ce368cc8 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:29.372961 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: exception: Aggregate -1 could not be found. Sep 27 01:32:29.374878 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '-1'} Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:29.375598 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.376752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.377963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1467e1c-e6be-43c2-ba55-6b36ce368cc8 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.380007 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1467e1c-e6be-43c2-ba55-6b36ce368cc8 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040230 Sep 27 01:32:29.380726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 135/248] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:29.397618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9f7450b-ec89-46cb-973f-5b1efe817c09 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1354331366"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:29.414189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-c9f7450b-ec89-46cb-973f-5b1efe817c09 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid b357bee3-5322-4f4f-b117-ad3b27c9e3c5 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:29.491621 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9f7450b-ec89-46cb-973f-5b1efe817c09 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.103859 Sep 27 01:32:29.493270 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 136/249] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:29.512847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8f1ce83-a6c6-4473-b927-a95885007493 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.516121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8f1ce83-a6c6-4473-b927-a95885007493 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8f1ce83-a6c6-4473-b927-a95885007493 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:29.520065 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 27 01:32:29.521523 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '10'} Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:29.522424 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 27 01:32:29.523724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.527524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8f1ce83-a6c6-4473-b927-a95885007493 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.529993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8f1ce83-a6c6-4473-b927-a95885007493 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.028322 Sep 27 01:32:29.532509 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 137/250] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:29.545097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a88a3ed-bb44-4800-8629-4c7e68893957 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.300315 Sep 27 01:32:29.549600 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 114/251] 10.222.0.52 () {60 vars in 1191 bytes} [Tue Sep 27 01:32:29 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:29.559157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1e59ad3-f86a-41fd-896e-cc3e78b61406 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.561927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23831224-f137-4352-99ea-00b5ec6276d4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.587943 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23831224-f137-4352-99ea-00b5ec6276d4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.032421 Sep 27 01:32:29.588961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 138/252] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:29.609801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8db6ba9-1f5d-4a6a-ab85-fc6cdc3c582a tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.622193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e8db6ba9-1f5d-4a6a-ab85-fc6cdc3c582a tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8db6ba9-1f5d-4a6a-ab85-fc6cdc3c582a tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:29.625805 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: exception: Aggregate -1 could not be found. Sep 27 01:32:29.627600 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '-1'} Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.628595 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 27 01:32:29.630139 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.633176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1e59ad3-f86a-41fd-896e-cc3e78b61406 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.072921 Sep 27 01:32:29.633724 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 115/253] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:29.637232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8db6ba9-1f5d-4a6a-ab85-fc6cdc3c582a tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.638441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-228e4b54-b5b3-4e6a-bf6d-e78b2f2af741 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1176789222"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:29.638882 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8db6ba9-1f5d-4a6a-ab85-fc6cdc3c582a tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042286 Sep 27 01:32:29.640074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 139/254] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:29 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:29.650180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d617bc7d-bf53-4998-9d5d-a27d102f9096 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.657923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d617bc7d-bf53-4998-9d5d-a27d102f9096 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d617bc7d-bf53-4998-9d5d-a27d102f9096 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:29.660579 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 27 01:32:29.661985 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:29.662833 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 27 01:32:29.664044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:29.665098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-228e4b54-b5b3-4e6a-bf6d-e78b2f2af741 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 983473a1-751d-405b-8f6d-c0f4e3025e9b for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:29.666555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d617bc7d-bf53-4998-9d5d-a27d102f9096 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:29.667699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d617bc7d-bf53-4998-9d5d-a27d102f9096 tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021859 Sep 27 01:32:29.668693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 140/255] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:32:29 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:29.718335 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-228e4b54-b5b3-4e6a-bf6d-e78b2f2af741 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.083424 Sep 27 01:32:29.718964 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 116/256] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:29.735722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27063954-0b67-4e1f-88b7-b6f235492feb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:29.751614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27063954-0b67-4e1f-88b7-b6f235492feb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:29.752099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27063954-0b67-4e1f-88b7-b6f235492feb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:29.752697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27063954-0b67-4e1f-88b7-b6f235492feb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:29.777331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:29.778001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:29.792613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:29.793271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:29.793577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:29.794472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:29.795598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:29.796346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.014773 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27063954-0b67-4e1f-88b7-b6f235492feb tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.287213 Sep 27 01:32:30.015714 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 141/257] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:29 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.029001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9dadace-7322-42ab-b70b-c097842bde2c tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.053496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9dadace-7322-42ab-b70b-c097842bde2c tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.055668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9dadace-7322-42ab-b70b-c097842bde2c tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.058129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9dadace-7322-42ab-b70b-c097842bde2c tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.149311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:30.158065 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-912655e3-cfe4-4145-8979-c99c79d35d6f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.390857 Sep 27 01:32:30.158645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 117/258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:29 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:30.260078 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9dadace-7322-42ab-b70b-c097842bde2c tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.235149 Sep 27 01:32:30.261917 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 142/259] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:30.273461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b1ff93c-758b-40d0-a9cf-4c6ff54f218d tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.311375 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b1ff93c-758b-40d0-a9cf-4c6ff54f218d tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.041762 Sep 27 01:32:30.312985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 118/260] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:30.322642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00fa4bdf-1048-464d-87c8-82a7d726f4d2 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-921187542"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.326276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-00fa4bdf-1048-464d-87c8-82a7d726f4d2 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 1676d53c-607a-476d-946f-646177f449a7 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:30.328147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d6e32e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.334018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.334862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.336932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.337748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.340442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.341097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.395639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00fa4bdf-1048-464d-87c8-82a7d726f4d2 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077329 Sep 27 01:32:30.410875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 143/261] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.411526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0dd0c90-664f-4dac-9a9b-fc279fc49e4e tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.087767 Sep 27 01:32:30.418720 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 119/262] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.420137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f26e627-f746-42bc-ad4e-e758e8ee02cf tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.427939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d7117f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.439056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.440521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.441124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.442081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.442713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.443302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.478128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41934ef7-9c3e-4e99-a9a5-6979569ad715 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.057013 Sep 27 01:32:30.479950 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f26e627-f746-42bc-ad4e-e758e8ee02cf tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.067052 Sep 27 01:32:30.480971 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 144/263] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:30.483988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 120/264] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.492504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d6e7a9d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.497133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.497833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.498487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.499141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.500543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.503148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.506180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36a54844-fb38-49c7-8146-07151338d1d1 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.518005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-36a54844-fb38-49c7-8146-07151338d1d1 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36a54844-fb38-49c7-8146-07151338d1d1 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Request method failure captured: Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKBqDKvxSjxbibCI0HBrQDFl4zGLNYkzbNcQ9U6-keWgIdbAPDnzw3trZw5ObQGDN0ykm7kCDkv-aDTS8wtffGWwnrohArlpdh_V104-JEBb6ODMMNuQt4WeSGuTTVv4vvNV1hUuP73eVoHKEaWy8v2YeZw7g7NWouhtxXlTLVcE-Q Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:30.520843 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed68b9ab01e34169886dab6b4a1261cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cbd69e62dcbd4b31bfd9252352cb4988 Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: exception: Aggregate 12 could not be found. Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '12'} Sep 27 01:32:30.522122 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.522858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 27 01:32:30.523968 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.527335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36a54844-fb38-49c7-8146-07151338d1d1 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:30.528618 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36a54844-fb38-49c7-8146-07151338d1d1 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.042525 Sep 27 01:32:30.533632 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 121/265] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:32:30.536109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd172af9-6c71-43f7-8efb-e3fc2c5c11de tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.046869 Sep 27 01:32:30.540021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9801c950-fb21-4046-b38a-a96674a018da tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1889912996"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.541522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 145/266] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:30.544411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-9801c950-fb21-4046-b38a-a96674a018da tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid f9471ed6-c58d-4e42-bfa1-071e6e697a46 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:30.550065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e684532e-4ce9-485e-8bf3-9f94e108ceec tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.559636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:30.567148 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e684532e-4ce9-485e-8bf3-9f94e108ceec tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e684532e-4ce9-485e-8bf3-9f94e108ceec tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Request method failure captured: Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKBqDKvxSjxbibCI0HBrQDFl4zGLNYkzbNcQ9U6-keWgIdbAPDnzw3trZw5ObQGDN0ykm7kCDkv-aDTS8wtffGWwnrohArlpdh_V104-JEBb6ODMMNuQt4WeSGuTTVv4vvNV1hUuP73eVoHKEaWy8v2YeZw7g7NWouhtxXlTLVcE-Q Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:30.569047 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed68b9ab01e34169886dab6b4a1261cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: cbd69e62dcbd4b31bfd9252352cb4988 Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: exception: Aggregate 12 could not be found. Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '12'} Sep 27 01:32:30.571872 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:30.573093 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.574625 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.585819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.585819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:30.585819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:30.585819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 27 01:32:30.585819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.586175 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9801c950-fb21-4046-b38a-a96674a018da tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039695 Sep 27 01:32:30.586175 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 122/267] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.586331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e684532e-4ce9-485e-8bf3-9f94e108ceec tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:30.586331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e684532e-4ce9-485e-8bf3-9f94e108ceec tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.039219 Sep 27 01:32:30.589631 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 146/268] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:30.599270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d72009d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.609260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7a444d1-ec3f-42aa-b8fe-7932dafab87d tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.612103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.612602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.613038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.629499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.629899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.630821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.653064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7a444d1-ec3f-42aa-b8fe-7932dafab87d tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.657685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7a444d1-ec3f-42aa-b8fe-7932dafab87d tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.658493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7a444d1-ec3f-42aa-b8fe-7932dafab87d tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.661914 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6837143-58db-4b42-aec2-306b4c4569e2 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h1-859358-1" status: 200 len: 332 microversion: 2.1 time: 0.084329 Sep 27 01:32:30.663511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 123/269] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-hosts/n-h1-859358-1 => generated 332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.678693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9a32dd2-9f51-416b-8575-f904d981eb95 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1177294303", "name": "tempest-test_aggregate-579245755"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.689130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-c9a32dd2-9f51-416b-8575-f904d981eb95 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid 8ae9ce19-c61b-468a-a79d-a0a34b8be17f for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:30.727226 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9a32dd2-9f51-416b-8575-f904d981eb95 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.062071 Sep 27 01:32:30.734821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 124/270] 10.222.0.52 () {60 vars in 1165 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.734821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Calling method '.version_select at 0x7f24d6e32c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.742761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.743300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.743848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.788601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:30.789089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:30.793214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:30.796645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:30.812737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be03d4df-27b6-417f-9f9b-994f70868966 tempest-HostsAdminTestJSON-504766740 tempest-HostsAdminTestJSON-504766740-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-h2-859358-1" status: 200 len: 467 microversion: 2.1 time: 0.082731 Sep 27 01:32:30.813595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 125/271] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-hosts/n-h2-859358-1 => generated 467 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.821971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e18d2c9-0147-4c6f-9828-b8b0153334c3 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.862417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e18d2c9-0147-4c6f-9828-b8b0153334c3 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047455 Sep 27 01:32:30.863331 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 126/272] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:30.871614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f21f041e-dbe7-41bb-9d17-08f71201a7b7 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.877469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=81,nova_api:DELETE=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:30.887142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f21f041e-dbe7-41bb-9d17-08f71201a7b7 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f21f041e-dbe7-41bb-9d17-08f71201a7b7 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Request method failure captured: Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKBqDKvxSjxbibCI0HBrQDFl4zGLNYkzbNcQ9U6-keWgIdbAPDnzw3trZw5ObQGDN0ykm7kCDkv-aDTS8wtffGWwnrohArlpdh_V104-JEBb6ODMMNuQt4WeSGuTTVv4vvNV1hUuP73eVoHKEaWy8v2YeZw7g7NWouhtxXlTLVcE-Q Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:30.889954 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed68b9ab01e34169886dab6b4a1261cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cbd69e62dcbd4b31bfd9252352cb4988 Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: exception: Aggregate 14 could not be found. Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '14'} Sep 27 01:32:30.891116 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.891802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 27 01:32:30.892838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.896150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f21f041e-dbe7-41bb-9d17-08f71201a7b7 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:30.899099 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f21f041e-dbe7-41bb-9d17-08f71201a7b7 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.031702 Sep 27 01:32:30.900319 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 127/273] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:32:30.908835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8c7cfe4-be9e-468a-a5c4-02600d5223fa tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:30.921294 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d8c7cfe4-be9e-468a-a5c4-02600d5223fa tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8c7cfe4-be9e-468a-a5c4-02600d5223fa tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Request method failure captured: Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKBqDKvxSjxbibCI0HBrQDFl4zGLNYkzbNcQ9U6-keWgIdbAPDnzw3trZw5ObQGDN0ykm7kCDkv-aDTS8wtffGWwnrohArlpdh_V104-JEBb6ODMMNuQt4WeSGuTTVv4vvNV1hUuP73eVoHKEaWy8v2YeZw7g7NWouhtxXlTLVcE-Q Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:30.930021 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed68b9ab01e34169886dab6b4a1261cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed68b9ab01e34169886dab6b4a1261cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed68b9ab01e34169886dab6b4a1261cb Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-867148481 Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cbd69e62dcbd4b31bfd9252352cb4988 Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-867148481-project-admin Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: exception: Aggregate 14 could not be found. Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '14'} Sep 27 01:32:30.931189 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:30.931901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.932899 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.934021 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.934021 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:30.934021 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:30.934021 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 27 01:32:30.934021 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.936467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8c7cfe4-be9e-468a-a5c4-02600d5223fa tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:30.937709 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8c7cfe4-be9e-468a-a5c4-02600d5223fa tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.033774 Sep 27 01:32:30.938756 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 128/274] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:30.942003 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7a444d1-ec3f-42aa-b8fe-7932dafab87d tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.351262 Sep 27 01:32:30.950141 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 147/275] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:30.950843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6060e1c-80f7-47f2-83c5-dd0217f3de6b tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1167960840"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.954808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-c6060e1c-80f7-47f2-83c5-dd0217f3de6b tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid dc4cba2b-712a-41b2-832e-c7d593fe393b for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:30.957704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5076ce50-f8a5-4c5e-b758-d891a455157f tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.961450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5076ce50-f8a5-4c5e-b758-d891a455157f tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6ea9dc04a34f4fdbb48761faa110b528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56a5709a5094e17879e617f2b318a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5076ce50-f8a5-4c5e-b758-d891a455157f tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Request method failure captured: Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 42 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlJ-d1Ex35I46xQHGz01xdmymTLZEl4pMth22w-CmWyWbbOKU5aUPPRDtjGb1D2en3Xys13UcrX2haAvvU5LrhnSIQydLNlmHkXoAou-ZP0-0NRlYQtjGa1OjOXmSq8enYmhk4bvJur15jo-0FfBsGxqKcG0x1Ok6l1gcaJTAaSLkJc Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:30.964828 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a56a5709a5094e17879e617f2b318a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a56a5709a5094e17879e617f2b318a86", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a56a5709a5094e17879e617f2b318a86 Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-475114840 Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 6ea9dc04a34f4fdbb48761faa110b528 Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-475114840-project Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: {"remove_host": {"host": "n-h1-859358-1"}} Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:30.966059 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-859358-1'}}} Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:30.967228 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 27 01:32:30.968267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:30.973852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5076ce50-f8a5-4c5e-b758-d891a455157f tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:30.975395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5076ce50-f8a5-4c5e-b758-d891a455157f tempest-AggregatesAdminNegativeTestJSON-475114840 tempest-AggregatesAdminNegativeTestJSON-475114840-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.023784 Sep 27 01:32:30.977149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6060e1c-80f7-47f2-83c5-dd0217f3de6b tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032246 Sep 27 01:32:30.978290 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 129/276] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:30.979249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 148/277] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:30.992419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeee3fc0-cf21-4a7f-968d-7dc7c215d030 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:30.997451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ba70d8b-6545-4cc0-a046-46c2e5897420 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.006630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee3fc0-cf21-4a7f-968d-7dc7c215d030 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.007237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee3fc0-cf21-4a7f-968d-7dc7c215d030 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.007739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee3fc0-cf21-4a7f-968d-7dc7c215d030 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.024105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ba70d8b-6545-4cc0-a046-46c2e5897420 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.036677 Sep 27 01:32:31.024676 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 149/278] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:30 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.038643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ed22eb6-9e46-430a-8320-e4ed6634d30b tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.074991 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ed22eb6-9e46-430a-8320-e4ed6634d30b tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.041608 Sep 27 01:32:31.075875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 150/279] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.094430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83776860-edc9-4fe3-9d0a-d246b464746a tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.171621 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eeee3fc0-cf21-4a7f-968d-7dc7c215d030 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.185890 Sep 27 01:32:31.180186 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 130/280] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:30 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.187294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-118a09c4-86c6-4523-9d6b-ce2b56d88a59 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.234619 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-118a09c4-86c6-4523-9d6b-ce2b56d88a59 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.051983 Sep 27 01:32:31.241849 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 131/281] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:31.248064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.249240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:31.257982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.259355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.259968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.260927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.261586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.262305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.320507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83776860-edc9-4fe3-9d0a-d246b464746a tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.235485 Sep 27 01:32:31.321239 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 151/282] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:31 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.328232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-157e9e49-d281-492e-b313-dbf38490ae15 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1863106487"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.332397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-157e9e49-d281-492e-b313-dbf38490ae15 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Generated uuid a6aa6425-8965-4aaf-b382-07cea0b94928 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:31.368455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-157e9e49-d281-492e-b313-dbf38490ae15 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045341 Sep 27 01:32:31.370097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 152/283] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.382113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5683510-8833-4728-93af-bbbb434b3ff4 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.426505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5683510-8833-4728-93af-bbbb434b3ff4 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.055345 Sep 27 01:32:31.427622 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 153/284] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:31.436880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.450562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.451216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.453435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.466130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.467531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.468250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.480018 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.compute.aggregates [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 27 01:32:31.480497 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Request method failure captured: Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 42 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKA7ofIjDRLID4eNEjd8pc5aVmJoB67HtQaF1Z0y_GN0iM8E1wtoGSyl1jIzFk2o20FMl37NAvzKycNnHjodr9oTEZ9UOk9wmDAO_9oxqjbEdq18Iv7mq1an0_DPG-UK_lEyX0t8L7l1d9tuqpR6ggMQJl_ei9eaiR8vzAzdctDfr4 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:31.483905 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ebd5751205349afbb507069fc3ef1f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ebd5751205349afbb507069fc3ef1f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0ebd5751205349afbb507069fc3ef1f0 Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810 Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bed778be18234f45a889b7b3e9197336 Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: {"remove_host": {"host": "nonexist_host"}} Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:32:31.485122 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot remove host nonexist_host in aggregate 16 Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 27 01:32:31.485980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 27 01:32:31.487061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:31.488129 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec3b4f38-162b-46e7-8514-f986f3926dd4 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.057327 Sep 27 01:32:31.490163 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 154/285] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:31.496561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a48fb72-5088-42dc-bf9c-f5a44c91c6c5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1199967287", "availability_zone": "tempest-test_az-1128296809"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.517382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:31.520995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-2a48fb72-5088-42dc-bf9c-f5a44c91c6c5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid d2e1461d-8168-4d81-9111-8706a4085cff for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:31.530956 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcfd5e7a-79bf-4b38-8065-bcdea2a21581 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.287770 Sep 27 01:32:31.532233 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 132/286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:31 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:31.546904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cfc07ea-d2a8-4f70-9e11-79a67548c5a7 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.565599 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a48fb72-5088-42dc-bf9c-f5a44c91c6c5 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.076219 Sep 27 01:32:31.568280 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 155/287] 10.222.0.52 () {60 vars in 1165 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.584633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-346be154-b747-4c1d-8b5c-440f5385dfad tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1199967287_new", "availability_zone": "tempest-test_az-1128296809_new"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.598787 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cfc07ea-d2a8-4f70-9e11-79a67548c5a7 tempest-AggregatesAdminNegativeTestJSON-1316454810 tempest-AggregatesAdminNegativeTestJSON-1316454810-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.063701 Sep 27 01:32:31.600103 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 133/288] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:31.647800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-346be154-b747-4c1d-8b5c-440f5385dfad tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:31.649186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-346be154-b747-4c1d-8b5c-440f5385dfad tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:31.649938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-346be154-b747-4c1d-8b5c-440f5385dfad tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:31.701877 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-346be154-b747-4c1d-8b5c-440f5385dfad tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.125842 Sep 27 01:32:31.708599 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 156/289] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 01:32:31 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:32:31.713542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d2812bd-4a17-4e14-86af-03e3e8c58e26 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.723737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d2812bd-4a17-4e14-86af-03e3e8c58e26 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.013768 Sep 27 01:32:31.724524 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 134/290] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:32:31 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.736387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c610a0aa-d25f-4521-bea9-daf18164d2fd tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.761165 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c610a0aa-d25f-4521-bea9-daf18164d2fd tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.028684 Sep 27 01:32:31.762607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 135/291] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:31.774302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3024fa9-8fc8-4cb9-81d2-05fdd970efe6 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-257785772"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:31.780127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.aggregate [None req-a3024fa9-8fc8-4cb9-81d2-05fdd970efe6 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Generated uuid edc6ef0d-c12c-4a91-9bba-80b65235c9b1 for aggregate {{(pid=128779) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 01:32:31.834853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3024fa9-8fc8-4cb9-81d2-05fdd970efe6 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065023 Sep 27 01:32:31.839754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 136/292] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.855010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-976c9642-d7ef-41e2-8a25-a895f27e0cb8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.875564 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-976c9642-d7ef-41e2-8a25-a895f27e0cb8 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.023818 Sep 27 01:32:31.885425 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 137/293] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:32:31 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:31.895061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c195ebb4-ea29-40c6-ba97-9add6526aa26 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.961072 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c195ebb4-ea29-40c6-ba97-9add6526aa26 tempest-AggregatesAdminTestJSON-867148481 tempest-AggregatesAdminTestJSON-867148481-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.073996 Sep 27 01:32:31.962224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 138/294] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 01:32:31.980196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:31.982648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:32.004028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.004725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.006373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.007123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.010847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.011322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.043388 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] HTTP exception thrown: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Request method failure captured: Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c HTTP/1.1 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlJ-5noZiLquXcNjnt0tbtyWe-iIsCQbynhyEl1Ckl8LCyhKH1ZdpAYBL-ovejz0EuvD2aXZNqqPANTM9wnPj9KZLRgVYJDaeX8x9DLfq8tx8cFrxsY8DX6z1ghVa-7lac47ZgVHu9SZqV0cQJ41CfB_Z7Cij40_P-mmSa0iGOz8wns Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:32.046390 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8b07061a8f51455ca67a232506aee738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8b07061a8f51455ca67a232506aee738", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 987474da5e5446d3a653c78326bf18fd Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.047677 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c'} Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:32.048327 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.049391 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.051172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Returning 404 to user: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:32.051172 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29e39b17-fb34-4148-bce3-cdec720881a7 tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 404 len: 111 microversion: 2.1 time: 0.078394 Sep 27 01:32:32.051172 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 139/295] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:32:31 2022] DELETE /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:32.057878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:32.059918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] [instance: 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:32.068247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.068951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.069428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.070974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.071714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.072296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.092539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] HTTP exception thrown: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Request method failure captured: Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c HTTP/1.1 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlJ-5noZiLquXcNjnt0tbtyWe-iIsCQbynhyEl1Ckl8LCyhKH1ZdpAYBL-ovejz0EuvD2aXZNqqPANTM9wnPj9KZLRgVYJDaeX8x9DLfq8tx8cFrxsY8DX6z1ghVa-7lac47ZgVHu9SZqV0cQJ41CfB_Z7Cij40_P-mmSa0iGOz8wns Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:32.094408 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8b07061a8f51455ca67a232506aee738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8b07061a8f51455ca67a232506aee738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8b07061a8f51455ca67a232506aee738", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8b07061a8f51455ca67a232506aee738 Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1764584761 Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 987474da5e5446d3a653c78326bf18fd Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AggregatesAdminTestJSON-1764584761-project Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.095615 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c'} Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:32.096279 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. Sep 27 01:32:32.097449 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:32.098465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] Returning 404 to user: Instance 2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:32.098465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc04ccc4-f64c-4cd6-9f78-e8c79dbd8f4a tempest-AggregatesAdminTestJSON-1764584761 tempest-AggregatesAdminTestJSON-1764584761-project] 10.222.0.52 "GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c" status: 404 len: 111 microversion: 2.1 time: 0.042706 Sep 27 01:32:32.098465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 140/296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:32 2022] GET /compute/v2.1/servers/2e6ff5a7-2223-4785-a0dd-9f3962ce5c8c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:32.210163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1512700371", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:32.319404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:32.556460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:32.557318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:32.567605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.568798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.570275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.572425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.573897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.578428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.694289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:32.694887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:32.695504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:32.695983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:32.696402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:32.722224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.723568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.725593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.726512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:32.727080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:32.728234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:32.751755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:32.759243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:32.773769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:32:32.776532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:32:32.875250 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a6b4fa4-766f-4f21-a3ff-b17ca37a428f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151755 Sep 27 01:32:32.877064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 157/297] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:32:32.883222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:32.895963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac6addfc-0e31-410a-926b-41b1af6f675d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.342313 Sep 27 01:32:32.901894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 141/298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:32 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:32.904248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab1b74e8-2435-4d0a-9b28-fa424121d6cb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:32.908226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab1b74e8-2435-4d0a-9b28-fa424121d6cb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:33.041276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab1b74e8-2435-4d0a-9b28-fa424121d6cb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:33.073047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab1b74e8-2435-4d0a-9b28-fa424121d6cb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1217 microversion: 2.1 time: 0.176879 Sep 27 01:32:33.074293 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 158/299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:32 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:33.921616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:33.923062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:33.934572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:33.938315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:33.939146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:33.940981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:33.941681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:33.942431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.247025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6dc3ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.250692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.251195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.251832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.297414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.297913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.298348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.312220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.312958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.313605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.320533 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c651e09b-6423-462e-b8c7-99a71885c205 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.735206 Sep 27 01:32:34.328664 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 142/300] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:34.333888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.334791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:34.349614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.350457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.351077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.354160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.354849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.355469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.441840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:34.451475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-821f8b2b-34fb-4ae0-b709-1d6de3953605 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 0.536010 Sep 27 01:32:34.454350 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 159/301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:33 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:34.460751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6d348b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.472657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.474816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.475892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.490884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:34.506982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-936981db-3669-4bac-b281-12b3b3092b9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1269 microversion: 2.1 time: 0.176793 Sep 27 01:32:34.507564 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 143/302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:34.511543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.521164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.521756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.540941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.542644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.544585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.559015 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d218d27-f185-42b8-8e3d-faf55f2e9153 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.101717 Sep 27 01:32:34.562959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 160/303] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:34.581797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6dd2af0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.584501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.585373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.585949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.634498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.635513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.635976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.668273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.672194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.672841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.690161 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f670d14-117b-4c3a-bb10-d7d867d850f2 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111497 Sep 27 01:32:34.694025 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 144/304] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:34.704400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6d34c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.706326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.706990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.707429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.747165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.747657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.749026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.779022 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12f3169a-09c2-413a-88cb-1d3cd96cff21 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.078556 Sep 27 01:32:34.786578 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 161/305] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:34.828909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6183337c-e123-4333-9ebf-e1171631a5e7 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6dbe280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.838514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6183337c-e123-4333-9ebf-e1171631a5e7 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.840010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6183337c-e123-4333-9ebf-e1171631a5e7 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.841387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6183337c-e123-4333-9ebf-e1171631a5e7 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.890690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6183337c-e123-4333-9ebf-e1171631a5e7 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.084794 Sep 27 01:32:34.891993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 145/306] 10.222.0.52 () {58 vars in 1179 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:34.905169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6d34f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:34.907018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.907546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.907978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.954383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.957634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.958272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:34.992910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:34.993771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:34.994393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.001179 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7987f59-95f3-47c2-a3e7-e363bcefee6f tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.100245 Sep 27 01:32:35.002047 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 162/307] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:35.016523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6dbe160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:35.019543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.020213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.020732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.051033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.051809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.052978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.066142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0d2c052-a8cd-4e30-9c54-fcbe566a3c95 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.054338 Sep 27 01:32:35.067312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 146/308] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:35.086512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d84b9e50>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:35.092473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.093364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.094261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.148674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.153502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.162074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.195733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4abe6e23-4fed-4598-b941-92406a45d911 tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.115981 Sep 27 01:32:35.200577 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 163/309] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:32:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:35.233528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Calling method '.version_select at 0x7f24d6dd2550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:35.246430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.252298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.253566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.315517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.317731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.320386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.361658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.365912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.366670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.404140 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8d88b46-12b9-404b-97fd-37e63382557c tempest-HypervisorAdminTestJSON-1546479654 tempest-HypervisorAdminTestJSON-1546479654-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.191022 Sep 27 01:32:35.406054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 147/310] 10.222.0.52 () {58 vars in 1173 bytes} [Tue Sep 27 01:32:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:35.477777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:35.478392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:35.496269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.496747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.497179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.498452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.498903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.499330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.551686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:35.555020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:35.575555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.576893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.577444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.582689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:35.583525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:35.584158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:35.827364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:35.842236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66af526b-febf-4cf2-a593-75563a028970 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1275 microversion: 2.1 time: 0.309677 Sep 27 01:32:35.843458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 148/311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:35 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1275 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:36.703376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:36.711947 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-565bf147-01bc-4b8e-bd73-086ac91c051e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 1.237961 Sep 27 01:32:36.719793 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 164/312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:35 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:36.876037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:36.877479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:36.904468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:36.905261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:36.907057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:36.908681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:36.912169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:36.915326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.145570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d5f4c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:37.149449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.150845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.153733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.175763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.183392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.186847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.210098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] HTTP exception thrown: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Request method failure captured: Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f HTTP/1.1 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 56 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK0zpl5xXwtC_QrngXjRCv2t1goBKA8JWOs_4DzHBUW-wVe5t_XTJ124jvHqWh60KrLQK3OewzpTCT1EaDRwBwez5IYnEZfbc_PLPjDzd0TMD2e6jSawkR2UVctFi6cyRBKmRA4gSMpm-U-mRG2XhpqMRZg9omwwAetuzhXcA_LaKE Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.53 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:37.212584 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a97c596acea44e30ac60bf21c1d487ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cc362bc69690486e8c19b90f9370bc20 Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:37.213875 n-d-859358-1 devstack@n-api.service[128779]: exception: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8f260624-acf3-49cf-b7b7-64470134e71f', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.214584 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.215723 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:37.216820 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:37.216820 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.216820 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.216820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Returning 404 to user: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:37.221730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48d4d113-2856-4cab-80f2-f18d4ecd4786 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f" status: 404 len: 110 microversion: 2.53 time: 0.669496 Sep 27 01:32:37.222801 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 149/313] 10.222.0.52 () {62 vars in 1309 bytes} [Tue Sep 27 01:32:36 2022] PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f => generated 110 bytes in 679 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:32:37.235018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a6eb49-ab9d-4843-8172-8da71781c9ff", "name": "network-vif-plugged", "status": "completed", "tag": "68a4b333-0100-4d8f-927d-e9c4b50f582a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:37.265447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.266052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.266513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.302821 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] Creating event network-vif-plugged:68a4b333-0100-4d8f-927d-e9c4b50f582a for instance 11a6eb49-ab9d-4843-8172-8da71781c9ff on n-h2-859358-1 Sep 27 01:32:37.309916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-183ff5d1-df3a-424f-a220-24167b87df87 req-c41687bd-b336-491a-a792-734d51b2d02a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085449 Sep 27 01:32:37.311667 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 150/314] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:37.323389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d3b550>, body: {"status": "disabled"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:37.335761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.336343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.336776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.348124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.348613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.349016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.367867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:37.384558 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-154db783-44ad-4e1a-b88c-e4a3dba403ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1275 microversion: 2.1 time: 0.511559 Sep 27 01:32:37.388066 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 165/315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:36 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1275 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:37.405324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] HTTP exception thrown: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Request method failure captured: Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f HTTP/1.1 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 22 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK0zpl5xXwtC_QrngXjRCv2t1goBKA8JWOs_4DzHBUW-wVe5t_XTJ124jvHqWh60KrLQK3OewzpTCT1EaDRwBwez5IYnEZfbc_PLPjDzd0TMD2e6jSawkR2UVctFi6cyRBKmRA4gSMpm-U-mRG2XhpqMRZg9omwwAetuzhXcA_LaKE Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.53 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:37.407271 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a97c596acea44e30ac60bf21c1d487ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cc362bc69690486e8c19b90f9370bc20 Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: {"status": "disabled"} Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: exception: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.409037 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8f260624-acf3-49cf-b7b7-64470134e71f', 'body': {'status': 'disabled'}} Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.410373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:37.411570 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:37.412582 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.412582 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.412582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Returning 404 to user: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:37.412582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbed1583-3ee9-4422-a317-c516e208e58d tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f" status: 404 len: 110 microversion: 2.53 time: 0.095903 Sep 27 01:32:37.412582 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 151/316] 10.222.0.52 () {62 vars in 1309 bytes} [Tue Sep 27 01:32:37 2022] PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f => generated 110 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:37.431259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Action: 'update', calling method: .version_select at 0x7f24d73b7160>, body: {"status": "enabled"} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:37.436459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.437252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.437881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.448624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.449093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.449763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.461651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] HTTP exception thrown: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Request method failure captured: Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: request: PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f HTTP/1.1 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 21 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK0zpl5xXwtC_QrngXjRCv2t1goBKA8JWOs_4DzHBUW-wVe5t_XTJ124jvHqWh60KrLQK3OewzpTCT1EaDRwBwez5IYnEZfbc_PLPjDzd0TMD2e6jSawkR2UVctFi6cyRBKmRA4gSMpm-U-mRG2XhpqMRZg9omwwAetuzhXcA_LaKE Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.53 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:37.463888 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a97c596acea44e30ac60bf21c1d487ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a97c596acea44e30ac60bf21c1d487ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a97c596acea44e30ac60bf21c1d487ad Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395 Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: cc362bc69690486e8c19b90f9370bc20 Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: {"status": "enabled"} Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: exception: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.465572 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8f260624-acf3-49cf-b7b7-64470134e71f', 'body': {'status': 'enabled'}} Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.467505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:37.468730 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:37.469802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. Sep 27 01:32:37.469802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:37.469802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Returning 404 to user: Service 8f260624-acf3-49cf-b7b7-64470134e71f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:37.469802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-279362c4-d310-418e-8485-2d3ee8b5b35c tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f" status: 404 len: 110 microversion: 2.53 time: 0.047061 Sep 27 01:32:37.469802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 166/317] 10.222.0.52 () {62 vars in 1309 bytes} [Tue Sep 27 01:32:37 2022] PUT /compute/v2.1/os-services/8f260624-acf3-49cf-b7b7-64470134e71f => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:37.476562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.484272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.484962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.485437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.486433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.486902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.487352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.523611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41076038-f3f9-4c51-a859-2fbbbdf9098e tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051151 Sep 27 01:32:37.524930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 152/318] 10.222.0.52 () {60 vars in 1178 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:37.547721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.559256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.559854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.565075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.569483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.571821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.572477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.608539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7c80a4c4-63ea-4050-b66c-d7be159dc154 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.074692 Sep 27 01:32:37.610400 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 167/319] 10.222.0.52 () {60 vars in 1211 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:37.624522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.628536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.630100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.630690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.633493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.637413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.637821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.731998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a8002b5-b892-4ebf-a229-84dd99185cdf tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.108232 Sep 27 01:32:37.732499 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 153/320] 10.222.0.52 () {60 vars in 1178 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:37.748754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.750498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.754654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.755559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.756152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.760439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.761108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.761841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:37.762032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.796182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.800582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.803757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.811431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.815367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.816082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.838870 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59088077-b458-4ffd-a4fa-210282496605 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-859358-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.096228 Sep 27 01:32:37.839805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 154/321] 10.222.0.52 () {60 vars in 1235 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services?host=n-d-859358-1&binary=xxx => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:37.855851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.871144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.871641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.872085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.872973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.874000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.874494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.940918 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bfafc8ba-06f4-4a7a-bdf9-286dba45e7ce tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.092385 Sep 27 01:32:37.957630 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 155/322] 10.222.0.52 () {60 vars in 1178 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:32:37.979067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:37.991360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.992569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.994380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:37.995646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:37.997067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:37.998859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:38.084167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ae46316-bc81-49f1-93e7-3ec3ac50a435 tempest-ServicesAdminNegativeV253TestJSON-762786395 tempest-ServicesAdminNegativeV253TestJSON-762786395-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.115843 Sep 27 01:32:38.089490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 156/323] 10.222.0.52 () {60 vars in 1239 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:38.693600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b03cbbe3-157e-4f0e-b89a-cdb7f8b4cf86 tempest-ServicesAdminNegativeV253TestJSON-670012916 tempest-ServicesAdminNegativeV253TestJSON-670012916-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:38.698884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b03cbbe3-157e-4f0e-b89a-cdb7f8b4cf86 tempest-ServicesAdminNegativeV253TestJSON-670012916 tempest-ServicesAdminNegativeV253TestJSON-670012916-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fcc8a75b4ca341a88ca1e9ae55a4cdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6c3c35956549339fdf676bbc5afc3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b03cbbe3-157e-4f0e-b89a-cdb7f8b4cf86 tempest-ServicesAdminNegativeV253TestJSON-670012916 tempest-ServicesAdminNegativeV253TestJSON-670012916-project] Request method failure captured: Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKyxXIwtZkPru-KMkSM_rG7r1G7D6qcVPYStA63ho3toSoRJBY9s9TVfLhqgQ_Fc0JcIlDI7B30zBhBHcWkPG67K4ieL5enqVyLgbeB5fPV5iIpMymjlz6RWAnEcw2iEK-qTRPTp9DLo2d384zj82kFYW0M1ZD5zesDBWyc_EQI8X4 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.53 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7d6c3c35956549339fdf676bbc5afc3c Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-670012916 Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:38.700526 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d6c3c35956549339fdf676bbc5afc3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7d6c3c35956549339fdf676bbc5afc3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7d6c3c35956549339fdf676bbc5afc3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7d6c3c35956549339fdf676bbc5afc3c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-670012916 Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7d6c3c35956549339fdf676bbc5afc3c Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-670012916 Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServicesAdminNegativeV253TestJSON-670012916-project Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: fcc8a75b4ca341a88ca1e9ae55a4cdf2 Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-670012916-project Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:32:38.702571 n-d-859358-1 devstack@n-api.service[128779]: action_args: {} Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:38.703498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:32:38.704800 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:38.706128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b03cbbe3-157e-4f0e-b89a-cdb7f8b4cf86 tempest-ServicesAdminNegativeV253TestJSON-670012916 tempest-ServicesAdminNegativeV253TestJSON-670012916-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:38.716492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b03cbbe3-157e-4f0e-b89a-cdb7f8b4cf86 tempest-ServicesAdminNegativeV253TestJSON-670012916 tempest-ServicesAdminNegativeV253TestJSON-670012916-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.617104 Sep 27 01:32:38.728144 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 157/324] 10.222.0.52 () {60 vars in 1178 bytes} [Tue Sep 27 01:32:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:38.743607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:38.744360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:38.778290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:38.778802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:38.779830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:38.780561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:38.788645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:38.789206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:39.426498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:39.451877 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c996e98e-3aa3-4269-9a48-ff7371605ab8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1391 microversion: 2.1 time: 1.715690 Sep 27 01:32:39.452485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 168/325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:37 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1391 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:39.658216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:39.674252 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-702d6fe4-096f-4064-a91d-1102bb73228d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.944274 Sep 27 01:32:39.676904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 158/326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:38 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:40.475719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:40.477650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:40.486406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:40.487544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:40.488341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:40.489401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:40.490486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:40.491152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:40.625517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cb4d2f-dfde-4d66-9438-99dba5838034", "tag": "c1d1798b-bf55-466d-842f-abe50bd83009"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:40.648067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:40.651226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:40.651804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:40.679536 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] Creating event network-changed:c1d1798b-bf55-466d-842f-abe50bd83009 for instance a2cb4d2f-dfde-4d66-9438-99dba5838034 on n-h1-859358-1 Sep 27 01:32:40.688522 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3c48bce3-c278-4b6f-b38a-c7044b0fe8fe req-92c3c5f5-525e-4fc3-a642-9d2de84d4c77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068141 Sep 27 01:32:40.689943 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 159/327] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:40.725803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:40.727161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:40.747336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:40.749502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:40.750123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:40.751088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:40.751967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:40.753504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:41.444714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:41.455855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29696240-fc36-4dc6-b7e8-1250a8c0bab1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.739486 Sep 27 01:32:41.456441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 160/328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:40 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:41.505071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:41.517863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8209522b-791d-49f6-8420-daf023eec7ad tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1589 microversion: 2.1 time: 1.045938 Sep 27 01:32:41.528132 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 169/329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:40 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1589 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:41.555203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:41.555707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:41.570122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:41.570614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:41.571045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:41.571769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:41.572240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:41.572670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:42.175395 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b6318ff-c047-4cd3-9071-0ad2f7e51ba4 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.624015 Sep 27 01:32:42.176086 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 161/330] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:32:41 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff/os-interface => generated 284 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:42.486510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:42.487573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:42.490687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=9 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:42.506298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:42.511009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:42.512744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:42.515018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:42.517069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:42.519523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:42.995046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Calling method '.version_select at 0x7f24d6d92f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.001665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:43.002266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:43.006007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:43.007598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:43.008262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:43.008880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:43.087953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:43.116469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-45cdf265-6e5a-4c47-ad91-6546cb26987f tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.744745 Sep 27 01:32:43.117068 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 170/331] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:32:42 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:43.133868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:43.149022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bdec60a0-ec30-4896-8e59-5793fd4d2463 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.670008 Sep 27 01:32:43.152156 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 162/332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:42 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:43.859724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99c5c453-5953-4e52-87a7-8d7073d18b5a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Calling method '.version_select at 0x7f24d6db0430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.866563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99c5c453-5953-4e52-87a7-8d7073d18b5a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99c5c453-5953-4e52-87a7-8d7073d18b5a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:43.868521 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:32:43.870082 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:43.871055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 27 01:32:43.872351 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.874129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99c5c453-5953-4e52-87a7-8d7073d18b5a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:43.874129 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99c5c453-5953-4e52-87a7-8d7073d18b5a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.740845 Sep 27 01:32:43.878944 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 171/333] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:32:43 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 750 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:43.881395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1c44495-1298-4184-8ffc-66b75ddbed2a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Calling method '.version_select at 0x7f24d6d5f1f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.883314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1c44495-1298-4184-8ffc-66b75ddbed2a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1c44495-1298-4184-8ffc-66b75ddbed2a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/n-d-859358-1/reboot HTTP/1.1 Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:43.885490 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1'} Sep 27 01:32:43.886691 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:43.887499 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 27 01:32:43.888699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.893456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1c44495-1298-4184-8ffc-66b75ddbed2a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:43.895069 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1c44495-1298-4184-8ffc-66b75ddbed2a tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-859358-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018260 Sep 27 01:32:43.902513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 163/334] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Sep 27 01:32:43 2022] GET /compute/v2.1/os-hosts/n-d-859358-1/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:43.912017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62535525-0f6f-4e93-b8e9-4636047cfd23 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Calling method '.version_select at 0x7f24d6c47280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.934062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-62535525-0f6f-4e93-b8e9-4636047cfd23 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62535525-0f6f-4e93-b8e9-4636047cfd23 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:43.938755 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'nonexistent_hostname'} Sep 27 01:32:43.940308 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:43.941208 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 27 01:32:43.942553 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:43.943807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.945259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62535525-0f6f-4e93-b8e9-4636047cfd23 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:43.947572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62535525-0f6f-4e93-b8e9-4636047cfd23 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.039587 Sep 27 01:32:43.949388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 172/335] 10.222.0.52 () {58 vars in 1212 bytes} [Tue Sep 27 01:32:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:43.960042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2608b1-4575-4d92-8803-d99dbad6c352 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Calling method '.version_select at 0x7f24d6d295e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.962390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e2608b1-4575-4d92-8803-d99dbad6c352 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2608b1-4575-4d92-8803-d99dbad6c352 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/n-d-859358-1 HTTP/1.1 Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:43.964128 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1'} Sep 27 01:32:43.965535 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:43.971373 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:43.972682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2608b1-4575-4d92-8803-d99dbad6c352 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:43.973895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e2608b1-4575-4d92-8803-d99dbad6c352 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-859358-1" status: 403 len: 109 microversion: 2.1 time: 0.010052 Sep 27 01:32:43.973895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 164/336] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 01:32:43 2022] GET /compute/v2.1/os-hosts/n-d-859358-1 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:43.975474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-640c738f-aa34-49f3-956a-27a85e78f34a tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Calling method '.version_select at 0x7f24d6e89040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:43.979373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:43.997718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-640c738f-aa34-49f3-956a-27a85e78f34a tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-640c738f-aa34-49f3-956a-27a85e78f34a tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:44.001547 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'nonexistent_hostname'} Sep 27 01:32:44.003073 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.003989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.005268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-640c738f-aa34-49f3-956a-27a85e78f34a tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.006585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-640c738f-aa34-49f3-956a-27a85e78f34a tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031226 Sep 27 01:32:44.015774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-130f6080-3ebf-476a-882a-db6f3f750239 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Calling method '.version_select at 0x7f24d6e32b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:44.017542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-130f6080-3ebf-476a-882a-db6f3f750239 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-130f6080-3ebf-476a-882a-db6f3f750239 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/n-d-859358-1/shutdown HTTP/1.1 Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:44.019072 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1'} Sep 27 01:32:44.020494 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.021331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 27 01:32:44.022639 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.023641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-130f6080-3ebf-476a-882a-db6f3f750239 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.023641 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-130f6080-3ebf-476a-882a-db6f3f750239 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-859358-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009475 Sep 27 01:32:44.033929 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 173/337] 10.222.0.52 () {58 vars in 1191 bytes} [Tue Sep 27 01:32:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:44.038796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86c543cf-59fd-41a8-bae7-61527e7b86e7 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Calling method '.version_select at 0x7f24d6d49b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:44.040640 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 165/338] 10.222.0.52 () {58 vars in 1194 bytes} [Tue Sep 27 01:32:44 2022] GET /compute/v2.1/os-hosts/n-d-859358-1/shutdown => generated 113 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:32:44.054447 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-86c543cf-59fd-41a8-bae7-61527e7b86e7 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86c543cf-59fd-41a8-bae7-61527e7b86e7 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:44.057278 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'nonexistent_hostname'} Sep 27 01:32:44.058766 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:44.059724 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 27 01:32:44.061076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.062495 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.064587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86c543cf-59fd-41a8-bae7-61527e7b86e7 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.066849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86c543cf-59fd-41a8-bae7-61527e7b86e7 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031707 Sep 27 01:32:44.067906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 174/339] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:32:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:44.077926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1880140b-cd95-4794-9698-6aefbc539959 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Calling method '.version_select at 0x7f24d6dd2ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:44.079767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1880140b-cd95-4794-9698-6aefbc539959 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1880140b-cd95-4794-9698-6aefbc539959 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hosts/n-d-859358-1/startup HTTP/1.1 Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:44.081327 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1'} Sep 27 01:32:44.082815 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.083679 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.085900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1880140b-cd95-4794-9698-6aefbc539959 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.087529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1880140b-cd95-4794-9698-6aefbc539959 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/n-d-859358-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011377 Sep 27 01:32:44.087529 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 166/340] 10.222.0.52 () {58 vars in 1191 bytes} [Tue Sep 27 01:32:44 2022] GET /compute/v2.1/os-hosts/n-d-859358-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:44.095362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b1e3836e-1c99-461b-a004-e8c752d62edb tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Calling method '.version_select at 0x7f24d73b70d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:44.105470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b1e3836e-1c99-461b-a004-e8c752d62edb tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b1e3836e-1c99-461b-a004-e8c752d62edb tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:44.107412 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'nonexistent_hostname'} Sep 27 01:32:44.108905 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:44.109801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 27 01:32:44.110996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b1e3836e-1c99-461b-a004-e8c752d62edb tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b1e3836e-1c99-461b-a004-e8c752d62edb tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017970 Sep 27 01:32:44.112223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 175/341] 10.222.0.52 () {58 vars in 1215 bytes} [Tue Sep 27 01:32:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:44.123719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8b6f874-eb74-4e97-9f71-0d8ca5e93fb9 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d8b280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8b6f874-eb74-4e97-9f71-0d8ca5e93fb9 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-hosts/n-d-859358-1 HTTP/1.1 Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 51 Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:44.129460 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: {"status": "enable", "maintenance_mode": "invalid"} Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.130912 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'disable', Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'Enable', Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'Disable', Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance: Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'invalid' Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.131858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.133558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.134789 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.134789 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:44.134789 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:44.134789 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.134789 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.136154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8b6f874-eb74-4e97-9f71-0d8ca5e93fb9 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.137177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8b6f874-eb74-4e97-9f71-0d8ca5e93fb9 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-859358-1" status: 400 len: 199 microversion: 2.1 time: 0.018270 Sep 27 01:32:44.148002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9175b7b-9241-466b-81f6-776a2bce23b6 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6c47a60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:44.151980 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 167/342] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-859358-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9175b7b-9241-466b-81f6-776a2bce23b6 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: request: PUT /compute/v2.1/os-hosts/n-d-859358-1 HTTP/1.1 Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 51 Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:44.152927 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: {"status": "invalid", "maintenance_mode": "enable"} Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:44.154945 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'n-d-859358-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'disable', Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'Enable', Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'Disable', Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance: Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'invalid' Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.155843 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.157677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.159328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.159328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:44.159328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:44.159328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 27 01:32:44.159328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.161350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9175b7b-9241-466b-81f6-776a2bce23b6 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.162381 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9175b7b-9241-466b-81f6-776a2bce23b6 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-859358-1" status: 400 len: 189 microversion: 2.1 time: 0.018409 Sep 27 01:32:44.173822 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 176/343] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-859358-1 => generated 189 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:44.175897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14169111-514c-4d57-a22b-1bea594d7d98 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Action: 'update', calling method: .version_select at 0x7f24d6d293a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:44.183249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14169111-514c-4d57-a22b-1bea594d7d98 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '615d3073fc4f4afc87f7b71ebdfdebab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd213814d111464794246f598469932b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:44.184725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14169111-514c-4d57-a22b-1bea594d7d98 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Request method failure captured: Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-hosts/n-d-859358-1 HTTP/1.1 Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 50 Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK44EEZWzUDIsAm684fFjO-bWtrIVW28YV88JP3UcQJ2U0_cox1fdjXDTrlW4gwUMsIEjOJaHDhxxE7IGGbaKAlkoxniHfBmJ-b5nS1zKqTfDSMs6_wyUIhWJmjhw53nf1U1tOLi-wUBS7IRFGeLF58e9_60zmg3za7iyqBKUkSm1Q Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:32:44.186581 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd213814d111464794246f598469932b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd213814d111464794246f598469932b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd213814d111464794246f598469932b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd213814d111464794246f598469932b Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-751954041 Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 615d3073fc4f4afc87f7b71ebdfdebab Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-751954041-project Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: {"status": "enable", "maintenance_mode": "enable"} Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 27 01:32:44.188022 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.188930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 27 01:32:44.190233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.192388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:44.194989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14169111-514c-4d57-a22b-1bea594d7d98 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.196009 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14169111-514c-4d57-a22b-1bea594d7d98 tempest-HostsAdminNegativeTestJSON-751954041 tempest-HostsAdminNegativeTestJSON-751954041-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-859358-1" status: 403 len: 111 microversion: 2.1 time: 0.026457 Sep 27 01:32:44.205244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 168/344] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-859358-1 => generated 111 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:44.210367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:44.211156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:44.212900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a784138-f256-4e1a-8b68-d0ee897ca898 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d5f3a0>, body: {"status": null, "maintenance_mode": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:44.213717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:44.214638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:44.215274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a784138-f256-4e1a-8b68-d0ee897ca898 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-hosts/n-d-859358-1 HTTP/1.1 Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 42 Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:44.220496 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: {"status": null, "maintenance_mode": null} Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 27 01:32:44.221937 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'n-d-859358-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'disable', Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'Enable', Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'Disable', Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance: Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi None Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.222706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.224163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:32:44.225208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:32:44.225208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 27 01:32:44.225208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.226466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:44.232242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a784138-f256-4e1a-8b68-d0ee897ca898 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.235091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a784138-f256-4e1a-8b68-d0ee897ca898 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/n-d-859358-1" status: 400 len: 127 microversion: 2.1 time: 0.028570 Sep 27 01:32:44.242242 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 169/345] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-859358-1 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:32:44.252653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6dc3dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:44.256176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.hosts [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Enabling host nonexistent_hostname. Sep 27 01:32:44.280306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Request method failure captured: Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 50 Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlK6vl2h9YuGb6fki7jlgGc1P8fA2fh--5tmwSZ2Wp0QKz_2LLDvQg0Y4lCyWOg1qtfNiTZGhIRTKDNyKZew9m4_8KcYKx4hDediM5yv0Nzl4CuXki_L2Res7hJb1ovlRW79ZSv4WzVzPic4pmyGkFxb1wXdqeqM0OukZ5qErXr3OLY Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:32:44.286211 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2dd3b6db4064f16a00fa906c5362aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2dd3b6db4064f16a00fa906c5362aed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c2dd3b6db4064f16a00fa906c5362aed Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1260878177 Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b0c88a7972744f43ae428132f5cda01e Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1260878177-project-admin Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: {"status": "enable", "maintenance_mode": "enable"} Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.287706 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 27 01:32:44.288612 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 27 01:32:44.289778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:44.290811 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bddf1f8-3625-4951-9f29-9b8fc4e4f1b3 tempest-HostsAdminNegativeTestJSON-1260878177 tempest-HostsAdminNegativeTestJSON-1260878177-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.047341 Sep 27 01:32:44.294115 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 170/346] 10.222.0.52 () {60 vars in 1211 bytes} [Tue Sep 27 01:32:44 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:32:45.045779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:45.057451 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bdfa01aa-efda-4784-99f8-9c99bff41d35 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.881877 Sep 27 01:32:45.070706 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 177/347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:44 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:45.752189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Calling method '.version_select at 0x7f24d6d67160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:45.756133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.756617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.758886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:45.767104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:45.806169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.806661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.812810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:45.850475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.852869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.854216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:45.873625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0cbb81d-0f7a-4724-b3c6-95191228af1b tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.475808 Sep 27 01:32:45.886004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Calling method '.version_select at 0x7f24d7c30940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:45.887399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.888776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.890496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:45.898561 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 171/348] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:32:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:45.934265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.935611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.939197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:45.959059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:45.959684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:45.962344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7c04a149-be14-4d7b-b3e8-29071d09ea16 tempest-HypervisorAdminV228Test-446978796 tempest-HypervisorAdminV228Test-446978796-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.077987 Sep 27 01:32:45.967035 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 178/349] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:32:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:32:45.980534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a6eb49-ab9d-4843-8172-8da71781c9ff", "tag": "68a4b333-0100-4d8f-927d-e9c4b50f582a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:45.989148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:45.991280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:45.996874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:46.000070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:46.001831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:46.002740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:46.004333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:46.008917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:46.009668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:46.048515 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] Creating event network-changed:68a4b333-0100-4d8f-927d-e9c4b50f582a for instance 11a6eb49-ab9d-4843-8172-8da71781c9ff on n-h2-859358-1 Sep 27 01:32:46.072660 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4ded8ad3-fcc7-4c8e-85d5-59a27bedd89b req-077af919-69a1-4259-a29d-152c6f292c4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102962 Sep 27 01:32:46.083455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 179/350] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:46.099136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:46.108343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:46.143387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:46.151291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:46.152883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:46.156439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:46.162127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:46.164814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:46.934555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:46.943801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8b3d305-08ad-4cef-ad4e-df22c7857b14 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.858752 Sep 27 01:32:46.947474 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 180/351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:46 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:47.034241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:47.048046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0b0856c-11df-4e50-81a1-85cb642c841e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 200 len: 1589 microversion: 2.1 time: 1.092731 Sep 27 01:32:47.051156 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 172/352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:45 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 1589 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:47.975416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:47.976427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:47.989409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:47.989893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:47.990333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:47.996183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:47.996751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:47.997249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:48.822498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:48.824841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:48.836117 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbd7def6-c71d-4fa4-ad74-1528d499a8af tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.865162 Sep 27 01:32:48.836707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 181/353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:47 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:49.859023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:49.859637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:49.863243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=28 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:49.895531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:49.896037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:49.896469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:49.897194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:49.897684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:49.898118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:50.225135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:50.235079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2502ef7-7c3a-4634-b564-ad20422510a2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.380354 Sep 27 01:32:50.266792 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 173/354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:49 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:50.937392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3cb9eb8f-7826-4f66-8075-37e40d1cb57e tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-26T01%3A32%3A50.250282&end=2022-09-28T01%3A32%3A50.250282" status: 404 len: 112 microversion: - time: 0.683198 Sep 27 01:32:50.938651 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 182/355] 10.222.0.52 () {58 vars in 1316 bytes} [Tue Sep 27 01:32:50 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-26T01%3A32%3A50.250282&end=2022-09-28T01%3A32%3A50.250282 => generated 112 bytes in 685 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 01:32:50.950890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-485e189b-ab29-4e58-844a-4534ad1e9c57 tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] Calling method '.version_select at 0x7f24d6c47b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:50.961112 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-485e189b-ab29-4e58-844a-4534ad1e9c57 tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-485e189b-ab29-4e58-844a-4534ad1e9c57 tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] Request method failure captured: Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-simple-tenant-usage/bb5ace30ab9849d39eb00140cf1f3021?start=2022-09-28T01%3A32%3A50.250282&end=2022-09-26T01%3A32%3A50.250282 HTTP/1.1 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLC4T3rFZH17fihLXv-BejjSGGgIjk5f5-ERHm61jPMUVhg09NAnpo4eQvRk65jO4D7ethf1AAvCz6aVaFqnmxA-x-gm3fY_dsHolWMmIvkZyYCiahaZzfEF8WfSdixBoKEm70pTYa6u46Z7gBcz5LNo1dOil07-Ec-nXhzIjMRL6g Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 19c1a1373f7443e3aaacb85dcde5e540 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-56141306 Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:50.963314 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19c1a1373f7443e3aaacb85dcde5e540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19c1a1373f7443e3aaacb85dcde5e540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19c1a1373f7443e3aaacb85dcde5e540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19c1a1373f7443e3aaacb85dcde5e540", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-56141306 Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 19c1a1373f7443e3aaacb85dcde5e540 Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-56141306 Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TenantUsagesNegativeTestJSON-56141306-project-admin Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 3a97bbe421ba421086cfee12f955b0b4 Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-56141306-project-admin Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid start time. The start time cannot occur after the end time. Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'bb5ace30ab9849d39eb00140cf1f3021'} Sep 27 01:32:50.964514 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 27 01:32:50.965283 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 27 01:32:50.968183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:50.974219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-485e189b-ab29-4e58-844a-4534ad1e9c57 tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:50.975453 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-485e189b-ab29-4e58-844a-4534ad1e9c57 tempest-TenantUsagesNegativeTestJSON-56141306 tempest-TenantUsagesNegativeTestJSON-56141306-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/bb5ace30ab9849d39eb00140cf1f3021?start=2022-09-28T01%3A32%3A50.250282&end=2022-09-26T01%3A32%3A50.250282" status: 400 len: 111 microversion: 2.1 time: 0.028822 Sep 27 01:32:50.981413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 183/356] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Sep 27 01:32:50 2022] GET /compute/v2.1/os-simple-tenant-usage/bb5ace30ab9849d39eb00140cf1f3021?start=2022-09-28T01%3A32%3A50.250282&end=2022-09-26T01%3A32%3A50.250282 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:32:51.081458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-515750365", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:51.194210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:51.272074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5e10e50-1aaa-429d-80bf-48f8f25cd985 tempest-TenantUsagesNegativeTestJSON-1348616352 tempest-TenantUsagesNegativeTestJSON-1348616352-project] Calling method '.version_select at 0x7f24d7223ca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:51.276713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5e10e50-1aaa-429d-80bf-48f8f25cd985 tempest-TenantUsagesNegativeTestJSON-1348616352 tempest-TenantUsagesNegativeTestJSON-1348616352-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'cff4ce6d9d524d6295f07642c8084efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5ace30ab9849d39eb00140cf1f3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5e10e50-1aaa-429d-80bf-48f8f25cd985 tempest-TenantUsagesNegativeTestJSON-1348616352 tempest-TenantUsagesNegativeTestJSON-1348616352-project] Request method failure captured: Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-26T01%3A32%3A50.250282&end=2022-09-28T01%3A32%3A50.250282&detailed=1 HTTP/1.1 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLACI7RyptfvjLDd94mqlgFfH6dsOssZ5_yZKJ3RCWJ2nf7CMuDYN1hkdX0oLNKbyekuqcCIkJ9pWLft0jbmqgxHVi89N9Im9r8syNE9qxejMURf976-g7TQUtSHpkoUe0L5g3mlzOdC2GuKU2841baWmuh7k2v0JJVumHm05KhjcQ Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: bb5ace30ab9849d39eb00140cf1f3021 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1348616352 Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:51.283070 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb5ace30ab9849d39eb00140cf1f3021"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bb5ace30ab9849d39eb00140cf1f3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bb5ace30ab9849d39eb00140cf1f3021"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bb5ace30ab9849d39eb00140cf1f3021", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1348616352 Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: bb5ace30ab9849d39eb00140cf1f3021 Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1348616352 Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TenantUsagesNegativeTestJSON-1348616352-project Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: cff4ce6d9d524d6295f07642c8084efa Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1348616352-project Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:32:51.284600 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:51.285331 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:51.286477 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 27 01:32:51.287579 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:51.287579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5e10e50-1aaa-429d-80bf-48f8f25cd985 tempest-TenantUsagesNegativeTestJSON-1348616352 tempest-TenantUsagesNegativeTestJSON-1348616352-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:51.287579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5e10e50-1aaa-429d-80bf-48f8f25cd985 tempest-TenantUsagesNegativeTestJSON-1348616352 tempest-TenantUsagesNegativeTestJSON-1348616352-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-26T01%3A32%3A50.250282&end=2022-09-28T01%3A32%3A50.250282&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.302823 Sep 27 01:32:51.287579 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 184/357] 10.222.0.52 () {58 vars in 1335 bytes} [Tue Sep 27 01:32:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-26T01%3A32%3A50.250282&end=2022-09-28T01%3A32%3A50.250282&detailed=1 => generated 123 bytes in 305 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:51.307115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:51.307847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:51.331328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:51.333754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:51.336154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:51.337122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:51.338277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:51.339032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:51.856146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:51.864147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6bfaead5-7f98-4cc6-8783-737560d74f69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 0.572286 Sep 27 01:32:51.873373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 185/358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:51 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:51.881243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cb4d2f-dfde-4d66-9438-99dba5838034", "name": "network-vif-plugged", "status": "completed", "tag": "c1d1798b-bf55-466d-842f-abe50bd83009"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:51.910583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:51.911074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:51.911513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:51.937896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] Creating event network-vif-plugged:c1d1798b-bf55-466d-842f-abe50bd83009 for instance a2cb4d2f-dfde-4d66-9438-99dba5838034 on n-h1-859358-1 Sep 27 01:32:51.963264 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5f04b578-9c38-4047-a2bc-d5de29234f08 req-3b980b5a-65f4-428e-9944-83e640c2b1c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088538 Sep 27 01:32:51.964391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 186/359] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:52.054789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:52.055573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:52.056745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:52.057400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:52.057998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:52.093911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:52.095923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:52.098470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:52.100031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:52.100653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:52.101724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:52.131589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Getting quotas for project 9cc13c5471ca4f209b88a07caf3669da. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:52.140642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Getting quotas for user 01f32acd5cf4439f9999d4c92b32f8f9 and project 9cc13c5471ca4f209b88a07caf3669da. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:52.161216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:32:52.164587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:32:52.275626 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68637f9f-259e-467e-b6ba-51a9fc1fba55 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336027 Sep 27 01:32:52.275626 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 174/360] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:32:52.288359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56579903-5b9e-4e82-b05f-b4405bb06c1e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:52.289605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56579903-5b9e-4e82-b05f-b4405bb06c1e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:52.792374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56579903-5b9e-4e82-b05f-b4405bb06c1e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:52.803844 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56579903-5b9e-4e82-b05f-b4405bb06c1e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1219 microversion: 2.1 time: 0.522512 Sep 27 01:32:52.818049 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 187/361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:52 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1219 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:52.895961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:52.899307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:52.923331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:52.928879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:52.929770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:52.931031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:52.934180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:52.934901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:53.780814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:32:53.990467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:54.003476 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-414e7440-19f8-4689-823c-9b580da39e46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1317 microversion: 2.1 time: 1.120111 Sep 27 01:32:54.007180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 175/362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:52 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1317 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:54.012162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:54.015299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:54.035198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.038133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.038584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.040076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.041278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.041738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.223852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:54.242380 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e21fa32a-e47b-48e1-939b-6176def0b61b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1271 microversion: 2.1 time: 0.233476 Sep 27 01:32:54.243101 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 176/363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:54 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:54.350177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Calling method '.version_select at 0x7f24d7c30790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:54.373871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.374437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.374916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.439245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.440078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.441837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.507304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.508182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.508957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.529072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.530145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.530947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.560476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.561552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.562276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.572076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d54cf903-d5e9-497e-8f22-9016f436cd0d tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.797807 Sep 27 01:32:54.596050 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 188/364] 10.222.0.52 () {60 vars in 1243 bytes} [Tue Sep 27 01:32:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:32:54.599175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Calling method '.version_select at 0x7f24d6ce29d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:54.607044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.608168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.608941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.638804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.641988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.642734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.700262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.700860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.701383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.715420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.717004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.717786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.754474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.755252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.756038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.798118 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5980ac0-e3a6-4fc8-ae1a-f50ba9a852be tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.210510 Sep 27 01:32:54.798691 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 177/365] 10.222.0.52 () {60 vars in 1222 bytes} [Tue Sep 27 01:32:54 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:54.811189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Calling method '.version_select at 0x7f24d6db18b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:54.815900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.816521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.817048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.891639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:54.892360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:54.893950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:54.910185 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b45486df-0bd1-44ad-b2ca-eb004b6273f4 tempest-HypervisorAdminV253TestBase-2073310585 tempest-HypervisorAdminV253TestBase-2073310585-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/70e28f92-3209-4703-903f-41032164d0d0" status: 200 len: 792 microversion: 2.53 time: 0.103053 Sep 27 01:32:54.910799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 189/366] 10.222.0.52 () {60 vars in 1298 bytes} [Tue Sep 27 01:32:54 2022] GET /compute/v2.1/os-hypervisors/70e28f92-3209-4703-903f-41032164d0d0 => generated 792 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:32:55.035704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:55.036336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:55.055656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:55.057230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:55.065288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:55.067760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:55.070917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:55.071698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:55.268456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:55.269163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:55.281075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:55.281665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:55.282166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:55.282964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:55.283497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:55.283985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:55.428645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:55.440156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a55cbfc-1a96-424e-8c91-d4bd70a50335 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1277 microversion: 2.1 time: 0.175413 Sep 27 01:32:55.442417 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 190/367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:55 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:55.610531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:55.619705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88b4754f-2095-4522-95fc-d1ce57750721 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1467 microversion: 2.1 time: 0.588539 Sep 27 01:32:55.634353 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 178/368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:55 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1467 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:56.413743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:56.415273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:56.429000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:56.431575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:56.432249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:56.433330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:56.437101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:56.437798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:56.466720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:56.467228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:56.496312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:56.496844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:56.497856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:56.498599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:56.499058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:56.499484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:56.676999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:56.692207 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c7c8bd5-3ba2-43ac-9764-d7ab6a25d767 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1277 microversion: 2.1 time: 0.227546 Sep 27 01:32:56.693776 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 179/369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:56 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:57.714396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:57.719422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:57.746503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:57.747309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:57.748418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:57.749733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:57.750491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:57.751078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:58.232712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:58.250514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd486ae6-dc25-4ea0-97c7-32130b1be15f tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 0.539558 Sep 27 01:32:58.263256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 180/370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:57 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:32:58.378539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7754914-df09-49ba-8d32-9865c8d2a1c0 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1618 microversion: 2.1 time: 2.716036 Sep 27 01:32:58.379131 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 191/371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:55 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1618 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:58.410637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: .version_select at 0x7f24d6c165e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1920993181", "policies": ["affinity"]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:58.504806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:58.527792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:58.628063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:58.636650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:58.657811 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca5c8bda-f1e5-40dd-a85d-3f3a0687fc32 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.256357 Sep 27 01:32:58.661813 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 192/372] 10.222.0.52 () {60 vars in 1174 bytes} [Tue Sep 27 01:32:58 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:58.683186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Calling method '.version_select at 0x7f24d6ce6700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:58.691535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:58.694104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:58.695430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:58.728955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:58.730384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:58.734957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:58.777975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:58.778548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:58.779010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:58.807137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6c42719-bf69-42f2-a30f-30aa73c1fa36 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.542137 Sep 27 01:32:58.808050 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 181/373] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:58.888134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1235980754", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5e7f8592-ec73-4530-a83a-74cdd658ea7c"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:32:58.980524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:32:59.150600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32334a6d-6102-458a-a18d-a34c2d5193cd tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Calling method '.version_select at 0x7f24d6c16dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.152433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-32334a6d-6102-458a-a18d-a34c2d5193cd tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '39a24cc9b774479284ae91243be6756b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944d3ab5406f4147a1c0ae688cb43ee1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32334a6d-6102-458a-a18d-a34c2d5193cd tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Request method failure captured: Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/n-h1-859358-1/search HTTP/1.1 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLH8zWnp4fj9qHTENaQZJ2A5D8xPR1jQllBg_nAH4jigVx2mthqgxwvMQvZSMW9vHIE0f5q2BUbM9bkIGCuWgWa9vwEhnyeYJG-PUQl-UmZG917jxye1rsQe3Kq45hb0JJzMApCVPPjz48u1cS1BsxiQiFVGwc85d1zoWuc47HD7JU Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 944d3ab5406f4147a1c0ae688cb43ee1 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:59.155162 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_944d3ab5406f4147a1c0ae688cb43ee1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 944d3ab5406f4147a1c0ae688cb43ee1 Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 39a24cc9b774479284ae91243be6756b Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 27 01:32:59.156386 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'n-h1-859358-1'} Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:59.157059 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 27 01:32:59.163027 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.163976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32334a6d-6102-458a-a18d-a34c2d5193cd tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:59.163976 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32334a6d-6102-458a-a18d-a34c2d5193cd tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-859358-1/search" status: 403 len: 117 microversion: 2.1 time: 0.340758 Sep 27 01:32:59.165991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 193/374] 10.222.0.52 () {58 vars in 1209 bytes} [Tue Sep 27 01:32:58 2022] GET /compute/v2.1/os-hypervisors/n-h1-859358-1/search => generated 117 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:59.170956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Calling method '.version_select at 0x7f24d6bd60d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.179392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.183597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.184913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.210794 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Request method failure captured: Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLJxb08waht5aprjI8kNiBHXAWKJiSOmoNK9ik23m_Xqhfgo3n0pV543Q_EvnqiaDutFfJwOOVkGQpyD77RLIALNlmn54VRly9hW1Pe_ly6EKbrxI1vHle06rEvCKxWfTSW5_Mo3gmO5GqTmTjeNBTctsyTX4vhNm-R3xngBwwO3aU Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: dc6bdbbe52aa4bccacb10871d1406eff Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:32:59.212196 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc6bdbbe52aa4bccacb10871d1406eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: dc6bdbbe52aa4bccacb10871d1406eff Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4efb92b3f54d4f2fbe7352c285eda4fb Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 27 01:32:59.213737 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.214759 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:59.217949 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f3a5830-55b8-4577-875f-2f3a3ec8f0ba tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.046443 Sep 27 01:32:59.225809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 194/375] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:32:59 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:59.234822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Calling method '.version_select at 0x7f24d6bd6670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.236479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.236982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.237451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.291540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.292034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.296116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.350108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.353871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.354305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.389669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09e2a4e8-2fb6-4109-bd4f-2f2ac2b8cc4c tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.160871 Sep 27 01:32:59.392851 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 195/376] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:32:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:32:59.417991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.421656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:32:59.469850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.474608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.476263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.477624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.481164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.483587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.650662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:32:59.651329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:32:59.651952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:32:59.652529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:32:59.653133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:32:59.717857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.718695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.719285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.720175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.720797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.721440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:32:59.763817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:59.787314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:59.829119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 2 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:32:59.832043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:32:59.928798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:59.929030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128779) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 27 01:32:59.942248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0bc9a8c-97e8-4ccf-a9e3-4a7181821d78 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 0.547156 Sep 27 01:32:59.945607 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 196/377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:32:59 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:32:59.955322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a291668-8078-4673-ae4a-2ac30d124ddc tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Calling method '.version_select at 0x7f24d6bef5e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.965178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:32:59.966499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a291668-8078-4673-ae4a-2ac30d124ddc tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '39a24cc9b774479284ae91243be6756b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944d3ab5406f4147a1c0ae688cb43ee1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a291668-8078-4673-ae4a-2ac30d124ddc tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Request method failure captured: Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLH8zWnp4fj9qHTENaQZJ2A5D8xPR1jQllBg_nAH4jigVx2mthqgxwvMQvZSMW9vHIE0f5q2BUbM9bkIGCuWgWa9vwEhnyeYJG-PUQl-UmZG917jxye1rsQe3Kq45hb0JJzMApCVPPjz48u1cS1BsxiQiFVGwc85d1zoWuc47HD7JU Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 944d3ab5406f4147a1c0ae688cb43ee1 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:32:59.971046 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/944d3ab5406f4147a1c0ae688cb43ee1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_944d3ab5406f4147a1c0ae688cb43ee1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 944d3ab5406f4147a1c0ae688cb43ee1 Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752 Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 39a24cc9b774479284ae91243be6756b Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1'} Sep 27 01:32:59.972391 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:32:59.973154 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 27 01:32:59.974844 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:32:59.975727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a291668-8078-4673-ae4a-2ac30d124ddc tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:32:59.975727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a291668-8078-4673-ae4a-2ac30d124ddc tempest-HypervisorAdminNegativeUnderV252Test-2123900752 tempest-HypervisorAdminNegativeUnderV252Test-2123900752-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025818 Sep 27 01:32:59.975727 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 197/378] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:32:59 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:32:59.984122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:32:59.984723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Calling method '.version_select at 0x7f24d6beff70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:32:59.986520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:32:59.987006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:32:59.987443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:00.008915 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] HTTP exception thrown: No hypervisor matching '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d' could be found. Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Request method failure captured: Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/32de49fb-3bd7-4ec7-851c-7b3b1b77d71d/servers HTTP/1.1 Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLJxb08waht5aprjI8kNiBHXAWKJiSOmoNK9ik23m_Xqhfgo3n0pV543Q_EvnqiaDutFfJwOOVkGQpyD77RLIALNlmn54VRly9hW1Pe_ly6EKbrxI1vHle06rEvCKxWfTSW5_Mo3gmO5GqTmTjeNBTctsyTX4vhNm-R3xngBwwO3aU Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: dc6bdbbe52aa4bccacb10871d1406eff Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:33:00.013270 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc6bdbbe52aa4bccacb10871d1406eff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc6bdbbe52aa4bccacb10871d1406eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: dc6bdbbe52aa4bccacb10871d1406eff Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151 Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4efb92b3f54d4f2fbe7352c285eda4fb Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: exception: No hypervisor matching '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d' could be found. Sep 27 01:33:00.014767 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d'} Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d' could be found. Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:00.015509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:00.016667 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:00.016667 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:00.016667 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:00.016667 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d' could be found. Sep 27 01:33:00.016667 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:00.019272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] Returning 404 to user: No hypervisor matching '32de49fb-3bd7-4ec7-851c-7b3b1b77d71d' could be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:00.022759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f6db0818-6a33-4718-b564-8dc2e9c3b1d3 tempest-HypervisorAdminNegativeUnderV252Test-1366500151 tempest-HypervisorAdminNegativeUnderV252Test-1366500151-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/32de49fb-3bd7-4ec7-851c-7b3b1b77d71d/servers" status: 404 len: 123 microversion: 2.1 time: 0.042329 Sep 27 01:33:00.023720 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 198/379] 10.222.0.52 () {58 vars in 1281 bytes} [Tue Sep 27 01:32:59 2022] GET /compute/v2.1/os-hypervisors/32de49fb-3bd7-4ec7-851c-7b3b1b77d71d/servers => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:33:00.107631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:00.127238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:00.163468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c364114-25f7-4300-a6d3-84a640090971", "tag": "f5d04854-e6cf-478f-9344-c8aacf8a5f11"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:00.181763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=8a3c75af-947a-4b65-906e-a940e974380a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:00.187232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:00.189324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:00.191103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:00.218087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] Creating event network-changed:f5d04854-e6cf-478f-9344-c8aacf8a5f11 for instance 7c364114-25f7-4300-a6d3-84a640090971 on n-h1-859358-1 Sep 27 01:33:00.243499 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c70cf077-0deb-444c-9010-ea8173db42fa req-064d62d0-624b-47d1-8549-fdd955163902 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082585 Sep 27 01:33:00.247266 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 199/380] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:33:00.291961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:00.320369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:00.332738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:00.437230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:00.448964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:00.527402 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-134c4eac-36a6-4143-8ae6-7b3b0c669a5b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.645256 Sep 27 01:33:00.530532 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 182/381] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:32:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1648 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 27 01:33:00.538815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:00.544466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:00.545060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Searching by: {'deleted': False, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:33:00.565405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:00.565890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:00.566327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:00.567245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:00.567965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:00.568534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:00.822338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:33:00.968162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:00.969573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:00.980145 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18be2f13-340f-4307-a47f-204d8c84a516 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.446091 Sep 27 01:33:00.982552 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 200/382] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:33:00 2022] GET /compute/v2.1/servers => generated 1004 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:00.987617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:00.989327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:00.993473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:00.995196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:00.997600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cba09bc1-b083-4816-a78c-ef19bbf06d8e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:00.998547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:00.999171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cba09bc1-b083-4816-a78c-ef19bbf06d8e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:00.999835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:01.197154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cba09bc1-b083-4816-a78c-ef19bbf06d8e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:01.210164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cba09bc1-b083-4816-a78c-ef19bbf06d8e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1219 microversion: 2.1 time: 0.216903 Sep 27 01:33:01.212482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 201/383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:00 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:01.798089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:01.811002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d9059bd-a688-4cc8-a1b7-da682cd8d01e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 0.847945 Sep 27 01:33:01.816999 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 183/384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:00 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:02.238052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:02.238784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:02.252062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:02.254055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:02.254716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:02.256139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:02.261206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:02.263028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:02.790473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:02.802574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76e2b015-7f58-4c63-944a-7e6ff30e3689 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1215 microversion: 2.1 time: 0.568623 Sep 27 01:33:02.823077 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 202/385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:02 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1215 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:02.845708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:02.847078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:02.879526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:02.883406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:02.886381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:02.889257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:02.893533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:02.895031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:03.834269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:03.841089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:03.865954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:03.869275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:03.871103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:03.875330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:03.877283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:03.878483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:04.037763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:04.058408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62c31406-7514-4e29-8e5d-f6fcdfae716f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1271 microversion: 2.1 time: 0.228939 Sep 27 01:33:04.062469 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 203/386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:03 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:04.591447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:04.609248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8b4fe6e-ba41-4f4e-b9da-5f3bedd6049d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 1.770806 Sep 27 01:33:04.622535 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 184/387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:02 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:04.798985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff1131bd-0aa8-4512-98d6-fb824161758d tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Calling method '.version_select at 0x7f24d6ac73a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:04.801375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff1131bd-0aa8-4512-98d6-fb824161758d tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1a219ce9f9f041309fbe3c1195a145ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c04b3563b3a4bad82bf73ee3510cfbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff1131bd-0aa8-4512-98d6-fb824161758d tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Request method failure captured: Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLOBaHZDbaBhAB0uplu700cbTCtDDutWBA2_hLZ6DhRBdrdRf_RA0WTQukjmBT49HLT1LxIUHgeUqiRRAtpJ6oXt_eg7EYWXCBZ58qQe0HUZ1hZQVfV9tPE7U8FA5LePuETJFbFFQxzOz3yrQ2W2rTZax2h6qDRZHDEdqJmWUOHgSU Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:04.803052 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c04b3563b3a4bad82bf73ee3510cfbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1a219ce9f9f041309fbe3c1195a145ad Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:33:04.804321 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:04.805034 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 27 01:33:04.806488 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.810784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff1131bd-0aa8-4512-98d6-fb824161758d tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:04.814493 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff1131bd-0aa8-4512-98d6-fb824161758d tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.308249 Sep 27 01:33:04.818125 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 204/388] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 01:33:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:04.846383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4a93293-9d15-4ae9-9112-d6ef289c17dd tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Calling method '.version_select at 0x7f24d7117f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:04.858182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4a93293-9d15-4ae9-9112-d6ef289c17dd tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1a219ce9f9f041309fbe3c1195a145ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c04b3563b3a4bad82bf73ee3510cfbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4a93293-9d15-4ae9-9112-d6ef289c17dd tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Request method failure captured: Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLOBaHZDbaBhAB0uplu700cbTCtDDutWBA2_hLZ6DhRBdrdRf_RA0WTQukjmBT49HLT1LxIUHgeUqiRRAtpJ6oXt_eg7EYWXCBZ58qQe0HUZ1hZQVfV9tPE7U8FA5LePuETJFbFFQxzOz3yrQ2W2rTZax2h6qDRZHDEdqJmWUOHgSU Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:04.862399 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c04b3563b3a4bad82bf73ee3510cfbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1a219ce9f9f041309fbe3c1195a145ad Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: action_args: {} Sep 27 01:33:04.863910 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:04.864808 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 27 01:33:04.866276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.870530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4a93293-9d15-4ae9-9112-d6ef289c17dd tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:04.874051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4a93293-9d15-4ae9-9112-d6ef289c17dd tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.051288 Sep 27 01:33:04.882778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 185/389] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:33:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:04.891810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5606e2c6-3ca0-4b23-bc31-5d1894ba35a5 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Calling method '.version_select at 0x7f24d6b89670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:04.894073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5606e2c6-3ca0-4b23-bc31-5d1894ba35a5 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1a219ce9f9f041309fbe3c1195a145ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c04b3563b3a4bad82bf73ee3510cfbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5606e2c6-3ca0-4b23-bc31-5d1894ba35a5 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Request method failure captured: Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLOBaHZDbaBhAB0uplu700cbTCtDDutWBA2_hLZ6DhRBdrdRf_RA0WTQukjmBT49HLT1LxIUHgeUqiRRAtpJ6oXt_eg7EYWXCBZ58qQe0HUZ1hZQVfV9tPE7U8FA5LePuETJFbFFQxzOz3yrQ2W2rTZax2h6qDRZHDEdqJmWUOHgSU Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:04.895418 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c04b3563b3a4bad82bf73ee3510cfbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1a219ce9f9f041309fbe3c1195a145ad Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:33:04.896819 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:04.897717 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 27 01:33:04.898966 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:04.900132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5606e2c6-3ca0-4b23-bc31-5d1894ba35a5 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:04.902322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5606e2c6-3ca0-4b23-bc31-5d1894ba35a5 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015670 Sep 27 01:33:04.903884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 205/390] 10.222.0.52 () {58 vars in 1179 bytes} [Tue Sep 27 01:33:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:04.989988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Calling method '.version_select at 0x7f24d6ce6f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:04.992086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:04.992750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:04.993391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.008731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.009534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.010132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.022261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.023007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.023603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.031158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a282659-b760-48a9-b004-903f7487945c tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.117473 Sep 27 01:33:05.032325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 186/391] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:33:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:05.045111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b33eccd-a46f-496f-99a6-656fe80aaa94 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Calling method '.version_select at 0x7f24d6d34940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.047105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b33eccd-a46f-496f-99a6-656fe80aaa94 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1a219ce9f9f041309fbe3c1195a145ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c04b3563b3a4bad82bf73ee3510cfbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b33eccd-a46f-496f-99a6-656fe80aaa94 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Request method failure captured: Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLOBaHZDbaBhAB0uplu700cbTCtDDutWBA2_hLZ6DhRBdrdRf_RA0WTQukjmBT49HLT1LxIUHgeUqiRRAtpJ6oXt_eg7EYWXCBZ58qQe0HUZ1hZQVfV9tPE7U8FA5LePuETJFbFFQxzOz3yrQ2W2rTZax2h6qDRZHDEdqJmWUOHgSU Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:05.049374 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c04b3563b3a4bad82bf73ee3510cfbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1a219ce9f9f041309fbe3c1195a145ad Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1'} Sep 27 01:33:05.050792 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:05.051685 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 27 01:33:05.052934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.055291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b33eccd-a46f-496f-99a6-656fe80aaa94 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:05.056332 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b33eccd-a46f-496f-99a6-656fe80aaa94 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017086 Sep 27 01:33:05.057520 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 206/392] 10.222.0.52 () {58 vars in 1173 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:05.067165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64723ea8-7171-4823-be89-1216dba7fd64 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Calling method '.version_select at 0x7f24d6dbe160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.068748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-64723ea8-7171-4823-be89-1216dba7fd64 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] HTTP exception thrown: Hypervisor with ID '833820f7-1930-4a4e-9d26-897cf57d000d' could not be found. Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64723ea8-7171-4823-be89-1216dba7fd64 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Request method failure captured: Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/833820f7-1930-4a4e-9d26-897cf57d000d/uptime HTTP/1.1 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLQhU1iYvsXQtX5te7SFrfVSibq-m9GMUUeRC399c4FJ7_ba742w0BiikYi4RktVybAfIonziMqgACs8pIhd4dtVsPyIfaSHdm6i5peo-ox9-kpjEzgHmtSAJCpZfIT0LgZnJif0XzLD6xPGb0mGzMsknVn_ECEyg8NAXFSm1nQ9_o Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 538c4f9891ba4c9f966151e686c99f76 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:33:05.080408 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_538c4f9891ba4c9f966151e686c99f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 538c4f9891ba4c9f966151e686c99f76 Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: d12adf9132914a00a5363a1efda29168 Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: exception: Hypervisor with ID '833820f7-1930-4a4e-9d26-897cf57d000d' could not be found. Sep 27 01:33:05.081928 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '833820f7-1930-4a4e-9d26-897cf57d000d'} Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '833820f7-1930-4a4e-9d26-897cf57d000d' Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 27 01:33:05.082781 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '833820f7-1930-4a4e-9d26-897cf57d000d' could not be found. Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.084398 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '833820f7-1930-4a4e-9d26-897cf57d000d' could not be found. Sep 27 01:33:05.085868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.086335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.087089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:05.087958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64723ea8-7171-4823-be89-1216dba7fd64 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Returning 404 to user: Hypervisor with ID '833820f7-1930-4a4e-9d26-897cf57d000d' could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:05.089212 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64723ea8-7171-4823-be89-1216dba7fd64 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/833820f7-1930-4a4e-9d26-897cf57d000d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025986 Sep 27 01:33:05.091322 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 187/393] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/os-hypervisors/833820f7-1930-4a4e-9d26-897cf57d000d/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:05.096074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.096574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.097003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.097754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.098204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.098625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.101547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Calling method '.version_select at 0x7f24d6e32c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.104863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.105705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.106388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.125300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.126380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.126998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.147776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.148794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.149239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.157728 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-538d6c96-f0a4-4632-b405-597934e3ef6d tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061302 Sep 27 01:33:05.159655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 188/394] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:05.171383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84713c7b-49a9-4c5a-8dab-f491a170e4b8 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Calling method '.version_select at 0x7f24d6d67040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.173175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84713c7b-49a9-4c5a-8dab-f491a170e4b8 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1a219ce9f9f041309fbe3c1195a145ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c04b3563b3a4bad82bf73ee3510cfbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84713c7b-49a9-4c5a-8dab-f491a170e4b8 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Request method failure captured: Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLOBaHZDbaBhAB0uplu700cbTCtDDutWBA2_hLZ6DhRBdrdRf_RA0WTQukjmBT49HLT1LxIUHgeUqiRRAtpJ6oXt_eg7EYWXCBZ58qQe0HUZ1hZQVfV9tPE7U8FA5LePuETJFbFFQxzOz3yrQ2W2rTZax2h6qDRZHDEdqJmWUOHgSU Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:05.174791 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9c04b3563b3a4bad82bf73ee3510cfbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9c04b3563b3a4bad82bf73ee3510cfbd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9c04b3563b3a4bad82bf73ee3510cfbd Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447 Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1a219ce9f9f041309fbe3c1195a145ad Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1655185447-project Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '1'} Sep 27 01:33:05.175973 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:05.181561 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 27 01:33:05.182651 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.183691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84713c7b-49a9-4c5a-8dab-f491a170e4b8 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:05.183691 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84713c7b-49a9-4c5a-8dab-f491a170e4b8 tempest-HypervisorAdminNegativeTestJSON-1655185447 tempest-HypervisorAdminNegativeTestJSON-1655185447-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010125 Sep 27 01:33:05.183691 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 189/395] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:33:05.191440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bd5fe8e-5091-4eda-bb98-9000e6857ce4 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Calling method '.version_select at 0x7f24d6d3b550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.194201 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0bd5fe8e-5091-4eda-bb98-9000e6857ce4 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] HTTP exception thrown: Hypervisor with ID '7d71f5b3-3432-477c-9f73-d9fdba772f72' could not be found. Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bd5fe8e-5091-4eda-bb98-9000e6857ce4 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Request method failure captured: Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-hypervisors/7d71f5b3-3432-477c-9f73-d9fdba772f72 HTTP/1.1 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLQhU1iYvsXQtX5te7SFrfVSibq-m9GMUUeRC399c4FJ7_ba742w0BiikYi4RktVybAfIonziMqgACs8pIhd4dtVsPyIfaSHdm6i5peo-ox9-kpjEzgHmtSAJCpZfIT0LgZnJif0XzLD6xPGb0mGzMsknVn_ECEyg8NAXFSm1nQ9_o Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 538c4f9891ba4c9f966151e686c99f76 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:33:05.196852 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/538c4f9891ba4c9f966151e686c99f76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_538c4f9891ba4c9f966151e686c99f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 538c4f9891ba4c9f966151e686c99f76 Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-447375566 Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: d12adf9132914a00a5363a1efda29168 Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: exception: Hypervisor with ID '7d71f5b3-3432-477c-9f73-d9fdba772f72' could not be found. Sep 27 01:33:05.198324 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7d71f5b3-3432-477c-9f73-d9fdba772f72'} Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7d71f5b3-3432-477c-9f73-d9fdba772f72' Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 27 01:33:05.198998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7d71f5b3-3432-477c-9f73-d9fdba772f72' could not be found. Sep 27 01:33:05.200713 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7d71f5b3-3432-477c-9f73-d9fdba772f72' could not be found. Sep 27 01:33:05.203913 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:05.207370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bd5fe8e-5091-4eda-bb98-9000e6857ce4 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] Returning 404 to user: Hypervisor with ID '7d71f5b3-3432-477c-9f73-d9fdba772f72' could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:05.208466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bd5fe8e-5091-4eda-bb98-9000e6857ce4 tempest-HypervisorAdminNegativeTestJSON-447375566 tempest-HypervisorAdminNegativeTestJSON-447375566-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/7d71f5b3-3432-477c-9f73-d9fdba772f72" status: 404 len: 123 microversion: 2.1 time: 0.021995 Sep 27 01:33:05.213920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:05.214203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 190/396] 10.222.0.52 () {58 vars in 1257 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/os-hypervisors/7d71f5b3-3432-477c-9f73-d9fdba772f72 => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:05.223725 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e923b4d9-3dd2-43a9-9664-bc9a93328eab tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1277 microversion: 2.1 time: 0.140705 Sep 27 01:33:05.238402 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 207/397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:05.634665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:05.636912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:05.645815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.646643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.648156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:05.649039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:05.649697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:05.650284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:06.191320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:06.196085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:06.205608 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ad09ce2-fadb-480f-b984-d7ca8586832d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 0.577328 Sep 27 01:33:06.206821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 191/398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:05 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:06.250532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:06.251419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:06.268837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:06.269460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:06.269988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:06.270809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:06.274780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:06.275431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:06.420786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:06.435338 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7035362c-56ab-4ffa-a0a4-af1df495a479 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1277 microversion: 2.1 time: 0.189563 Sep 27 01:33:06.438146 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 208/399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:06 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:07.233561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:07.234488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:07.247697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:07.248583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:07.251788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:07.254302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:07.256610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:07.257168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:07.463218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:07.464414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:07.479451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:07.480792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:07.483047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:07.484555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:07.486897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:07.487556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:07.772337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:07.791495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-943b16f3-ad18-444f-a4ae-c733019e711b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.330792 Sep 27 01:33:07.794885 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 209/400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:07 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:07.805798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c364114-25f7-4300-a6d3-84a640090971", "name": "network-vif-plugged", "status": "completed", "tag": "f5d04854-e6cf-478f-9344-c8aacf8a5f11"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:07.832628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:07.833573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:07.834637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:07.850107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] Creating event network-vif-plugged:f5d04854-e6cf-478f-9344-c8aacf8a5f11 for instance 7c364114-25f7-4300-a6d3-84a640090971 on n-h1-859358-1 Sep 27 01:33:07.858967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d9c2f75d-8fdc-4fbc-9ead-5472a8a2b414 req-c1dc49be-0bf2-42a8-b494-7ce704dbcc92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062382 Sep 27 01:33:07.860299 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 210/401] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:08.339901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:08.353503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dbc0be2-ee26-4095-8972-153a4e9d9aaa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 1.122268 Sep 27 01:33:08.354710 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 192/402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:07 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:08.775728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2eb1f2df-3890-4b80-86a0-7ed54de162ba tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Action: 'create', calling method: .version_select at 0x7f24d6b89b80>, body: {"keypair": {"name": "tempest-keypair-1707542776", "type": "ssh", "user_id": "0cc68a50cb3343a8ad2563e9c0728864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT9mGJMZXfzKzRrUr/oFTJxLjeR3PH7WQ5WIMId+3x7GQwG0Dnr8UqOyJmh+SYGSHpEAHU3F9LVZ4u2dJmLqQdPaleExlPL98F4UJOCfyCH80MyYbBuSuNJOKU2ZUW5RA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:08.818749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:08.819473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:08.826022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2eb1f2df-3890-4b80-86a0-7ed54de162ba tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:08.831702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:08.832729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:08.833191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:08.835230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:08.835893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:08.837420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:08.843415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2eb1f2df-3890-4b80-86a0-7ed54de162ba tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for user 4fda7afc1e204cba8d0e422e1113a694 and project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:08.864640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:08.890296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2eb1f2df-3890-4b80-86a0-7ed54de162ba tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.442930 Sep 27 01:33:08.891340 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 211/403] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:33:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 445 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:33:08.906629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-649464ff-f4b3-4368-b13c-8c3be779a417 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Action: 'create', calling method: .version_select at 0x7f24d6c16820>, body: {"keypair": {"name": "tempest-keypair-1692838121", "type": "ssh", "user_id": "0cc68a50cb3343a8ad2563e9c0728864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9SGLC63vJaDI9qaoEtQ64Fm+34u4z2ghEeoBhw82HgXuxpjLw3wSnWNGQODaYDqNE/ULYmnBTDvywIuYme7XMOG4Dt3KEyUh08q2jE+IZ3k90ka8VgXhmz3yjgapdTZQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:08.943752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-649464ff-f4b3-4368-b13c-8c3be779a417 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:08.959438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-649464ff-f4b3-4368-b13c-8c3be779a417 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for user 4fda7afc1e204cba8d0e422e1113a694 and project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:09.016685 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-649464ff-f4b3-4368-b13c-8c3be779a417 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.115451 Sep 27 01:33:09.017597 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 212/404] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:33:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:33:09.032196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7de91b0e-4b38-469d-9a3c-cc4aa121d2fe tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Calling method '.version_select at 0x7f24d6bd6dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.066292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7de91b0e-4b38-469d-9a3c-cc4aa121d2fe tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1707542776?user_id=0cc68a50cb3343a8ad2563e9c0728864" status: 200 len: 512 microversion: 2.10 time: 0.040680 Sep 27 01:33:09.070690 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 213/405] 10.222.0.52 () {60 vars in 1340 bytes} [Tue Sep 27 01:33:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1707542776?user_id=0cc68a50cb3343a8ad2563e9c0728864 => generated 512 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:33:09.086666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ae69f5b-81d2-4650-b6d6-4f4f2132a878 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Action: 'create', calling method: .version_select at 0x7f24d6a45ca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2008211163", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHjFq6Lujxdyup4Qb/tex0Aq+eyBv3jAbP/uMP88d62inpUMdqZJ+PL53VWc7lkVUGepCVPDeFBWfkOzFgPpUe1gaWuO9bSAHKhCm7rJsUajQriPaLPXvIJ/Xrj94xnIg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:09.133487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8ae69f5b-81d2-4650-b6d6-4f4f2132a878 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:09.149819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8ae69f5b-81d2-4650-b6d6-4f4f2132a878 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Getting quotas for user 4fda7afc1e204cba8d0e422e1113a694 and project c029cc22b69a4d399385f7e668789433. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:09.207401 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ae69f5b-81d2-4650-b6d6-4f4f2132a878 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.126561 Sep 27 01:33:09.208372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 214/406] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:33:09 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:33:09.219492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db535e35-47fc-4e65-aab0-5fee111758bf tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Calling method '.version_select at 0x7f24d6bd6670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.223589 n-d-859358-1 devstack@n-api.service[128778]: WARNING oslo_db.sqlalchemy.utils [None req-db535e35-47fc-4e65-aab0-5fee111758bf tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:33:09.241910 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db535e35-47fc-4e65-aab0-5fee111758bf tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=0cc68a50cb3343a8ad2563e9c0728864" status: 200 len: 726 microversion: 2.10 time: 0.019479 Sep 27 01:33:09.243039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 215/407] 10.222.0.52 () {60 vars in 1259 bytes} [Tue Sep 27 01:33:09 2022] GET /compute/v2.1/os-keypairs?user_id=0cc68a50cb3343a8ad2563e9c0728864 => generated 726 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:33:09.252783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:09.254355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2012d568-0620-46bc-9606-3c5eb9136348 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Calling method '.version_select at 0x7f24d6a68550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.263079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bd4c707-3b4d-44f1-829b-a6196a77c87e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.450414 Sep 27 01:33:09.266952 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 193/408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:08 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:09.292826 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2012d568-0620-46bc-9606-3c5eb9136348 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2008211163" status: 204 len: 0 microversion: 2.10 time: 0.042251 Sep 27 01:33:09.293439 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 216/409] 10.222.0.52 () {60 vars in 1325 bytes} [Tue Sep 27 01:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2008211163 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:33:09.304793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e05bc3f8-9cb8-4f74-9f2a-bcfead81b23c tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Calling method '.version_select at 0x7f24d6c29280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.371225 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e05bc3f8-9cb8-4f74-9f2a-bcfead81b23c tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692838121?user_id=0cc68a50cb3343a8ad2563e9c0728864" status: 204 len: 0 microversion: 2.10 time: 0.071637 Sep 27 01:33:09.377021 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 194/410] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692838121?user_id=0cc68a50cb3343a8ad2563e9c0728864 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:33:09.382415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.383365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:09.385224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce072161-f824-4532-bdaa-fbc36a95bbd1 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] Calling method '.version_select at 0x7f24d6ce2790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:09.395320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:09.396134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:09.396293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:09.398959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:09.399437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:09.404101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:09.428756 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce072161-f824-4532-bdaa-fbc36a95bbd1 tempest-KeyPairsV210TestJSON-1290731794 tempest-KeyPairsV210TestJSON-1290731794-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707542776?user_id=0cc68a50cb3343a8ad2563e9c0728864" status: 204 len: 0 microversion: 2.10 time: 0.049315 Sep 27 01:33:09.437839 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 195/411] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707542776?user_id=0cc68a50cb3343a8ad2563e9c0728864 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:33:09.445142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:09.981658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:10.015617 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea096295-be98-427d-8fee-8d797d44220b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1319 microversion: 2.1 time: 0.637134 Sep 27 01:33:10.020341 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 217/412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:09 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:10.294735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:10.295355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:10.297215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:10.340070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:10.340634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:10.345961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:10.346806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:10.347180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:10.347618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:10.479448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=28 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:10.983139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:11.000896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3775a0c4-bc2b-4be1-998f-3b09fedf3e5d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.703434 Sep 27 01:33:11.002479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 196/413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:10 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:11.040177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:11.044339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:11.045501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:11.057661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:11.058145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:11.064117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:11.065292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:11.067124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:11.070053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:11.789055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:11.807766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-479ec478-d777-41ca-807f-57579a53174e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1469 microversion: 2.1 time: 0.768216 Sep 27 01:33:11.810053 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 218/414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:11 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1469 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:12.094934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef6874ff-d25e-44ee-a5c2-71b1cc154e43 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] Calling method '.version_select at 0x7f24d6bbbb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:12.113647 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef6874ff-d25e-44ee-a5c2-71b1cc154e43 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.527592 Sep 27 01:33:12.114819 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 197/415] 10.222.0.52 () {60 vars in 1226 bytes} [Tue Sep 27 01:33:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:12.121770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3c75af-947a-4b65-906e-a940e974380a", "tag": "d3e883a5-cf98-42f6-8759-aee348355ab9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:12.143753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.145186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.145955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.171383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] Creating event network-changed:d3e883a5-cf98-42f6-8759-aee348355ab9 for instance 8a3c75af-947a-4b65-906e-a940e974380a on n-h2-859358-1 Sep 27 01:33:12.194429 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f5cf384f-4e12-4e28-9043-1814456050a2 req-f4e37b83-a27e-4f06-9a08-4e4f4cc13efc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077532 Sep 27 01:33:12.195379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 198/416] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:12.202893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:12.203615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:12.227774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.228282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.230774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.233982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.237024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.238423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.254428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:12.254921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:12.262358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.262848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.263283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.263996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.264452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.264876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.318961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:33:12.669085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:12.679466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a1819a7-3087-475d-ad26-0bcfdecfb040 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.482360 Sep 27 01:33:12.681441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 199/417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:12 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:12.689809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cff3b906-df18-4010-b5f2-a94932685f44 tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 204 len: 0 microversion: 2.1 time: 0.839165 Sep 27 01:33:12.689809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 219/418] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:33:11 2022] DELETE /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:33:12.695992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:12.700057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73e6ced7-716d-4add-b676-f590732a0062 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6f80430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:12.700566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:12.714521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.716289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.716723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.717553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:12.718062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:12.718486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:12.880507 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73e6ced7-716d-4add-b676-f590732a0062 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.195878 Sep 27 01:33:12.883007 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 200/419] 10.222.0.52 () {62 vars in 1247 bytes} [Tue Sep 27 01:33:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:12.899772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-360dbef0-e733-4523-acc4-0b6031609c38 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] Calling method '.version_select at 0x7f24d6d29b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:12.938750 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-360dbef0-e733-4523-acc4-0b6031609c38 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.047551 Sep 27 01:33:12.939630 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 201/420] 10.222.0.52 () {60 vars in 1226 bytes} [Tue Sep 27 01:33:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:12.954934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37bd6bd0-75ed-4ef3-aa5d-0f235ec8eba6 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] Action: 'update', calling method: .version_select at 0x7f24d6d3bee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:13.096374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37bd6bd0-75ed-4ef3-aa5d-0f235ec8eba6 tempest-QuotaClassesAdmin257Test-403946403 tempest-QuotaClassesAdmin257Test-403946403-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.149701 Sep 27 01:33:13.099375 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 202/421] 10.222.0.52 () {62 vars in 1247 bytes} [Tue Sep 27 01:33:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:13.197885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:13.207260 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a2249cda-ed03-4d01-97d0-629ca43765b2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1475 microversion: 2.1 time: 0.519278 Sep 27 01:33:13.211151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 220/422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:12 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1475 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:13.703631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:13.704622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:13.722620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:13.723220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:13.723679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:13.726315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:13.726818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:13.727259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:13.956470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8674bdeb-64df-430e-8087-236f01a4ad4a", "tag": "693ae5ec-e710-4404-b8fb-3f41b65a6229"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:13.974679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:13.975157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:13.975587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:14.002044 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] Creating event network-changed:693ae5ec-e710-4404-b8fb-3f41b65a6229 for instance 8674bdeb-64df-430e-8087-236f01a4ad4a on n-h2-859358-1 Sep 27 01:33:14.007318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1d9f0aa2-384d-42a2-98c3-db054413c87f req-a712e325-34bc-4879-a374-b17b871b8250 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347199 Sep 27 01:33:14.008456 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 203/423] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:14.234084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:14.235478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:14.261668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:14.267422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:14.268311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:14.269975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:14.271169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:14.273970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:14.276132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:14.291147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6d193f5-3469-4a62-ba56-00f79da97ffc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.590595 Sep 27 01:33:14.293981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 221/424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:13 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:14.703426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:14.720391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1704ab7-14ec-4c8e-b07f-a607817339f2 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1475 microversion: 2.1 time: 0.493339 Sep 27 01:33:14.721956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 204/425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:14 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:15.101864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c364114-25f7-4300-a6d3-84a640090971", "name": "network-vif-deleted", "tag": "f5d04854-e6cf-478f-9344-c8aacf8a5f11"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:15.112107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:15.177116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.182632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.184748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.225102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] Creating event network-vif-deleted:f5d04854-e6cf-478f-9344-c8aacf8a5f11 for instance 7c364114-25f7-4300-a6d3-84a640090971 on n-h1-859358-1 Sep 27 01:33:15.233495 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0c0ace6a-4b98-4dc3-8a37-ffe1658b771f req-081eb010-ec59-45f7-92af-1c0b442b89e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134468 Sep 27 01:33:15.234358 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 205/426] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:33:15.285049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1826987195", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:15.318920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:15.320100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:15.336057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.340550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.341510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.342477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.344592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.345311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.399818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:15.811062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:15.823902 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3dd4dc1-3bcd-4abb-9397-c8840a6f8123 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.508444 Sep 27 01:33:15.841003 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 206/427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:15 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:15.850337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:15.852459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:15.872746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.873626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.874542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.875517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.876162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.876825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.954940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:15.955430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:15.955928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:15.956319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lazy-loading 'fault' on Instance uuid 7c364114-25f7-4300-a6d3-84a640090971 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:16.031715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:16.040302 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c34e5e1-fb1a-46b0-933a-31472c7a4abd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 200 len: 1309 microversion: 2.1 time: 0.204945 Sep 27 01:33:16.041116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 207/428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:15 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 1309 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:16.655035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:16.655537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:16.656864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:16.657295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:16.657744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:16.672980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=25 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:16.694148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:16.696855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:16.697379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:16.701954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:16.702544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:16.702991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:16.778496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Getting quotas for project 862ef10c99004b439614e74ff0ef1882. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:16.792881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Getting quotas for user d8fe716033ee444e86a10ef605dd79fc and project 862ef10c99004b439614e74ff0ef1882. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:16.817949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:16.823756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:16.849579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:16.850813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:16.861958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:16.863896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:16.872247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:16.878493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:16.879248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:16.879765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:16.892111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2085b39-d2f9-4392-89cc-477381d37449 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875798 Sep 27 01:33:16.893853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 222/429] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:16.907046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b936e25-6a48-4a19-ae6d-97939b3f76f5 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:16.908104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b936e25-6a48-4a19-ae6d-97939b3f76f5 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:17.057239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b936e25-6a48-4a19-ae6d-97939b3f76f5 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:17.070778 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b936e25-6a48-4a19-ae6d-97939b3f76f5 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1219 microversion: 2.1 time: 0.169038 Sep 27 01:33:17.078912 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 223/430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:16 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:17.303726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:17.315819 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32b81306-8476-45d2-91c6-6448b3c0c83c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.469965 Sep 27 01:33:17.318461 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 208/431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:16 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:17.329217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:17.332759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:17.352088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:17.356917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:17.357879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:17.358804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:17.359416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:17.360900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:17.384796 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 HTTP/1.1 Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:17.387308 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:17.388805 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7c364114-25f7-4300-a6d3-84a640090971'} Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:17.390047 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:17.391465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:17.407740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:17.411039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c8e6c2a-45b7-4b85-967a-0ec624a75014 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 404 len: 111 microversion: 2.1 time: 0.091051 Sep 27 01:33:17.413715 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 209/432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:17 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:17.441502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-536216161", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "e586b006-974b-41f8-931d-30e9fc73d562"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:17.581248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] validate_networks() for [('e586b006-974b-41f8-931d-30e9fc73d562', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:17.719704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-867480600", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:17.858122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:18.268736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:18.269430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:18.270129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:18.270909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:18.271379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:18.289885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:18.290380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:18.291180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:18.291935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:18.292395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:18.292826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:18.350908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Getting quotas for project 9cc13c5471ca4f209b88a07caf3669da. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:18.359557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Getting quotas for user 01f32acd5cf4439f9999d4c92b32f8f9 and project 9cc13c5471ca4f209b88a07caf3669da. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:18.378664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:18.382119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:18.469694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-666b11d2-a0fa-4212-9e14-8961b0de780d tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755920 Sep 27 01:33:18.475337 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 210/433] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:18.947539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1525111883", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:19.044339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:19.653248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:19.653831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:19.654168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:19.654577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:19.654989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:19.689775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.690269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.697051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:19.698000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.698492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.698930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:19.719825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:19.720222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:19.720691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:19.721107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:19.721564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:19.742003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:19.742209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.742565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.743175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:19.744938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.762258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.765489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:19.781644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for user 56e5b4943e3c4d31aec5dd4dc2ecac66 and project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:19.803555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:19.816241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Getting quotas for project 9f77a3ccb96a41a6ac99b2d8119f7247. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:19.820088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:19.851117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Getting quotas for user 213bd4f694cf4c01982771714d3dbe13 and project 9f77a3ccb96a41a6ac99b2d8119f7247. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:19.900151 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9571e965-7ef2-4791-804b-7ac71af39bac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.816592 Sep 27 01:33:19.900901 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 224/434] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:19.910649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:19.911558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:19.911758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:19.914002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:19.919095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.919930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.920443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:19.921218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:19.921777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:19.922404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:20.035760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:20.044942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35a60064-889a-4fad-ba43-21998f807e2a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1277 microversion: 2.1 time: 0.142605 Sep 27 01:33:20.046018 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 225/435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:19 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:20.051455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:20.052348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:20.059175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:20.060010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:20.060651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:20.061757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:20.062485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:20.063114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:20.070992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4148a1a7-efc7-4047-acb9-5b370926f917 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594433 Sep 27 01:33:20.072823 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 211/436] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:20.079015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:20.079786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:20.088820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:20.089548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:20.090703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:20.091586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:20.092492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:20.093065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:20.439725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:20.474599 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c139053f-1779-444e-8ce0-dec882cd1249 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.403718 Sep 27 01:33:20.477078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 226/437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:20 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:20.646395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:20.661060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62ebc91a-8e83-4b0a-81f2-a313367aa54a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1271 microversion: 2.1 time: 0.583083 Sep 27 01:33:20.661974 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 212/438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:20 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1271 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:20.678885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3666da39-7de9-4d4c-90b8-1c83cacf3692 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:20.678885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3666da39-7de9-4d4c-90b8-1c83cacf3692 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:21.040149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] Calling method '.version_select at 0x7f24d69dc0d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:21.153279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 could not be found", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:33:21.154548 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] HTTP exception thrown: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] Request method failure captured: Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-floating-ips/958f2ed2-aa2c-48ce-84be-6ba5598f7a79 HTTP/1.1 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLeyoRvnk_Iwh9sDRFQFGnLOGgHq-Sv1Qw3LxO9hWvTacU4Apq0ANWOmbwocHj2E12_2LDQBBt458W5U0z9udCU3lDbdrV6wcibnkCxdQYVyRtgsj83_1atvF0q4Bpux0k6xy4lAnG298ZlPENvJUk6q6IFlg2MdyTn7t4hqukY2Rg Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b2a0bf2613ee494392f45c83f4eaf325 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1407077375 Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:21.165757 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b2a0bf2613ee494392f45c83f4eaf325"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b2a0bf2613ee494392f45c83f4eaf325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b2a0bf2613ee494392f45c83f4eaf325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b2a0bf2613ee494392f45c83f4eaf325", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1407077375 Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b2a0bf2613ee494392f45c83f4eaf325 Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1407077375 Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ce67ce5b0d934a418f109a9136bb9692 Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: exception: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 Sep 27 01:33:21.167070 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '958f2ed2-aa2c-48ce-84be-6ba5598f7a79'} Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:33:21.167834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 could not be found Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fff6befa-d71e-44e6-912a-887253c1f48d'] Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79. Sep 27 01:33:21.169558 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:21.170645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:21.171823 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:21.171823 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 Sep 27 01:33:21.171823 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:21.176482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] Returning 404 to user: Floating IP not found for ID 958f2ed2-aa2c-48ce-84be-6ba5598f7a79 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:21.178134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3666da39-7de9-4d4c-90b8-1c83cacf3692 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:21.178793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af11208b-b0c9-4093-aa48-4d26534f50d7 tempest-FloatingIPDetailsNegativeTestJSON-1407077375 tempest-FloatingIPDetailsNegativeTestJSON-1407077375-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/958f2ed2-aa2c-48ce-84be-6ba5598f7a79" status: 404 len: 111 microversion: 2.1 time: 0.699018 Sep 27 01:33:21.179680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 227/439] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:33:20 2022] GET /compute/v2.1/os-floating-ips/958f2ed2-aa2c-48ce-84be-6ba5598f7a79 => generated 111 bytes in 702 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:21.188678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24be16a2-8288-483a-88c0-cd7fe9714897 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:21.192066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3666da39-7de9-4d4c-90b8-1c83cacf3692 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1210 microversion: 2.1 time: 0.526354 Sep 27 01:33:21.196826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24be16a2-8288-483a-88c0-cd7fe9714897 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:21.210000 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 213/440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:20 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1210 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:21.236996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:21.238459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:21.262867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.265255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.265743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.266495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.266960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.272354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.390333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24be16a2-8288-483a-88c0-cd7fe9714897 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:21.398535 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24be16a2-8288-483a-88c0-cd7fe9714897 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1223 microversion: 2.1 time: 0.217569 Sep 27 01:33:21.415974 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 228/441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:21 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1223 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:21.487785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:21.497381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f22456e-ef4d-40e0-99a1-d1195d69bd32 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1277 microversion: 2.1 time: 0.285925 Sep 27 01:33:21.498152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:21.498764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:21.499825 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 214/442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:21 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:21.510902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.522301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.523093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.537595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.538704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.540603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.688318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:21.689792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:21.703461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.705109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.706932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.709100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:21.710454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:21.711557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:21.974267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:21.985511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec98f326-addb-421b-9cb7-600036a207c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.491108 Sep 27 01:33:21.986874 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 229/443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:21 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:22.090518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:22.101024 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2042176a-ceb2-4570-846d-16868fd7ecc0 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1277 microversion: 2.1 time: 0.418068 Sep 27 01:33:22.120847 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 215/444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:21 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1277 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:22.215199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Action: 'update', calling method: .version_select at 0x7f24d69dc5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:22.217362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:22.218212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:22.235332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.235723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.236174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.236880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.237291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.237738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.395186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.396115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.398142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.401513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.403106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.403752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.446130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:22.522731 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6ee996b-8bfa-4c33-8abd-ec81b9dad191 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30" status: 200 len: 240 microversion: 2.36 time: 0.534403 Sep 27 01:33:22.523592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 230/445] 10.222.0.52 () {62 vars in 1303 bytes} [Tue Sep 27 01:33:21 2022] PUT /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30 => generated 240 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:22.534310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:22.536344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:22.542953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.543793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.544481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.545472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.546205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.546846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.596641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:22.607684 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8d63378-fd8d-4ce9-b566-66409c5a4eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1262 microversion: 2.1 time: 0.396509 Sep 27 01:33:22.609263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 216/446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:22 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1262 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:22.639884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:22.640501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:22.658514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.659533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.661493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.662871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.663687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.665249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.667638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:22.680055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3cd28124-6e2c-4377-b012-394bfc05f428 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1275 microversion: 2.1 time: 0.155161 Sep 27 01:33:22.681684 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 231/447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:22 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:22.697823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Calling method '.version_select at 0x7f24d6ac7ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:22.854219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.858009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.862418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.863628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:22.864420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:22.866117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:22.948835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3334487-9bad-4a0d-af34-ecb35b6976d6 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30/detail" status: 200 len: 672 microversion: 2.36 time: 0.265264 Sep 27 01:33:22.960409 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 232/448] 10.222.0.52 () {60 vars in 1304 bytes} [Tue Sep 27 01:33:22 2022] GET /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30/detail => generated 672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:23.013730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:23.014642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:23.021083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.022007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.022790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.023717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.024377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.025646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.146365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:23.160759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1191dec8-f148-45b8-9286-d0ffb1bb75a0 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.549511 Sep 27 01:33:23.161370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 217/449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:22 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:23.166130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:23.167155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:23.177177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.177922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.179238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.181998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.183674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.184380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.487758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:23.496577 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1ba74da-48ff-4dec-b480-9cbe6537d835 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.486995 Sep 27 01:33:23.502821 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 233/450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:23 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:23.507968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Action: 'update', calling method: .version_select at 0x7f24d69a2670>, body: {"quota_set": {"ram": "2048"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:23.621944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.624047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.627908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.629227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.630018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.630755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.697573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.698487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.699816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.701261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.702084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.702848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.805458 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e609bf6-fbca-4d76-aa6f-63bcb40f1147 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30?user_id=fafc72a2f684458dba7670e902f233c2" status: 200 len: 240 microversion: 2.36 time: 0.301245 Sep 27 01:33:23.808028 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 234/451] 10.222.0.52 () {62 vars in 1384 bytes} [Tue Sep 27 01:33:23 2022] PUT /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30?user_id=fafc72a2f684458dba7670e902f233c2 => generated 240 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:23.817190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:23.829648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3c75af-947a-4b65-906e-a940e974380a", "name": "network-vif-plugged", "status": "completed", "tag": "d3e883a5-cf98-42f6-8759-aee348355ab9"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:23.831706 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b527deea-7e5c-4baa-bd6c-f8180c36ddcb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.669033 Sep 27 01:33:23.851574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 218/452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:23 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:23.860307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:23.861298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:23.862101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.862591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.863023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.872241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.872876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.873454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.874255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.877515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.878165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.885461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] Creating event network-vif-plugged:d3e883a5-cf98-42f6-8759-aee348355ab9 for instance 8a3c75af-947a-4b65-906e-a940e974380a on n-h2-859358-1 Sep 27 01:33:23.895663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ab9d7661-7dd1-4af5-acb4-e372539dd269 req-52b1a497-cbe1-4ab0-a9ef-865e196fdc7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085549 Sep 27 01:33:23.896949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 235/453] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:23.909718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:23.910469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:23.911874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:23.930924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.931591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.932042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:23.932920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:23.934036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:23.934705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.034915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:24.046247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3b55b98-2db4-40df-ad84-6fae9c7bdff6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1268 microversion: 2.1 time: 0.193013 Sep 27 01:33:24.059910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 219/454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:23 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:24.065887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2765e7cc-4fd1-4a66-87a8-d050ffa4a367 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] Calling method '.version_select at 0x7f24d6c25940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:24.142451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:24.154185 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c0a8933-6339-440e-b41b-6f666745773b tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1281 microversion: 2.1 time: 0.256372 Sep 27 01:33:24.156242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 236/455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:23 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:24.190066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:24.190949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:24.204873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.206333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.206770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.209790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.211081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.211557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.257149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2765e7cc-4fd1-4a66-87a8-d050ffa4a367 tempest-QuotasAdminTestV236-1550570088 tempest-QuotasAdminTestV236-1550570088-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30?user_id=fafc72a2f684458dba7670e902f233c2" status: 200 len: 282 microversion: 2.36 time: 0.195660 Sep 27 01:33:24.258936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 220/456] 10.222.0.52 () {60 vars in 1364 bytes} [Tue Sep 27 01:33:24 2022] GET /compute/v2.1/os-quota-sets/1ec9592b75cd43759a722dd4761f1e30?user_id=fafc72a2f684458dba7670e902f233c2 => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:33:24.531135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:24.531759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:24.544203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.546002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.546610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.547491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.548106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.549229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.621838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:24.631761 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a053c4f-ee58-4ade-b7ae-d5af8ff34b48 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.448637 Sep 27 01:33:24.634714 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 237/457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:24 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:24.858533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:24.859383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:24.869487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.872194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.872795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:24.874237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:24.877109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:24.877798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.478562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:25.493281 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93b741cc-e7e1-4326-a638-dc8218340090 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.967375 Sep 27 01:33:25.494558 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 221/458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:24 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:25.500734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:25.501615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:25.508299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.509133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.509829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.510799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.512056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.512710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.541507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:25.545355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:25.556908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86d5393a-768b-457f-916e-c35b6d0820dd tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.702671 Sep 27 01:33:25.560579 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 238/459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:24 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:25.592119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:25.593299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:25.602409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.603330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.604511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.606396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.609616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.610341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.752917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:25.775201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-72c7fed6-4884-435b-8243-e11081538c3e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1281 microversion: 2.1 time: 0.209284 Sep 27 01:33:25.785360 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 239/460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:25 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:25.785360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:25.785360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:25.796317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.796659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.797084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:25.798936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:25.805905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:25.806618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.201014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:26.212839 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-601f2a64-2608-44bb-81eb-19a780aabcf1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.433617 Sep 27 01:33:26.215425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 240/461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:25 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:26.234160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8674bdeb-64df-430e-8087-236f01a4ad4a", "name": "network-vif-plugged", "status": "completed", "tag": "693ae5ec-e710-4404-b8fb-3f41b65a6229"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:26.248331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.248990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.249887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.265173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] Creating event network-vif-plugged:693ae5ec-e710-4404-b8fb-3f41b65a6229 for instance 8674bdeb-64df-430e-8087-236f01a4ad4a on n-h2-859358-1 Sep 27 01:33:26.271349 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-598d2acf-b311-4599-989a-332377a6fcc3 req-f15da527-3873-41f9-b360-76bb025753b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051525 Sep 27 01:33:26.277404 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 241/462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:26.285071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ccbd51-27b9-4522-af89-12f1d9e24398", "tag": "4d688ee8-fd2b-4118-ada6-de55808916a2"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:26.297878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.298747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.299501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.312075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:26.319951 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac3395a3-539a-4101-b020-b31c2d7339f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.824088 Sep 27 01:33:26.326131 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 222/463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:25 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:26.349411 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] Creating event network-changed:4d688ee8-fd2b-4118-ada6-de55808916a2 for instance c5ccbd51-27b9-4522-af89-12f1d9e24398 on n-h1-859358-1 Sep 27 01:33:26.354704 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-466c622e-90a0-4695-9cd7-3505db2feee6 req-e53ffb8d-e666-4615-9a91-7e85d042368d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074572 Sep 27 01:33:26.356282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 242/464] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:26.400048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0", "tag": "fb1fe77b-216c-4f77-8f7b-5f20ba4a4058"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:26.417189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.417863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.418397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.431609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] Creating event network-changed:fb1fe77b-216c-4f77-8f7b-5f20ba4a4058 for instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 on n-h1-859358-1 Sep 27 01:33:26.437516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f83abdfb-15df-4c31-92e6-96f9f9e32f2c req-29c533ea-d860-4e20-85b0-dce808c44e98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041799 Sep 27 01:33:26.438117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 223/465] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:33:26.524664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:26.535132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:26.545712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.546908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.548563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.549434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.550239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.551040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.592759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:26.594921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:26.617592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.619953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.622709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.625528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.627539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.628107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.922573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:26.934210 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f1b1d64-5f38-4d38-b09f-90032472155c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.419816 Sep 27 01:33:26.935343 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 243/466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:26 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:26.942079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:26.942691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:26.949130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.950075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.950754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:26.951452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:26.951901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:26.952320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.149962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:27.166071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-272ab695-b3c2-4445-bcc8-830e1a4ae763 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.581443 Sep 27 01:33:27.168417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:27.179253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e9ea799-07ec-4e40-b979-8e615b017d6e tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.242564 Sep 27 01:33:27.181244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 224/467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:26 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:27.186476 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 244/468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:26 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:27.240614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:27.241241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:27.248861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.249564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.250003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.250707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.251653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.252575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.348234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:27.348871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:27.355713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.356412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.357028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.359194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.359829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.360419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.500486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:27.508812 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d36226d1-6315-4229-8091-0c25bf7a3471 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.272812 Sep 27 01:33:27.510043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 225/469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:27 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:27.751762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:27.771891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06fa1f5c-0442-474a-b240-feeaff9b3fa6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.426489 Sep 27 01:33:27.778477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 245/470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:27 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:27.963155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:27.963989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:27.980753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.981591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.982734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:27.983624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:27.985624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:27.987903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.190333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:28.190941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:28.209824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.210682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.212781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.215427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.218394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.219063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.461611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:28.473550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc01feeb-7b4d-4113-ae2f-f0586281973c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1319 microversion: 2.1 time: 0.513362 Sep 27 01:33:28.474362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 226/471] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:27 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:28.480315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:28.480924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:28.487167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.487841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.488541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.489244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.489730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.490306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.783147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:28.791268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:28.798296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23d62653-6883-41c8-836d-5f110d94479b tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.610096 Sep 27 01:33:28.798836 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 246/472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:28 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:28.804141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647d420a-9dd2-4d47-acc4-ece1000d8365", "tag": "140d4304-1de9-44e9-a328-06cf241e556c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:28.816061 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6de37bfa-c6ff-4680-ae78-038a724769ab tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.340471 Sep 27 01:33:28.824826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.825655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.826344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.836468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 227/473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:28 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:28.842500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:28.843308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:28.849751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.850894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.851492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.851628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] Creating event network-changed:140d4304-1de9-44e9-a328-06cf241e556c for instance 647d420a-9dd2-4d47-acc4-ece1000d8365 on n-h2-859358-1 Sep 27 01:33:28.852485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.853097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.853759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.862663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-34988e3d-d686-4376-aacf-6ca819d6de72 req-35e9fb45-9f59-42ec-9ac3-b3687d1de1f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062340 Sep 27 01:33:28.863581 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 247/474] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:28.878925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:28.879954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:28.906057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.907099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.907983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:28.908912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:28.909888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:28.910528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.168889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:29.179592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2904ae2c-11d3-41cd-93f7-3a67871d27f1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.341800 Sep 27 01:33:29.180390 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 228/475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:28 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:29.241123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e1eab0-0c30-4c73-b103-93f3db9bd0a2", "tag": "fc90baee-3728-4dd7-b44c-591a4dbb37f5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:29.245241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:29.256279 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dff3c2a6-c61c-4850-81fd-0090c13656fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.390141 Sep 27 01:33:29.256877 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 248/476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:28 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:29.262928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.266108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.266720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.300601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] Creating event network-changed:fc90baee-3728-4dd7-b44c-591a4dbb37f5 for instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 on n-h2-859358-1 Sep 27 01:33:29.305831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2196f46b-852a-4833-a8cf-450e1926a966 req-abd807fa-daa6-4a03-9ea6-4cac2f481c59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073671 Sep 27 01:33:29.318125 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 229/477] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:29.498103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:29.498970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:29.505979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.506707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.507406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.508292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.508743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.509326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.821847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:29.823222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:29.826276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:29.834134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.834815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.835420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.836457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.837163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.837929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.912001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:29.926806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5faad99-ed99-4f96-b7fd-69091fd3c18b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1469 microversion: 2.1 time: 0.432570 Sep 27 01:33:29.929024 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 249/478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:29 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:29.937164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:29.938362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:29.949884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.950937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.952056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:29.953107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:29.955758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:29.956381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.024297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.032341 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f1b5767-5269-4dcf-aae4-98bc12aaa6e7 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.215613 Sep 27 01:33:30.033219 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 230/479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:29 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:30.050334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:30.051051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:30.057449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.059509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.059946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.060655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.061108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.062136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.177873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.188714 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e396f38-0604-4b79-832c-e869ff89ebd4 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.258296 Sep 27 01:33:30.190011 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 250/480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:29 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:30.210033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:30.211044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:30.219083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.220726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.220853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.221654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.222161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.222594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.282865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.291971 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fe1024a-7057-442b-8db2-f4125d562a80 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1468 microversion: 2.1 time: 0.256974 Sep 27 01:33:30.292680 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 231/481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:30 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1468 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:30.297678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:30.298551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:30.305125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.305838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.306455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.307312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.308477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.308930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.492300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.502660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6475fa32-d6f3-4e0c-af09-4a1b274a97e0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.207879 Sep 27 01:33:30.503251 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 232/482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:30 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:30.513514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:30.521244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.534674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Searching by: {'reservation_id': 'r-ugf0r936', 'deleted': False, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:33:30.550335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.550819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.551252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.552028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.552410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.552830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:30.554091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.567471 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64b1b2ae-93ba-4459-a958-4980c041cda7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.365136 Sep 27 01:33:30.568096 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 251/483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:30 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:30.738564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:33:30.907440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:30.917252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:30.918691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:30.919345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.057235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:31.058705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:31.074443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.086925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.087631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.088793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.090169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.090760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.176355 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fab6ea8-17f9-402c-a514-cb515a8f048a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-ugf0r936" status: 200 len: 2930 microversion: 2.1 time: 0.671973 Sep 27 01:33:31.178001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 233/484] 10.222.0.52 () {58 vars in 1197 bytes} [Tue Sep 27 01:33:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ugf0r936 => generated 2930 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:31.319957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:31.328423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84828fad-98bf-4582-b645-36e0408ccb52 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.276153 Sep 27 01:33:31.330186 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 252/485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:31.335016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:31.362620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.server_groups [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Querying cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) for 2 instances {{(pid=128778) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 27 01:33:31.363547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.364271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.364883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.397728 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab6028f1-27af-4ee5-a602-620a6fab881a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/5e7f8592-ec73-4530-a83a-74cdd658ea7c" status: 200 len: 266 microversion: 2.1 time: 0.066209 Sep 27 01:33:31.398886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1235395699", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:31.399438 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 253/486] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/os-server-groups/5e7f8592-ec73-4530-a83a-74cdd658ea7c => generated 266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:31.408398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:31.409493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:31.416606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.417372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.417999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.419003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.419458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.419888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.482915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:31.483457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:31.484028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:31.484528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:31.485013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:31.494364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.495102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.496275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.497077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.497922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.498562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.513520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:31.519589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Getting quotas for project 05ede12f6bb04b979efdd776e2efa760. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:31.525848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Getting quotas for user f97908a2d1e94485bab269f086c384d7 and project 05ede12f6bb04b979efdd776e2efa760. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:31.540710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:31.543198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:31.599269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d05cb0d3-2d7f-4cfd-a719-a80b7405544f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.419760 Sep 27 01:33:31.599967 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 234/487] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:33:31.604517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ccbd51-27b9-4522-af89-12f1d9e24398", "name": "network-vif-plugged", "status": "completed", "tag": "4d688ee8-fd2b-4118-ada6-de55808916a2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:31.614282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.614761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.615200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.626930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] Creating event network-vif-plugged:4d688ee8-fd2b-4118-ada6-de55808916a2 for instance c5ccbd51-27b9-4522-af89-12f1d9e24398 on n-h1-859358-1 Sep 27 01:33:31.631968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-56a98a1f-c8cc-462f-8e84-15ad46035d2d req-79725815-a4e8-4b89-ae0b-04512ed18d26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030819 Sep 27 01:33:31.632729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 235/488] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:31.638558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:31.639260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:31.641150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:31.645927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.646426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.646860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.647561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.648012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.648660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.670485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-828ef5b2-86c5-43b0-9104-39e082f8fc33 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.269759 Sep 27 01:33:31.672574 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 254/489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:31.678054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:31.679228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:31.687738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.688548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.689165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.690584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:31.691224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:31.691864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:31.989867 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-906cc29e-c8a4-442d-9252-8425ef1064bb tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 200 len: 1620 microversion: 2.1 time: 0.355591 Sep 27 01:33:32.001275 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 236/490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 1620 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:32.001275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:32.001275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:32.005265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.005701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.006192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.006630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.007481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.007955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.010854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.015748 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc6b12c2-e87c-4638-adbb-2c4b0cbc2bd5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.341888 Sep 27 01:33:32.018035 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 255/491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:32.027860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:32.030339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:32.181871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.192346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.196763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.215543 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5512a208-b145-49e1-84bf-b3e8002df31c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "PUT /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1359 microversion: 2.75 time: 0.196219 Sep 27 01:33:32.216160 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 256/492] 10.222.0.52 () {62 vars in 1297 bytes} [Tue Sep 27 01:33:32 2022] PUT /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:32.222340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:32.222958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:32.230549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.231094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.231718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.232606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.233202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.233790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.473747 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97bc111e-8f2f-4b97-99aa-cdfff1585e1a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1619 microversion: 2.1 time: 0.256421 Sep 27 01:33:32.483275 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 257/493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:32 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1619 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:32.492430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:32.493046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:32.497720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:32.509720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.510390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.511040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.512007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.513220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.513822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.632036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.642678 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e802d0ba-d4d3-42e9-a668-02befa10066a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.648558 Sep 27 01:33:32.644294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 237/494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:31 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:32.654398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:32.656185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:32.664359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.665086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.665731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.667131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:32.667795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:32.668227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:32.938722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.942297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:32.953149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.958597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:32.974534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0777ba5-21ed-4562-a5d1-08fe5997a2a5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1355 microversion: 2.75 time: 0.487365 Sep 27 01:33:32.975013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 258/495] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:32 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1355 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:32.985886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: .version_select at 0x7f24d69a2700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2116836014", "policies": ["anti-affinity"]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:33.016403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:33.022876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:33.028943 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7362a51-5c23-4837-b017-23a3ceebca2a tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1319 microversion: 2.1 time: 0.379999 Sep 27 01:33:33.030968 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 238/496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:32 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:33.043120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:33.046438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:33.049199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.071357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.074790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.076210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.076652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.077637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.088929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.089585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.161722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.167908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.182422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ec5a2ad-1e3c-47f0-b7e0-de295a493ab5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.206317 Sep 27 01:33:33.183539 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 259/497] 10.222.0.52 () {60 vars in 1174 bytes} [Tue Sep 27 01:33:32 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:33.188357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:33.189144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:33.195978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.196464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.196898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.197656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.198052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.198533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.256478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:33.265177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a98af5e8-b947-43c4-a0de-9cecd3f26caa tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.232817 Sep 27 01:33:33.266709 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 239/498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:33 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:33.301908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-84780720", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e1941332-c20c-4962-952c-dc23db4cbc95"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:33.336927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:33.345322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c8c2ac1-9cf3-4b19-bf6a-f62424dd3193 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.160553 Sep 27 01:33:33.357111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 260/499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:33 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:33.359385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:33.584162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:33.584583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:33.585056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:33.585496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:33.585908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:33.600763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.601240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.601707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.602439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.602889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.603310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.620067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.625290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.637883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 2 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:33.640228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:33.668217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:33.668838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:33.676399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.677402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.678183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.678891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.679338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.680075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.689135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.696925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.734463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.734748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:33.739534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.754800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=9950be27-4e7c-42ea-b32e-90972afe3d31,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:33.810140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.815360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.830388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:33.838670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83ccfb0f-8498-4cc0-93b0-61c08e44e907 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.174861 Sep 27 01:33:33.853796 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 261/500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:33 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:33.859416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0", "name": "network-vif-plugged", "status": "completed", "tag": "fb1fe77b-216c-4f77-8f7b-5f20ba4a4058"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:33.865363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:33.868894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.869470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.869896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.871341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'server_group_members'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:33.881036 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] Creating event network-vif-plugged:fb1fe77b-216c-4f77-8f7b-5f20ba4a4058 for instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 on n-h1-859358-1 Sep 27 01:33:33.885801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d0aaea8c-b647-46e0-bc71-bc4777ef7e6a req-96d95846-6714-46c0-9982-aab5b3c2db03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Sep 27 01:33:33.886928 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 262/501] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:33.906982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cdc8143f-daf8-45f5-a1f6-ae6afb5d6f9f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.608890 Sep 27 01:33:33.907571 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 240/502] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 27 01:33:33.916054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:33.921221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:33.921794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Searching by: {'deleted': False, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:33:33.938571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.939052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.939590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.940220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:33.940667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:33.941088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:33.968212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:33:33.998577 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91c85921-5133-49a6-b509-c402b0c3afd5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.086404 Sep 27 01:33:33.999286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 263/503] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:33:33 2022] GET /compute/v2.1/servers => generated 1662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:34.010072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.010908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.013602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a9d06fb-1699-4e62-9a3b-5e7f8ddc7c88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.014590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a9d06fb-1699-4e62-9a3b-5e7f8ddc7c88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.018811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.019356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.019848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.020612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.021133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.021650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.070752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a9d06fb-1699-4e62-9a3b-5e7f8ddc7c88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.079654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a9d06fb-1699-4e62-9a3b-5e7f8ddc7c88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1217 microversion: 2.1 time: 0.070131 Sep 27 01:33:34.080301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 264/504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:34.089103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.090114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.100702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.101262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.101802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.110331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.110820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.111641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.156895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.169860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.171673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.186266 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa85ffed-c247-45db-b1ed-df3bf1c81c13 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1417 microversion: 2.75 time: 0.182253 Sep 27 01:33:34.197098 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 241/505] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1417 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:34.261407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.269490 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33f48166-3b52-4232-96a8-8710848f0358 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1469 microversion: 2.1 time: 0.187477 Sep 27 01:33:34.289504 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 265/506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:34.294646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:34.295523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.296232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.296890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.303161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.303656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.304087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.304777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.305218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.305673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.307243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.308944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.309541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.312531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.313224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.314022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.429562 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8cb2bc9f-304c-424a-b121-6d58cd9f1bbd tempest-DeleteServersAdminTestJSON-1867707450 tempest-DeleteServersAdminTestJSON-1867707450-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398/action" status: 202 len: 0 microversion: 2.1 time: 0.138861 Sep 27 01:33:34.430735 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 266/507] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:33:34 2022] POST /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:33:34.440270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.441236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.460212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.461239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.461930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.463080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.463949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.465427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.691110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.704428 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6830c3ae-bc6b-46b7-82aa-253d68aa15f5 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.420340 Sep 27 01:33:34.704784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.705743 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 242/508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:34.719490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.720319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.722434 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1d305a9-c543-4838-bd6a-3e055857fa27 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.289990 Sep 27 01:33:34.723764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 267/509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:34.727715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.728194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.728880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.729565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.730614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.731301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.761981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:34.765581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.766071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.766502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.766951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lazy-loading 'fault' on Instance uuid c5ccbd51-27b9-4522-af89-12f1d9e24398 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:34.805630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e313beff-698e-434a-8ba0-42ad0de30f2f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d68ce550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.867417 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e313beff-698e-434a-8ba0-42ad0de30f2f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319" status: 200 len: 662 microversion: 2.1 time: 0.065637 Sep 27 01:33:34.868368 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 268/510] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:33:34.878610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.879223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:34.885780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.886777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.887207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.887900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:34.888352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:34.888770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:34.938217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:34.946186 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-feeeeba9-e2c7-4eb8-b239-e3b6335d511e tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1452 microversion: 2.1 time: 0.239213 Sep 27 01:33:34.947033 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 243/511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:34.952336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0219d35a-7760-45e6-87b4-b54a61dbcb6e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6bf4ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:34.995443 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0219d35a-7760-45e6-87b4-b54a61dbcb6e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319" status: 200 len: 662 microversion: 2.1 time: 0.046759 Sep 27 01:33:34.996109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 244/512] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319 => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:35.000777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.001661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.008959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.009561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.010072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.011339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.012025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.012659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.029740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.038007 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1952d5a7-cd26-4f99-926e-fedbe438976f tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.168676 Sep 27 01:33:35.038643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 269/513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:34 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:35.042390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:33:35.103490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.104222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.110381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.110929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.111361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.112041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.112517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.112899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.118312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d9600aa-2fcf-4379-b5d8-e251c19e2b45 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 204 len: 0 microversion: 2.1 time: 0.120913 Sep 27 01:33:35.119072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 245/514] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:33:34 2022] DELETE /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:33:35.127935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.128654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.136531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.137022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.137547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.138266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.138800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.139466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.182594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.183221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.183665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.184123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lazy-loading 'fault' on Instance uuid c5ccbd51-27b9-4522-af89-12f1d9e24398 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:35.188646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.196207 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-540cbf8c-b34e-4c95-b43f-67e245f63138 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1221 microversion: 2.1 time: 0.096540 Sep 27 01:33:35.196754 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 270/515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:35 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:35.216241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.217082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.223054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.223532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.223964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.224645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.225094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.225542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.294409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.302374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.303810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.305454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.309211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc916a8e-7cdb-47b1-ba1e-7ad6092f574f tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1417 microversion: 2.75 time: 0.097356 Sep 27 01:33:35.309985 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 271/516] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:35 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1417 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:33:35.315506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35e32cea-698e-4db7-9b7a-54b51a544a75 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1458 microversion: 2.1 time: 0.191994 Sep 27 01:33:35.326578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 246/517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:35 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1458 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:35.753095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.756164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:35.757038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.760736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:35.769359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.769852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.770282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.770980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.771429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.771841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.773890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.774756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.775265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.776202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.776760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.777216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.917735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.925599 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4a253f9-8804-4892-a574-626499386e4b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.176375 Sep 27 01:33:35.926165 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 247/518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:35 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:35.930878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647d420a-9dd2-4d47-acc4-ece1000d8365", "name": "network-vif-plugged", "status": "completed", "tag": "140d4304-1de9-44e9-a328-06cf241e556c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:35.931722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:35.940584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:35.940742 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-480f2244-1e5b-499c-9c54-701858e55277 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.196066 Sep 27 01:33:35.941055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:35.941265 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 272/519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:35 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:35.941803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:35.952586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] Creating event network-vif-plugged:140d4304-1de9-44e9-a328-06cf241e556c for instance 647d420a-9dd2-4d47-acc4-ece1000d8365 on n-h2-859358-1 Sep 27 01:33:35.957617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e8ab16ed-68e1-48f0-bfcc-4ac2af00b046 req-a5228bfa-fc34-4ea7-87f4-ab9214e6e820 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030202 Sep 27 01:33:35.958174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 248/520] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:36.061064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.061806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.067616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.068094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.068516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.069196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.069664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.070085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.228536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.230145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.236631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.237223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.237776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.238699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.239375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.240065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.250995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.260989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e62cc973-b112-49da-b871-682f30e8bda9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.203610 Sep 27 01:33:36.262119 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 273/521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:36.320298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.328941 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b2953c1-026f-4500-a40a-8af8b46f333d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1269 microversion: 2.1 time: 0.104562 Sep 27 01:33:36.329960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 249/522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:36.338069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.338871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.349087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.349873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.350519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.351684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.352128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.352593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.352959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.353377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.359814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.360297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.361139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.362062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.362821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.363400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.402925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.403773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.405455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.407040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lazy-loading 'fault' on Instance uuid c5ccbd51-27b9-4522-af89-12f1d9e24398 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:36.456800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.466921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.468355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.473365 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0d764ff-dea3-4bc5-a7eb-62e81caa96ad tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1417 microversion: 2.75 time: 0.140183 Sep 27 01:33:36.473934 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 274/523] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1417 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:36.478221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6948a292-4c9e-4bb1-9812-29a5c2f6edb3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69319d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.529256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6948a292-4c9e-4bb1-9812-29a5c2f6edb3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92" status: 200 len: 662 microversion: 2.1 time: 0.054282 Sep 27 01:33:36.531758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 275/524] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:36.550535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-57739456-2ed6-488c-a74a-101d523b676f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67fb820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.602232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-57739456-2ed6-488c-a74a-101d523b676f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92" status: 200 len: 662 microversion: 2.1 time: 0.055563 Sep 27 01:33:36.603645 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 276/525] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92 => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:36.604975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:36.614508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73f7f245-d75d-4840-9917-1c6807475e84 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1458 microversion: 2.1 time: 0.269820 Sep 27 01:33:36.615577 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 250/526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1458 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:36.948871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.949444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.956542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.957041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.957493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.958181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.958623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.959041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.963048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:36.963655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:36.970863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.971346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.971956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:36.972740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:36.973193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:36.974135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.102550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.110533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.110748 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ef2a7672-58a4-4005-bbd0-35bde42682e1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1310 microversion: 2.1 time: 0.165734 Sep 27 01:33:37.111323 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 277/527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:37.120607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38830e71-8680-4882-9e2c-9cbb0657fc26 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.161319 Sep 27 01:33:37.121236 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 251/528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:36 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:37.285245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:37.285893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:37.291735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.292209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.292639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.293319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.294286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.294713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.358914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:37.359805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:37.370857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.372495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.373125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.374040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.374491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.374912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.488414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.498480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0967c154-3eef-4e9b-aad4-e1b366addfda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1319 microversion: 2.1 time: 0.216493 Sep 27 01:33:37.499238 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 278/529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:37 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:37.504235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:37.504822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:37.514688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.515530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.516564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.517800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.518537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.518959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.537066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:37.579520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.594627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.599201 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afe281f0-2cc0-4be0-8a58-b9d0d65f1126 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1275 microversion: 2.1 time: 0.246100 Sep 27 01:33:37.600917 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 252/530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:37 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:37.613917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.615597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:37.624158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2fcd69ca-94eb-42cc-925b-73fe24fb4581 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1438 microversion: 2.75 time: 0.123508 Sep 27 01:33:37.634261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 279/531] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:37 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:37.641582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:37.642498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:37.653671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.658458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.659249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.662042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:37.662475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.662951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.663388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.666574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:37.676812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.677518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.677999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.679988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.680702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.681090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.751595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:37.752244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:37.752694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:37.753330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lazy-loading 'fault' on Instance uuid c5ccbd51-27b9-4522-af89-12f1d9e24398 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:37.799629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:37.800056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:37.800550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:37.800930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:37.801351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:38.020836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:38.038802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.039046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.039488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.043272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.046339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.047081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.165179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.175448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.179350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.194695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8d1b625d-c6fb-46dc-9f28-7c12f67e95fc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "POST /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3/action" status: 202 len: 1495 microversion: 2.75 time: 0.539274 Sep 27 01:33:38.195503 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 280/532] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:33:37 2022] POST /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3/action => generated 1495 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 27 01:33:38.199836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:38.202004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:38.223745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.224803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.228456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.229674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.230364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.232152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.449210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f32acd5cf4439f9999d4c92b32f8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc13c5471ca4f209b88a07caf3669da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.466773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c5940ae-1c35-48b6-a6e3-2404fbc6edd9 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 200 len: 1458 microversion: 2.1 time: 0.829710 Sep 27 01:33:38.473373 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 253/533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:37 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 1458 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:38.485674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:38.486667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:38.499948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.504257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.505032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.510340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.511142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.511833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.752636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.755492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:38.763497 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0287b866-ea80-4390-96ba-5636cfa51a9f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.288517 Sep 27 01:33:38.770525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 254/534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:38 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:38.774344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.788065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5adb9963-077f-4938-9ac9-d4ee9b4e3ef4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1493 microversion: 2.1 time: 0.591624 Sep 27 01:33:38.788666 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 281/535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:38 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1493 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:38.790422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:38.791936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:38.796623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3f0c7bf-9ce1-48df-80ab-d92fce35898e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69a2dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:38.810406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.811337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.811782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.812514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.813287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.813751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.863687 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3f0c7bf-9ce1-48df-80ab-d92fce35898e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b" status: 200 len: 662 microversion: 2.1 time: 0.073899 Sep 27 01:33:38.864264 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 282/536] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:38 2022] GET /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:38.880021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:38.888849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:38.900724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.901763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.902232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.905742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:38.906858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:38.908605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:38.937124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.956877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.958613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:38.977649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f8aad2f-05f7-433e-8fdf-d80653dae940 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.210031 Sep 27 01:33:38.978438 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 255/537] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:38 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:38.991442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ccbd51-27b9-4522-af89-12f1d9e24398", "name": "network-vif-deleted", "tag": "4d688ee8-fd2b-4118-ada6-de55808916a2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:39.022451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.022955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.023398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.036172 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] Creating event network-vif-deleted:4d688ee8-fd2b-4118-ada6-de55808916a2 for instance c5ccbd51-27b9-4522-af89-12f1d9e24398 on n-h1-859358-1 Sep 27 01:33:39.051137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5ed0d27a-9e4c-4c95-b6ab-5f2ff53bb27f req-81206aae-c31b-4f08-b154-246505a40783 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071285 Sep 27 01:33:39.051825 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 256/538] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:39.057272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:39.057930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:39.064752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.065475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.066103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.066992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.067609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.068303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.234330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:39.246615 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09f2187c-f26b-4b63-98c9-edbcec3a594b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1468 microversion: 2.1 time: 0.381311 Sep 27 01:33:39.247707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 283/539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:38 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1468 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:39.313921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:39.324353 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de10b7a8-d9bf-496c-9426-f5362af5c5d2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.270966 Sep 27 01:33:39.325998 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 257/540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:39 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:39.330884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fefd721-e072-47f7-bbab-5e90d1e6e0d8 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6bf4310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:39.386404 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fefd721-e072-47f7-bbab-5e90d1e6e0d8 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b" status: 200 len: 662 microversion: 2.1 time: 0.058130 Sep 27 01:33:39.387827 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 258/541] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:33:39 2022] GET /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:39.564367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1671801900", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:39.567921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:39.568214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:39.568439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:39.575942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.576440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.576876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.577608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.578065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.578494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.584683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.585200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.585659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.587188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.587649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.588318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.658522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lazy-loading 'flavor' on Instance uuid 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:39.705882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Going to try to live migrate instance to tempest-host-1671801900 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:33:39.712692 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] HTTP exception thrown: Compute host tempest-host-1671801900 could not be found. Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Request method failure captured: Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0/action HTTP/1.1 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 107 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLazHqybrGkPOKMCEOHyLh82x_dRg8N6tg2nvesA_zokVZpz5DQMLemh2pacsq0_nVndtgjaJ_GghxcYvWSBboUP8vRQeOa5bwpA8jHVxY8_1b8xVQxGCUu8hbzKFfDFcj2Kzx73HukxUtq9J48YJ4b3ybpTf7OE7ZeiSuE5isbCjc Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: abd5c40eca4448df966c442cd1ba6a08 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:33:39.717085 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abd5c40eca4448df966c442cd1ba6a08", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: abd5c40eca4448df966c442cd1ba6a08 Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationNegativeTest-1091392320-project-admin Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: adce223ef0fd4856b5b1ed2270c4a970 Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationNegativeTest-1091392320-project-admin Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: {"os-migrateLive": {"host": "tempest-host-1671801900", "block_migration": true, "disk_over_commit": false}} Sep 27 01:33:39.718685 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: exception: Compute host tempest-host-1671801900 could not be found. Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0', 'body': {'os-migrateLive': {'host': 'tempest-host-1671801900', 'block_migration': True, 'disk_over_commit': False}}} Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:33:39.719531 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1671801900 could not be found. Sep 27 01:33:39.720847 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1671801900 could not be found. Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.722802 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1671801900 could not be found. Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Returning 400 to user: Compute host tempest-host-1671801900 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f195e6ce-bb2f-4406-a007-403a05c5a533 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0/action" status: 400 len: 100 microversion: 2.1 time: 0.328820 Sep 27 01:33:39.724380 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 259/542] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Sep 27 01:33:39 2022] POST /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0/action => generated 100 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:33:39.725089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:39.725089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:39.731257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.731741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.732175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.732872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.733324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.733787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.751877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 HTTP/1.1 Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:39.754068 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:39.755602 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c5ccbd51-27b9-4522-af89-12f1d9e24398'} Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:39.756580 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:39.758065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:39.759620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:39.759620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25da6f38-0a7b-4f89-9f51-834613d14b62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 404 len: 111 microversion: 2.1 time: 0.035487 Sep 27 01:33:39.759620 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 260/543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:39 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:39.769534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1538517052", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:39.825614 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08ad4d87-a235-42fd-9363-c8e5cd475653 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1644 microversion: 2.1 time: 0.575244 Sep 27 01:33:39.829784 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 284/544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:39 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1644 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:39.829972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:39.852466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:39.859350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:39.873054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.878459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.879995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:39.881718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:39.882418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:39.883077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.116644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:40.140657 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac630816-08c9-40f8-878d-17f3ad3610a7 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1468 microversion: 2.1 time: 0.307637 Sep 27 01:33:40.155467 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 285/545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:39 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:40.182333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.184941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.203691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.204505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.205128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.207569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.208225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.210505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.236703 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 HTTP/1.1 Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:40.246471 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.248503 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'c5ccbd51-27b9-4522-af89-12f1d9e24398'} Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:40.249635 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.251333 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.255196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:40.257795 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7991db74-3d07-4edd-8adb-753a34336f62 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 404 len: 111 microversion: 2.1 time: 0.100838 Sep 27 01:33:40.264027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 286/546] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:33:40 2022] DELETE /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:40.274130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.274952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.276617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:40.277041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:40.277781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:40.278455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:40.279031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:40.282914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.283566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.284419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.285279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.286466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.287082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.300140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.300614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.301057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.303714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.306591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.307602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.355019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Getting quotas for project d8306b6829dd47f28c763765aa7895a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:40.361627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Getting quotas for user 98a950fcfbd24116b873d5be27643e9a and project d8306b6829dd47f28c763765aa7895a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:40.377773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:40.380483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:40.443902 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37bcc302-3021-415d-90d3-79536ad99591 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681796 Sep 27 01:33:40.445068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 261/547] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:40.454270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.455099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.476535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.476535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.479981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.481646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.481802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.482234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.616991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:40.626564 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3dd335c-9bd0-447a-94c4-bb940b5dd8cb tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.361207 Sep 27 01:33:40.629999 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 287/548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:40 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:40.634970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.638672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.653980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.655407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.656503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.657470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.658267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.659172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.755863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:40.768986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:40.783221 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f70c7c9f-90a3-4d26-ad0a-50bdea9df3ee tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1644 microversion: 2.1 time: 0.331838 Sep 27 01:33:40.784369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 262/549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:40 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1644 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:40.787129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:40.789493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.790302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: c5ccbd51-27b9-4522-af89-12f1d9e24398] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.799200 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-648a77ea-aeb7-4442-9af7-a36dcba2688d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.167836 Sep 27 01:33:40.802536 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 288/550] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:40 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:40.815475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.816205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.816808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.817708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.818513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.819096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.819593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1334378231", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:40.849160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 HTTP/1.1 Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:40.863540 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.865157 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c5ccbd51-27b9-4522-af89-12f1d9e24398'} Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:40.866090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. Sep 27 01:33:40.867563 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:40.868862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance c5ccbd51-27b9-4522-af89-12f1d9e24398 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:40.868862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-702b2d0c-baca-41d9-acfb-1c941f4e1377 tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398" status: 404 len: 111 microversion: 2.1 time: 0.079798 Sep 27 01:33:40.871082 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 263/551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:40 2022] GET /compute/v2.1/servers/c5ccbd51-27b9-4522-af89-12f1d9e24398 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:40.876552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:40.877202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:40.888901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.889425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.890082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.890791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:40.891276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:40.891866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:40.915511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:41.177572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:41.187280 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6393529f-8e89-434d-b252-11a640623c0f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.314320 Sep 27 01:33:41.188736 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 264/552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:40 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:41.193658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e1eab0-0c30-4c73-b103-93f3db9bd0a2", "name": "network-vif-plugged", "status": "completed", "tag": "fc90baee-3728-4dd7-b44c-591a4dbb37f5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:41.204885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.205966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.206534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.218713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] Creating event network-vif-plugged:fc90baee-3728-4dd7-b44c-591a4dbb37f5 for instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 on n-h2-859358-1 Sep 27 01:33:41.223846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4a29949c-1f37-4d7c-815b-0ac92a303982 req-7c6b6e1d-aecb-45c9-8c30-13bfc0ec0428 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Sep 27 01:33:41.224607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 265/553] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:41.231658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-84651095", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:41.296097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:41.623097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:41.623803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:41.624381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:41.624881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:41.625514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:41.634442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=69,nova_cell0:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:41.636378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.637298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.638217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.639166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:41.639634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:41.640066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:41.640335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.640456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:41.640854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:41.640953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.641498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.645152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:41.650890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.651373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.651806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.652598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.653102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.653553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.674080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Getting quotas for project d8306b6829dd47f28c763765aa7895a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:41.678382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Getting quotas for project 862ef10c99004b439614e74ff0ef1882. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:41.682885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Getting quotas for user 98a950fcfbd24116b873d5be27643e9a and project d8306b6829dd47f28c763765aa7895a5. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:41.685053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Getting quotas for user d8fe716033ee444e86a10ef605dd79fc and project 862ef10c99004b439614e74ff0ef1882. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:41.697119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:41.698217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:41.699571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:41.701169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:41.751962 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7aff5f4-88cb-44df-9213-f8185a9725c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525805 Sep 27 01:33:41.752771 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 266/554] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:41.756969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:41.760691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.761175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.761298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ddefbfc-3c72-4fb2-a8b7-1496b78700b1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954372 Sep 27 01:33:41.761625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.762559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.763243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.763812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.768944 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 289/555] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:41.774309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:41.775420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:41.782392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.782976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.783358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.784377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.784829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.785254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.794952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58eb4b41-265f-47d6-990f-7f9d4ef9e0e4 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041246 Sep 27 01:33:41.795547 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 267/556] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:33:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:41.800097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7712ee57-f899-4f07-8845-13195e4ed128", "tag": "fed7f93a-ba1d-4770-bc7d-03775dec547a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:41.800896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 HTTP/1.1 Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:41.802621 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:41.804020 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7c364114-25f7-4300-a6d3-84a640090971'} Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:41.804819 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:41.806621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:41.807834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:41.807834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e076cbd-bff0-40d6-9e32-783974d892fa tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 404 len: 111 microversion: 2.1 time: 0.034018 Sep 27 01:33:41.807834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 290/557] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:33:41 2022] DELETE /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:41.810348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:41.810957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:41.811971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.812578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.812872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.819627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.820113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.820541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.821229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.821701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.822138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.832514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] Creating event network-changed:fed7f93a-ba1d-4770-bc7d-03775dec547a for instance 7712ee57-f899-4f07-8845-13195e4ed128 on n-h2-859358-1 Sep 27 01:33:41.837690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f049e741-5858-4c3b-ae49-2443ebf270ae req-54d2a3a7-92c6-4e7f-89c5-bfca1837a7a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041016 Sep 27 01:33:41.838619 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 268/558] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:41.844712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9950be27-4e7c-42ea-b32e-90972afe3d31", "tag": "2b4b6147-9cf6-4c0a-ab8e-9072a427c434"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:41.855116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:41.855833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:41.857319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:41.871100 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] Creating event network-changed:2b4b6147-9cf6-4c0a-ab8e-9072a427c434 for instance 9950be27-4e7c-42ea-b32e-90972afe3d31 on n-h1-859358-1 Sep 27 01:33:41.877814 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b6d148f6-7526-4ab0-a8ea-af8c1e27aff6 req-25630e93-523b-4898-bd7c-e83fccf03a5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037375 Sep 27 01:33:41.878739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 269/559] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:41.885600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-398823bc-a2a4-480c-baf9-ad81622b2d8c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:41.886573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-398823bc-a2a4-480c-baf9-ad81622b2d8c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:41.945762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-398823bc-a2a4-480c-baf9-ad81622b2d8c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:41.954722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-398823bc-a2a4-480c-baf9-ad81622b2d8c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1216 microversion: 2.1 time: 0.074519 Sep 27 01:33:41.955797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 270/560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:41 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:41.972751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf17c566-a9f6-43ab-a4a8-713499841bf9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:41.973414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf17c566-a9f6-43ab-a4a8-713499841bf9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:41.984003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:42.038735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf17c566-a9f6-43ab-a4a8-713499841bf9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.050125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf17c566-a9f6-43ab-a4a8-713499841bf9 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1219 microversion: 2.1 time: 0.092933 Sep 27 01:33:42.051753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 271/561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:41 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:42.065681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-859358-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:42.069239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:42.073067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.076029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.076701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.076955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.077832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.078292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.078718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.088500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-659b477e-84c8-4e20-a50c-620f8a3fcd6f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.282642 Sep 27 01:33:42.089073 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 291/562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:41 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:42.105330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lazy-loading 'flavor' on Instance uuid 647d420a-9dd2-4d47-acc4-ece1000d8365 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:42.116830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:42.120225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Going to try to live migrate instance to n-h1-859358-1 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:33:42.121088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] [instance: 7c364114-25f7-4300-a6d3-84a640090971] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:42.136781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.137350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.138658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.139663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.140306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.140927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.169266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] HTTP exception thrown: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Request method failure captured: Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 HTTP/1.1 Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLAVJLn117T-O47Jvy22V9SfNsi8EIzFUvYdmlUR_laGbL39PUm4vP8-Av0QsWW92MQcuqKWww7xk_LGQO_hEpnJXB6LSFPKxMg5IgFzmxBrV0Qwb8ao1w2D6ao1K4ArChszPzuE5ZmvC-BaJbdVHd_iOtUJltBl05GRVzVZtsWzpA Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:42.171006 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9cc13c5471ca4f209b88a07caf3669da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9cc13c5471ca4f209b88a07caf3669da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9cc13c5471ca4f209b88a07caf3669da Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-712955028 Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 01f32acd5cf4439f9999d4c92b32f8f9 Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersAdminTestJSON-712955028-project Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:42.172507 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7c364114-25f7-4300-a6d3-84a640090971'} Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:42.173394 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. Sep 27 01:33:42.174818 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:42.177194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] Returning 404 to user: Instance 7c364114-25f7-4300-a6d3-84a640090971 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:42.178356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae918efb-a6f6-402b-b522-39ad2fa17cdb tempest-DeleteServersAdminTestJSON-712955028 tempest-DeleteServersAdminTestJSON-712955028-project] 10.222.0.52 "GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971" status: 404 len: 111 microversion: 2.1 time: 0.078471 Sep 27 01:33:42.179521 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 292/563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:42 2022] GET /compute/v2.1/servers/7c364114-25f7-4300-a6d3-84a640090971 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:42.185120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:42.185933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:42.192805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.193576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.194223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.195593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.196241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.197713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.287277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.306073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.325801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.341444 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f656ef7-1f79-4c28-9b9a-d3e1bcbe4d39 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.160099 Sep 27 01:33:42.350885 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 293/564] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:42 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:42.358539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:42.359147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:42.379641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.380134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.380570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.381272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.381755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.382188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.791124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:42.800801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b24bcd9-9b72-49bc-9021-055336db9115 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.448709 Sep 27 01:33:42.801785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 294/565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:42 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:42.978765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:42.979375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:42.986375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.986856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.987281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:42.992234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:42.992838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:42.994753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.082211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.092514 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5579c43-70ea-41ff-b109-74b68968b571 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1212 microversion: 2.1 time: 0.118337 Sep 27 01:33:43.093414 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 295/566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:42 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:43.098061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:43.098664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:43.109908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.110397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.110838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.111539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.113618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.114200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.296712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.308534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8c8d0a64-17eb-433b-a23a-895110c41bdb tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1215 microversion: 2.1 time: 0.213794 Sep 27 01:33:43.312075 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 296/567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:43 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:43.321351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:43.322338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:43.329466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.330437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.331126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.332683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.333808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.334428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.354528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:43.649325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.658241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-836d902b-a5bc-460e-b052-c431e4e2fed3 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.343672 Sep 27 01:33:43.669365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 297/568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:43 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:43.669365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:43.669365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:43.675764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.676248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.676833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.677534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.678004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.678529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.786070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.795818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.797267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:43.802572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62024003-76d3-449c-a790-cbfd638cf074 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.142510 Sep 27 01:33:43.803653 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 298/569] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:43 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:43.834507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:43.835348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:43.842921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.843413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.843840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:43.844728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:43.845181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:43.845628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.097238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:44.108085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77731cbd-472e-4450-951b-82754c16a965 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.280618 Sep 27 01:33:44.109500 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 299/570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:43 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:44.141728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:44.142684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:44.161626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.162057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.174240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.175056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.175532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.175964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.269581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:44.278526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7d0ee45-e3c5-4055-9e3f-68a3422ccee2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1268 microversion: 2.1 time: 0.161440 Sep 27 01:33:44.279504 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 300/571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:44 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:44.334531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:44.335144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:44.341179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.341688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.342126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.342812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.343264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.343683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.413473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:44.424363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68158500-c751-4937-b50c-778687b0ac8d tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1215 microversion: 2.1 time: 0.093673 Sep 27 01:33:44.432600 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 301/572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:44 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:44.682945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:44.683543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:44.690034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.690513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.690939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:44.691765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:44.692262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:44.692477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.089271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:45.099011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00134aab-654e-41b5-8bc8-b8b5206937f2 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1323 microversion: 2.1 time: 0.419816 Sep 27 01:33:45.118287 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 302/573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:44 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:45.125798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:45.126583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:45.133043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.133891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.134485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.135371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.136004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.136583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.288941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:45.343627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:45.354343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:45.384121 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae0a76b9-ef4d-44c0-9077-2bc9209b5381 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.264441 Sep 27 01:33:45.387809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 303/574] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:45 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:45.398984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:45.402040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:45.420404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.420967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.421846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.422853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.423522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.424155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.827890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:45.841047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f5c57277-81c4-46a9-9a48-ea1025d7a1c1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.448322 Sep 27 01:33:45.841803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 304/575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:45 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:45.846651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:45.856822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:45.879189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.879985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.881906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:45.890352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:45.892088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:45.895554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.458872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:46.470653 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b9d7cb2-8863-4107-bba1-793020ef643d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1274 microversion: 2.1 time: 0.627403 Sep 27 01:33:46.471396 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 305/576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:45 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1274 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:46.476560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:46.477705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:46.494932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.495722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.496326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.497865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.498647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.499857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.628502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:46.640613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-425c7360-72ce-40f0-8114-5ed118225364 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1277 microversion: 2.1 time: 0.167792 Sep 27 01:33:46.641948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 306/577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:46 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:46.817006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Calling method '.version_select at 0x7f24d69a25e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:46.818959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.819443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.819972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.841723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.841723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.842329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.855059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.855792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.856146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.863671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eab35706-8ae8-4709-b847-5fd539d912dc tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.220117 Sep 27 01:33:46.864263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 307/578] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:33:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:46.876650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:46.877275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:46.884452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.884929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.885408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:46.886114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:46.886564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:46.887511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:47.395082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:47.403416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b1be2e4-5b53-4944-bb39-50d9fc46e775 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1473 microversion: 2.1 time: 0.530887 Sep 27 01:33:47.404002 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 308/579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:46 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:47.438354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:47.439246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:47.446867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:47.446867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:47.447269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:47.448026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:47.448667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:47.449481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:47.587660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:47.596665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:47.598533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:47.604622 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fbef9edc-dd1f-478a-9787-14de1153b3cc tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.185457 Sep 27 01:33:47.605211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 309/580] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:47 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:47.633324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:47.634237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:47.640963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:47.641484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:47.642537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:47.643233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:47.643681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:47.644099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.033618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.041941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9133d93d-a744-41cd-8bbb-9ef684aec191 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.421240 Sep 27 01:33:48.057832 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 310/581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:47 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:48.062996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Calling method '.version_select at 0x7f24d67e93a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.065133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.065789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.066463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.083917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.084020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.084469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.098296 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65f1e933-298d-402e-8080-15ea014744a3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365/action" status: 202 len: 0 microversion: 2.1 time: 6.045402 Sep 27 01:33:48.102984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 272/582] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:33:42 2022] POST /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365/action => generated 0 bytes in 6051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:33:48.110708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:48.151696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.153227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.154565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.185735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] Creating event network-changed:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:33:48.186679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.187779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.187779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.201715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-61b7ef1e-e648-4e12-ba79-1564f93ffba6 req-f800f1bd-7b21-423d-a098-ca88ff4c12d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096535 Sep 27 01:33:48.202879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c1d57f3-fbda-4032-a30d-21dfb2f10fd5 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-859358-1/servers" status: 200 len: 670 microversion: 2.1 time: 0.143981 Sep 27 01:33:48.203687 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 273/584] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.203800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 311/584] 10.222.0.52 () {58 vars in 1212 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-859358-1/servers => generated 670 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.209706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9950be27-4e7c-42ea-b32e-90972afe3d31", "name": "network-vif-plugged", "status": "completed", "tag": "2b4b6147-9cf6-4c0a-ab8e-9072a427c434"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:48.211235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd751e1f-0877-451b-8a83-3bbd8620f463", "tag": "84aa3138-ded6-4164-a5c3-4ea57647dc07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:48.220933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.221432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.221864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.229712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.230460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.231621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.237105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] Creating event network-vif-plugged:2b4b6147-9cf6-4c0a-ab8e-9072a427c434 for instance 9950be27-4e7c-42ea-b32e-90972afe3d31 on n-h1-859358-1 Sep 27 01:33:48.243145 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-28d54645-1153-407d-b312-f4aa7fbb77e2 req-c40826c3-98f8-419e-99b1-2323df10df6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037717 Sep 27 01:33:48.243647 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 312/585] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.248779 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] Creating event network-changed:84aa3138-ded6-4164-a5c3-4ea57647dc07 for instance dd751e1f-0877-451b-8a83-3bbd8620f463 on n-h1-859358-1 Sep 27 01:33:48.249323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.249955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.255976 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-85a56aac-fbf7-4ce7-a8e4-00cfdbb05b2b req-7fd312a2-a069-4455-9582-e27e9fdb5d8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050119 Sep 27 01:33:48.257739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.257739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.258092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.258986 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 274/586] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.261731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.262308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.262730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.267697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.268854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.275036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.275517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.275943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.276640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.277155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.278615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.292908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Request method failure captured: Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2/diagnostics HTTP/1.1 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLbC2pbikzl8mB1RX1s8zrGEetQ225EvBczw6o8k7d0kV3DDJx_9cO4Xymwz0K3KGi8nuU9sM3klgNCdZNSzRPrJK1wxHIdETHqyUY6yobJzCSDCMfA50kMQYxnlqHfvEIKmvk-hTIWwGoqI9ZXWw2nrdJ5DiyZ7NBls7RJes0IFiQ Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9f77a3ccb96a41a6ac99b2d8119f7247 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:33:48.295542 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f77a3ccb96a41a6ac99b2d8119f7247", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9f77a3ccb96a41a6ac99b2d8119f7247 Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiagnosticsNegativeTest-1830133504-project Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 213bd4f694cf4c01982771714d3dbe13 Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1830133504-project Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:33:48.297087 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '08e1eab0-0c30-4c73-b103-93f3db9bd0a2'} Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:33:48.297912 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:33:48.299381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:48.300643 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26f8b69c-8d6f-4718-b659-b5d7e9d45094 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.052425 Sep 27 01:33:48.300643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 313/587] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2/diagnostics => generated 117 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:48.310629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.311241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.318534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.319019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.319445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.320139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.320617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.321035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.446131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.456574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c5dc75e-2347-43dd-b1f7-cf6f83279425 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.196076 Sep 27 01:33:48.459622 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 275/588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:48.464750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.466190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.476775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.477533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.478708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.480523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.481684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.482766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.488381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.490948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:48.497926 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97484082-e86c-409a-831a-e030f08cfd59 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.191170 Sep 27 01:33:48.498501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 314/589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:48.503553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Calling method '.version_select at 0x7f24d6732ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.505549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.506184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.506795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.522455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.523083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.523516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.535224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.535709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.536322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.550087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eaa75a3c-08e1-48ff-bdb9-a09edc01a635 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049778 Sep 27 01:33:48.550880 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 315/590] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.556184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.556830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.564341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.565089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.565745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.566456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.567080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.567511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.595492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:33:48.643521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.654199 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c582ef06-f0cd-418b-af8b-097aea9f7ef2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.193177 Sep 27 01:33:48.655147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 276/591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:48.659902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Calling method '.version_select at 0x7f24d68db160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.661751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.662227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.662654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.680411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.680890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.681316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.688309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31ebd271-c2ee-4e6f-ae49-4163e8393c76 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "DELETE /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 204 len: 0 microversion: 2.1 time: 0.136343 Sep 27 01:33:48.688922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 316/592] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:33:48 2022] DELETE /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:33:48.689582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04f3fa24-db80-4431-8965-056bc30b1a68 tempest-HypervisorAdminUnderV252Test-1340285275 tempest-HypervisorAdminUnderV252Test-1340285275-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/n-h1-859358-1/search" status: 200 len: 104 microversion: 2.1 time: 0.033128 Sep 27 01:33:48.690730 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 277/593] 10.222.0.52 () {58 vars in 1209 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-859358-1/search => generated 104 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:48.702250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.702875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.710485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:48.712692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:48.714694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.715232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.715700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.716450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.716906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.717650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.725116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.725769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.726205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.726900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:48.727352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:48.727774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:48.801814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.813618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.816943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.823243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5269ce3c-5806-4531-a201-44407d203aff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.133148 Sep 27 01:33:48.829374 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 317/594] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:48.864499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:48.873988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-69cd5533-d362-456c-af9e-f9643043d969 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1479 microversion: 2.1 time: 0.176112 Sep 27 01:33:48.874642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 278/595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:48 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1479 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:49.072545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.073188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.088772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.088993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.089320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.090115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.090614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.091388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.496775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.497679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.504454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.504951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.505415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.506300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.506761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.507182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.621927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.633933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b131b42-c94c-48e1-b3ec-eb0466fa5e23 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.567796 Sep 27 01:33:49.634894 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 318/596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:49.647491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.648328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.655660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.656393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.657173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.658120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.658723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.659545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.688747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.691313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:49.705725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef27a3e5-bf20-4f01-a47d-2dc348fa7b3f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.212127 Sep 27 01:33:49.707327 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 279/597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:49.716725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.717965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.728069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.729064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.729726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.731173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.731874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.732522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.889634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.896835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.897815 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9980ea7e-be2b-4e1a-904e-58c20575a8af tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.189224 Sep 27 01:33:49.898555 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 280/598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:49.905098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.905794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.906983 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6aa9f810-3aec-4185-ae91-5f1a8a07f2d1 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.263134 Sep 27 01:33:49.907771 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 319/599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:49.912209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.912767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.913316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.914127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.914791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.914996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:49.915395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.915612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:49.923515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.923515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.923948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.925004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:49.925500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:49.926551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:49.985142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.993673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:49.995123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:50.007396 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cef2839f-e216-43d6-a998-f4e4f0ce324d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.107332 Sep 27 01:33:50.021476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 281/600] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:50.195749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:50.209563 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c794ce93-c3bc-4d26-a4c7-8830498265ad tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1479 microversion: 2.1 time: 0.300146 Sep 27 01:33:50.210854 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 320/601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:49 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1479 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:50.259351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7712ee57-f899-4f07-8845-13195e4ed128", "name": "network-vif-plugged", "status": "completed", "tag": "fed7f93a-ba1d-4770-bc7d-03775dec547a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:50.271626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.272341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.272958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.289940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] Creating event network-vif-plugged:fed7f93a-ba1d-4770-bc7d-03775dec547a for instance 7712ee57-f899-4f07-8845-13195e4ed128 on n-h2-859358-1 Sep 27 01:33:50.295519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a0bb08c2-b800-47f6-9a01-cd2152be93fd req-b2c1ddc7-0451-42f1-88fa-7f17cc4dd38a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Sep 27 01:33:50.296128 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 282/602] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:50.363777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378927ff-1600-480f-929c-179a3fa466eb", "tag": "5d3e63f2-470e-4085-b88e-782122a2a9b3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:50.374164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.374644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.375075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.387847 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] Creating event network-changed:5d3e63f2-470e-4085-b88e-782122a2a9b3 for instance 378927ff-1600-480f-929c-179a3fa466eb on n-h1-859358-1 Sep 27 01:33:50.393138 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ee82f16f-2085-40b0-99c4-96e1f123e986 req-2ff1f642-c4b9-477e-b540-1cf2b3f6066a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033233 Sep 27 01:33:50.394317 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 321/603] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:50.662045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:50.663696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:50.671629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.672397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.672930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.674093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.674661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.675163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.729669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:50.730380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:50.738410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:50.740181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.740682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.741136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.741879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.742507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.743429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.913152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:50.923712 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc12d82d-ee8f-4d74-9749-695387b1b2eb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.267125 Sep 27 01:33:50.925556 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 283/604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:50 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:50.948266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:50.948888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:50.964708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.968799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.969144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:50.969917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:50.970384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:50.973944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.218885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.231427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-270fdb2a-d057-48b5-98a1-07e4ddb40181 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.287326 Sep 27 01:33:51.235708 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 284/605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:50 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:51.240860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:51.247998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:51.262529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.263306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.263675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.264392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.264891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.265484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.415958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.426025 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86328456-c179-461f-a903-b2ec6ed0b2e9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.700606 Sep 27 01:33:51.426608 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 322/606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:50 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:51.469410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:51.469981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:51.476730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.477228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.480977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.481884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.482362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.483542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.546283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.557414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c257277a-ac2d-4f78-b1f9-f369bdb91a49 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.320485 Sep 27 01:33:51.558028 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 285/607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:51 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:51.576107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:51.576737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:51.590915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.593745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.594212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.596018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.596488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.596915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.623891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.632337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.640828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:51.646545 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b18f136-ebb5-4b69-8dc5-3dfaaa649d34 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.198033 Sep 27 01:33:51.648031 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 323/608] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:51 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:51.773790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:51.955007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:51.957095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:51.968566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:51.970503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=55 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:51.975470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.976454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.977083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:51.983446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:51.984477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:51.985267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.046255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=9 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:52.166786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:52.196455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cdb5251-3760-4870-a362-e4539486d537 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1479 microversion: 2.1 time: 0.636841 Sep 27 01:33:52.198709 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 286/609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:51 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1479 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:52.256604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:52.257233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:52.264918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.265447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.265894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.266602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.267061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.267490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.619206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:52.639459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54bf6321-de4d-4de3-9fae-dfeaa7c87e15 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.386683 Sep 27 01:33:52.640592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 287/610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:52 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:52.659902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:52.660779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:52.662962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:52.669125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.669644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.670078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.670777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.671387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.672047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.676102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efd9170a-d035-41d6-9876-b86824ec07cc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1317 microversion: 2.1 time: 0.729411 Sep 27 01:33:52.676688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 324/611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:51 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:52.686817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:52.686817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:52.692400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.692400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.693947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.694729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.695208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.695653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.926920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:52.936866 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4edae428-1099-4a82-90ed-d83f1a1b7167 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.294761 Sep 27 01:33:52.937959 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 288/612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:52 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:52.944258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e1eab0-0c30-4c73-b103-93f3db9bd0a2", "name": "network-vif-deleted", "tag": "fc90baee-3728-4dd7-b44c-591a4dbb37f5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:52.957236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:52.957858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:52.958580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:52.974447 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] Creating event network-vif-deleted:fc90baee-3728-4dd7-b44c-591a4dbb37f5 for instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 on n-h2-859358-1 Sep 27 01:33:52.982060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c111a0df-6572-4521-9cea-30568e6ea57d req-bde4d727-0ccf-4f7c-9b4d-25ac125ad8cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042252 Sep 27 01:33:52.983069 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 289/613] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:52.989378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:52.990294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:53.008997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.010289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.010992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.012434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.013143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.013810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.027207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.036843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-07bf255b-7051-408b-ac0d-ca70b5745003 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.359131 Sep 27 01:33:53.038034 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 325/614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:52 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:53.096749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647d420a-9dd2-4d47-acc4-ece1000d8365", "name": "network-vif-unplugged", "status": "completed", "tag": "140d4304-1de9-44e9-a328-06cf241e556c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:53.106756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.107435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.108050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.122221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.124851 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] Creating event network-vif-unplugged:140d4304-1de9-44e9-a328-06cf241e556c for instance 647d420a-9dd2-4d47-acc4-ece1000d8365 on n-h2-859358-1 Sep 27 01:33:53.130554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9cd6f401-3847-4de3-94d4-1be963794eab req-8b4e6e4a-5eea-4056-8d62-056eb57a6ee2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037424 Sep 27 01:33:53.131341 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 326/615] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:33:53.131678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.133295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.141044 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-891b6514-72a3-48f5-9cd8-4c4238ab902a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.156598 Sep 27 01:33:53.142337 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 290/616] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:52 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:53.227799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:53.228899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:53.241274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.242409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.243429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.244970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.245939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.247572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.298128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.299697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.300399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.301257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lazy-loading 'fault' on Instance uuid 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:33:53.355885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213bd4f694cf4c01982771714d3dbe13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f77a3ccb96a41a6ac99b2d8119f7247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.365519 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d30c6364-04ab-4b39-a690-443732a4876f tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 200 len: 1313 microversion: 2.1 time: 0.144828 Sep 27 01:33:53.366776 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 327/617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:53 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:53.662655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:53.663818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:53.681755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.682485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.683206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.685232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.685972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.686631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.703621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:53.704728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:53.716668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.717161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.720041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.722344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.725421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.726817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.854577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:53.879948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-031bc7d1-ff7e-45c0-959b-153077d65602 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.221169 Sep 27 01:33:53.882684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 291/618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:53 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:53.890866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-plugged", "status": "completed", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:53.910510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.911123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.911648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.923919 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] Creating event network-vif-plugged:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:33:53.929578 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5798d855-9168-480d-aa43-282f84b4bc53 req-3c93d4cf-bfa1-45c1-a1fa-802af1cbea7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044886 Sep 27 01:33:53.930862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 292/619] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:53.964096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:53.965418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:53.974168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.975379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.975972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:53.976825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:53.977281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:53.978207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.031500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.041932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc537726-c764-4bcc-96cc-a9405765810b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1467 microversion: 2.1 time: 0.345260 Sep 27 01:33:54.045959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 328/620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:53 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1467 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:54.061743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.063478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:54.070702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.071178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.071721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.072487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.073094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.073531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.183695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.195609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2846eb86-afb2-46f6-a73c-9da8a5ccf51c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.236102 Sep 27 01:33:54.196596 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 293/621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:53 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:54.206890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.210367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:54.221000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.228194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.228648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.229427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.230056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.231225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.382035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.393604 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-19126cda-d016-47c5-bcf6-5a3bc231a3e5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.335556 Sep 27 01:33:54.412098 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 329/622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:54.422035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.423164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:54.430087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.430822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.431504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.432737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.433461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.434043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.482456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.490762 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99f1ebd2-af54-4877-9e8b-098946dd4116 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1467 microversion: 2.1 time: 0.292282 Sep 27 01:33:54.491558 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 294/623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1467 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:54.496464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.497314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] [instance: 08e1eab0-0c30-4c73-b103-93f3db9bd0a2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:54.503930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.504589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.505186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.506009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.506768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.507356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.529167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] HTTP exception thrown: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Request method failure captured: Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 HTTP/1.1 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLbC2pbikzl8mB1RX1s8zrGEetQ225EvBczw6o8k7d0kV3DDJx_9cO4Xymwz0K3KGi8nuU9sM3klgNCdZNSzRPrJK1wxHIdETHqyUY6yobJzCSDCMfA50kMQYxnlqHfvEIKmvk-hTIWwGoqI9ZXWw2nrdJ5DiyZ7NBls7RJes0IFiQ Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9f77a3ccb96a41a6ac99b2d8119f7247 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:33:54.532028 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f77a3ccb96a41a6ac99b2d8119f7247"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f77a3ccb96a41a6ac99b2d8119f7247", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9f77a3ccb96a41a6ac99b2d8119f7247 Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1830133504 Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerDiagnosticsNegativeTest-1830133504-project Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 213bd4f694cf4c01982771714d3dbe13 Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1830133504-project Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. Sep 27 01:33:54.534779 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '08e1eab0-0c30-4c73-b103-93f3db9bd0a2'} Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:33:54.536705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. Sep 27 01:33:54.538974 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:33:54.540375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.544228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:54.546118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] Returning 404 to user: Instance 08e1eab0-0c30-4c73-b103-93f3db9bd0a2 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:33:54.547373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c47a007f-1ed6-4438-a7ec-72f4a38cabd1 tempest-ServerDiagnosticsNegativeTest-1830133504 tempest-ServerDiagnosticsNegativeTest-1830133504-project] 10.222.0.52 "GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2" status: 404 len: 111 microversion: 2.1 time: 0.054459 Sep 27 01:33:54.550121 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 295/624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/08e1eab0-0c30-4c73-b103-93f3db9bd0a2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:33:54.557977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.564551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.565360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.577078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.579244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Searching by: {'reservation_id': 'r-yj33g0bg', 'deleted': False, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:33:54.579376 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-486d51ca-c8a9-4bc4-9b39-8890fbc7afdd tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.165772 Sep 27 01:33:54.581451 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 330/625] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:54.587315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.587797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.588232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.588956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.591126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.602012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.704934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:33:54.806751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:54.814875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.815407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.815845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.906287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:54.907662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:54.920425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.920907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.921385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:54.922083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:54.922541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:54.925515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.011655 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86db82df-5ef4-4343-a9e3-f7ecfb2cfc9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-yj33g0bg" status: 200 len: 2927 microversion: 2.1 time: 0.459708 Sep 27 01:33:55.013019 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 296/626] 10.222.0.52 () {58 vars in 1197 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yj33g0bg => generated 2927 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:55.041281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.059940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Querying cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) for 2 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 27 01:33:55.060930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.061580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.062249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.097117 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af7a5088-710f-4643-893c-85fce9973ccc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/e1941332-c20c-4962-952c-dc23db4cbc95" status: 200 len: 271 microversion: 2.1 time: 0.059796 Sep 27 01:33:55.098369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 297/627] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/os-server-groups/e1941332-c20c-4962-952c-dc23db4cbc95 => generated 271 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:55.110270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.111173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:55.118378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.119172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.119907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.120838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.122023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.124122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.332983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:33:55.335546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:55.337592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ab3d631-df78-49a2-b483-1139c6e1d517 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1618 microversion: 2.1 time: 0.232395 Sep 27 01:33:55.351181 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 298/628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1618 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:55.364671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-07435bbc-bba3-4e0b-9649-fcf5825c567e tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.463957 Sep 27 01:33:55.365620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 331/629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:54 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:33:55.372480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647d420a-9dd2-4d47-acc4-ece1000d8365", "tag": "140d4304-1de9-44e9-a328-06cf241e556c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:55.373139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.373788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:55.380323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.381093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.381706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.383150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.384697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.385532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.403512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.407485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.408319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.429538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] Creating event network-changed:140d4304-1de9-44e9-a328-06cf241e556c for instance 647d420a-9dd2-4d47-acc4-ece1000d8365 on n-h2-859358-1 Sep 27 01:33:55.446282 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e10da262-dd9f-4b3e-b1ef-230da929f90d req-b5020db5-35e5-4e24-81fd-5c12e81bad63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084683 Sep 27 01:33:55.448114 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 299/630] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:55.453805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.455419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:55.462276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.463073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.463709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.465770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.466455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.467346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.830973 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83ba8dea-3831-4481-a8e8-fe22c4b3920a tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1618 microversion: 2.1 time: 0.381498 Sep 27 01:33:55.833991 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 300/631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1618 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:55.843835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.847348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:55.860760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.868068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.868652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.869526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.870090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.870665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.872770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:55.883163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af1a6b4e-f587-4a6a-a153-2b94e01c787f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.516165 Sep 27 01:33:55.884418 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 332/632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:55.890366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:55.891177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:55.909268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.910117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.910757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:55.911969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:55.912616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:55.913668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.030898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:56.044810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:56.046923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:56.055372 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f93f91b-8b28-48ea-bc98-7534581b719a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.169567 Sep 27 01:33:56.056352 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 333/633] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:56.075228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd751e1f-0877-451b-8a83-3bbd8620f463", "name": "network-vif-plugged", "status": "completed", "tag": "84aa3138-ded6-4164-a5c3-4ea57647dc07"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:56.092854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.093362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.094615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.124874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] Creating event network-vif-plugged:84aa3138-ded6-4164-a5c3-4ea57647dc07 for instance dd751e1f-0877-451b-8a83-3bbd8620f463 on n-h1-859358-1 Sep 27 01:33:56.131684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8f835555-6dd9-4da8-92f6-585b1214842b req-a1388bc3-49ce-4dfb-871b-43aefaeabb16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073774 Sep 27 01:33:56.133464 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 334/634] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:56.139886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1117578580", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a2cb4d2f-dfde-4d66-9438-99dba5838034"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:56.220098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:56.382232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:56.408452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-133ccdce-0bab-4655-bbda-e33b66da5442 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.571693 Sep 27 01:33:56.410115 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 301/635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:55 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:56.417484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:56.418475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:56.428084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.429257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.430830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.433173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.434474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.435117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.725402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:33:56.725915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:33:56.726294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:33:56.726697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:33:56.727102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:33:56.748687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.749167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.749811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.750524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.750957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.751369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.794679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:33:56.801028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:33:56.829197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:33:56.835445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:33:56.919971 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-047e2a80-da0e-44f8-96a5-cd8643a0d5c2 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782861 Sep 27 01:33:56.923029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 335/636] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:33:56.935924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:56.936809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:56.946385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.947677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.948849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:56.950534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:56.952318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:56.958090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:57.145134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.154191 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e37715a8-ed2a-49e0-82c1-6eecf564fb27 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.741117 Sep 27 01:33:57.160109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 302/637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:56 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:57.165143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83b3fd68-fb75-40be-81c6-54323419c5ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:57.170808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83b3fd68-fb75-40be-81c6-54323419c5ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:57.229093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.244641 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-037d9b78-8892-4c4f-b7f8-f5232586080f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1316 microversion: 2.1 time: 0.313292 Sep 27 01:33:57.247859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 336/638] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:56 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:57.255946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:57.259776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:57.273357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:57.274098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:57.274889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:57.275778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:57.276730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:57.278348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:57.336100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83b3fd68-fb75-40be-81c6-54323419c5ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.344426 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83b3fd68-fb75-40be-81c6-54323419c5ec tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1217 microversion: 2.1 time: 0.182937 Sep 27 01:33:57.355987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 303/639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:57 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:57.380751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.408684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.416677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:57.423858 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a00cf3b-5edb-442f-9e2b-9765e879a12d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.174929 Sep 27 01:33:57.424931 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 337/640] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:57 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:57.444451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:57.445059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:57.467265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:57.467772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:57.468206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:57.468915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:57.469389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:57.469813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.186413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:58.187111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:58.196590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.200209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.203516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.204580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.205230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.205852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.408218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:58.451953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f749c78-a12d-4d20-8c7b-fbf5a2b8849a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 1.011085 Sep 27 01:33:58.456190 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 304/641] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:57 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:58.471103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:58.473163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:58.484706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.485208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.485681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.486401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.491218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.491777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.536261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:58.544154 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e52c49ab-6b44-49cd-ab8f-972a31eaddda tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.361984 Sep 27 01:33:58.550774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 338/642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:58 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:58.564893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378927ff-1600-480f-929c-179a3fa466eb", "name": "network-vif-plugged", "status": "completed", "tag": "5d3e63f2-470e-4085-b88e-782122a2a9b3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:58.579949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.581851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.582504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.604133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] Creating event network-vif-plugged:5d3e63f2-470e-4085-b88e-782122a2a9b3 for instance 378927ff-1600-480f-929c-179a3fa466eb on n-h1-859358-1 Sep 27 01:33:58.613162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-97e6bc07-fd43-496d-b224-4d94c9f67c4c req-faa07886-37aa-444d-9c2b-aa6930d827da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058116 Sep 27 01:33:58.614032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 339/643] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:33:58.635016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:58.639746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:58.660729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.661234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.661708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.662430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.662885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.663315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.811919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:58.822270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce46ac50-5922-483d-9b0b-75c80ab7de6b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1213 microversion: 2.1 time: 0.205917 Sep 27 01:33:58.822860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 340/644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:58 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1213 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:58.827474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:58.836982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:58.853869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.854513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.855859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.856614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.857089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.857542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.868973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:58.877827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51f37d65-0bc2-413d-8a4d-7850368f56c0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1466 microversion: 2.1 time: 0.419246 Sep 27 01:33:58.901222 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 305/645] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:58 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:58.913205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:58.913854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:58.922574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.923047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.923682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:58.924560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:58.925178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:58.925788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.016032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:59.031062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:59.032743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:59.038933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70cd72ba-7ae2-436b-933b-2bbd8365b2eb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.215081 Sep 27 01:33:59.040016 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 341/646] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:33:58 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:33:59.169759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:59.182207 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39cf2388-a735-4617-aa1a-e6e0f065f83f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1467 microversion: 2.1 time: 0.275334 Sep 27 01:33:59.184993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 306/647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:58 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:59.208764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1166541696"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:59.211434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:59.232244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.232754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.234818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.236688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.241616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.242523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.627086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eefbd557-47a2-40d0-8ed6-d0334c3f64e4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "POST /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b/action" status: 202 len: 0 microversion: 2.1 time: 0.422502 Sep 27 01:33:59.634331 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 342/648] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:33:59 2022] POST /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:33:59.640140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:59.654391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:59.661212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.661977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.662571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.663438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.664046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.664623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.719149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-541312901", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:33:59.810532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:33:59.899791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:33:59.909237 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a40162a-12a1-435c-9ecb-646094b25554 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.272953 Sep 27 01:33:59.910723 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 343/649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:59 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:33:59.915673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:33:59.916464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:33:59.924483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.925150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.925689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:33:59.926487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:33:59.927081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:33:59.927647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.087969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:00.096496 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b6e44e0-4bcf-4f1e-810e-603c9185e88a tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1319 microversion: 2.1 time: 0.184593 Sep 27 01:34:00.099175 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 344/650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:33:59 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:00.104170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6701bc86-8a48-4820-b192-d7baa70ddafb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66be160>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:00.163711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6701bc86-8a48-4820-b192-d7baa70ddafb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.065464 Sep 27 01:34:00.169390 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 345/651] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:00 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:00.169967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:00.170658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:00.179564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.180183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.193469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.193469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.193469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.193469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.274199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:00.283500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8f2b045-0eb7-4f99-9888-6b261859a9be tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1275 microversion: 2.1 time: 0.117870 Sep 27 01:34:00.284887 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 346/652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:00 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:00.292354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:00.293602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:00.301151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:00.301641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.302289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.302404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:00.302731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.303311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:00.303542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.304002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.304378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:00.304488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.305123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:00.322973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.324438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.325093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.326092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.326801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.327448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.349329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:00.355233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for user 3f9556a6309d40c3950ea3696323ade4 and project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:00.368475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:00.371231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:00.418100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:00.438039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:00.442411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:00.447947 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5bb5060-9059-4913-9a7a-1d4cf06eb585 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984180 Sep 27 01:34:00.448597 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 307/653] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:33:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:00.477754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e430aa9-8b8a-429d-9783-2d4aa47d334a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.191500 Sep 27 01:34:00.488090 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 347/654] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:00 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:00.517467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1203837561", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:00.541731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:00.591638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:00.932122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:00.932654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:00.941712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.946279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.946469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:00.947298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:00.947674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:00.950079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.259620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:01.282137 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8299708-fd2a-4dd6-9e58-d567c0a3922a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.353956 Sep 27 01:34:01.283445 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 348/655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:00 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:01.288834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.291923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:01.300226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.300860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.308806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.312070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:01.312922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:01.313655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:01.314075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:01.314387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.314501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:01.318923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.319776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.331183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:01.340119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.340615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.341057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.341954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.342414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.342841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.366686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:34:01.374349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:01.380272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for user 3f9556a6309d40c3950ea3696323ade4 and project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:01.399161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:01.402700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:01.485534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94f06794-eb64-432b-a4e8-d27b0b990fba tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 204 len: 0 microversion: 2.1 time: 0.198991 Sep 27 01:34:01.488444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-937c1bc2-795d-44cb-8e8b-fd0197ef65b7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975081 Sep 27 01:34:01.488795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 349/656] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:34:01 2022] DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:34:01.500498 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 308/657] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:01.500935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.501697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:01.504146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-657dd2f2-d06e-4e35-b0af-bc61de279515 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6726e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.520365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.522617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.524475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.527574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.531242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.531984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.574812 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-657dd2f2-d06e-4e35-b0af-bc61de279515 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.074472 Sep 27 01:34:01.578240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 309/658] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:01 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:01.606981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.607887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:01.619785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.621411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.622208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.624745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.626220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.631021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.774317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:01.795732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89ac7ca2-1ce6-4abc-b615-43b059cfc3bf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1275 microversion: 2.1 time: 0.204002 Sep 27 01:34:01.809522 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 310/659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:01 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:01.809857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:01.815671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e168a75e-0e1e-4d25-8e65-ee3ec319d5de tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1469 microversion: 2.1 time: 0.322177 Sep 27 01:34:01.829363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 350/660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:01 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:01.829363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a7c4024-5a35-4c80-b9fb-97dff4bd0ef5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.829363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a7c4024-5a35-4c80-b9fb-97dff4bd0ef5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:01.830194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:01.835306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:01.851621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.852403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.853048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.854012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:01.855638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:01.856239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:01.904654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a7c4024-5a35-4c80-b9fb-97dff4bd0ef5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:01.918803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a7c4024-5a35-4c80-b9fb-97dff4bd0ef5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1214 microversion: 2.1 time: 0.101367 Sep 27 01:34:01.920079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 351/661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:01 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:01.934779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-657043653", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "1941996725", "adminPass": "***", "networks": [{"uuid": "5129a9b0-bf63-4c85-b080-ed5425322fc8"}], "security_groups": [{"name": "tempest-securitygroup--1183385619"}], "key_name": "tempest-keypair-1096786391", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:02.064647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:02.075810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:02.077265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:02.100957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-288f7ebe-869d-4e42-99b5-479fcbd030b2 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.285074 Sep 27 01:34:02.101672 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 311/662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:01 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:02.126479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:02.127036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:02.142145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.142637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.143075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:02.143782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.144245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.144671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:02.145277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] validate_networks() for [('5129a9b0-bf63-4c85-b080-ed5425322fc8', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:02.501885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lazy-loading 'flavor' on Instance uuid 378927ff-1600-480f-929c-179a3fa466eb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:02.615352 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70287053-13db-4b64-ac5a-c1fba71499f6 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb/action" status: 202 len: 0 microversion: 2.1 time: 0.509738 Sep 27 01:34:02.619163 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 312/663] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:02 2022] POST /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:34:02.635201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:02.637266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:02.655245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.656019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.656622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:02.658094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.660275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.662927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:02.946064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:02.946522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:02.947284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:02.947709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:02.948126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:02.965447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.965947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.966388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:02.968064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:02.968529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:02.970510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.040305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:03.062458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:03.073797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Getting quotas for user 2089ee58706a4b1da251c4256b9673c8 and project eb5f6fe6f6b14b978d83872c917e4dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:03.092140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:03.095282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:03.247828 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49afc379-c359-449a-8fa7-29034af99eea tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.323262 Sep 27 01:34:03.255560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 352/664] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:03.272508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cec48426-d304-44f5-9fb2-d419ee155603 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69a21f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:03.354423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cec48426-d304-44f5-9fb2-d419ee155603 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.100704 Sep 27 01:34:03.359950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 353/665] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:03 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:03.366422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:03.367289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:03.375978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.376734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.378974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.380027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.381325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.381946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.532088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:03.550363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d7f3152-06cb-4497-96f6-226a6b4dd7c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 0.927626 Sep 27 01:34:03.553711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 313/666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:02 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:03.565999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:03.566885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:03.582480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.586310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.586769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.587619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.590800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.591255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.802689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:03.822308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-81796e98-ec81-481c-a02f-17526401ba77 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1477 microversion: 2.1 time: 0.458910 Sep 27 01:34:03.824592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 354/667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:03 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:03.833493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:03.838550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:03.856283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.857156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.858186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:03.859329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:03.860120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:03.860722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:04.497984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:04.524279 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52d0519c-fa4e-450f-aba9-ce49a7703322 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1210 microversion: 2.1 time: 0.694576 Sep 27 01:34:04.527376 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 355/668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:03 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1210 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:04.545928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:04.548462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:04.567372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:04.568526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:04.569293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:04.572339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:04.573369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:04.574769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:04.756856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:04.782552 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8afdaa9-e2b0-4991-8eeb-d515a4936578 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 1.226582 Sep 27 01:34:04.786736 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 314/669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:03 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:04.805294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:04.806113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:04.818561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:04.820436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:04.822298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:04.825411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:04.825946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:04.827544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:04.856235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:04.869471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:04.875358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:04.894898 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90229fda-26c5-4e2e-a48f-69a09cf20c07 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.362874 Sep 27 01:34:04.913809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 356/670] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:04 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:04.922166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3a8004c-77a5-4a7e-9027-ed3ccd34a6b5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66be9d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:04.985658 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3a8004c-77a5-4a7e-9027-ed3ccd34a6b5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.068558 Sep 27 01:34:04.986705 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 357/671] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:04 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:04.992353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:04.993453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:05.002075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:05.002695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:05.003424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:05.004640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:05.005234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:05.006087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:05.083113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:05.095695 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a63407cb-0d62-41ef-9a9e-2b50d1490b66 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1260 microversion: 2.1 time: 0.306055 Sep 27 01:34:05.098107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 315/672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:04 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:05.108289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:05.117857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:05.141401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:05.142031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:05.142497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:05.143214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:05.143665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:05.144092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.079202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:06.093269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0d75a5a-2ffa-40b7-b679-3b5e18842837 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1460 microversion: 2.1 time: 0.992450 Sep 27 01:34:06.106055 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 316/673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:05 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1460 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:06.117525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:06.128299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:06.171378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.173821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.176825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.182431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.186900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.187547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.234566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:06.246822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fa30bce-dd2f-4760-a216-3d536236c04c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 1.256607 Sep 27 01:34:06.248113 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 358/674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:04 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:06.262407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:06.263398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:06.286021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.286529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.286970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.287698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.291170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.291859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.588278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:06.592489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:06.609416 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-249749dc-b0c8-48df-b160-ac31ded644e5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1272 microversion: 2.1 time: 0.497330 Sep 27 01:34:06.610734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 317/675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:06 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1272 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:06.624618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:06.626585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:06.648937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.651502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.652352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.660314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:06.661142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:06.661747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:06.812900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:06.832748 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3b865d99-35ae-4d29-8fd5-608eacd2dc88 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.582469 Sep 27 01:34:06.838518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 359/676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:06 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:06.844947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70041308-eb18-4caa-8500-dc76cb7cf463 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6732ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:06.953100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70041308-eb18-4caa-8500-dc76cb7cf463 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.112369 Sep 27 01:34:06.963724 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 360/677] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:06 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:06.977979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:06.979036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:06.999819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.006514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.007345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:07.008391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.009147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.009858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:07.113702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:07.124767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:07.144008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:07.165945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1511a59e-58f8-4007-808f-acdc203c6ceb tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.553680 Sep 27 01:34:07.174365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 318/678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:06 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:07.200470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:07.201104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:07.221184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.221615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.222554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:07.223502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.224148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.225911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:07.574367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:07.587825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1df14ca2-a628-4d03-941f-bc4fd03bf92f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1334 microversion: 2.1 time: 0.408038 Sep 27 01:34:07.591295 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 319/679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:07 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1334 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:07.598983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:07.606191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:07.615116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.622040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.622718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:07.625030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:07.625838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:07.627574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:08.971677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6791f089-2f07-4f12-b0f3-c196d80e52b8 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1611 microversion: 2.1 time: 2.005948 Sep 27 01:34:08.979425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 361/680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:06 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1611 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:08.984665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:09.008248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98309369-5f2d-4d45-ab5e-7a7ae22fb224 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1503 microversion: 2.1 time: 1.415515 Sep 27 01:34:09.011707 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 320/681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:07 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1503 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:09.027188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:09.032507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:09.046294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:09.053747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:09.060853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.072822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.073293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.080076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.080567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.087112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.092934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.097292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.098525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.099521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.101808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.102616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.689764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:09.712059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7c4ef44-8be4-484d-bf18-3212c0b7adf4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.721048 Sep 27 01:34:09.716955 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 362/682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:08 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:09.730043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1015be6f-1602-4910-9638-0efadf2cfddf tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69a2940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:09.803824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1015be6f-1602-4910-9638-0efadf2cfddf tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.085511 Sep 27 01:34:09.805891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 363/683] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:09 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:09.812261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b41540-3ef8-45d5-872b-f2327c6ff302", "tag": "18a35574-3c52-4fd2-b25b-83bc820fef07"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:09.824718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.829492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.830177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.856696 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] Creating event network-changed:18a35574-3c52-4fd2-b25b-83bc820fef07 for instance 70b41540-3ef8-45d5-872b-f2327c6ff302 on n-h2-859358-1 Sep 27 01:34:09.872974 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-67fc9c93-9576-4ecc-9726-0370db61e753 req-6c52b859-843f-4b32-8c38-b13ddaa65b41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065568 Sep 27 01:34:09.875997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 364/684] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:09.885191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:09.891579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:09.905543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.906446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.907786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:09.910982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:09.911742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:09.912461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.105564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:10.132683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:10.141254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:10.167591 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e47517af-39bb-49fd-8de9-0b55f49ce1b5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.289561 Sep 27 01:34:10.174590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 365/685] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:09 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:10.190399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-plugged", "status": "completed", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:10.219384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.221188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.221865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.260407 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] Creating event network-vif-plugged:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:34:10.276149 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a99dfb35-0c59-43c6-a83f-6b69523aca09 req-4e0c3d5a-cd3a-4bf2-ad93-2fffd1accee7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098384 Sep 27 01:34:10.278844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 366/686] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:10.296793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:10.298565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:10.314665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.315726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.316485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.317485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.318180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.318846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.626495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:10.639143 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-807a67fe-2a3e-4b0e-bb9c-487b43ace47c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1322 microversion: 2.1 time: 0.357933 Sep 27 01:34:10.639742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 367/687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:10 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:10.675887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:10.704101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.706605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.708170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.711613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.712634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.713257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.756775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d32f1e2-eba1-4bf0-bd2c-75518a1f2773 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095922 Sep 27 01:34:10.758051 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 368/688] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:34:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:10.764661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a6eb49-ab9d-4843-8172-8da71781c9ff", "name": "network-vif-deleted", "tag": "68a4b333-0100-4d8f-927d-e9c4b50f582a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:10.779835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.780593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.781556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.804933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] Creating event network-vif-deleted:68a4b333-0100-4d8f-927d-e9c4b50f582a for instance 11a6eb49-ab9d-4843-8172-8da71781c9ff on n-h2-859358-1 Sep 27 01:34:10.812618 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-070eff1f-799c-45c7-b9c6-e0e4383601f2 req-46f3e11d-d7c8-4844-aa40-febc6aa0acf0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052992 Sep 27 01:34:10.813966 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 369/689] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:10.821524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:10.823260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:10.845677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.848773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.849858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:10.851123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:10.852546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:10.853228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.012952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:11.026419 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-928de1f9-b1ce-4006-b3b9-50efad37cebc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 2.003678 Sep 27 01:34:11.034340 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 321/690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:09 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:11.043946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:11.048860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:11.065519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.067345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.067799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.072101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.072607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.073054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.223546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:11.234306 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9306c26e-5454-45f0-b836-8c9d3e01b56e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1493 microversion: 2.1 time: 0.418723 Sep 27 01:34:11.254847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 370/691] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:10 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1493 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:11.271877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-859358-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:11.274667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:11.300310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.310105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.310817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.311744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.312388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.312980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.362847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:11.393122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:11.644675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Lazy-loading 'flavor' on Instance uuid 378927ff-1600-480f-929c-179a3fa466eb {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:11.771905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 378927ff-1600-480f-929c-179a3fa466eb while it is in vm_state suspended Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Request method failure captured: Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb/action HTTP/1.1 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 97 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLazHqybrGkPOKMCEOHyLh82x_dRg8N6tg2nvesA_zokVZpz5DQMLemh2pacsq0_nVndtgjaJ_GghxcYvWSBboUP8vRQeOa5bwpA8jHVxY8_1b8xVQxGCUu8hbzKFfDFcj2Kzx73HukxUtq9J48YJ4b3ybpTf7OE7ZeiSuE5isbCjc Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: abd5c40eca4448df966c442cd1ba6a08 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:34:11.774055 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/abd5c40eca4448df966c442cd1ba6a08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_abd5c40eca4448df966c442cd1ba6a08", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: abd5c40eca4448df966c442cd1ba6a08 Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1091392320 Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-LiveMigrationNegativeTest-1091392320-project-admin Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: adce223ef0fd4856b5b1ed2270c4a970 Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-LiveMigrationNegativeTest-1091392320-project-admin Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: {"os-migrateLive": {"host": "n-h2-859358-1", "block_migration": true, "disk_over_commit": false}} Sep 27 01:34:11.775524 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'os-migrateLive' instance 378927ff-1600-480f-929c-179a3fa466eb while it is in vm_state suspended Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '378927ff-1600-480f-929c-179a3fa466eb', 'body': {'os-migrateLive': {'host': 'n-h2-859358-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:34:11.776494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 378927ff-1600-480f-929c-179a3fa466eb in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:34:11.778446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 378927ff-1600-480f-929c-179a3fa466eb while it is in vm_state suspended Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 378927ff-1600-480f-929c-179a3fa466eb while it is in vm_state suspended Sep 27 01:34:11.780103 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:11.781362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 378927ff-1600-480f-929c-179a3fa466eb while it is in vm_state suspended {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:34:11.781465 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74f724ab-d33c-40e2-9bbe-4ada5e751d50 tempest-LiveMigrationNegativeTest-1091392320 tempest-LiveMigrationNegativeTest-1091392320-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb/action" status: 409 len: 155 microversion: 2.1 time: 0.524903 Sep 27 01:34:11.788810 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 371/692] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:11 2022] POST /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb/action => generated 155 bytes in 529 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:34:11.798358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85c83d48-2d86-4ddf-b29f-1ef96930b71d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69a2280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:11.904425 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85c83d48-2d86-4ddf-b29f-1ef96930b71d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.117928 Sep 27 01:34:11.905330 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 372/693] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:11 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:11.920401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:11.924066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:11.935743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:11.951880 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af69f6b6-2aed-4a56-80d6-40c4f693d81f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.916348 Sep 27 01:34:11.952476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 322/694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:11 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:11.964199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e098aea-6ac0-4591-903a-05a592f936d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '.version_select at 0x7f24d685eee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:11.969897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.970422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.970858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.971578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.972033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.972459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:11.973927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e098aea-6ac0-4591-903a-05a592f936d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:11.978288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e098aea-6ac0-4591-903a-05a592f936d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:11.978991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e098aea-6ac0-4591-903a-05a592f936d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.007491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:12.018107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e098aea-6ac0-4591-903a-05a592f936d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.061658 Sep 27 01:34:12.019741 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 323/695] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:34:11 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:12.032318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:12.032527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:12.050992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.051489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.051932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.052657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.053116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.053578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.398228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:12.413813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:12.424933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:12.442193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7054a3e-295c-4adc-a7b1-5c8ec0b99811 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.534780 Sep 27 01:34:12.468057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 373/696] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:11 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:12.499460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:12.499970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:12.551699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:12.555513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.555948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.556391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.557106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.557618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.558594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.575578 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a632c44-53e4-4198-854f-da2cce50dafc tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.554545 Sep 27 01:34:12.578735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 324/697] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:12 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:12.590533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:12.593071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:12.606815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.609144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.609839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.612358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:12.612992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:12.614482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:12.672245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:34:13.040074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1b62da0-2164-45d3-8b47-0fa0eef22f1c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "DELETE /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 204 len: 0 microversion: 2.1 time: 0.566917 Sep 27 01:34:13.046695 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 374/698] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:34:12 2022] DELETE /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:34:13.051875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.052252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:13.059660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.059660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.059982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.060533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.060984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.061427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.086463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:13.145809 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-444bc41e-9e9d-4500-85b0-b7e58697aed3 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1644 microversion: 2.1 time: 0.565783 Sep 27 01:34:13.146416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 325/699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:12 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1644 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:13.167490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:13.199530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.201213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.202917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.235489 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] Creating event network-changed:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:34:13.252475 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-83f46c8b-3229-4ed5-acc1-5c1b7bc01b8c req-49104c8a-c4b6-43a9-8ed2-62876998652f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096682 Sep 27 01:34:13.255350 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 326/700] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:13.276080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fd58f48-02b2-4b32-ac10-12e6afe36004 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6bc33a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.281642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.291424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d135b092-6e9e-4af9-a669-a992ccafe0d3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.244849 Sep 27 01:34:13.292960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 375/701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:13.298309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.299825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:13.307710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.308259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.308826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.309969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.310534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.311066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.353729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fd58f48-02b2-4b32-ac10-12e6afe36004 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.095917 Sep 27 01:34:13.355129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 327/702] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:13.363268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.368380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:13.377048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.382716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.384677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.386176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.387373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.389068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.513606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.524219 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-860e4865-ca95-4e5f-8f68-d86caba39a2a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.229950 Sep 27 01:34:13.525153 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 376/703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:13.530328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-237192679", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "e586b006-974b-41f8-931d-30e9fc73d562"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:13.600112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] validate_networks() for [('e586b006-974b-41f8-931d-30e9fc73d562', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:13.733167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.742516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-968c6b2b-01cc-436f-be3a-7e3cb718101b tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1466 microversion: 2.1 time: 0.386170 Sep 27 01:34:13.754063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 328/704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1466 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:13.759696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.760352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:13.773404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.774492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.774927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.775637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:13.776251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:13.776999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:13.923858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.942618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.944106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:13.960504 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4be5ba1c-38ba-4c86-bd31-853a5804e10d tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.211375 Sep 27 01:34:13.961083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 329/705] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:13.991159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:13.991907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:13.999845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.000559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.001198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.002417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.003078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.003781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.194761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:14.195746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:14.196977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:14.197222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:14.197878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:14.227207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.231461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.233426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.235281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.239356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.242556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.282262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:14.298066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-333ba130-60a8-4821-8803-2aba022ce14e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.308368 Sep 27 01:34:14.302799 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 330/706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:13 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:14.312776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a", "tag": "1d7d0d3c-2b96-412e-abd5-81b20e85977e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:14.314888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:14.328045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for user 56e5b4943e3c4d31aec5dd4dc2ecac66 and project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:14.344024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:14.346725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:14.362864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.363530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.364231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.389172 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] Creating event network-changed:1d7d0d3c-2b96-412e-abd5-81b20e85977e for instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a on n-h2-859358-1 Sep 27 01:34:14.399663 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c95721f3-56d2-480d-b7fc-0400c52270a1 req-c5d31bf2-bdec-4e90-8b37-5453364d1ebf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092467 Sep 27 01:34:14.403743 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 331/707] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:14.416332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:14.420212 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f179059-d75a-497b-8f68-54804255773c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894138 Sep 27 01:34:14.421376 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 377/708] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:14.429311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:14.431191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-883d74a7-1876-4dd2-bbc5-25949f6e0228 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67323a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:14.503916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.504732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.505434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.506376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.507027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.508195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.540302 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-883d74a7-1876-4dd2-bbc5-25949f6e0228 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.117803 Sep 27 01:34:14.551065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 378/709] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:14 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:14.562614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d918e924-246f-478f-be64-535bcf426b9c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:14.563226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d918e924-246f-478f-be64-535bcf426b9c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:14.690874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d918e924-246f-478f-be64-535bcf426b9c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:14.701705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d918e924-246f-478f-be64-535bcf426b9c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1210 microversion: 2.1 time: 0.149022 Sep 27 01:34:14.702587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 379/710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:14 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:14.713935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:14.715531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:14.727188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.729981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.730744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:14.731288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:14.731745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:14.732367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.138165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.147238 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9faa0c2-f01d-4811-a3a8-13ed769f826c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.738731 Sep 27 01:34:15.153464 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 332/711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:14 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:15.165804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.170727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:15.171529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:15.177156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d101426-0a9f-4a9b-9bf6-580ef215f73e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.473199 Sep 27 01:34:15.178256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 380/712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:14 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:15.185004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.188631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:15.189232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:15.189531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.190297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.191374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.192437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.193221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.212659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.213163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.213636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.214395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.214846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.215269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.445199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.472761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.474253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.489589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-578499e5-4c25-4f8c-aec5-366f3bb8da5c tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1447 microversion: 2.75 time: 0.304519 Sep 27 01:34:15.496963 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 381/713] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:15 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1447 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:15.501829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:15.502477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:15.515351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.517981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.519478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.524741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.525463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.526067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.668558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.686606 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b720d6c-2495-42ea-91d3-e38c64d3c278 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1466 microversion: 2.1 time: 0.531696 Sep 27 01:34:15.705497 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 333/714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:15 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1466 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:15.715755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-866e7dfd-d782-4ac3-a75c-c29f46c37716 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d667e670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:15.838066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:15.843613 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-866e7dfd-d782-4ac3-a75c-c29f46c37716 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.137134 Sep 27 01:34:15.845901 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 334/715] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:15 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:15.851360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:15.852157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:15.862195 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc7f4343-e2c9-4be0-ae2b-9f7801bef9e8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.359337 Sep 27 01:34:15.868717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.869510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.870656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.872024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:15.872830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:15.873520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:15.881258 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 382/716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:15 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:16.012069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.020616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb1155a8-b44a-410f-9cea-763fb2dc3b54 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1262 microversion: 2.1 time: 0.173498 Sep 27 01:34:16.037432 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 335/717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:15 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1262 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:16.180282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:16.181364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:16.203860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:16.204216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:16.214875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.216355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.217448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.220862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.221707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.222121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.223221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.223663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.224395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.224840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.225271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.233410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.676318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.689701 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-42dc16d5-bf2d-4241-abd9-b33d50043bfc tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.513453 Sep 27 01:34:16.694106 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 383/718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:16 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:16.708538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:16.710106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:16.722385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.727895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.730115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.731153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.732998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.733680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.754081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.767602 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3854eb9-2c83-4fe1-8926-9f5bbf73e767 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.566090 Sep 27 01:34:16.768892 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 336/719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:16 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:16.776993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:16.779271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:16.792970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.794853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.796376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.798044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:16.799357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:16.801382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:16.881629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.902539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.904055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:16.913362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26467316-afcb-4836-b2c9-44a1e7456ad0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1453 microversion: 2.75 time: 0.217911 Sep 27 01:34:16.925380 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 384/720] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:16 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:16.928500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ea3a145-06c5-4f00-91b9-2f2707c741fb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67863a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:17.005269 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ea3a145-06c5-4f00-91b9-2f2707c741fb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.089828 Sep 27 01:34:17.006377 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 385/721] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:16 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:17.016229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1c64ff-e97c-4523-865b-7788bf200424", "tag": "0d0834fa-4ab7-4e82-b401-50506eedac01"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:17.043033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.043679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.044228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.063548 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] Creating event network-changed:0d0834fa-4ab7-4e82-b401-50506eedac01 for instance 7e1c64ff-e97c-4523-865b-7788bf200424 on n-h2-859358-1 Sep 27 01:34:17.073256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-020462b2-6bce-4916-879b-3551e85118de req-1fbf7a99-f6f7-460f-9879-790938c456af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065522 Sep 27 01:34:17.077637 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 386/722] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:17.087017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:17.087737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:17.111847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:17.114014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.117034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.117560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.118330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.118816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.119253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.123503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:17.135383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41d7e415-4276-4c3b-bc5c-a7c023710411 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1466 microversion: 2.1 time: 0.365093 Sep 27 01:34:17.136342 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 337/723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:16 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:17.142383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:17.142999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:17.179700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.180184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.180633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.181371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.181824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.182256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.258023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:17.311005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:17.322477 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96743ea0-63a8-42bc-a634-c9cfc1bd974c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1262 microversion: 2.1 time: 0.185050 Sep 27 01:34:17.325090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 338/724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:17 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1262 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:17.340678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378927ff-1600-480f-929c-179a3fa466eb", "name": "network-vif-deleted", "tag": "5d3e63f2-470e-4085-b88e-782122a2a9b3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:17.360813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.361812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.362524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.378318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] Creating event network-vif-deleted:5d3e63f2-470e-4085-b88e-782122a2a9b3 for instance 378927ff-1600-480f-929c-179a3fa466eb on n-h1-859358-1 Sep 27 01:34:17.385101 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b03fa886-ca58-4b10-8585-985403f5e3cd req-71a90feb-c256-412d-ad32-2be222423ecf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057933 Sep 27 01:34:17.387662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 339/725] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:17.487248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:17.496470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49748cea-056c-471f-bd2e-62f50cd1bb60 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.417485 Sep 27 01:34:17.501291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 387/726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:17 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:17.722154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:17.722893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:17.733754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.734591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.735342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.736267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.736947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.737632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.796439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:17.797230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:17.807954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.814542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.815089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.815850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:17.821564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:17.822117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:17.946626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:17.962137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-779d3adc-1c3c-44b0-959e-4e9c85f7086d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.238585 Sep 27 01:34:17.982462 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 340/727] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:17 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:17.995598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.001740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:18.010863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.014362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.015103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.016133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.016865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.017474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.066075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.075651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28c5f666-763f-4513-8b5f-7ac9dd4d9b5f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.284134 Sep 27 01:34:18.099298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 388/728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:17 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:18.107720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-372a5551-e428-45a0-a1c5-3064fea7f062 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6931d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.200791 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-372a5551-e428-45a0-a1c5-3064fea7f062 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.100284 Sep 27 01:34:18.208739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 389/729] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:18 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:18.208923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.211851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.214951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:18.225318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.227246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.228938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.230274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.233293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.233919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.235351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.236182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.252628 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75463d35-b492-46a7-9f3f-2407195bacb0 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1453 microversion: 2.75 time: 0.267467 Sep 27 01:34:18.255234 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 341/730] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:17 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1453 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:18.300657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.301298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.301863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.302453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lazy-loading 'fault' on Instance uuid 378927ff-1600-480f-929c-179a3fa466eb {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:18.352896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.353552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:18.366051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.367805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.368472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.369780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.370960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.372013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.432780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.441068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d92bf70-c821-49ab-a86c-29b6bb476dec tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1309 microversion: 2.1 time: 0.238217 Sep 27 01:34:18.443993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 390/731] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:18 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1309 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:18.467734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:18.477354 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3053edf3-61f6-4996-9227-c56057575a88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1262 microversion: 2.1 time: 0.130035 Sep 27 01:34:18.487208 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 342/732] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:18 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1262 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:18.528324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.529184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:18.547248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.547991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.549063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.559359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:18.560152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:18.562326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:18.993711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:18.994328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:19.016128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.024146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.027750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.029562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.034381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.037326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.233002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.243138 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8184dcd-e8bf-4805-85c5-0690c8f3d416 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.720291 Sep 27 01:34:19.246860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 391/733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:18 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:19.256092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:19.257003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:19.279107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.282408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.283218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.285589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.286416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.287058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.332920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.347548 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-118b4e55-7ab1-417c-9c53-5af275446d8c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.355230 Sep 27 01:34:19.350715 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 343/734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:18 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:19.361614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fab0698c-e4a0-4307-a1e2-0c770ec5c9f1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6800550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:19.435953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fab0698c-e4a0-4307-a1e2-0c770ec5c9f1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.084158 Sep 27 01:34:19.436714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 344/735] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:19 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:19.442857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:19.444079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:19.499538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.500516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.501211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.502187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.502784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.503597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.628787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.646990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.650393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.669625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bb7fe2c-1b20-47b5-ba21-602a5fd8b7b4 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1453 microversion: 2.75 time: 0.228741 Sep 27 01:34:19.671821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 345/736] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:19 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1453 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:19.681152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:19.685211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:19.709267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.712491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.713005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.716734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.717255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.717945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.755716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:19.768835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4604a21-135f-4dc3-87df-a780ad10a1d7 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.520503 Sep 27 01:34:19.778439 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 392/737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:19 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:19.788551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:19.794787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:19.794992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.795300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.795749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.796211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lazy-loading 'fault' on Instance uuid 378927ff-1600-480f-929c-179a3fa466eb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:19.811675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.812316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.813020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.815311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:19.816006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:19.816648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:19.863386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:20.009611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:20.021919 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70174d39-8e20-45c1-a149-30e008547ee6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1270 microversion: 2.1 time: 0.242250 Sep 27 01:34:20.040755 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 393/738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:19 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1270 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:20.105800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:20.117627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c21f3cd-eb58-4012-beef-2b1bac1ebe46 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 200 len: 1309 microversion: 2.1 time: 0.444474 Sep 27 01:34:20.118416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 346/739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:19 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:20.272197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:20.273613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:20.286257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:20.287084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:20.287770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:20.291174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:20.292851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:20.293610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:20.385950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:20.386812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:20.423466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:20.427402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:20.429669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:20.430671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:20.432858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:20.433607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.072274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.092949 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bffa61e6-5e68-415f-a289-71f93f528ed6 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.824996 Sep 27 01:34:21.100960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 394/740] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:20 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:21.106577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ede75a0-6b7a-4ce1-be68-86254bed820d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66be0d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:21.179356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ede75a0-6b7a-4ce1-be68-86254bed820d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.076273 Sep 27 01:34:21.180645 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 395/741] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:21 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:21.187131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:21.188058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:21.195836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.196740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.197637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.199372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.200116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.200823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.202813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.218249 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2939ea33-4336-41ba-8d32-26a1ea0794d6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.839234 Sep 27 01:34:21.229361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 347/742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:20 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:21.229361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:21.229361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:21.250073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.250844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.251528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.259312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.260196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.269118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.481576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.495766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.506137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.519812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-535e6ea5-a1ea-47f5-a267-cb9c1125c97a tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1438 microversion: 2.75 time: 0.337473 Sep 27 01:34:21.522906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 396/743] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:21 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1438 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:21.540008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:21.541209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:21.555471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.558090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.561495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.563622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.564717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.565610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.702569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:21.717646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-78e3947d-322d-4d63-a857-194e913a2cd1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1268 microversion: 2.1 time: 0.192603 Sep 27 01:34:21.720727 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 397/744] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:21 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:21.725843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:21.726965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 378927ff-1600-480f-929c-179a3fa466eb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:21.737950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.747924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.748492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.751641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.753037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.753690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.773796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] HTTP exception thrown: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Request method failure captured: Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb HTTP/1.1 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLYVXZ2ioVbPAz6DtIgiv6dF3SlN_med8OGibfOeEhl1tKAcTfC0mpn4w4D29tjGNpsvzwjmw-uyzCUvKnvPJZnHaqzVbVhAoQXlmiATzdmDe5yfamYOPUAsPIVB4G3tViwBW_xgnR0ShXndyyAslsZG800U1I0WMtNhxQMCTHpDog Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 862ef10c99004b439614e74ff0ef1882 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:34:21.777154 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_862ef10c99004b439614e74ff0ef1882", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 862ef10c99004b439614e74ff0ef1882 Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-LiveMigrationNegativeTest-1644927018-project Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d8fe716033ee444e86a10ef605dd79fc Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-LiveMigrationNegativeTest-1644927018-project Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. Sep 27 01:34:21.778849 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '378927ff-1600-480f-929c-179a3fa466eb'} Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:34:21.779803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. Sep 27 01:34:21.781168 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:21.783920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Returning 404 to user: Instance 378927ff-1600-480f-929c-179a3fa466eb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:34:21.785027 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24ee0399-dea0-4a71-a783-36648ef26e93 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb" status: 404 len: 111 microversion: 2.1 time: 0.062962 Sep 27 01:34:21.786183 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 398/745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:21 2022] GET /compute/v2.1/servers/378927ff-1600-480f-929c-179a3fa466eb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:34:21.792074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b41540-3ef8-45d5-872b-f2327c6ff302", "name": "network-vif-plugged", "status": "completed", "tag": "18a35574-3c52-4fd2-b25b-83bc820fef07"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:21.814427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:21.816702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:21.818960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:21.845960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] Creating event network-vif-plugged:18a35574-3c52-4fd2-b25b-83bc820fef07 for instance 70b41540-3ef8-45d5-872b-f2327c6ff302 on n-h2-859358-1 Sep 27 01:34:21.859435 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-50c3cb48-0eea-4f68-a38e-1989d5c6cf31 req-1d5227c9-b007-436d-b0b0-40a6e9470d51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071778 Sep 27 01:34:21.860329 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 399/746] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:22.157081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:22.173170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22841a45-1053-40bf-9381-c9803d308904 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.951052 Sep 27 01:34:22.174157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 348/747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:21 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:22.189164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:22.190214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:22.199643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.202000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.202737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.206769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.209038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.209742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.220566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:22.224543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:22.232289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.233092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.233588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.234625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.235583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.236013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.269384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:34:22.391822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:22.395614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:22.396581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:22.396999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:22.397442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:22.496248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:22.532322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:22.553042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.553939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.554646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.555626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:22.556401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:22.557516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:22.564244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7633ee24-7947-433b-b4d2-92c9254e5f6c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 204 len: 0 microversion: 2.1 time: 0.386908 Sep 27 01:34:22.567078 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 349/748] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:34:22 2022] DELETE /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:34:22.733288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1384608351", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "239c95d9-c168-4521-87d2-b79ab3af1a31"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:22.827623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:22.860656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] validate_networks() for [('239c95d9-c168-4521-87d2-b79ab3af1a31', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:23.003163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4da07783-43c1-471d-8337-5161d9c7638c tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3/action" status: 202 len: 1942 microversion: 2.75 time: 1.138804 Sep 27 01:34:23.004993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 400/749] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:34:21 2022] POST /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3/action => generated 1942 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 27 01:34:23.018269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:23.021640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:23.043127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.051384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.052578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.054439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.059382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.060388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.514592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:23.529140 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ef11145-59d5-4f5f-97c5-52798bff3117 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.522514 Sep 27 01:34:23.548775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 401/750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:23 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:23.554198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e515bc24-58bb-417f-8ecd-0d46fdefd311 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66be4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:23.620973 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e515bc24-58bb-417f-8ecd-0d46fdefd311 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.071082 Sep 27 01:34:23.621642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 402/751] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:23 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:23.634799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:23.635474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:23.647444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.650880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.651387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.652153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.652626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.653063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.759201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:23.760461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:23.761115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:23.761721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:23.762298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:23.779559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.780046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.781859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.784418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.785067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.787586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.837754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:23.851254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:23.856546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for user 5591a6d007e9465a9ec1a856483feb6d and project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:23.862676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-21809c3a-80d0-46af-8822-304d77895506 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1317 microversion: 2.1 time: 0.239988 Sep 27 01:34:23.877886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 403/752] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:23 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:23.882164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:23.884173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:23.885006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:23.891673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.892431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.893075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:23.893477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:23.894180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:23.894794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:23.895384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.051416 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4e968a1-55f1-40f2-84ec-9032736493d0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.480009 Sep 27 01:34:24.059650 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 350/753] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:34:24.096227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:24.100907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:24.118792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.121284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.121790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.123512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.125913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.126556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.288435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:24.313956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:24.322137 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8092605f-ece3-45d9-ab7f-ed0ebdc8d9dc tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1474 microversion: 2.1 time: 0.442887 Sep 27 01:34:24.342571 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 404/754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:23 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1474 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:24.352282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:24.354926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:24.371216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.371759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.373380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.374132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.374600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.375911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.663802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:24.711629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:24.757597 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bea89685-4527-448e-9341-48cab4d46705 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.413764 Sep 27 01:34:24.758782 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 405/755] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:24 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:24.764579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:24.768202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:24.781663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.782906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.785007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:24.786077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:24.788151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:24.788782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.112184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.135545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53968f49-5906-43eb-907a-1d5d85e036df tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 1.073788 Sep 27 01:34:25.139723 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 351/756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:24 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:25.155293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a", "name": "network-vif-plugged", "status": "completed", "tag": "1d7d0d3c-2b96-412e-abd5-81b20e85977e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:25.179123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.179597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.193585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.203057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.224618 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9c90a32-1fe0-4643-afe6-c957c487327c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.463620 Sep 27 01:34:25.229768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 406/757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:24 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:25.244404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:25.246055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:25.250715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] Creating event network-vif-plugged:1d7d0d3c-2b96-412e-abd5-81b20e85977e for instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a on n-h2-859358-1 Sep 27 01:34:25.264846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f16cec16-1300-4541-831d-f1c712f7eebc req-5c97ca50-3dbc-4dd3-b150-83e94afd199b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123676 Sep 27 01:34:25.268802 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 352/758] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:25.271333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.276584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.277163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.278635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.279187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.279692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.280232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:25.280949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:25.297941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.298437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.298879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.299591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.300043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.300467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.416949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.427691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.430829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.433691 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9aa229ae-7fff-4fe6-9d4e-71ebe88d0a0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1258 microversion: 2.25 time: 0.202729 Sep 27 01:34:25.451797 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 407/759] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:25 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:25.473973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd2acb99-18e1-443b-9f6d-c9521fe1601c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67323a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:25.582619 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd2acb99-18e1-443b-9f6d-c9521fe1601c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.129409 Sep 27 01:34:25.584257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 408/760] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:25 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:25.591008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:25.592490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:25.602075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.602941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.603602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.604674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.607020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.607671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.916034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:25.933096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7186f252-2465-4af9-ba48-a960cdb10712 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1467 microversion: 2.1 time: 0.346256 Sep 27 01:34:25.945855 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 409/761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:25 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:25.956701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:25.957621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:25.966975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.968637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.969971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:25.972113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:25.973106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:25.974256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.075227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:26.093734 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea33237d-d4cc-4c5f-9a5a-1d03a3a8fe3e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.823099 Sep 27 01:34:26.110611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 353/762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:25 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:26.119955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:26.121723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:26.130801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.132314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.132943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.133945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.135707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.136311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.238336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:26.255398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f37ab5a-f37a-4bad-88b2-1416af39aa74 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1474 microversion: 2.1 time: 0.304065 Sep 27 01:34:26.256038 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 410/763] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:25 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:26.269560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:26.270855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:26.277554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.278039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.278484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.279168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.279614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.280044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.309773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:26.399430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:26.503479 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47156928-edb4-47ee-8587-b0306467e243 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1618 microversion: 2.1 time: 0.245700 Sep 27 01:34:26.504817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 411/764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:26 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1618 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:26.515823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:26.516637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:26.523890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.524764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.525535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.527351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.528343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.528934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.602461 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4350078-dc4b-4c97-aa1b-3438a0515f70 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.490010 Sep 27 01:34:26.604426 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 354/765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:26 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:26.610327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd37ed9d-c74d-40a7-9a37-12b6a8a490f1", "tag": "772958ef-077e-4e59-b95a-c1309b8c6b76"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:26.623211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.624247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.624906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.639029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] Creating event network-changed:772958ef-077e-4e59-b95a-c1309b8c6b76 for instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 on n-h2-859358-1 Sep 27 01:34:26.645642 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7b209d59-e3df-4911-9176-17f32173af30 req-af01e0d5-4f80-442c-8158-32b035411668 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039406 Sep 27 01:34:26.651001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 355/766] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:26.672302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:26.676662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:26.705018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.705867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.707915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.708919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:26.717840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:26.718651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:26.770879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:27.019070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.035008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5c455c2-8b33-4b32-9ced-74258031cc7c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.527102 Sep 27 01:34:27.036789 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 412/767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:26 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:27.047298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:27.048122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:27.055110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.055836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.057494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.059116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.059758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.060357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.185803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.200338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.200727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13ea1531-2788-449c-9b58-3202617245a2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.544709 Sep 27 01:34:27.202683 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 356/768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:26 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:27.218854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3dc95cb-5fd9-4013-bba6-3f9c491ee7b1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69e74c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:27.227470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.231635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.232426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-21c6ac6f-0275-4e46-846e-e2a9596e72fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1320 microversion: 2.25 time: 0.194431 Sep 27 01:34:27.235672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 413/769] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:27 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:27.257092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1831073142", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a2cb4d2f-dfde-4d66-9438-99dba5838034"]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:27.314141 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3dc95cb-5fd9-4013-bba6-3f9c491ee7b1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.108445 Sep 27 01:34:27.315545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 357/770] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:27 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:27.327057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:27.329431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:27.348901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.350543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.353270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.354689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.355864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.357696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.407646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:27.742075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:27.742499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:27.742980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:27.744175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:27.745128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:27.757038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.757874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.758476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.759538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.760759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.761400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.770289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:27.781147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ddbaf3ce-19be-4a3d-9039-7ca2b7253c0c tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.464453 Sep 27 01:34:27.782376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 358/771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:27 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:27.794168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:27.795161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:27.802642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:27.808162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.808779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.809535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.811646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:27.811961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.813156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.813938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.829290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:27.832014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:27.896902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9831e6a-6156-4c50-9895-765e5cbbcf46 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660035 Sep 27 01:34:27.897149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.897644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.903921 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 414/772] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:27.903921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:27.903921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:27.908067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.909070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lazy-loading 'fault' on Instance uuid 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:27.911331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.911886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.912322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:27.913666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:27.914141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:27.914797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.022735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fe716033ee444e86a10ef605dd79fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ef10c99004b439614e74ff0ef1882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.077115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab7c4db7-b43e-4be6-8979-78fbb3cc0f95 tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 200 len: 1309 microversion: 2.1 time: 0.293405 Sep 27 01:34:28.078334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 359/773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:27 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 1309 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:28.086266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77f6e1a0-8885-4a8e-a693-c25f3c98e8ff tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.094124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77f6e1a0-8885-4a8e-a693-c25f3c98e8ff tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:28.148772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:28.189931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0084235e-55d3-4e8d-bf25-6571fe5f6554 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.290344 Sep 27 01:34:28.190981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 415/774] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:27 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:28.197075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.198236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:28.206025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.206644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.207297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.207721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.208180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.208897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.218032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77f6e1a0-8885-4a8e-a693-c25f3c98e8ff tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.232001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77f6e1a0-8885-4a8e-a693-c25f3c98e8ff tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1217 microversion: 2.1 time: 0.147101 Sep 27 01:34:28.233482 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 360/775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:28.240613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.244059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:28.258073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.258737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.259947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.261641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.262412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.263548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.473178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.486830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50c3ceae-0d49-4abe-9cd6-6ac14eed8e75 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.294421 Sep 27 01:34:28.500365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 416/776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:28.500365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.508852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:28.516457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.516940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.517388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.518097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.518541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.518959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.634695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.645492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fed63bd-2e7a-4bc0-9102-ec3a70533b19 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.410743 Sep 27 01:34:28.653492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 361/777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:28.667060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-efaa83ed-4477-4257-867a-bc053bf9524c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6800a60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.772337 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-efaa83ed-4477-4257-867a-bc053bf9524c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1455 microversion: 2.1 time: 0.116862 Sep 27 01:34:28.774995 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 362/778] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:28.792393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0", "name": "network-vif-deleted", "tag": "fb1fe77b-216c-4f77-8f7b-5f20ba4a4058"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:28.818875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.820777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.821073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.821794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.831828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.838686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] Creating event network-vif-deleted:fb1fe77b-216c-4f77-8f7b-5f20ba4a4058 for instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 on n-h1-859358-1 Sep 27 01:34:28.842291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:28.843642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f5192e02-668d-4972-9c5e-c15bb2c68b38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.355086 Sep 27 01:34:28.844727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fe697a23-a0a1-412e-a786-004c48250941 req-de7cb2b6-bb96-4b05-ac63-c1861c79efb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067683 Sep 27 01:34:28.845872 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 363/779] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:28.851322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:28.852348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:28.854089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 417/780] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:28.859659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.860455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.861153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:28.862115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:28.862790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:28.863435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.104501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.106122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] [instance: 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.112154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.112892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.113318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.114069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.114515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.114966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.130302 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] HTTP exception thrown: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Request method failure captured: Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 HTTP/1.1 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLYVXZ2ioVbPAz6DtIgiv6dF3SlN_med8OGibfOeEhl1tKAcTfC0mpn4w4D29tjGNpsvzwjmw-uyzCUvKnvPJZnHaqzVbVhAoQXlmiATzdmDe5yfamYOPUAsPIVB4G3tViwBW_xgnR0ShXndyyAslsZG800U1I0WMtNhxQMCTHpDog Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 862ef10c99004b439614e74ff0ef1882 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:34:29.133775 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/862ef10c99004b439614e74ff0ef1882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_862ef10c99004b439614e74ff0ef1882", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 862ef10c99004b439614e74ff0ef1882 Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1644927018 Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-LiveMigrationNegativeTest-1644927018-project Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d8fe716033ee444e86a10ef605dd79fc Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-LiveMigrationNegativeTest-1644927018-project Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. Sep 27 01:34:29.136093 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0'} Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:34:29.137381 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. Sep 27 01:34:29.140472 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:29.143235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] Returning 404 to user: Instance 8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:34:29.143235 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a23dd0c-ce4f-4cd2-9b49-ca4a2b1d404c tempest-LiveMigrationNegativeTest-1644927018 tempest-LiveMigrationNegativeTest-1644927018-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0" status: 404 len: 111 microversion: 2.1 time: 0.034826 Sep 27 01:34:29.144277 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 418/781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/8ef5e5f6-a3b4-4846-bae3-2788ccdf99d0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:34:29.176107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:29.184710 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad112f21-a960-44b1-8f8a-88842b987ee3 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.337414 Sep 27 01:34:29.185283 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 364/782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:28 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:29.222492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.223349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.230339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.231031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.231735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.232930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.233598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.235080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.254821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.255436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.263741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.264429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.264966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.265580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.266115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.267467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.339789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:29.358462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2411ca21-0ca7-4a98-a1e3-803ac4888847 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.139693 Sep 27 01:34:29.361382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 419/783] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:29.363552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:29.375394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fcc5ed3-2c98-41b0-88bc-852e398b1df8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1221 microversion: 2.1 time: 0.124790 Sep 27 01:34:29.376038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 365/784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:29.516661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.517387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.523559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.524298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.524724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.525649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.526253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.526875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.673393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.674692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.687047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.687839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:29.690947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.692167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.694296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.696333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.698026 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-289deb9e-afe2-4db9-82d8-0c8118add913 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.185082 Sep 27 01:34:29.699499 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 420/785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:29.701469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.791800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d83ebdd3-832a-4790-9fad-cc9118b841c3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66beb80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.841118 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d83ebdd3-832a-4790-9fad-cc9118b841c3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1464 microversion: 2.1 time: 0.054137 Sep 27 01:34:29.845731 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 421/786] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:29.849873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-plugged", "status": "completed", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:29.860478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.861252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.861767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.875120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] Creating event network-vif-plugged:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:34:29.881050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9729695b-eb0b-4148-9201-417c8f647338 req-925288ba-5f80-431a-b8ac-56421184b38a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037263 Sep 27 01:34:29.882329 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 422/787] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:29.889990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cdb4a28f-8e48-4a16-9a51-a953810be08a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6732ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.944579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cdb4a28f-8e48-4a16-9a51-a953810be08a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 200 len: 1464 microversion: 2.1 time: 0.060046 Sep 27 01:34:29.954883 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 423/788] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:29.960987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:29.961763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:29.968644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.969134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.969598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:29.970301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:29.970752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:29.971175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.149159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.158854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.160547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.161693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70ca5170-a079-4439-8de3-7c659698828d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.206382 Sep 27 01:34:30.162246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 424/789] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:30.167796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.169229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.175903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.176616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.177049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.177776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.178377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.178958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.254561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.264582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-baa67e1d-fb70-49e8-834d-ff66cb4421bd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.595624 Sep 27 01:34:30.265959 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 366/790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:29 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:30.271992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.272795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.279605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.280609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.281289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.282269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.282977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.283906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.357458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.365216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-995073c3-ed2c-41da-8599-88e69a657de5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1467 microversion: 2.1 time: 0.201515 Sep 27 01:34:30.366035 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 425/791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1467 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:30.387240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.387851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.394785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.395271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.395701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.396398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.396853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.397287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.491687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:30.515348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e0ea3cb-74dc-4671-8758-7297daa1db12 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.131431 Sep 27 01:34:30.517507 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 426/792] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:30.525031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-669163391"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:30.527615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.531027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:30.536009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.536691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.539667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.539667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.539667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.539667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.557557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.578044 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a76d75a0-66e6-458b-8329-3526c0fa9828 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.310677 Sep 27 01:34:30.578644 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 367/793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:30.596514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.597131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.611449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.612080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.612378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.613094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.613591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.614022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.755555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:30.766110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-198ffed8-7a86-44a2-b9b5-b973cec84563 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1213 microversion: 2.1 time: 0.173320 Sep 27 01:34:30.767067 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 368/794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:30.773214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.773995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:30.781017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.781537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.781967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.782748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.783200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.784080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:30.853669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67a4fefc-67e7-4fa2-a6f8-0357c3025926 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "POST /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463/action" status: 202 len: 0 microversion: 2.1 time: 0.334620 Sep 27 01:34:30.854878 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 427/795] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:30 2022] POST /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:34:30.866573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6dd143a-9941-46c4-b3d2-7683ce432714 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69a2160>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:30.926608 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6dd143a-9941-46c4-b3d2-7683ce432714 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.064203 Sep 27 01:34:30.928427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 428/796] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:30.946748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0e22af-37a9-410b-8046-383f083d74b2", "tag": "ca3bf94d-3340-4cbd-9452-55bc799058e4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:30.971794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:30.972810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:30.979607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.013834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] Creating event network-changed:ca3bf94d-3340-4cbd-9452-55bc799058e4 for instance 4f0e22af-37a9-410b-8046-383f083d74b2 on n-h1-859358-1 Sep 27 01:34:31.022373 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-795732c6-f421-4e43-8e79-21cf5e6eedd7 req-480e3b8d-e845-453d-94a9-62c8696d035f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092477 Sep 27 01:34:31.023164 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 429/797] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:31.039906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.053152 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1493cb57-1d0c-4ed6-80f4-68b80fb659a6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.283743 Sep 27 01:34:31.054468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 369/798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:30 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:31.188219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.189209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:31.196666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.197941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.198591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.199324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.200060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.200653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.291911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.292521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:31.299552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.300040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.300477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.301174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.301651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.302074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.339649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.356578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.358865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.360271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-54944050-8cf7-4700-8b76-aaa0581e6324 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.176256 Sep 27 01:34:31.360955 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 430/799] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:31.448493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.456551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-efa34822-90bf-44fe-99f3-d4d3168832e1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.168212 Sep 27 01:34:31.457123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 370/800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:31.543967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.544672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:31.550848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.551331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.551758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.552438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.552888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.553308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.570196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:31.606933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.607853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:31.615118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.615911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.616786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.617525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.618198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.618941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.659310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:31.683505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00993fad-f392-40f9-a5f9-4e95e3506795 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.143098 Sep 27 01:34:31.689389 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 431/801] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:31.768260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.776624 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f962af1-e237-447e-bfa2-1c4d372dd867 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.173672 Sep 27 01:34:31.777300 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 371/802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:31.790373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.791008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:31.797418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.797901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.798329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.799010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:31.799455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:31.799874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:31.868886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:31.877016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e25cd15e-d46d-4429-a754-8df21543dbd7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1269 microversion: 2.1 time: 0.090993 Sep 27 01:34:31.877795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 432/803] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:31.943370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d804a3c7-e758-4998-8bc5-15320eee3c55 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d69e7430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:31.988712 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d804a3c7-e758-4998-8bc5-15320eee3c55 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.048968 Sep 27 01:34:31.989418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 372/804] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:31 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:32.075950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.076562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.082566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.083047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.083652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.084350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.084800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.085222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.239127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:32.247551 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32ad831f-1916-40fc-8cff-6d2afbd37907 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.175391 Sep 27 01:34:32.248140 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 433/805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:32.256881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1c64ff-e97c-4523-865b-7788bf200424", "name": "network-vif-plugged", "status": "completed", "tag": "0d0834fa-4ab7-4e82-b401-50506eedac01"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:32.268225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.268565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.268996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.280825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] Creating event network-vif-plugged:0d0834fa-4ab7-4e82-b401-50506eedac01 for instance 7e1c64ff-e97c-4523-865b-7788bf200424 on n-h2-859358-1 Sep 27 01:34:32.286104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f514e60a-a1cb-4ad4-8b66-d92f5ae50e38 req-b2177c99-b6d7-419b-9d85-b71f54fdb0c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Sep 27 01:34:32.286877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 373/806] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:32.383939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.385551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.392296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.392791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.393232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.393982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.394654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.395005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.481870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.482577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.497848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.498713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.499162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.500971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.503079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.504327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.671864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:32.690072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:32.690072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:32.690072 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a75c2ff-aa00-40f2-8572-a62354373f2b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.304734 Sep 27 01:34:32.709822 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 434/807] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:32.716683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.718301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.725842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.727095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.727780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.728829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.729688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.730569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.774006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:32.804323 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21894da2-6ea2-4b07-b65a-1ee16d0bf158 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1314 microversion: 2.1 time: 0.328131 Sep 27 01:34:32.821364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 374/808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:32.832707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.834787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.837658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:32.848942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.849533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.853239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.854086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.854577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.855029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.858111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93c548c4-8d2c-4a8f-9793-634468e0c923 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.146097 Sep 27 01:34:32.858714 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 435/809] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:32.901157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:32.902072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:32.911281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.912162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.912783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:32.914336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:32.914966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:32.915583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.005189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.016347 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0585ea5c-27f8-4d28-b8c9-9f654a6a447a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1269 microversion: 2.1 time: 0.120188 Sep 27 01:34:33.017673 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 436/810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:33.022974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f44619e-a1e7-48ec-9b73-ef2f3bbcc5e5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6931e50>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.082339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f44619e-a1e7-48ec-9b73-ef2f3bbcc5e5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.063132 Sep 27 01:34:33.082911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 437/811] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:33.099047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.124094 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f61daa8-47b7-4e1c-af97-4f2e2cb6182d tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.293433 Sep 27 01:34:33.125223 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 375/812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:32 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:33.271690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.272311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:33.278964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.279673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.280285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.281229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.281862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.282659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.287889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-511934796", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:33.342946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:33.418187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.427220 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35ace3d7-f2c5-42cf-91d6-62d3b7f168c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.160011 Sep 27 01:34:33.428043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 376/813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:33.531823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:33.532288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:33.532762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:33.533169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:33.533862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:33.543455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.543936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.544371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.545101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.545584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.546321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.568885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:33.574141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:33.586914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:33.589207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:33.633474 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75fd229a-5223-4fed-8bff-da8ab014bef3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547408 Sep 27 01:34:33.634106 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 438/814] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:34:33.645695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3c0eec0-b182-4f74-864a-eda3faf278f4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.646306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3c0eec0-b182-4f74-864a-eda3faf278f4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:33.700708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3c0eec0-b182-4f74-864a-eda3faf278f4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.710567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3c0eec0-b182-4f74-864a-eda3faf278f4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1212 microversion: 2.1 time: 0.068800 Sep 27 01:34:33.711793 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 377/815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1212 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:33.726801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.729398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:33.736811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.737446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.737964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.739507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.740046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.740557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.826773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.827392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:33.830007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:33.836286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.836779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.837256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.838543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.839008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.839470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.884519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.893279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.894748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:33.895867 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-72b647b3-2a02-4ec6-8792-56f117ff5e54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.189492 Sep 27 01:34:33.896587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 439/816] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:33.901981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:33.902774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:33.911018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.911749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.912338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.913266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:33.913966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:33.914577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:33.997893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:34.018488 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbcedf52-aa64-4c49-96e0-8f9ff6c7afa4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.120653 Sep 27 01:34:34.019092 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 440/817] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:34.038103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.047420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.047871 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-334d695e-7d5c-4492-9fdd-9fd65ca1588d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1463 microversion: 2.1 time: 0.224865 Sep 27 01:34:34.048687 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 378/818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:33 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:34.049668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.061440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.062046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.062828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.064063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.064755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.065642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.070783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.071597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.079846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.080271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.080883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.081787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.082408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.083021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.087468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:34.147985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.157492 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39079a79-ccba-401b-9dab-1dc2c14be957 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1277 microversion: 2.1 time: 0.122857 Sep 27 01:34:34.158893 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 441/819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:34.164915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b1551353-0e12-49f9-a2b4-c138a70fee6d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d68e2d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.226665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b1551353-0e12-49f9-a2b4-c138a70fee6d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.066113 Sep 27 01:34:34.227378 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 442/820] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:34.245230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.246064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.255422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.258540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.259254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.264674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb8d111e-38bf-4633-b564-c4ce35ff3137 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1462 microversion: 2.1 time: 0.197770 Sep 27 01:34:34.270943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.273183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.274149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.274777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.285936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 379/821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1462 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:34.400429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-475504653", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "938f5884-2b74-4b26-beae-a4bd7951634e"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:34.470815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.476912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:34.481574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91535a60-2699-4cec-a449-c36a2689cb62 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1390 microversion: 2.1 time: 0.252976 Sep 27 01:34:34.482161 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 443/822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:34.493994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-unplugged", "status": "completed", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:34.511545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.512314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.512856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.525506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] Creating event network-vif-unplugged:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:34:34.531276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b5a7ae14-cf33-400c-85de-e27f718067f9 req-5b25ca8d-1c1a-48a4-8768-8712933ed575 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041798 Sep 27 01:34:34.532425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 444/823] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:34.538442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.539351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.546874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.547951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.547951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.548766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.549329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.549888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.818986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.828592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d13b94da-5e67-4d5e-a5c4-a2dbd53b1439 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.294791 Sep 27 01:34:34.831683 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 445/824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:34.837227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.839200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.848600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.849172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.849715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.850523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.851048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.851551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.912505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:34.913030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:34.913403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:34.913813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:34.914223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:34.918729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:34.925046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.925644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.926269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.928246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95464571-5a98-4a3a-8329-c24586155365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1264 microversion: 2.1 time: 0.095265 Sep 27 01:34:34.928904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 446/825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1264 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:34.934086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.934434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:34.935130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:34.935371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.935827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.942698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.943311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.944248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.945206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:34.945912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:34.946436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:34.978635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:34.996107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Getting quotas for user 3f9556a6309d40c3950ea3696323ade4 and project 5671347af8a2476cb85feb2e14b6a30c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:35.019286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:35.022671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:35.094440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4239251-c24a-404d-863e-918a8c1b4ce4 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698481 Sep 27 01:34:35.095090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 380/826] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:34:35.102310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.102958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.114181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.115298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.115737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.116448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.116907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.117639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.161225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.173988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.184397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.185813 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae4a4c18-7fa5-4d89-b554-bc4977e29470 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.255257 Sep 27 01:34:35.186931 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 447/827] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:34 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:35.200978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-66580580-b9be-4ce0-b177-4f34001f4639 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.201903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-66580580-b9be-4ce0-b177-4f34001f4639 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.233799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:35.274443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:35.278169 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eacb69f3-dd4a-4f12-baeb-f5b732ede243 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.180732 Sep 27 01:34:35.282267 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 381/828] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:35.296788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.297750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.306031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.307139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.307977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.308304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.308781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.309208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.313913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-66580580-b9be-4ce0-b177-4f34001f4639 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.324198 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-66580580-b9be-4ce0-b177-4f34001f4639 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1213 microversion: 2.1 time: 0.135849 Sep 27 01:34:35.337392 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 448/829] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:35.345460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b83a0c54-cd06-4f75-973c-68950c2871f2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d68e29d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.403693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b83a0c54-cd06-4f75-973c-68950c2871f2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.077519 Sep 27 01:34:35.411980 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 449/830] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:35.419264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.428435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-540cf9de-5f80-4fca-855f-84f2c8f2700a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1275 microversion: 2.1 time: 0.144925 Sep 27 01:34:35.433417 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 382/831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:35.504195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.504797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.517540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.517976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.518600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.519231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.519687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.520112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.774077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:35.784704 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-65e87e03-db82-451e-b922-b595e367e7d5 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1588 microversion: 2.1 time: 0.284375 Sep 27 01:34:35.808209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.808935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.814132 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 450/832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1588 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:35.815937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.816592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.817218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.818107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.818716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.819298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.852237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.853305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.864075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.864806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.865476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.866351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.866958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.867542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.959193 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03863501-d626-422e-a2a5-343a51478144 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155617 Sep 27 01:34:35.970904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 383/833] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:34:35.983916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:35.985667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:35.995884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.996618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:35.997272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:35.998337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:35.998986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.000232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.117943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.129911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-241fb290-674b-497b-8132-0da5ccfeca54 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1270 microversion: 2.1 time: 0.155631 Sep 27 01:34:36.130779 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 384/834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:36.138991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.147789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b9c0b21-26ca-4d21-b361-42f6436fb276 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.299510 Sep 27 01:34:36.150875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 451/835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:35 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:36.215865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:36.216776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:36.223397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.224106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.224657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.225670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.226273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.226986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.308788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:36.310216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:36.317067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.317990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.318647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.320240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.320930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.323136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.342783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:36.407804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:36.426935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-194bd5c6-5868-400e-ab70-eb2384536bc0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.122832 Sep 27 01:34:36.428582 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 452/836] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:36 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:36.435510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:36.436686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:36.444835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.445785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.446462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.448383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.449041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.449721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.529373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.538661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-570ef270-04e7-4561-92b9-109791c92304 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1217 microversion: 2.1 time: 0.108459 Sep 27 01:34:36.549370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 453/837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:36 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:36.549370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bf8a283a-d050-4a67-b5e1-ce766ef20828 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67df820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:36.606400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bf8a283a-d050-4a67-b5e1-ce766ef20828 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.064684 Sep 27 01:34:36.607018 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 454/838] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:36 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:36.622345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:36.623219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:36.630815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.631354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.631799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.634114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:36.635113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:36.635561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:36.668126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.676422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.690063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.691550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9ce768c-a637-451a-a313-0e224c33cf65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.481398 Sep 27 01:34:36.692617 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 385/839] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:36 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:36.820343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:36.835948 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18fbb548-cb30-4d00-aed7-0f944555ba2e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.217935 Sep 27 01:34:36.837068 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 455/840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:36 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:37.083250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0e22af-37a9-410b-8046-383f083d74b2", "name": "network-vif-plugged", "status": "completed", "tag": "ca3bf94d-3340-4cbd-9452-55bc799058e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:37.105942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.106421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.106854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.128908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] Creating event network-vif-plugged:ca3bf94d-3340-4cbd-9452-55bc799058e4 for instance 4f0e22af-37a9-410b-8046-383f083d74b2 on n-h1-859358-1 Sep 27 01:34:37.140401 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-16f57a9b-d7a2-4dc7-b712-2fc5cb46d429 req-bba58095-11d9-48ae-8c3c-1fb2a4eb891b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058955 Sep 27 01:34:37.143219 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 386/841] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:37.158844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.163732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.180451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.184946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.186133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.186793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.188450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.189562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.190292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.190968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.207083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.218475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.219447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.221200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.221953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.226651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.441239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:37.450684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c56efb5c-3219-469f-a406-6637d78cb6c7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1270 microversion: 2.1 time: 0.297536 Sep 27 01:34:37.456379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 456/842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:37.470050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.476124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.497286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.499514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.500180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.505204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.508452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.509956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.525032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:37.533900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75320cc2-0dd2-49bc-8db0-e1531c0d03c1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.361037 Sep 27 01:34:37.538360 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 387/843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:37.567371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.568185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.577656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.587409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.588399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.589155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.589648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.590083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.653427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:37.679866 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f33000e3-916f-4437-9ce8-2860684f6286 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.221945 Sep 27 01:34:37.681749 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 457/844] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:37.686679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89c328cb-1c13-4037-a3d0-728ec25b5aa1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67df9d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.722101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:37.731761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a004c127-b382-4595-b115-a80b7a0deb98 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1217 microversion: 2.1 time: 0.168893 Sep 27 01:34:37.732600 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 388/845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:37.755491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.756151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.764139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.764631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.765060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.765997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.766639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.767222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.769887 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89c328cb-1c13-4037-a3d0-728ec25b5aa1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.086790 Sep 27 01:34:37.770629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 458/846] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:37.859126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:37.859759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:37.871236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.871725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.872218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:37.872949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:37.873425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:37.873821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:38.120264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:38.129896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b0fa049-943a-4e90-b879-5fd07b00d07e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.274714 Sep 27 01:34:38.132341 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 459/847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:38.151736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:38.169142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:38.171028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:38.172726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4b63db4-13be-4b75-8c42-3e73ed11030b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1362 microversion: 2.25 time: 0.433230 Sep 27 01:34:38.173609 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 389/848] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:37 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:38.386718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:38.387555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:38.390160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e1c64ff-e97c-4523-865b-7788bf200424", "tag": "0d0834fa-4ab7-4e82-b401-50506eedac01"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:38.397803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:38.406287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:38.407021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:38.410993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:38.411634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:38.412251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:38.415393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:38.416945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:38.418427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:38.445975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] Creating event network-changed:0d0834fa-4ab7-4e82-b401-50506eedac01 for instance 7e1c64ff-e97c-4523-865b-7788bf200424 on n-h2-859358-1 Sep 27 01:34:38.462554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-afcfa840-3f5b-4abb-9dab-c30d039363b8 req-ddb64019-1201-4f18-a266-ed5c54c84c8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077792 Sep 27 01:34:38.469108 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 390/849] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:34:38.483636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:38.485947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:38.499388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:38.500175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:38.500800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:38.501764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:38.502376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:38.502960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.331145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:39.341651 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a434830-9b13-479e-84fe-95f3ebe67a60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.863386 Sep 27 01:34:39.350589 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 391/850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:38 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:39.366552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.370654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:39.386600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.391507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.392494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.398074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.400054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.403139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.413552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:39.425047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a5e961a-2f59-4a51-80b3-96f686cdc334 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1588 microversion: 2.1 time: 1.042356 Sep 27 01:34:39.425660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 460/851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:38 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1588 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:39.445580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.450043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:39.466635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.471662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.472502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.481304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.483213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.483995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.648846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:39.698442 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af90e448-ff7c-4239-b4a4-575dd85d50d4 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.262528 Sep 27 01:34:39.699037 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 461/852] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:39.714497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.719890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:39.741668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.742637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.745117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.747981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.749907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.750349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.776359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:39.788224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3aa22dbe-2cd5-4a27-997c-b343344a24a7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.433153 Sep 27 01:34:39.791510 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 392/853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:39.805275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1736bdd3-65b1-45ed-9ee4-a5fd91dd2dc4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6c251f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.861330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1736bdd3-65b1-45ed-9ee4-a5fd91dd2dc4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.059677 Sep 27 01:34:39.862442 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 393/854] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:39.869314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.870649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:39.879207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.879979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.880655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.881712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:39.882617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:39.883499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:39.967130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:39.985292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2aadafbe-f784-4e27-9778-19c3cdfba419 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1265 microversion: 2.1 time: 0.282819 Sep 27 01:34:39.987888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 462/855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:39.994414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:39.995450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:40.003038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.003890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.004491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.005378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.005990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.014086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.450662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:40.459762 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2f4c657-b1ec-4279-ba6c-5f8c0e6ceaf9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.595005 Sep 27 01:34:40.460068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 394/856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:40.480546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd751e1f-0877-451b-8a83-3bbd8620f463", "name": "network-vif-plugged", "status": "completed", "tag": "84aa3138-ded6-4164-a5c3-4ea57647dc07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:40.487615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:40.501724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:40.512946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.513535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.513978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.526205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:40.528729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6cd63095-53ea-45d3-8f2e-2aea79f8c807 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1559 microversion: 2.25 time: 0.539833 Sep 27 01:34:40.549361 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] Creating event network-vif-plugged:84aa3138-ded6-4164-a5c3-4ea57647dc07 for instance dd751e1f-0877-451b-8a83-3bbd8620f463 on n-h1-859358-1 Sep 27 01:34:40.551763 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 463/857] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:39 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1559 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:40.554485 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8962a295-c013-4d4f-8029-3df75f7aa359 req-c3374494-d4d8-48bf-93ed-11927f3cd86a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092314 Sep 27 01:34:40.554485 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 395/858] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:40.567846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feccfde8-cbbf-407f-a831-72c824bdc146", "tag": "0cc906f8-dad8-4b29-97a9-b9280a59b413"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:40.568046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:40.568575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:40.578916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.579609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.580382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.587183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.588220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.588666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.589431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.589862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.590289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.596028 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] Creating event network-changed:0cc906f8-dad8-4b29-97a9-b9280a59b413 for instance feccfde8-cbbf-407f-a831-72c824bdc146 on n-h2-859358-1 Sep 27 01:34:40.600946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-16bdaee1-0c61-4348-9443-8fb92d286ce5 req-85b585fc-f91f-4513-97a2-f5172ba1648d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047698 Sep 27 01:34:40.602643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 464/859] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:40.799724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:40.800496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:40.815638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.816478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.819755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:40.820883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:40.824603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:40.825400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.136753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 4f0e22af-37a9-410b-8046-383f083d74b2 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:41.163268 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-176e9914-0557-486c-a300-a899cb8c9e74 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 2052 microversion: 2.25 time: 0.557766 Sep 27 01:34:41.166490 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 465/860] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:40 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 2052 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:41.178083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.179083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:41.190895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.191702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.194262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.194950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.195417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.195846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.272158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:41.288088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f1f77ca-421a-4fa8-9e58-bd6be7f3cfdc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.732344 Sep 27 01:34:41.288699 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 396/861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:40 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:41.297208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.299497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:41.317007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.318024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.318678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.319623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.320306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.321183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.558832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:41.591739 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff4c3f03-6609-47d6-acaa-e287495bea8a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.417538 Sep 27 01:34:41.620351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:41.621056 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 466/862] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:41.628590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4889183d-d4d3-4b60-90d5-653efdb3348b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d653bd30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.646507 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4497b4f-1b44-43ff-a661-c678ac1ba27c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.354131 Sep 27 01:34:41.648879 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 397/863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:41.662306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.665390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:41.682510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.688393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.691136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.691930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.693982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.694354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.719438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4889183d-d4d3-4b60-90d5-653efdb3348b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.093822 Sep 27 01:34:41.733003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 467/864] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:41.748418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.751187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:41.767546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.768396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.773564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.774558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.775295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.775994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.820887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:41.828936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35bc464f-094d-4d1e-aff3-75e87faf9ce9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1271 microversion: 2.1 time: 0.178593 Sep 27 01:34:41.834451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 398/865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:41.839191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:41.853868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.864863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.865574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.891848 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] Creating event network-changed:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h1-859358-1 Sep 27 01:34:41.900521 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-768e1302-dd28-4418-9cbe-c77b72ad469a req-eae8be6e-9040-4305-a2e3-97dc1f68998f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064785 Sep 27 01:34:41.903210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 399/866] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:41.922391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:41.927847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:41.946877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.956763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.959530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:41.966741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:41.969542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:41.970639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.018158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:42.088531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 4f0e22af-37a9-410b-8046-383f083d74b2 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:42.130003 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c6d9996-2d8b-4824-907a-764df7b62cd8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 2052 microversion: 2.25 time: 0.392669 Sep 27 01:34:42.132363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 468/867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 2052 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:42.159289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:42.174718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.175332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.176877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.180642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.182236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.183598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.235791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:42.269405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-40985577-d07c-4793-bf9d-4b7788f7a9c6 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.114441 Sep 27 01:34:42.275432 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 469/868] 10.222.0.52 () {60 vars in 1217 bytes} [Tue Sep 27 01:34:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:34:42.284299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-859358-1", "block_migration": "auto"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:42.292756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:42.299464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.299962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.300395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.301094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.301567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.301987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.341085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'flavor' on Instance uuid 4f0e22af-37a9-410b-8046-383f083d74b2 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:42.355099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Going to try to live migrate instance to n-h2-859358-1 {{(pid=128778) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:34:42.365907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:42.375664 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ea36c82-bbe8-433b-a9a6-9de9fa417152 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.470228 Sep 27 01:34:42.376328 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 400/869] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:41 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:42.380238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:42.383114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:42.383813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:42.398642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.399264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.399954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.401408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.401948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.405063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.746640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:42.770298 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d1bb419-467e-41e2-926e-85a6a5b9948f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.391984 Sep 27 01:34:42.772522 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 401/870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:42 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:42.777613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:42.778227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:42.784838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.785325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.785963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.786680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.787138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.788576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.902944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:42.925657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26c51166-3a13-47ca-b524-04f8abd793ff tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.151736 Sep 27 01:34:42.926790 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 402/871] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:42 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:42.932605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:42.934061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:42.940777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.941771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.942213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:42.942939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:42.943391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:42.943871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.174186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:43.188875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da1d446b-ceb4-4bf1-8a35-79aa116c1664 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.261090 Sep 27 01:34:43.189631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 403/872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:42 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:43.202950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-107368bb-da94-4d9d-bd86-b25d483af0d2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6dbed30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:43.257257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-107368bb-da94-4d9d-bd86-b25d483af0d2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.066616 Sep 27 01:34:43.258203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 404/873] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:43 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:43.264634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:43.265942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:43.272745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.273230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.273700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.274478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.274982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.276092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.424230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:43.433487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54163fa4-9141-4939-9149-195dd69e112c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.173037 Sep 27 01:34:43.434539 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 405/874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:43 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:43.439836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:43.440539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:43.447733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.448429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.448963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.449925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.450463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.450966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.623352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:43.631760 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c489693-e817-42cd-9eaa-03bd3c7c68c4 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.195645 Sep 27 01:34:43.645937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 406/875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:43 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:43.797806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:43.799229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:43.805416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.805996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.807078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:43.807861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:43.808518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:43.809145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.017636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:44.027233 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8c6480a-a157-4ae4-a1a8-f093f6388012 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.233287 Sep 27 01:34:44.028887 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 407/876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:43 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:44.034234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:44.035020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:44.043485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.044221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.044843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.047586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.048247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.048859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.204452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:44.241838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b583d666-46ea-4162-b869-19a011cefa54 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.210297 Sep 27 01:34:44.257900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 408/877] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:44 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:44.276330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:44.277323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:44.285503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.302891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.303726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.304715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.305428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.306150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.589725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:44.599411 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa117d93-2a94-4591-8f22-d9e4b973bf4f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.340196 Sep 27 01:34:44.600089 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 409/878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:44 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:44.605661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c65fd119-9bdf-462d-8adf-1649e0ad9a7c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67740d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:44.657563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c65fd119-9bdf-462d-8adf-1649e0ad9a7c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.056179 Sep 27 01:34:44.659721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 410/879] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:44 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:44.664798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:44.665974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:44.673883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.674377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.674808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.675665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.676120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.676544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.862539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:44.876604 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f8bd1e8-ac7f-450b-a1dc-e7c6052e3ccf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.214704 Sep 27 01:34:44.895441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 411/880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:44 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:44.903029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:44.905086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:44.928174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.928949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.929633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.930519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:44.931738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:44.932330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:44.958770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:45.010942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:45.095631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:45.104255 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6da68523-5be3-47ad-adca-050068f80c5e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.207509 Sep 27 01:34:45.105214 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 412/881] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:44 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:45.109983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:45.110789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:45.116811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.117524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.118122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.119641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.120884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.121519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.262160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:45.271094 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f06c8b90-662b-43e1-adff-f2be64bde325 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.164657 Sep 27 01:34:45.272110 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 413/882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:45 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:45.280338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:45.280944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:45.288876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.289269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.289606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.290311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.291322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.291699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.321215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:45.398644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:45.419403 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cb0e141-8d50-4a82-a3e2-d256a80ae3d8 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.142650 Sep 27 01:34:45.431855 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 414/883] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:45 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:45.623343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:45.624155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:45.634018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.635483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.639591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.640587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:45.641203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:45.641955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:45.888858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:45.903772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d95da821-0658-4da9-b0e5-46cad6e2633e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.283163 Sep 27 01:34:45.905703 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 415/884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:45 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:45.917064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30113d6f-cfa9-43c6-8980-bbfc68ee4791 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d685e790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:45.985141 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30113d6f-cfa9-43c6-8980-bbfc68ee4791 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.075656 Sep 27 01:34:45.987157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 416/885] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:45 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:45.995648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd37ed9d-c74d-40a7-9a37-12b6a8a490f1", "name": "network-vif-plugged", "status": "completed", "tag": "772958ef-077e-4e59-b95a-c1309b8c6b76"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:46.011502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.012363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.013076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.028407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] Creating event network-vif-plugged:772958ef-077e-4e59-b95a-c1309b8c6b76 for instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 on n-h2-859358-1 Sep 27 01:34:46.035186 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8e43b97c-098d-416c-8ab9-6e6c8596abbb req-85143b73-c244-4fcb-9ee3-9580ddc75b15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045852 Sep 27 01:34:46.036064 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 417/886] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:46.044257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:46.045213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:46.053456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.054360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.055022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.055979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.057212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.057885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.594577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:46.602359 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82b4c559-99d6-4088-b269-f20fd436216c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.564188 Sep 27 01:34:46.606286 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 418/887] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:46 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:46.626612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:46.627233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:46.636425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.637276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.639295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.640279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.641646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.642313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.703102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:46.910337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:46.937554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c46fb33-dcd5-433d-93a6-71bd41acf39f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.330106 Sep 27 01:34:46.948802 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 419/888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:46 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:46.962833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:46.963460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:46.979762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.986216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.987563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:46.988617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:46.989569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:46.990262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.108091 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1486ca2-0db1-40c6-98d5-f958ae2e0da9 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2/action" status: 202 len: 0 microversion: 2.25 time: 4.827644 Sep 27 01:34:47.110335 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 470/889] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:34:42 2022] POST /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2/action => generated 0 bytes in 4831 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:34:47.116717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.118029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:47.146523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.148134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.148948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.151113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.151997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.152758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.258210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:47.282399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52f2a7db-745b-4ffc-b24b-765a982ead2a tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.170260 Sep 27 01:34:47.285118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 471/890] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:47.287628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.291050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf55516-0542-4bd6-a7c7-724352d08290", "tag": "b142c4e8-b593-4811-ace7-28a420e570e7"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:47.297821 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9df9bd56-fc8a-46e7-98d0-8b554899dc71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.339503 Sep 27 01:34:47.300165 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 420/891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:46 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:47.302336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.305088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.306123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:47.312617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.313104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.313571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.314437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.315060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.315487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.318793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.319403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.333198 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] Creating event network-changed:b142c4e8-b593-4811-ace7-28a420e570e7 for instance edf55516-0542-4bd6-a7c7-724352d08290 on n-h2-859358-1 Sep 27 01:34:47.340506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7fa8d0ee-da1a-4236-a669-0d931813efed req-f8aa18d8-2c3c-478b-9435-e6eed5c3cb96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053957 Sep 27 01:34:47.341718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 472/892] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:47.347647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-224b172f-bf9e-4a36-ba0b-c8a9b565f41f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64ff5e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.421852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-224b172f-bf9e-4a36-ba0b-c8a9b565f41f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.078580 Sep 27 01:34:47.423286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 473/893] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:47.428886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.429882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:47.438504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.439229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.439883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.441200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.441944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.442588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.491405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.500783 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbce7c15-0ec8-4865-bcdc-6cc907f8f048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1310 microversion: 2.1 time: 0.199421 Sep 27 01:34:47.501771 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 421/894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1310 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:47.600172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.608797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.610598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.611749 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4dc2c5f-8f12-4c39-ab6c-35bb00d14ae9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.187392 Sep 27 01:34:47.612454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 474/895] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:47.629184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.629821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:47.636768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.637878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.638423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.639361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.639818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.640243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.795830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:47.804237 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70073d3c-0a00-4842-b8dc-792ff0404a62 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.179346 Sep 27 01:34:47.805238 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 422/896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:47.963986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:47.964607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:47.973148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.973678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.974336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:47.975013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:47.975649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:47.976230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.313783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:48.315151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:48.326290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.326979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.327500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.328363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.331714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.332280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.394204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:48.418833 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16e65e90-f54b-47f5-a6ee-8fecd0698f6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.458853 Sep 27 01:34:48.426177 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 475/897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:47 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:48.445630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:48.447136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:48.472983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.473754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.474552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.480488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.496911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.497689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.533956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:48.588688 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15179bad-845b-46c7-880c-958bcfff0f53 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.278462 Sep 27 01:34:48.591946 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 423/898] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:48 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:48.596848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53546841-5baa-4c32-aa11-77ff501102d5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d686b3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:48.670137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53546841-5baa-4c32-aa11-77ff501102d5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.076606 Sep 27 01:34:48.671362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 424/899] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:48 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:48.677324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:48.678946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:48.686251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.687137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.687285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.688082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.688759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.689530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.881039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:48.893076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf0fb751-27e8-4bc7-8ca6-56bd6aad03ac tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1494 microversion: 2.1 time: 0.220874 Sep 27 01:34:48.906031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 425/900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:48 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1494 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:48.914891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:48.916118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:48.922532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.923058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.923515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.924274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:48.924757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:48.925214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:48.991236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.000582 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-936af56d-2dfb-4ceb-a0c8-587e29f0eb0f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.573112 Sep 27 01:34:49.021012 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 476/901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:48 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.028222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "name": "network-vif-plugged", "status": "completed", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:49.044217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.044952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.046290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.061105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] Creating event network-vif-plugged:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h1-859358-1 Sep 27 01:34:49.066821 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c9ab2126-732a-4447-ae29-571ff98c0a79 req-8d436f8a-bccb-483b-b64b-58fa80f847eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044179 Sep 27 01:34:49.075162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 477/902] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:49.081657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.082655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.090793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.091634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.092295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.093228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.093942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.094580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.142939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.152643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.154132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.156328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54e5c1bc-b849-454e-8f0e-c1bcbd20d236 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.249079 Sep 27 01:34:49.177857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 426/903] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:48 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:49.182649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.183269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.190395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.192800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.192800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.192800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.192800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.193148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.414969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.431501 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e43a080-a162-4a36-aa3e-c974497905fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.354087 Sep 27 01:34:49.434230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 478/904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.442816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee14b44-5849-4536-9065-df39e34a8842 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1645 microversion: 2.1 time: 0.262681 Sep 27 01:34:49.442816 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 427/905] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1645 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.452354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.453051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.467484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.469191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.472166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.472871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.473307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.474046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.474498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.474922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.475674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.476229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.476738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.477596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.478186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.479308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.636498 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0cc0b29-35a1-456f-8408-3a78f0cd8484 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1645 microversion: 2.1 time: 0.176665 Sep 27 01:34:49.637381 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 428/906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1645 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.637861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:49.642557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.643416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.646732 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a54a4a2c-aca7-439e-8a84-d145d7668d17 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.200614 Sep 27 01:34:49.649796 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 479/907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.649933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.650385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.650903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.651671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.652320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.652826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.660141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.667487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.668337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.668981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.670062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.670789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.671516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.703356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-412c3aed-bf1e-4e95-997b-81fee21a0f04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046888 Sep 27 01:34:49.704705 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 480/908] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:49.712444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-79185ca8-6ff8-46aa-aaf4-91c5b33e228a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d7c30790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.739949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:49.762665 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd837574-4a38-4c83-8fde-ddbce4860a64 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.124370 Sep 27 01:34:49.775684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 429/909] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:49.775902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-79185ca8-6ff8-46aa-aaf4-91c5b33e228a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.061232 Sep 27 01:34:49.776008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:49.776008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.776173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 481/910] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:49.778024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.778677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.779112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.779972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.780426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.787229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.862662 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79ae07d3-4b2c-4fca-949a-52704efb5eaa tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1/action" status: 202 len: 0 microversion: 2.1 time: 0.096491 Sep 27 01:34:49.865367 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 430/911] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:49 2022] POST /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:34:49.872044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:49.872649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:49.880990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.882683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.883136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:49.883860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:49.884417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:49.884853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.039335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.042577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:50.048222 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f657d1d-06a7-47ee-8427-3470be998c8a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1650 microversion: 2.1 time: 0.180418 Sep 27 01:34:50.050122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:50.057376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.057376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.057666 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 482/912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:49 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1650 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:50.057763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.057763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.057763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.057763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.184884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.185849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:50.194779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.195590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.196376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.198554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.199425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.200343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.220612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.230049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-feb05b50-d9a9-4e63-aa71-06f340384765 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.204912 Sep 27 01:34:50.236977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 431/913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:50.373923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.383771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.385273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.386727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-872a8afc-8f34-400e-ab21-1d7ef4623433 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.206534 Sep 27 01:34:50.401364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 483/914] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:50.459686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.461055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:50.468911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.469436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.469884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.470606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.471072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.471507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.644059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.652721 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad4e4ac9-813d-42d3-912c-315a5d465c1b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.198785 Sep 27 01:34:50.653663 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 432/915] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:50.674630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.675274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:50.681940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.682428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.682861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.684087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.684087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.684413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.783541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce85cd5b-5de8-48e6-a8e0-eb92edc6963c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6726ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.844275 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce85cd5b-5de8-48e6-a8e0-eb92edc6963c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1454 microversion: 2.1 time: 0.064867 Sep 27 01:34:50.845805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 433/916] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:50.851160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:50.852033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:50.863432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.864500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.865239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.866366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:50.867033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:50.867696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:50.872570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:50.884765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c8eefd8-33ef-428c-92e9-950e90b16d21 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.212122 Sep 27 01:34:50.898487 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 484/917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:50.962506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:50.983556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d3fa1f4-d7f6-44e6-9822-56a9f7516c39 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1929 microversion: 2.75 time: 0.136358 Sep 27 01:34:50.984555 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 434/918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:50 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:51.075548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.076387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.083164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feccfde8-cbbf-407f-a831-72c824bdc146", "name": "network-vif-plugged", "status": "completed", "tag": "0cc906f8-dad8-4b29-97a9-b9280a59b413"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:51.095410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.097125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.097755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.098286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.099102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.099652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.100193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.100727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.101265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.127193 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] Creating event network-vif-plugged:0cc906f8-dad8-4b29-97a9-b9280a59b413 for instance feccfde8-cbbf-407f-a831-72c824bdc146 on n-h2-859358-1 Sep 27 01:34:51.136275 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-82281fe6-99bf-4c4b-a92c-474d9a015a45 req-372681e4-6d04-48e7-8783-670bd37163e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056624 Sep 27 01:34:51.136966 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 435/919] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:51.251835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d996d06-166b-40e6-855f-8b8fa8926d0a tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1650 microversion: 2.1 time: 0.180572 Sep 27 01:34:51.252557 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 485/920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1650 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:51.256434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.257401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.266088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.266575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.267005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.267828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.268362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.268836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.401261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:51.403664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:51.411129 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-352a6709-8c71-4da0-873d-d45b011b6bfc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1312 microversion: 2.1 time: 0.159745 Sep 27 01:34:51.411699 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 436/921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:51.417117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.418297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.428822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.429704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.430506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.432431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.433280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.434107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.564623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:51.573068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:51.575613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:51.575717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae9c86f1-1984-4943-867a-24ba9ef9f595 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.165959 Sep 27 01:34:51.576404 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 486/922] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:51.676717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.677447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.685953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.686533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.686969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.687665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.688123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.688546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.822053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:51.830557 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad10be75-aca9-46dd-ba8e-40fee0c3c5c8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.157586 Sep 27 01:34:51.831139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 437/923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:51.859980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1bf9e938-6fcd-423a-80b0-6c40ad0c20fb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d687d3a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.902972 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1bf9e938-6fcd-423a-80b0-6c40ad0c20fb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1463 microversion: 2.1 time: 0.046700 Sep 27 01:34:51.903543 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 487/924] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1463 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:51.911555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.912177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.917878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83b98661-3ad2-41b8-8251-77138268bfe3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6507430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.918969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.919460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.919901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.920667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.921064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.921519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.963021 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83b98661-3ad2-41b8-8251-77138268bfe3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 200 len: 1463 microversion: 2.1 time: 0.049563 Sep 27 01:34:51.968545 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 488/925] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 1463 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:51.977113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:51.978423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:51.985922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.986898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.986898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:51.987510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:51.987959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:51.988384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.054782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.063653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e961d90a-37f4-4a80-923e-91ccf4452ab9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.155631 Sep 27 01:34:52.077708 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 438/926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:52.083908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.084535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.091854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.092346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.093008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.093559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.094016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.094607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.140829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.148648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6437e4ea-ff96-457a-bf66-d6cc195cd79b tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1479 microversion: 2.1 time: 0.175349 Sep 27 01:34:52.149199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 489/927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:51 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1479 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:52.169506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:52.185417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64c48920-e091-4a5e-bdea-2cea69ef5557 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1935 microversion: 2.75 time: 0.106614 Sep 27 01:34:52.185983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 439/928] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1935 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:52.275531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.276142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.282193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.282673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.283105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.284059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.284510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.284932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.406535 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fe7ccd53-85ee-49d7-a052-244d9745b743 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1650 microversion: 2.1 time: 0.135321 Sep 27 01:34:52.407096 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 490/929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1650 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:52.450323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.450985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.456971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.457498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.457939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.458692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.459154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.459582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.589545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.597321 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e4d694b-bc13-4712-891e-e3383f78ebac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1462 microversion: 2.1 time: 0.151423 Sep 27 01:34:52.597907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 440/930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1462 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:52.601219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.601852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.608563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.608975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.609428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.610113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.610560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.610982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.677686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.678312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.685648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.686109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.686728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.687429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.687876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.688295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.861485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.865443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:52.873991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.875739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:52.877242 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b0d453bf-30fc-461d-91b6-88242d333e1c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.280908 Sep 27 01:34:52.877954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 491/931] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:52.883879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:52.884520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.891440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.892222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.892890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.893828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.894513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.895034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.943574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d7af159-edc4-4838-aba0-3ece713a513f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1613 microversion: 2.1 time: 0.328189 Sep 27 01:34:52.944548 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 441/932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1613 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:52.968634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:52.969207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:52.975303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.975788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.976225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:52.976920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:52.977395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:52.978356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.036423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:53.057748 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d819114d-0299-46df-a332-0d5803520a0d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.178616 Sep 27 01:34:53.061558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '41a88f32357d4ef799c49031cfe12d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e594c37169d4384a8a2db19ff852d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:53.063302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] flavor_id is None. Assuming migration. {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 27 01:34:53.063302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 01:34:53.073617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 492/933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:52 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:53.090244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:53.091269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.097806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.098294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.098922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.099630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.100081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.100505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.259166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2d8fb0e-51e1-474d-8ce0-cb6042b769c1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7/action" status: 202 len: 0 microversion: 2.1 time: 0.294149 Sep 27 01:34:53.259998 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 442/934] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:52 2022] POST /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:34:53.265508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:53.266348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.273819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.275041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.275647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.277392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.278734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.279490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.431923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:53.442224 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae119191-fc83-42fc-b446-215af0fcd89c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.355570 Sep 27 01:34:53.442976 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 493/935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:53 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:53.447862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:53.448585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.468953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.469600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.470067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.471001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.471572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.472069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.523517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:53.531984 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f66d733-c97e-4f7e-a8bb-f59d962871ab tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1466 microversion: 2.1 time: 0.270630 Sep 27 01:34:53.532545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 443/936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:53 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:53.542813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:53.542813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.546520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.547006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.547437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.548133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.548583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.549405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.557533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:53.578097 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e22fe425-f8dc-423a-90fe-615fe7a67fa0 tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1935 microversion: 2.75 time: 0.133794 Sep 27 01:34:53.590162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 494/937] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:53 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1935 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:53.595799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:53.596416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.603336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.603825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.604255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.604953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.605441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.605921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.774289 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93ccef5a-c01b-4c80-841e-644afd7cd762 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1630 microversion: 2.1 time: 0.182932 Sep 27 01:34:53.790986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 495/938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:53 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1630 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:53.799063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-942306788"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:53.801539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:53.807672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.808157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.808624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:53.809431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:53.809749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:53.810212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.010627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.021668 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1853d384-bd78-411c-bf2b-eee02fcc4fc2 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1471 microversion: 2.1 time: 0.487616 Sep 27 01:34:54.023117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 444/939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:53 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1471 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:54.029211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-859358-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:54.034008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.050876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.051485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.052462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.053033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.053718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.054338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.070144 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e27f328-3be4-450a-8c62-eb2a0d0d389f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "POST /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b/action" status: 202 len: 0 microversion: 2.1 time: 0.274527 Sep 27 01:34:54.072200 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 496/940] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:53 2022] POST /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:34:54.082802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.083952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.087628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lazy-loading 'flavor' on Instance uuid cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:54.092584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.093399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.094105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.095262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.096059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.097393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.100639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Going to try to live migrate instance to n-h1-859358-1 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:34:54.281854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.296928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.298949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.300398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fb33f81-ff9d-48bb-869a-3188a0aa07d2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.226153 Sep 27 01:34:54.314424 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 497/941] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:54 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:54.325128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84dcc7e7-022c-461d-b49c-167e16c5de9c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d66bef70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.380925 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84dcc7e7-022c-461d-b49c-167e16c5de9c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.065367 Sep 27 01:34:54.381526 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 498/942] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:54 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:54.387130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.387949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.394249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.394977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.395617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.396319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.396775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.397200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.547955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.556993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41ed5cb0-0e65-4b11-94a8-30d932e1491c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.174120 Sep 27 01:34:54.568111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 499/943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:54 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:54.575615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0e22af-37a9-410b-8046-383f083d74b2", "name": "network-vif-unplugged", "status": "completed", "tag": "ca3bf94d-3340-4cbd-9452-55bc799058e4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:54.586362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.586966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.587686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.599297 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] Creating event network-vif-unplugged:ca3bf94d-3340-4cbd-9452-55bc799058e4 for instance 4f0e22af-37a9-410b-8046-383f083d74b2 on n-h1-859358-1 Sep 27 01:34:54.604939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e0b11c20-2000-404a-a520-f39db926eb01 req-d55752d0-3a6f-4043-b981-c024e5e9252c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034760 Sep 27 01:34:54.605561 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 500/944] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:54.610815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.611521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.617632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.618172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.619187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.619887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.620346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.620775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.767701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:54.777417 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23abcf33-8649-4e2e-a1cb-bbc837fde036 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.170430 Sep 27 01:34:54.778182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 501/945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:54 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:54.782751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.783608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.791355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.791835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.792260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.793205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.793683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.794103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.884264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] Lazy-loading 'services' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:54.931049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63c39bef-7bb2-4fb7-8210-19dda8ca4acd tempest-ServersAdmin275Test-807573527 tempest-ServersAdmin275Test-807573527-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1920 microversion: 2.75 time: 0.151549 Sep 27 01:34:54.933825 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 502/946] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:54 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1920 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:54.976850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:54.978510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:54.985916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.986684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.987348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:54.988265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:54.989018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:54.989681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.027079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:34:55.137183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c1b3926-ce8b-4c02-94c8-99021cb2f687 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 204 len: 0 microversion: 2.75 time: 0.164793 Sep 27 01:34:55.137913 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 503/947] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:34:54 2022] DELETE /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:34:55.144424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.145216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:55.151755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.152233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.152662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.153373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.153833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.154253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.292679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.300741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09832c7c-245e-4790-97cc-69876becc588 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1471 microversion: 2.1 time: 0.161764 Sep 27 01:34:55.301309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 504/948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:55.305855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.306514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:55.312318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.312805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.313242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.314340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.314454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.314821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.380544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.389532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.390974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.396115 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b61da44b-1145-4cd1-aa9b-946369e67ac5 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1444 microversion: 2.75 time: 0.093843 Sep 27 01:34:55.396680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 505/949] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:55.401691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.402291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:55.408418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.408918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.409364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.410082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.410541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.410970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.426739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:55.542800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.550940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.552368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.553557 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94b33d15-9378-4071-97d7-1d07bd934b65 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.155936 Sep 27 01:34:55.554119 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 506/950] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:55.558932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a2c4273-ad6e-4328-8d4d-a8895c8589f6 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6511dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.601630 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a2c4273-ad6e-4328-8d4d-a8895c8589f6 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.046482 Sep 27 01:34:55.602185 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 507/951] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:55.606604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.607205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:55.613127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.613643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.614066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.614748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.615189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.615605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.755855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.764626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28221fe8-3c9e-41c8-aab2-8a72ed3da44b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.161450 Sep 27 01:34:55.765230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 508/952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:55.799992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:55.800512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:55.807186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.807673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.808110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.808806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:55.809263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:55.809718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:55.951611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:55.962183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f78dc47-fac5-4bbf-9510-d4664035c858 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1317 microversion: 2.1 time: 0.165986 Sep 27 01:34:55.973364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 509/953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:55 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:56.279764 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18940b0e-a05b-4beb-839b-5ad70b2dcb48 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1/action" status: 202 len: 0 microversion: 2.1 time: 2.255210 Sep 27 01:34:56.284296 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 445/954] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:34:54 2022] POST /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1/action => generated 0 bytes in 2260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:34:56.294804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.298428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.308226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.312594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.314613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.315641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.318928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.320036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.325396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.325804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.333006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.333532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.333976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.334687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.335367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.335789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.507098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.520661 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab57a020-b515-4843-a277-d5e1a34aafb5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1471 microversion: 2.1 time: 0.200720 Sep 27 01:34:56.521729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 446/955] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:56.527604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.528449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.535190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.536441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.537484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.539679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.540848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.541328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.631861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.641036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.642550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.648083 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e23eb79f-047c-459f-b20b-67c34dc07dff tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1444 microversion: 2.75 time: 0.125021 Sep 27 01:34:56.648668 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 447/956] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:56.654145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd751e1f-0877-451b-8a83-3bbd8620f463", "name": "network-vif-unplugged", "status": "completed", "tag": "84aa3138-ded6-4164-a5c3-4ea57647dc07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:56.666625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.667448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.668168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.681833 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] Creating event network-vif-unplugged:84aa3138-ded6-4164-a5c3-4ea57647dc07 for instance dd751e1f-0877-451b-8a83-3bbd8620f463 on n-h1-859358-1 Sep 27 01:34:56.687067 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3207eabf-1f09-4531-891b-bd9e73b2d621 req-4d09b068-be79-4e24-9f9a-f2e304aefaa4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037006 Sep 27 01:34:56.687901 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 448/957] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:56.692776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.693510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.699824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.700312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.700835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.701492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.701954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.702395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.817277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.824940 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a339ec1-4dd3-4f35-b0f0-28e1e6705f0e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.539774 Sep 27 01:34:56.825563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 510/958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:56.831059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-670c648b-5ebb-4949-b607-c24933871d17 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67328b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.846639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.855282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.856671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:56.857935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d4da09b-931d-471b-ac1c-0d245a80b49b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.169120 Sep 27 01:34:56.858494 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 449/959] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:56.862872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0e22af-37a9-410b-8046-383f083d74b2", "tag": "ca3bf94d-3340-4cbd-9452-55bc799058e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:56.873178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.873690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.874121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.876716 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-670c648b-5ebb-4949-b607-c24933871d17 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.049381 Sep 27 01:34:56.877457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 511/960] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:56.881713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:56.882447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.883127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.889143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.889746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.890247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.890365 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] Creating event network-changed:ca3bf94d-3340-4cbd-9452-55bc799058e4 for instance 4f0e22af-37a9-410b-8046-383f083d74b2 on n-h1-859358-1 Sep 27 01:34:56.890943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.891399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.891822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.895750 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9b8979ab-1a57-4860-9783-40da53bbd781 req-505221c5-6417-40cc-82fb-434f433da321 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036099 Sep 27 01:34:56.896348 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 450/961] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:56.988853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:56.989712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:56.996663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.997171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.997622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:56.998315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:56.998761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:56.999178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.018439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:57.027249 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ccf7ccc-1d52-4bf9-bcbb-2dba544bc0a9 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.148755 Sep 27 01:34:57.027856 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 512/962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:57.167246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:57.174868 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-784d75ad-e36f-4f6c-a4b5-cb0b15f69ad1 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1466 microversion: 2.1 time: 0.190650 Sep 27 01:34:57.175436 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 451/963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:56 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1466 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:34:57.197257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:57.197977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:57.204244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.204728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.205161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.205967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.206329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.206751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.480142 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a8ff050-ba53-405f-9a1e-aacd028173c2 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1617 microversion: 2.1 time: 0.286534 Sep 27 01:34:57.481234 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 513/964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:57 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1617 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:57.545579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:57.546449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:57.559497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.559993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.560432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.561135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.566203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.567022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.649007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1838417589", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a2cb4d2f-dfde-4d66-9438-99dba5838034"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:57.717970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:34:57.844738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:57.860908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2a87095-ba71-414e-b5db-7b98014ca553 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1471 microversion: 2.1 time: 0.319306 Sep 27 01:34:57.861677 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 452/965] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:57 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:57.881579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:57.882293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:57.890000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.890555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.891708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.893193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.893193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.893425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.929205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:57.930357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:57.931637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:57.932297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lazy-loading 'fault' on Instance uuid 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:34:57.983397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:57.994940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:57.996653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f97908a2d1e94485bab269f086c384d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ede12f6bb04b979efdd776e2efa760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.002120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a39511f6-30fa-4ebd-978d-fd70a30e1911 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 200 len: 1449 microversion: 2.75 time: 0.139335 Sep 27 01:34:58.003072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 453/966] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:57 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 1449 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:58.008419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.011516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:58.017735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.018473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.019131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.020025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.020661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.021455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.164874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.173414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a5102f4-2608-41f2-89f3-a6a082d177f0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.169068 Sep 27 01:34:58.174157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 454/967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:58.179456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.180265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:58.186351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.187016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.187645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.188513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.189184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.189906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.323500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.333972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.336467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.338847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d1f628c-be1c-4e24-9af7-8d9b6c9102fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.163340 Sep 27 01:34:58.354513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 455/968] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:34:58.365146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17e67d5b-5c3f-423b-ad53-c7a55f012fd0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6529ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.393381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:34:58.394023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:34:58.394600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:34:58.395107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:34:58.395615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:34:58.411387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.414435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.415043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.417768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.418173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.421800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.430109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17e67d5b-5c3f-423b-ad53-c7a55f012fd0 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.074282 Sep 27 01:34:58.431905 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 456/969] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:58.439164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.439781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:58.442053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=9 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:58.447377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.449538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.450563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.451401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.452274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.453098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.469871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:34:58.477392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:34:58.484560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Getting quotas for user 771bb2e636e942f5ad824bc251cc2ba3 and project b40ffb6379f0428c8e370a8220fd7d1f. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:34:58.500021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:34:58.502810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:34:58.576110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c92d9328-708c-4e5e-be98-7ecc047b3e4d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928600 Sep 27 01:34:58.578450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 514/970] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:34:58.593062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-954cecae-611e-4a3f-b6e0-9562442fd240 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.593999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-954cecae-611e-4a3f-b6e0-9562442fd240 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:58.704254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.716984 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6993d7b2-bd0a-4b5e-926c-07ddf8e77c30 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.282271 Sep 27 01:34:58.717767 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 457/971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:58.796997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-954cecae-611e-4a3f-b6e0-9562442fd240 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:58.807900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-954cecae-611e-4a3f-b6e0-9562442fd240 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1217 microversion: 2.1 time: 0.222817 Sep 27 01:34:58.822768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 515/972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:58.885107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:58.885792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:58.895161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.895654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.896095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:58.896801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:58.897256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:58.897711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.032211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.032926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] [instance: 1ae9ee85-5a24-4c6b-8192-634ebc7957b3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:59.044647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.047869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.052466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.053400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.059092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.060908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.109232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] HTTP exception thrown: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Request method failure captured: Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 HTTP/1.1 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLp3jEzBBqdt82VC3aSQXxypjGWv2SoR4zzzkAF9e2fZeW5yuo2viQXGjIh8_lvPrP7LWX3-3Zudftx2QcKpUhKZ5wJTbNNqhKIoXN8Wtj5cqRlT8aT0lyN0qxyxdymEQBkx7j5EljQpSUy33reig-I2SBldBxldY0gNc2kSk37f-0 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.75 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 05ede12f6bb04b979efdd776e2efa760 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdmin275Test-1422111662 Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:34:59.114517 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/05ede12f6bb04b979efdd776e2efa760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/05ede12f6bb04b979efdd776e2efa760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/05ede12f6bb04b979efdd776e2efa760"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_05ede12f6bb04b979efdd776e2efa760", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdmin275Test-1422111662 Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 05ede12f6bb04b979efdd776e2efa760 Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdmin275Test-1422111662 Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdmin275Test-1422111662-project Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: f97908a2d1e94485bab269f086c384d7 Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdmin275Test-1422111662-project Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. Sep 27 01:34:59.116122 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1ae9ee85-5a24-4c6b-8192-634ebc7957b3'} Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:34:59.116929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. Sep 27 01:34:59.119614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:34:59.126003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] Returning 404 to user: Instance 1ae9ee85-5a24-4c6b-8192-634ebc7957b3 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:34:59.126003 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1e0193d3-79fd-4cc8-aeaa-aa388844fdf7 tempest-ServersAdmin275Test-1422111662 tempest-ServersAdmin275Test-1422111662-project] 10.222.0.52 "GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3" status: 404 len: 111 microversion: 2.75 time: 0.089146 Sep 27 01:34:59.126003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 516/973] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/servers/1ae9ee85-5a24-4c6b-8192-634ebc7957b3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:34:59.136556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf55516-0542-4bd6-a7c7-724352d08290", "name": "network-vif-plugged", "status": "completed", "tag": "b142c4e8-b593-4811-ace7-28a420e570e7"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:59.166093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.167265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.167724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.193649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] Creating event network-vif-plugged:b142c4e8-b593-4811-ace7-28a420e570e7 for instance edf55516-0542-4bd6-a7c7-724352d08290 on n-h2-859358-1 Sep 27 01:34:59.212459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-096a6462-abdc-4b61-a88f-994e190bec80 req-1a4d8c97-279c-4b05-b77b-596cced86223 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087019 Sep 27 01:34:59.213228 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 517/974] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:59.220778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.221730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:59.229684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.230593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.231244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.232232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.232907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.233601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.253065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:59.263445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce3fa19d-51f9-4831-a20b-ede17e5a3162 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1471 microversion: 2.1 time: 0.382865 Sep 27 01:34:59.270880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 458/975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:58 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1471 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:59.370190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.370915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:59.384521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.385801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.386518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.387375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.387935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.392865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.646130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:59.657085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:59.659249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:59.672421 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ffcf2a6-76f9-4d84-801c-6cb659fc82b3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.306122 Sep 27 01:34:59.675086 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 459/976] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:34:59.693490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0826fef4-2102-465a-9846-d694a4f26271 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6529670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.782360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0826fef4-2102-465a-9846-d694a4f26271 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.105109 Sep 27 01:34:59.786577 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 460/977] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:59.795175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.795811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:59.807439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:34:59.812381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.813037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.813505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.814309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.819875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6bc5b43d-8286-4595-9e2b-dccb1323e69b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.603813 Sep 27 01:34:59.820481 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 518/978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:34:59.822690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.826129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.841170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd37ed9d-c74d-40a7-9a37-12b6a8a490f1", "name": "network-vif-unplugged", "status": "completed", "tag": "772958ef-077e-4e59-b95a-c1309b8c6b76"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:34:59.856883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.857666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.858242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.873319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] Creating event network-vif-unplugged:772958ef-077e-4e59-b95a-c1309b8c6b76 for instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 on n-h2-859358-1 Sep 27 01:34:59.878637 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9b5a7d93-a5b3-463a-89a7-15017656a817 req-171d1c00-82da-4fd0-9bce-2c7c11896119 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043327 Sep 27 01:34:59.879997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 519/979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:34:59.885496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:34:59.886241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:34:59.894610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.895652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.896087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:34:59.896838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:34:59.897292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:34:59.897755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.022125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:00.030632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e486e49-6274-4429-ae93-fa01b7a11940 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1269 microversion: 2.1 time: 0.149436 Sep 27 01:35:00.031401 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 520/980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:00.107226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:00.116726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64daed7f-15e4-47f7-bd8e-aa5c0a4570f5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.328996 Sep 27 01:35:00.129739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 461/981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:34:59 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:00.304877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:00.305612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:00.315246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.315730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.316154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.316853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.317319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.317764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.601709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:00.616000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64c8e57e-e219-40aa-9279-30af804c0a2d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.322822 Sep 27 01:35:00.618717 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 521/982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:00 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:00.699537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:00.700148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:00.715797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.716291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.716886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.717760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.718279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.718636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.798607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95d4d60b-f3ba-4dda-99b7-bee75c9aaaa2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d7c304c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:00.886460 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95d4d60b-f3ba-4dda-99b7-bee75c9aaaa2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.091605 Sep 27 01:35:00.888645 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 522/983] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:00 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:00.893655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:00.894524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:00.904642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.906462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.907222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:00.910217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:00.911577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:00.912262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.035362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.046218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.051110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.053119 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f96f4d4-473d-4a1b-b2ad-22004eabdf67 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.357989 Sep 27 01:35:01.054612 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 462/984] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:00 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:01.074183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:01.075130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:01.083011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.083951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.085130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.086679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.087381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.088200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.206813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.217188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a61ae27-c0c6-413e-8d02-549be235a21f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1277 microversion: 2.1 time: 0.160362 Sep 27 01:35:01.225647 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 463/985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:01 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:01.241577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:01.242131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:01.270101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.272646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.277439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.279379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.280122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.280613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.344494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.356272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7e79490-e9e7-41a7-9377-5b26e755c8bc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.466337 Sep 27 01:35:01.360717 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 523/986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:00 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:01.365658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-plugged", "status": "completed", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:01.398289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.398769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.399251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.421727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] Creating event network-vif-plugged:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:35:01.427787 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5e9574a8-2b56-439d-938b-7fd0ea028d58 req-b2a07996-4a08-4986-ad72-b055c8012ae5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065398 Sep 27 01:35:01.428895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 524/987] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:01.552597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:01.561260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90119a2b-8285-43bf-b142-cb2537c98cda tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1313 microversion: 2.1 time: 0.334139 Sep 27 01:35:01.561868 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 464/988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:01 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:01.648025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:01.648750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:01.663598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.665085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.665905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.667379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:01.668810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:01.669546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:01.903844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ccea2cc-d0ea-4c4f-a773-51b2ac5b6a78 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d67260d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:01.972313 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ccea2cc-d0ea-4c4f-a773-51b2ac5b6a78 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.073412 Sep 27 01:35:01.973207 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 465/989] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:01 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:01.985426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd37ed9d-c74d-40a7-9a37-12b6a8a490f1", "tag": "772958ef-077e-4e59-b95a-c1309b8c6b76"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:02.003316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.004144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.004580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.023672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.029086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] Creating event network-changed:772958ef-077e-4e59-b95a-c1309b8c6b76 for instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 on n-h2-859358-1 Sep 27 01:35:02.032049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a32886c6-31fa-4436-bcb9-59ea9972ee1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.391396 Sep 27 01:35:02.040235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-370652a9-140f-4458-b03f-d6bf1e93495b req-8ee945ed-1b86-4397-b75d-8c4ac54d3270 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062279 Sep 27 01:35:02.047386 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 466/990] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:02.051320 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 525/991] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:01 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:02.083886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:02.084494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:02.095053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.095573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.095985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.096720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.097296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.097730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.246282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:02.247274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:02.256107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.259672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.261902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.263471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.266484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.267193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.487302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.496670 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5aff6aac-dfd9-425d-8f5b-0127931a2685 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.254437 Sep 27 01:35:02.497949 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 467/992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:02 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:02.504429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:02.505367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:02.512941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.514498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.515159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.516100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.516768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.517439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.840435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.870046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.877967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.884074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-407bedb9-f5c8-4673-8fc0-223ebbcbb4c2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.801687 Sep 27 01:35:02.886927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 526/993] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:02 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:02.902157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:02.903968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:02.906240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:02.924465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.926583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.927913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.931763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:02.932538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:02.933847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:02.935179 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-975056a2-bedd-496e-94a8-168f77d8b17e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.433213 Sep 27 01:35:02.935803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 468/994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:02 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:02.990487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35fe8fdc-0b0e-45cb-b558-137e348aa267 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d65bb5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:03.115335 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35fe8fdc-0b0e-45cb-b558-137e348aa267 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.123563 Sep 27 01:35:03.117031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 469/995] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:02 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:03.130375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:03.133256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:03.148312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.150080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.152065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:03.155202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.156037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.159061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:03.419603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:03.428922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c65483eb-46cd-4bfe-9b57-445c85da681a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.309904 Sep 27 01:35:03.430131 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 470/996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:03 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:03.526558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:03.527587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:03.538756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.539652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.541024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:03.543703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.545144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.548630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:03.582408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:03.595571 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5de6d55-3336-4993-9916-36c334f8a5b8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1463 microversion: 2.1 time: 0.705901 Sep 27 01:35:03.596365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 527/997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:02 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1463 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:03.849746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:03.852372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:03.860839 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14d730b1-557e-438e-93f9-138207c41213 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.340560 Sep 27 01:35:03.873370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 471/998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:03 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:03.916170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:03.916486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:03.933476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.935539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.936011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:03.937937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:03.940956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:03.941465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.035410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.047263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'deleted': False, 'project_id': '012f3550ff4545fbac13f014cd4bc1d3'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:04.059801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.060777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.061518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.064889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.065645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.067166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.242356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:04.259464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:04.264704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:04.266507 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e78bf708-5acc-4823-8721-69ac9e920f38 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.355167 Sep 27 01:35:04.268553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 472/999] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:03 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:04.279802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.281732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:04.300215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.302252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.302863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.303758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.304278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.308735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.324868 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-533e5c4e-05dd-47fe-82d2-41ad6155ad71 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.699380 Sep 27 01:35:04.337635 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 528/1000] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:35:03 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:35:04.350631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8be2c241-5f73-4681-b028-60070a0bb8c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64e0940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.403111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8be2c241-5f73-4681-b028-60070a0bb8c2 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.064344 Sep 27 01:35:04.404283 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 529/1001] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:04 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:04.516424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:04.527495 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1814e66a-a6d1-42ec-b1eb-c0125a5cf00d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.256067 Sep 27 01:35:04.527495 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 473/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:04 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:04.534050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.558195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:04.579124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.580713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.581442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.582502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.582968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.583446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.699698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.703465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.703975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.705003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.706280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.706930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.707761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.750953 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ae0d48c-9adb-489b-b2eb-bbd00d74f870 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.342903 Sep 27 01:35:04.750953 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 530/1003] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:35:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:04.755825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:04.756527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:04.764545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.765227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.765931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.766684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.767201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.767865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:04.849965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Listed batch of 18 results from cell out of 1000 limit. Returned 18 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:35:04.962181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:04.962848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:04.963388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.345718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:05.353728 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd7b4278-1a7a-4afe-aa84-843120ef5e1a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.602074 Sep 27 01:35:05.357469 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 531/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:04 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:05.366865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.372282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.374103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.374873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.375871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.376656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.377986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.407309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-692c4b90-81c1-4dce-800f-df36a0c4a77e tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.047200 Sep 27 01:35:05.408759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 532/1005] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:05.413600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.414506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:05.421123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.421858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.422500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.423361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.424005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.424593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.451984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:05.579279 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e108110-3689-4422-9925-fe44cda15c44 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 29183 microversion: 2.1 time: 1.049314 Sep 27 01:35:05.594252 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 474/1006] 10.222.0.52 () {58 vars in 1171 bytes} [Tue Sep 27 01:35:04 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 29183 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:35:05.613867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.616063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:05.644614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.645708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.646405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.647348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.648017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.648658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.761363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:05.769843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-023bccf3-b1ec-42f7-90ea-0ba85d3d7885 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.359663 Sep 27 01:35:05.797240 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 533/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:05.802401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d65e9b6e-fa82-4241-9fe1-594e08aae572 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6507550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.868291 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d65e9b6e-fa82-4241-9fe1-594e08aae572 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.069499 Sep 27 01:35:05.869194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 534/1008] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:05.880797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.884955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.885471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.885914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.886641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.887096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.893778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.927533 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5dbb1ea4-8bcb-4b70-8f7d-cf54addf7d5b tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.057272 Sep 27 01:35:05.928154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 535/1009] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:05.933645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.934033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:05.934936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:05.942164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.942592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.943241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.943811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.944260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.944682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.946472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:05.950601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:05.952456 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ffa36e0e-b5f2-46c9-bb22-f41f85ac53d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.357153 Sep 27 01:35:05.953245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 475/1010] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:05.959336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:05.964510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'deleted': False, 'project_id': '012f3550ff4545fbac13f014cd4bc1d3'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:05.969265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.970704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.971164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:05.971967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:05.972438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:05.972813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.145824 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fb5f0ec-0d43-4ef4-b211-91a85f7c7424 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=5671347af8a2476cb85feb2e14b6a30c" status: 200 len: 15 microversion: 2.1 time: 0.191592 Sep 27 01:35:06.157381 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 476/1011] 10.222.0.52 () {58 vars in 1231 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/servers/detail?tenant_id=5671347af8a2476cb85feb2e14b6a30c => generated 15 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:06.165305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.166800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.167291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.167733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.168765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.168965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.169427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.201545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:06.210900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1452ae47-898e-416e-a760-082fa18114b0 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-859358-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.062697 Sep 27 01:35:06.212877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 477/1012] 10.222.0.52 () {58 vars in 1194 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/os-services?host=n-d-859358-1&binary=xxx => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:06.222091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af245bf-32cf-4f4c-8885-d467a10bb22a", "tag": "9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:06.235700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.236527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.237186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.250776 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] Creating event network-changed:9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f for instance 5af245bf-32cf-4f4c-8885-d467a10bb22a on n-h1-859358-1 Sep 27 01:35:06.270363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8ccb1482-8dbe-48ee-bc42-c64db3e2abbd req-50e318a9-4eba-408b-ab9f-6abcd37819f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047568 Sep 27 01:35:06.272426 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 478/1013] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:06.282214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.291587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'tenant_id': '5671347af8a2476cb85feb2e14b6a30c', 'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:06.298057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.298903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.299553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.300919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.301642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.302299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.323544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:06.333390 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c890172-6c64-44b2-b5f8-e4465a40f3f2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.404188 Sep 27 01:35:06.341875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:35:06.354070 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 536/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:05 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:06.361400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.375681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.376684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.378624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.379611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.380252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.388834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.437965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.438572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.439164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.445025 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b4b0e50-115e-43f5-875b-f8e76539e970 tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.087766 Sep 27 01:35:06.446301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 537/1015] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:06.454440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.455280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:06.470483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.472642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.473264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.474189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.477911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.478621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.677316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ba1f6de-8667-4e0f-839e-4ac9d33f3ad6 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5671347af8a2476cb85feb2e14b6a30c" status: 200 len: 4824 microversion: 2.1 time: 0.402583 Sep 27 01:35:06.677973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 479/1016] 10.222.0.52 () {58 vars in 1257 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5671347af8a2476cb85feb2e14b6a30c => generated 4824 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:06.699337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.703236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.703728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.704166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.704916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.708213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.708378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.738441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:06.747502 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d50bbf8-f172-4a92-aab8-1de91294dfae tempest-ServicesAdminNegativeTestJSON-50554914 tempest-ServicesAdminNegativeTestJSON-50554914-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.068481 Sep 27 01:35:06.748416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 480/1017] 10.222.0.52 () {58 vars in 1198 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:06.751259 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efdc8a75-46ed-4f73-b870-70d1cb5a30e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.303744 Sep 27 01:35:06.752046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 538/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:06.752771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.758820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'tenant_id': '012f3550ff4545fbac13f014cd4bc1d3', 'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:06.763664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.765767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.765767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.765767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.765767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.766264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.826669 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c227afc-7fd5-4fc2-bcca-7b254cb82a6b tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=012f3550ff4545fbac13f014cd4bc1d3" status: 200 len: 15 microversion: 2.1 time: 0.077150 Sep 27 01:35:06.828689 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 481/1019] 10.222.0.52 () {58 vars in 1257 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=012f3550ff4545fbac13f014cd4bc1d3 => generated 15 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:06.846138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:06.848773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:06.873981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.874490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.874932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:06.875871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:06.876343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:06.876774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.070121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f6b33bf-378d-45c5-a7d2-8f2eeffb4baf tempest-ServicesAdminNegativeTestJSON-1868066746 tempest-ServicesAdminNegativeTestJSON-1868066746-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.076225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f6b33bf-378d-45c5-a7d2-8f2eeffb4baf tempest-ServicesAdminNegativeTestJSON-1868066746 tempest-ServicesAdminNegativeTestJSON-1868066746-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e40c364bf40d449580f318f2da80d163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a091d7648c441295dd1a2e58e5ec71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f6b33bf-378d-45c5-a7d2-8f2eeffb4baf tempest-ServicesAdminNegativeTestJSON-1868066746 tempest-ServicesAdminNegativeTestJSON-1868066746-project] Request method failure captured: Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlNHBSDzsl-gWaUTwMjMz9b0vzaQR1TIy01MYRwVN6KVJxZiGZW2DdK_xtrBRRSgO3q6gqSE5xQeiMc0pquk2DrPmBYJrxf5OX8RzdvDc1rkygHdE_5uBuI1CUWXPpL-4wb-QSxC1X21c96IbfL3qAEk1yG0PTdHBvmF-V0sAxgA5yM Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c6a091d7648c441295dd1a2e58e5ec71 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1868066746 Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:35:07.078177 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6a091d7648c441295dd1a2e58e5ec71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6a091d7648c441295dd1a2e58e5ec71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6a091d7648c441295dd1a2e58e5ec71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6a091d7648c441295dd1a2e58e5ec71", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1868066746 Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c6a091d7648c441295dd1a2e58e5ec71 Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1868066746 Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServicesAdminNegativeTestJSON-1868066746-project Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e40c364bf40d449580f318f2da80d163 Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1868066746-project Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:35:07.079855 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:35:07.080926 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 27 01:35:07.082600 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:07.084962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f6b33bf-378d-45c5-a7d2-8f2eeffb4baf tempest-ServicesAdminNegativeTestJSON-1868066746 tempest-ServicesAdminNegativeTestJSON-1868066746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:07.085871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f6b33bf-378d-45c5-a7d2-8f2eeffb4baf tempest-ServicesAdminNegativeTestJSON-1868066746 tempest-ServicesAdminNegativeTestJSON-1868066746-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.318743 Sep 27 01:35:07.087410 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 539/1020] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 321 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:35:07.091797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7babacd7-1d10-4edb-97fe-072dbc0c7beb tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.100713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7babacd7-1d10-4edb-97fe-072dbc0c7beb tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012183 Sep 27 01:35:07.101233 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 540/1021] 10.222.0.52 () {58 vars in 1189 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:07.125315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53fab219-1d2a-4a11-8370-b9674cc71265 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64fa4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.139826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.151523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85420b54-cbbf-4c4d-bae0-02d84fd07e9c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.321262 Sep 27 01:35:07.152349 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 482/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:06 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:07.168452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.169066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.180658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.181506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.182967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.191316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.191870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.192314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.201718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53fab219-1d2a-4a11-8370-b9674cc71265 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.090031 Sep 27 01:35:07.202600 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 541/1023] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:07.207998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:07.212166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.223632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.224364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.224999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.225897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.226503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.227124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.338967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68bd2526-894d-4904-a2aa-0d2c821d74ce tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 0 microversion: 2.1 time: 0.135077 Sep 27 01:35:07.340353 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 542/1024] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:07 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:35:07.356601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.369017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.369017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5671347af8a2476cb85feb2e14b6a30c'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:07.374386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.375076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.375659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.376784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.377448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.378027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.398472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.409086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.411844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.420675 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-feb900c0-f1fb-42f1-88c4-8aa1fda4bcd7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1569 microversion: 2.25 time: 0.267409 Sep 27 01:35:07.423067 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 483/1025] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:07.430763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.431591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.438968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.439730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.440342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.441227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.441960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.442569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.497917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:35:07.580843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0de4b0a8-f62a-49f4-9986-2c05a3bfa116 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.235945 Sep 27 01:35:07.583198 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 543/1026] 10.222.0.52 () {58 vars in 1150 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:07.596011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:07.599409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.608134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.609014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.609769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.610704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.611371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.612049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.723600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:07.728244 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d3831b3-9203-4025-8120-c24f600729b0 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 0 microversion: 2.1 time: 0.136256 Sep 27 01:35:07.729576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 544/1027] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:07 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:35:07.735304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4288587-7b87-4ea5-8ed7-38ea79aa2e56 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.310720 Sep 27 01:35:07.735877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 484/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:07.738435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.739615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.749897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.750801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.751655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.752883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.753710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.754444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.778847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:07.779536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:07.791004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.791536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.791984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.793858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:07.794313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:07.797398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:07.992908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:08.003331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-edc74157-0a43-43a7-9f0d-e54feb24de8d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.228337 Sep 27 01:35:08.004684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 485/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:08.176493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.177438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:08.184368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.187505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.188131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.189188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.189682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.190283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.343840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ef013cb6-255b-4118-b46c-1204d682cc78 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1613 microversion: 2.1 time: 0.606039 Sep 27 01:35:08.345722 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 545/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:07 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1613 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:08.352450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-982d0b8a-3bb6-4d43-9ed2-89a15eadabb4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6507d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.417663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:08.448276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-982d0b8a-3bb6-4d43-9ed2-89a15eadabb4 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.100578 Sep 27 01:35:08.449246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 546/1031] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:08.453363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ef8a6d3-5f9a-4cbe-92dd-67f5c4454d22 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.280584 Sep 27 01:35:08.475092 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 486/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:08.485518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.486483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:08.490953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.495043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:08.505010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.510880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.511982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.512462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.513284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.516158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.516873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.517018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.517554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.517870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.518346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.518780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.743928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:08.753950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:08.761282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:08.763755 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68d2b856-8e31-426e-bfff-3c9558a376ff tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1559 microversion: 2.25 time: 0.287603 Sep 27 01:35:08.769437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 487/1033] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1559 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:08.776547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.779302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:08.792471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.795968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.796688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.799450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.801481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.802025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.806032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:08.893807 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b60d063d-e8a0-4af4-afc2-01ad22076f50 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1613 microversion: 2.1 time: 0.442955 Sep 27 01:35:08.894452 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 547/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1613 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:08.910216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad7b157e-b763-490d-a137-7f89722a09d8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '.version_select at 0x7f24d69318b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.920397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad7b157e-b763-490d-a137-7f89722a09d8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.920958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad7b157e-b763-490d-a137-7f89722a09d8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.921487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad7b157e-b763-490d-a137-7f89722a09d8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.960568 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad7b157e-b763-490d-a137-7f89722a09d8 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2188 microversion: 2.25 time: 0.053938 Sep 27 01:35:08.971168 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 548/1035] 10.222.0.52 () {60 vars in 1184 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/os-migrations => generated 2188 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:08.976361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:08.983239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'host': 'n-h2-859358-1', 'deleted': False} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:08.992653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.992653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.993066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:08.993816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:08.994269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:08.994714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.022524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:09.036498 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c55d906c-d94f-4e87-8f7f-a140371ccb01 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.265452 Sep 27 01:35:09.037092 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 488/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:09.052509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:09.053154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:09.074318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.074814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.075252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.075963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.076436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.076839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.213035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:35:09.349293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb27459a-27f1-4cb3-ad42-ce87a118619c tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=n-h2-859358-1&all_tenants=1" status: 200 len: 3634 microversion: 2.1 time: 0.376805 Sep 27 01:35:09.351388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 549/1037] 10.222.0.52 () {58 vars in 1190 bytes} [Tue Sep 27 01:35:08 2022] GET /compute/v2.1/servers?host=n-h2-859358-1&all_tenants=1 => generated 3634 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:09.356826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:09.357801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:09.364678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.365506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.366215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.367027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.367622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.368141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.411875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 4f0e22af-37a9-410b-8046-383f083d74b2 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:09.429329 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6735f7a7-92e8-4695-bb1c-44bf053b49df tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 2052 microversion: 2.25 time: 0.390718 Sep 27 01:35:09.430572 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 489/1038] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:09 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 2052 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:09.435618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:09.442063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:35:09.447917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.448582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.449328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.450335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.450963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.451392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.594144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:09.597309 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32208888-4fe2-42fd-b837-978beba2e3d3 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.164993 Sep 27 01:35:09.598595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 490/1039] 10.222.0.52 () {58 vars in 1196 bytes} [Tue Sep 27 01:35:09 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:35:09.606299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e82f94c3-8ecd-4b9a-b385-c44a3e317950 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64f9820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:09.691764 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e82f94c3-8ecd-4b9a-b385-c44a3e317950 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.091449 Sep 27 01:35:09.692711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 491/1040] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:09 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:09.699368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:09.700529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:09.713188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.713735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.714601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.715338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:09.715977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:09.716568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:09.956765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:09.963640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:09.967568 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b594c60c-861e-43de-8a2d-bd1722e830c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.271673 Sep 27 01:35:09.968195 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 492/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:09 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:09.980367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:09.982976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:10.000068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.000596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.000827 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7c472128-165c-49a2-8895-7ea7ce4430e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.647811 Sep 27 01:35:10.001096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.001888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 550/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:09 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:10.003170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.003558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.003982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.007175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1225818683", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "239c95d9-c168-4521-87d2-b79ab3af1a31"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:10.154946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] validate_networks() for [('239c95d9-c168-4521-87d2-b79ab3af1a31', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:35:10.217379 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6506734-bdda-41a6-8560-1eea03fed6df tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 0 microversion: 2.1 time: 0.244521 Sep 27 01:35:10.218654 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 493/1043] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:09 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:35:10.224354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:10.224964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:10.232185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.232656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.233097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.234333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.234809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.235234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.771678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:10.784935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-896b50ee-56df-4d9e-8f30-e73b5984cf14 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1504 microversion: 2.1 time: 0.565048 Sep 27 01:35:10.786089 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 494/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:10 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:10.808870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:10.823086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:10.865003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.865773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.866399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.867293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:10.868812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:10.869440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:10.973271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:10.974452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:10.975285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:10.975848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:10.976428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:11.026769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:11.027482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:11.028059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:11.028824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:11.029442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:11.063926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.064868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.068138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.069187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.071035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.074638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.090468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:11.102761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.106531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.107113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.107959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.108522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.110252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.125840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:11.150545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for user 5591a6d007e9465a9ec1a856483feb6d and project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:11.152515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b914b77-1212-426d-8d4b-899570013f63 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 1066 microversion: 2.1 time: 0.348258 Sep 27 01:35:11.153621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 495/1045] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:10 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 1066 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 27 01:35:11.159138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4d534be-b3d8-4a1b-bc00-192fcb8c7ce3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62f6ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:11.208009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:35:11.210952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:35:11.253313 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4d534be-b3d8-4a1b-bc00-192fcb8c7ce3 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.098246 Sep 27 01:35:11.254684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 496/1046] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:11 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:11.281850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:11.282685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:11.290978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.291704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.292261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.293401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.294313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.294460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.394555 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b0be1d27-4c2a-4a7e-98b9-0dcab6d8e517 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.391318 Sep 27 01:35:11.395737 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 551/1047] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:35:11.410633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:11.411513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:11.421081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.421844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.422510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.425810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.426650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.427851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.652133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:11.673230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d02a057-a00a-44ab-8b69-3d9034f65bdb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.417373 Sep 27 01:35:11.675511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 497/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:11 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:11.693968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:11.693968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:11.693968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.693968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.694341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.694341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:11.694341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:11.695804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:11.864120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:11.872467 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-742ba89b-5da5-4c8f-bdfa-c037c1b7c877 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.468524 Sep 27 01:35:11.875895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 552/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:11 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:11.898352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:11.906410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:11.920022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:12.026715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:12.037997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:12.040928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:12.046736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e823b5e5-1de2-4c6a-b73c-b70f7ffc1ba2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1262 microversion: 2.25 time: 0.154097 Sep 27 01:35:12.049642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 553/1050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:11 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:12.059069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:12.065226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.071797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64b86bb3-5c93-4d33-92c8-4aa96574d048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.393994 Sep 27 01:35:12.073245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:12.077991 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 498/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:11 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:12.084070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.084759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.085379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.086757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.087362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.093993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.284670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-57dcc238-41b1-4523-a811-5ac9e92c3db7 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d633faf0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.324694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:12.354343 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b7711b9-5326-421a-a20f-710ab217f568 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1479 microversion: 2.1 time: 0.303449 Sep 27 01:35:12.354924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 554/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1479 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:12.364096 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-57dcc238-41b1-4523-a811-5ac9e92c3db7 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.085577 Sep 27 01:35:12.364667 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 499/1053] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:12.381867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b47b30e-0281-4ecf-baa8-629b2e1dafd8 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '.version_select at 0x7f24d64e6dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.388534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b47b30e-0281-4ecf-baa8-629b2e1dafd8 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.389535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b47b30e-0281-4ecf-baa8-629b2e1dafd8 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.389975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b47b30e-0281-4ecf-baa8-629b2e1dafd8 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.392554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:12.442615 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b47b30e-0281-4ecf-baa8-629b2e1dafd8 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.058042 Sep 27 01:35:12.443821 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 555/1054] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:12.470790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.471604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:12.487302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.488260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.489485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.491497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.492378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.494019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.673898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af245bf-32cf-4f4c-8885-d467a10bb22a", "name": "network-vif-plugged", "status": "completed", "tag": "9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:12.716490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.717262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.717757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.725492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e19bc766-9da7-441f-81a5-818d0ef4837d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1630 microversion: 2.1 time: 0.262048 Sep 27 01:35:12.726076 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 500/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1630 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:12.760836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f4d3228-ec9d-4045-a96d-43a8c9762a76 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: .version_select at 0x7f24d633f3a0>, body: {"keypair": {"name": "tempest-keypair-1799841155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9SuR5FU82cacXiBzE8DDZOhpPdd+V/tk5XppEC0Y3Jm5857YQFlhxyOACXW/3IBok/5SB2s7IVYiP4XMuSrs26A6AXFf0FD7m4ZVIcI/CE62uIpKjnqHNM9qmeMgXVkA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:12.762892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] Creating event network-vif-plugged:9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f for instance 5af245bf-32cf-4f4c-8885-d467a10bb22a on n-h1-859358-1 Sep 27 01:35:12.774674 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d100be9e-5452-48d1-8355-3feb55495b86 req-d907e9d1-3639-4df4-a440-b9dd0631a558 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110191 Sep 27 01:35:12.776319 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 556/1056] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:12.814903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.819466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:12.830978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2f4d3228-ec9d-4045-a96d-43a8c9762a76 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:12.838007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2f4d3228-ec9d-4045-a96d-43a8c9762a76 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for user 56e5b4943e3c4d31aec5dd4dc2ecac66 and project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:12.839714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.849462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.851492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.852882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.857037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.857037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.875015 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f4d3228-ec9d-4045-a96d-43a8c9762a76 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118085 Sep 27 01:35:12.889758 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 501/1057] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:35:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:12.900993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:12.901875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:12.915350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.916173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.916772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:12.917664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:12.918772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:12.919855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:13.232003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.241038 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eccd9fe8-8f13-4c83-92bc-646e42f64256 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.345790 Sep 27 01:35:13.244632 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 502/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:13.258601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:13.259550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:13.273365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.281790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:13.282235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:13.282678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:13.283692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:13.284150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:13.284680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:13.286861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c17cc2a4-3403-4a0f-b590-bc68fe95bf03 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.509076 Sep 27 01:35:13.290187 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 557/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:12 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:13.312928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:13.313975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:13.325124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:13.326002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:13.328131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:13.329174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:13.329822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:13.330413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:13.433297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.473320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.482177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.500607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12b7e767-ff63-4eaa-8ded-e179b8f6623d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1314 microversion: 2.25 time: 0.249931 Sep 27 01:35:13.501255 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 503/1060] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:13 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:13.531415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-654aedc2-70ef-45f9-8f30-f87c43dba969 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6291940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:13.555853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:13.581934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99382f45-8b05-4185-9691-4e93d6129aad tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.274582 Sep 27 01:35:13.587058 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 558/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:13 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:13.687887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-654aedc2-70ef-45f9-8f30-f87c43dba969 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.182100 Sep 27 01:35:13.693662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 504/1062] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:13 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:14.267738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:14.268356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:14.277318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.278009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.278247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.278948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.279396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.279818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.313552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:14.314153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:14.324708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.326246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.327886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.328647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.329752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.330391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.667162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:14.677070 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d007d20e-5bc2-497e-a7a7-0994cdbf3631 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.413789 Sep 27 01:35:14.678522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 559/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:14 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:14.702600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:14.703638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:14.714252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.717489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.733038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.735212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.737029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.740115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.878291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:14.892984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:14.895126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:14.896473 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d618b332-d54d-4516-bfc6-88424fbac4dc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1320 microversion: 2.25 time: 0.206228 Sep 27 01:35:14.898151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 560/1064] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:14 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:14.905413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:14.906273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:14.912896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.913661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.917845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:14.924041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:14.929033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:14.930361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:15.156382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:15.168853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d81ce38-dd16-46c9-8936-2bd5946d141e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1317 microversion: 2.1 time: 0.859592 Sep 27 01:35:15.169462 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 505/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:14 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1317 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:15.204297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0b78456-fd51-45b3-a6b3-731305f60ccc tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64f9160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:15.249451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:15.257600 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ec149cf-edb7-4aa4-bd0c-4737d8d80d58 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.356093 Sep 27 01:35:15.275272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 561/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:14 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:15.295467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0b78456-fd51-45b3-a6b3-731305f60ccc tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.113007 Sep 27 01:35:15.297311 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 506/1067] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:15 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:15.707830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:15.708374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:15.722754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:15.725448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:15.726135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:15.728418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:15.729962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:15.730560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:15.932211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:15.932823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:15.946710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:15.947204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:15.947641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:15.948357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:15.948812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:15.949243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:16.060915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:16.076137 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae737f7a-8f53-4918-8407-ba711899867c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.373234 Sep 27 01:35:16.093003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 562/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:15 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:16.196251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:16.197843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:16.205238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:16.208806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:16.211885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:16.212769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:16.218268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:16.219066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:16.526511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:16.539696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:16.543555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:16.547062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-859ef820-bb0e-4c42-8cda-4b3b2c920216 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.619918 Sep 27 01:35:16.547596 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 507/1069] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:15 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:16.560476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:16.561450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:16.579894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:16.580881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:16.584765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:16.585851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:16.587328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:16.593703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:16.968183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:16.978251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06a9973b-39f6-4c52-8991-f3c5fab7bfaa tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1466 microversion: 2.1 time: 0.787001 Sep 27 01:35:16.985311 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 563/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:16 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1466 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:17.004149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f4777c5-78b7-41b6-ad7e-42e18c6cca11 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62da3a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:17.006179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:17.022469 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58d86f9b-78ab-4efb-ae3f-7bfaa1fbbe85 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.472346 Sep 27 01:35:17.025299 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 508/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:16 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:17.043372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1208464373", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "e586b006-974b-41f8-931d-30e9fc73d562"}], "security_groups": [{"name": "tempest-securitygroup--1377012643"}], "key_name": "tempest-keypair-1799841155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:17.078306 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f4777c5-78b7-41b6-ad7e-42e18c6cca11 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.087774 Sep 27 01:35:17.078878 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 564/1072] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:16 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:17.093184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:17.097508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:17.121530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.122780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.123756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:17.125906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.127520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.128701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:17.565395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b690b62c-003c-4e27-8c30-89254aa88188 tempest-ServersOnMultiNodesTest-1884219555 tempest-ServersOnMultiNodesTest-1884219555-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1617 microversion: 2.1 time: 0.485431 Sep 27 01:35:17.565999 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 565/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:17 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1617 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:17.570896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:17.571508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:17.590840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.591139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.591571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:17.592274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.597585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.598488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:17.759344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] validate_networks() for [('e586b006-974b-41f8-931d-30e9fc73d562', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:35:17.897763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:17.906912 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5bbe2ed1-dbd7-4396-ad46-bdb6b838f785 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.338596 Sep 27 01:35:17.924660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 566/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:17 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:17.931395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:17.933276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:17.940596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.941455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.942124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:17.943164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:17.943831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:17.944471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.296429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:18.315208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:18.317359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:18.318722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f2127b4-1c1f-4612-90a7-68dd01c411ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.392546 Sep 27 01:35:18.333736 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 567/1075] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:17 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:18.351746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:18.352516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:18.362038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.362515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.362953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.363668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.364123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.364566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.415431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:18.522136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:18.522757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:18.523132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:18.523618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:18.524032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:18.537163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.537835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.538385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.540014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.541285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.542097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.572852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:18.573422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9d22b26-2eee-434c-95f2-806c7547e98b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 204 len: 0 microversion: 2.1 time: 0.237956 Sep 27 01:35:18.576960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 568/1076] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:18 2022] DELETE /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:18.583886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for user 56e5b4943e3c4d31aec5dd4dc2ecac66 and project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:18.591229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:18.591948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:18.599803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:35:18.602680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:35:18.609297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.609826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.610264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.610981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.611434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.611873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.701863 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29b6b38a-8451-41ca-b9ff-0d7a37a74005 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.674042 Sep 27 01:35:18.708458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 509/1077] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:35:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:35:18.740690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f591d0a-e95e-4e6c-ae32-c6f638f0b01a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6291700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:18.845282 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f591d0a-e95e-4e6c-ae32-c6f638f0b01a tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1454 microversion: 2.1 time: 0.141192 Sep 27 01:35:18.846342 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 510/1078] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:18 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:18.871510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe00e739-4be2-4555-9c66-8908657ba317", "tag": "846b5a4d-457b-4be0-b262-66e080ae9d57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:18.889079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.889610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.890028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.903593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] Creating event network-changed:846b5a4d-457b-4be0-b262-66e080ae9d57 for instance fe00e739-4be2-4555-9c66-8908657ba317 on n-h1-859358-1 Sep 27 01:35:18.910002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0f3c555e-182a-4326-983b-45efea9cda5e req-81a9535f-6673-4c00-b9cf-0458dc42623b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057136 Sep 27 01:35:18.910774 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 511/1079] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:18.918318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:18.919109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:18.926902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.927390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.927563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.928413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:18.928865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:18.929286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:18.936595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:19.004770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.017385 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84db0ce2-70ce-49b6-bd00-119cf4cfff79 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.442077 Sep 27 01:35:19.019652 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 569/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:18 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:19.027117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f92509a-bbd7-4403-bde9-27237d5b6d71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:19.028020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f92509a-bbd7-4403-bde9-27237d5b6d71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:19.104082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.113102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0bcd35f-8423-4823-93c5-6ee51cebdc5f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1472 microversion: 2.1 time: 0.200221 Sep 27 01:35:19.130179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 512/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:18 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:19.136216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:19.136842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:19.140308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f92509a-bbd7-4403-bde9-27237d5b6d71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.144102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:19.144980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:19.145265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:19.146063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:19.146597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:19.147088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:19.149602 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f92509a-bbd7-4403-bde9-27237d5b6d71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1235 microversion: 2.1 time: 0.128803 Sep 27 01:35:19.166986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 570/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:19 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1235 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:19.307220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.317699 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07692c4b-03a3-4725-aa8e-34557f37c153 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.186074 Sep 27 01:35:19.318537 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 513/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:19 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:19.348109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:19.348877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:19.355751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:19.356369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:19.356898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:19.357809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:19.358390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:19.358919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:19.604686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.613371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.615372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:19.616487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5c5e48f-d30f-428b-a6c8-ba7f3b6ff5f8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.273417 Sep 27 01:35:19.617092 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 571/1084] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:19 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:19.862734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35240c6a-9475-42e6-b2c2-42876e94d547 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6407f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:19.934088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35240c6a-9475-42e6-b2c2-42876e94d547 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1463 microversion: 2.1 time: 0.075329 Sep 27 01:35:19.934769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 514/1085] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:19 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:19.952609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a17523bb-60ac-4488-9769-ceabe8b46b7f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62daca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.023974 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a17523bb-60ac-4488-9769-ceabe8b46b7f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 200 len: 1463 microversion: 2.1 time: 0.076775 Sep 27 01:35:20.026182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 572/1086] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:19 2022] GET /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 1463 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.042089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.043076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.043644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.044273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.061371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.061940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.062393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.063129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.063683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:20.065569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.066514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.071410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.072431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.073839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.077136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.079749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.080457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.291115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:20.307865 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-084ad449-11a3-4d8d-85b3-8afd3c87a132 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1467 microversion: 2.1 time: 0.270157 Sep 27 01:35:20.321734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 515/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1467 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.340102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.341070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.349008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.349825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.350411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.352164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.352897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.354196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.518996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:20.527725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24582bb0-1dfa-491a-8836-fb866ffdc13c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1472 microversion: 2.1 time: 0.197866 Sep 27 01:35:20.528315 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 516/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.549453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.550631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.557885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.558466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.558998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.559789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.560314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.560991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.563980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:20.572211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4cc139dd-08a1-43b3-b8ee-8e25dec6974b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.533680 Sep 27 01:35:20.572968 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 573/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:20.588300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f982597f-5c60-4722-bb29-fe8b05eea9f1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6511a60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.664762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:20.680321 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e5eac8e-5194-4745-a222-42dd60f18b59 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1287 microversion: 2.1 time: 0.150911 Sep 27 01:35:20.681494 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 517/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.688110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.688944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.707151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.708146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.708808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.709971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.710692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.712045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.719510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f982597f-5c60-4722-bb29-fe8b05eea9f1 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-09-27T01%3A33%3A37Z" status: 200 len: 1902 microversion: 2.1 time: 0.143472 Sep 27 01:35:20.720881 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 574/1091] 10.222.0.52 () {58 vars in 1199 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/images?changes-since=2022-09-27T01%3A33%3A37Z => generated 1902 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.725919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:20.726698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:20.734537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.736083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.736083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.736800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:20.737815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:20.738407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:20.760380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:20.957763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:20.975089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86225e21-2fb0-4a1d-a511-6c78dd9aaa23 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.292155 Sep 27 01:35:20.975852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 518/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:20.980792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b841000d-84b4-420c-9665-55eb1de5fcba tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62b44c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.079849 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b841000d-84b4-420c-9665-55eb1de5fcba tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1361946239" status: 200 len: 485 microversion: 2.1 time: 0.102585 Sep 27 01:35:21.081097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 519/1093] 10.222.0.52 () {58 vars in 1231 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1361946239 => generated 485 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:21.094883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5335429b-1954-4258-8675-11ec2583ba88 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62ad430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.101716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=17 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:21.224423 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5335429b-1954-4258-8675-11ec2583ba88 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?server=f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 957 microversion: 2.1 time: 0.134381 Sep 27 01:35:21.225020 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 520/1094] 10.222.0.52 () {58 vars in 1209 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?server=f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 957 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:21.239820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf6749c9-9e64-4a74-bc39-6051e292046d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62f61f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.308713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf6749c9-9e64-4a74-bc39-6051e292046d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 484 microversion: 2.1 time: 0.072748 Sep 27 01:35:21.309757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 521/1095] 10.222.0.52 () {58 vars in 1317 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463 => generated 484 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:21.322248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18131acd-267b-45ac-ae50-95d42ffa8912 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62ad8b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.377533 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18131acd-267b-45ac-ae50-95d42ffa8912 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 484 microversion: 2.1 time: 0.059283 Sep 27 01:35:21.378124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 522/1096] 10.222.0.52 () {58 vars in 1303 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463 => generated 484 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:21.391691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c6aee65-3cc5-4c2a-bcbd-52c7422b09cd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6245b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.482049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:21.501717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:21.510476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:21.512053 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e2e2ad8-8bf0-49d6-8703-d3b039378513 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.790015 Sep 27 01:35:21.513146 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 575/1097] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:20 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:21.539775 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c6aee65-3cc5-4c2a-bcbd-52c7422b09cd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.150719 Sep 27 01:35:21.540794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 523/1098] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:21.557135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.558292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:21.565546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.567202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.567995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:21.569241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.570044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.570697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:21.623697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.624334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:21.631676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.632382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.633051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:21.634596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.635427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.636036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:21.699433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:21.711840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70b0c104-c7d4-4991-980f-024e7eff6b6f tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1430 microversion: 2.1 time: 0.158092 Sep 27 01:35:21.722802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 576/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1430 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:21.732329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5860d256-b263-4e98-8dbe-24523f29254e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d629c9d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.835449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5860d256-b263-4e98-8dbe-24523f29254e tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.118014 Sep 27 01:35:21.837130 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 577/1100] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:21.840556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:21.843148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.849923 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17fa7969-0ea0-4c61-adc9-54a3de75d26b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.251316 Sep 27 01:35:21.850289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:21.851268 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 524/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:21.856782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6144c48-ad4c-425c-a2bd-9352441c2bda tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6245d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:21.858853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.859347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.860152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:21.860866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:21.861877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:21.862505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.012025 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6144c48-ad4c-425c-a2bd-9352441c2bda tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.158959 Sep 27 01:35:22.013554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 525/1102] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:22.019471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af245bf-32cf-4f4c-8885-d467a10bb22a", "name": "network-vif-deleted", "tag": "9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:22.035906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.036474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.036964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.052388 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] Creating event network-vif-deleted:9f64c316-a262-4c8d-8dd9-6ff36e6e9f3f for instance 5af245bf-32cf-4f4c-8885-d467a10bb22a on n-h1-859358-1 Sep 27 01:35:22.058961 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-59225370-65a4-43a2-846b-9fa375f75fea req-8e5f3d4a-6539-421a-b677-0e417bb09c6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043885 Sep 27 01:35:22.059880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 526/1103] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:22.066251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.066971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:22.075200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.075696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.077021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.078990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.079477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.079912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.099314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.107962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3738f689-14ec-4c7d-9de3-7766d313d8c8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1293 microversion: 2.1 time: 0.269584 Sep 27 01:35:22.109094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 578/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:21 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.113738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-945b7379-dba4-44ac-8773-8d89e9c5d2f9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6282af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.261206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-945b7379-dba4-44ac-8773-8d89e9c5d2f9 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-09-27T01%3A33%3A33Z" status: 200 len: 6334 microversion: 2.1 time: 0.150781 Sep 27 01:35:22.264548 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 579/1105] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-27T01%3A33%3A33Z => generated 6334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.307697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7f591fa-a2ae-433f-876c-19553d4dd3df tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6388550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.341540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.354766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24492d7e-73ee-4b4b-b165-ea91f3ca291e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.292860 Sep 27 01:35:22.356606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 527/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.473312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7f591fa-a2ae-433f-876c-19553d4dd3df tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1361946239" status: 200 len: 665 microversion: 2.1 time: 0.170255 Sep 27 01:35:22.473947 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 580/1107] 10.222.0.52 () {58 vars in 1252 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1361946239 => generated 665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:22.493689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc97fc37-e5de-4b02-ab1c-383d99f2e346 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6245790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.538578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.539348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:22.547494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.552203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.552903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.553950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.555102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.555721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.640792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc97fc37-e5de-4b02-ab1c-383d99f2e346 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1466 microversion: 2.1 time: 0.151712 Sep 27 01:35:22.641574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 528/1108] 10.222.0.52 () {58 vars in 1338 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.658277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-557238d4-ce99-4bce-9ea0-c2a825a441ff tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64f9ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.738497 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-557238d4-ce99-4bce-9ea0-c2a825a441ff tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1466 microversion: 2.1 time: 0.084445 Sep 27 01:35:22.751854 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 529/1109] 10.222.0.52 () {58 vars in 1324 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2Fdd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1466 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.756808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.757473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:22.774212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.774916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.777676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.778660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.779313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.779930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.834815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.835623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.836312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.836992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 5af245bf-32cf-4f4c-8885-d467a10bb22a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:22.900978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.906894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.915617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ea1fbf7-cf44-48e1-a449-ca4bcf6ec537 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 200 len: 1307 microversion: 2.1 time: 0.162623 Sep 27 01:35:22.916201 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 530/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:22.922207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.926201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:22.927639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f97ced77-a5cb-408e-8b27-908b66301874 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.393344 Sep 27 01:35:22.930363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-450ce83c-5699-46d9-ae51-ffd8c4df733c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d64f9670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.932807 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 581/1111] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:22.938941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:22.939954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:22.948717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.949724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.950394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:22.951548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:22.953096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:22.953907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.158763 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-450ce83c-5699-46d9-ae51-ffd8c4df733c tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.235958 Sep 27 01:35:23.159381 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 531/1112] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:23.305123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:23.314987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4c2b472-2aef-4891-9a23-1aa54d00f8c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1470 microversion: 2.1 time: 0.379930 Sep 27 01:35:23.330829 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 582/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:22 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:23.331077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c237b1b6-90e3-4d63-94f1-e890fee17907 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Action: 'create', calling method: .version_select at 0x7f24d64f95e0>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:23.338398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.339461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:23.346348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.347736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.348390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.350070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.350814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.351501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.430681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:23.439629 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e8a79c2-33b6-4fa1-b9cf-e47156ca387d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1293 microversion: 2.1 time: 0.107636 Sep 27 01:35:23.440574 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 583/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:23.446209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f829140-833b-4eb9-85c6-0fe581b1d9e5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62cc280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.522284 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f829140-833b-4eb9-85c6-0fe581b1d9e5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.080418 Sep 27 01:35:23.522888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 584/1115] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:23.528258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.529050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:23.537254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.537831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.538264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.539493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.539947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.540544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.763149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:23.773837 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1934833d-f042-4f81-8299-1a09403f14cf tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.249671 Sep 27 01:35:23.776016 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 585/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:23.796473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f614b60d-9e83-4bca-adbd-eccaa6400059 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62cc040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.876749 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f614b60d-9e83-4bca-adbd-eccaa6400059 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27" status: 200 len: 784 microversion: 2.1 time: 0.099372 Sep 27 01:35:23.878312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 586/1117] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27 => generated 784 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:23.894869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bba2cff1-60bb-4766-aa18-0364f85b86eb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6282310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.980372 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bba2cff1-60bb-4766-aa18-0364f85b86eb tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.089397 Sep 27 01:35:23.982486 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 587/1118] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:23.987272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:23.987886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 5af245bf-32cf-4f4c-8885-d467a10bb22a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:23.994485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.994971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.995411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:23.996108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:23.996563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:23.996985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:24.020305 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a HTTP/1.1 Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:35:24.023500 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. Sep 27 01:35:24.025623 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5af245bf-32cf-4f4c-8885-d467a10bb22a'} Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:24.026645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. Sep 27 01:35:24.028306 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:24.030296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 5af245bf-32cf-4f4c-8885-d467a10bb22a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:24.030296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36c70bb9-3868-464f-b536-41eaa4e24e9e tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a" status: 404 len: 111 microversion: 2.1 time: 0.041926 Sep 27 01:35:24.033177 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 588/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:23 2022] GET /compute/v2.1/servers/5af245bf-32cf-4f4c-8885-d467a10bb22a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:24.044393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:24.044393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:24.055816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:24.056451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:24.057411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:24.071471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:24.072233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:24.073359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:24.373413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:24.385732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:24.388498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:24.392315 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25ab4f66-5a6e-4624-a8e4-3e71565e57fc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.357845 Sep 27 01:35:24.392903 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 589/1120] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:24 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:24.401171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d91237ea-2450-4e12-8282-59821cd4a8d8 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d63884c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.075872 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c237b1b6-90e3-4d63-94f1-e890fee17907 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.905404 Sep 27 01:35:25.077452 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 532/1121] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:35:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:25.090264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.090836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:25.102321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.103338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.103960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.105376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.105996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.106579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.159979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:25.307292 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76015168-3e47-45e0-8acb-f1399e2dee6a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 204 len: 0 microversion: 2.1 time: 0.228179 Sep 27 01:35:25.308807 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 533/1122] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:25 2022] DELETE /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:25.317544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.318787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:25.329292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.330233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.330919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.331815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.332668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.333257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.390889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d91237ea-2450-4e12-8282-59821cd4a8d8 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b" status: 204 len: 0 microversion: 2.1 time: 0.995039 Sep 27 01:35:25.395208 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 590/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:24 2022] DELETE /compute/v2.1/images/4f41564b-8eca-4820-8658-70f8b36aac2b => generated 0 bytes in 998 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:25.399960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.400230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:25.426889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.427663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.428339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.430061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.430825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.431511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.509463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:25.517810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35ec7232-0cd9-48ef-a81f-7eea024b67fa tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.207453 Sep 27 01:35:25.539981 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 534/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:25 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:25.546731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.547257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:25.553902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.555408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.556828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.558462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.560374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.561272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.713600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:25.724010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c14b1ce7-a124-4e3b-8a97-d5c726a0fcf6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.330720 Sep 27 01:35:25.724867 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 591/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:25 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:25.746235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38d1b431-7d14-4e45-9d11-6d0623009ec9 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d6282f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.747555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:25.757297 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71f16015-0aaf-469e-be9c-bac8f6292413 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1476 microversion: 2.1 time: 0.216024 Sep 27 01:35:25.758216 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 535/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:25 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:25.784125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:25.784799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:25.792189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.792682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.793297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.794047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:25.794491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:25.794912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:25.974754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:25.985929 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-077eadf2-5f9c-482e-b02d-165ac9e407d9 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1472 microversion: 2.1 time: 0.216523 Sep 27 01:35:25.999097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 536/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:25 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:26.010784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-unplugged", "status": "completed", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:26.022325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.023764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.024778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.040331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] Creating event network-vif-unplugged:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:35:26.046256 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-452fc922-1960-4851-aa59-464fc35adf77 req-8079de71-0f22-435e-84f3-e7a1cc172c2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044626 Sep 27 01:35:26.047458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 537/1128] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:26.054599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca78405a-a1b3-4f3d-b269-857f48952738 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6262ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:26.079412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38d1b431-7d14-4e45-9d11-6d0623009ec9 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/298b439f-238e-4f6d-8c60-f8d69ee71821" status: 200 len: 141 microversion: 2.1 time: 0.351765 Sep 27 01:35:26.080004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 592/1129] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:35:25 2022] GET /compute/v2.1/os-floating-ips/298b439f-238e-4f6d-8c60-f8d69ee71821 => generated 141 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:26.085985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:26.086840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:26.095057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.095734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.096337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.097211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.098395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.099100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.256915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:26.268512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:26.270069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:26.271399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2dd5adb2-9529-4c71-84cb-ac3f39d28bbe tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.189748 Sep 27 01:35:26.271948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 593/1130] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:26 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:26.276527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:26.286314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.286789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.287211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.299276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] Creating event network-changed:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h2-859358-1 Sep 27 01:35:26.305866 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-aedbefc7-26e4-42ac-9a25-662ea2e7513b req-d973d240-2aa7-4264-8a83-5abaedb777a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Sep 27 01:35:26.306634 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 594/1131] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:26.312970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-586d8e43-702e-4272-b745-6a1b094d24e0 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d67668b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:26.530501 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-586d8e43-702e-4272-b745-6a1b094d24e0 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.222447 Sep 27 01:35:26.531426 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 595/1132] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:35:26 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:26.544846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67c5c197-f74c-487a-ba07-f8f0176537b9 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d62cc550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:26.560275 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca78405a-a1b3-4f3d-b269-857f48952738 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21" status: 204 len: 0 microversion: 2.1 time: 0.511328 Sep 27 01:35:26.560853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 538/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:26 2022] DELETE /compute/v2.1/images/ba391bfe-633f-439b-a7a6-e9f98e0bcf21 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:26.565713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:26.566377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:26.572877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.573794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.574230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.574922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:26.575368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:26.575786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:26.705656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:26.715635 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-716baa3c-24b0-46f0-ab2e-d33ad579f540 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.153297 Sep 27 01:35:26.716977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 539/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:26 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:26.725447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5011295-4bf4-453a-b12e-60ab55ef94d7 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d62f6790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.241178 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5011295-4bf4-453a-b12e-60ab55ef94d7 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868" status: 204 len: 0 microversion: 2.1 time: 0.522925 Sep 27 01:35:27.241817 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 540/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:26 2022] DELETE /compute/v2.1/images/d43d9297-b32d-4c2b-b66a-11dc639ec868 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:27.247695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.248313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.254531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.255011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.255440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.256131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.256573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.257208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.262634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:27.394509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.402984 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8b66177-6398-49eb-8231-2551de0e14c2 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.160019 Sep 27 01:35:27.403648 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 541/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:27 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:27.408307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.408908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.414626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.415107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.415543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.416230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.416685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.417114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.549650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.558188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a71d32a9-fa0b-4c5d-9e27-a6e28d091a3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.153569 Sep 27 01:35:27.559148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 542/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:27 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:27.563669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.564323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.570809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.571295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.571728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.572427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.572880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.573305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.630901 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67c5c197-f74c-487a-ba07-f8f0176537b9 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/298b439f-238e-4f6d-8c60-f8d69ee71821" status: 202 len: 0 microversion: 2.1 time: 1.090458 Sep 27 01:35:27.631485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 596/1138] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:35:26 2022] DELETE /compute/v2.1/os-floating-ips/298b439f-238e-4f6d-8c60-f8d69ee71821 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:35:27.637027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.637810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.643946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.644430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.644865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.645630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.646086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.646510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.672254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:27.703918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.711867 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5dcd308-010d-4ac2-8b35-1be40e508521 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1472 microversion: 2.1 time: 0.151855 Sep 27 01:35:27.712672 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 543/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:27 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:27.717106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.717919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.723695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.724376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.724784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.725608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.726074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.726496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.751866 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60f836fd-7810-45de-8a85-7ba525f96bc5 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 204 len: 0 microversion: 2.1 time: 0.119115 Sep 27 01:35:27.752565 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 597/1140] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:27 2022] DELETE /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:27.758849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d2e413a-89d2-40b5-84c4-07f9f615acf1 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Action: 'create', calling method: .version_select at 0x7f24d62821f0>, body: {"pool": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:27.860613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.869241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.870764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:27.871880 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a00ddcc9-5792-4db0-9670-02fe7d196ebc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.158292 Sep 27 01:35:27.872440 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 544/1141] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:27 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:27.876927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:27.877934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:27.883964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.885907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.886358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:27.887072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:27.887587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:27.888022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.017884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:28.025712 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bb8a4fb-59e6-454b-bc06-7207b5d1d589 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.152271 Sep 27 01:35:28.026479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 545/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:27 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:28.032014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:28.032014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:28.037615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.038095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.039015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.039859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.040348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.040727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.180184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:28.187929 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-891128dc-b009-40f8-b618-9b6e9fd4869f tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1472 microversion: 2.1 time: 0.160647 Sep 27 01:35:28.188507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 546/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:28 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:28.192846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe00e739-4be2-4555-9c66-8908657ba317", "name": "network-vif-plugged", "status": "completed", "tag": "846b5a4d-457b-4be0-b262-66e080ae9d57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:28.202473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.202951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.203358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.214214 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] Creating event network-vif-plugged:846b5a4d-457b-4be0-b262-66e080ae9d57 for instance fe00e739-4be2-4555-9c66-8908657ba317 on n-h1-859358-1 Sep 27 01:35:28.219274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-631bbf70-f8a9-4b7a-97a5-e6d236700cd9 req-9b90b0cb-6152-4370-8a6e-f783b9701495 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 Sep 27 01:35:28.219870 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 547/1144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:28.426452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:28.427326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:28.434631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.435133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.435542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.436259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.436706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.437121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.555234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:28.568933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:28.576759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e319ab0-a691-409c-8ae4-6df8bf0fc69a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.154467 Sep 27 01:35:28.577365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 548/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:28 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:28.607191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:28.608205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:28.615953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:28.624801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.625404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.625911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.626686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.627213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.627704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.769604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:28.778049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecdd9be4-6e37-4aa5-b70c-aa39c4f88d07 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.199297 Sep 27 01:35:28.793720 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 549/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:28 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:28.799572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:28.800193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:28.806164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.806645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.807082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.807792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.808224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.808647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.940965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:28.949438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52af9ecc-74f3-4957-bcec-49b01f63f62d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1472 microversion: 2.1 time: 0.154614 Sep 27 01:35:28.950009 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 550/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:28 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:28.954424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:28.955151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:28.961476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.961965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.962396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.963090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:28.963541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:28.963979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:28.966340 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d2e413a-89d2-40b5-84c4-07f9f615acf1 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.212505 Sep 27 01:35:28.966924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 598/1148] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:35:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:28.978975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f47555eb-5359-43c8-b321-2c2eb4113e53 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d62ccb80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.099347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.107519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.108939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.110066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05412a92-42d2-4352-bfce-2905273cf34e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.159156 Sep 27 01:35:29.110615 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 551/1149] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:28 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:29.114928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.115819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:29.122155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.122692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.123297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.124260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.124448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.124868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.149112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:29.266865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.275508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e69b9dcd-0352-49e7-a01e-928ba6f031d2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.163912 Sep 27 01:35:29.276084 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 552/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:29 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:29.280712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.281322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:29.290617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.291101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.291529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.292219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.292665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.293088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.423545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.431758 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1edbf301-a572-4c55-a323-c4312c012e58 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1472 microversion: 2.1 time: 0.154715 Sep 27 01:35:29.432328 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 553/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:29 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:29.601999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.602649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:29.608564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.609117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.609589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.610285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.610727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.611144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.738923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.747498 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22eb650a-9f4d-4c12-b869-7ea58f316f93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.150433 Sep 27 01:35:29.748189 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 554/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:29 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:29.805920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.806537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:29.812483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.813046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.813586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.814391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.814920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.815419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.948955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:29.957093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6504b82e-2f46-4fc8-abce-fc45d71ac0d1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.155693 Sep 27 01:35:29.957740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 555/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:29 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:29.974691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:29.976480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:29.982453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.982935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.983523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:29.984062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:29.984507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:29.984927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.013687 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f47555eb-5359-43c8-b321-2c2eb4113e53 tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b" status: 202 len: 0 microversion: 2.1 time: 1.038167 Sep 27 01:35:30.018364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 599/1154] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:35:28 2022] DELETE /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:35:30.035274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d62ccc10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.132188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b could not be found", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:35:30.133422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] HTTP exception thrown: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Request method failure captured: Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b HTTP/1.1 Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlNaDvk467IEwuT7Bq4mUytIUTXqE8CTm_ExqUV-PmySs1IWwCaarUQAzCjyD0vMvifG9jcKrtJovb8CMgP3GGa5jeu-Nha6JmJ4SNpdY_w2p_lAM6Kk0VeITFUEdFefzTBvI0XMy6g8KSEq3yzMBBt4h3Ygs5VSpjdXCGW9fJfA2_c Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c519658e8cd54334bc0e9cfb4801dbfc Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:35:30.135651 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c519658e8cd54334bc0e9cfb4801dbfc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c519658e8cd54334bc0e9cfb4801dbfc Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FloatingIPsTestJSON-507180901-project Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 61165fcc640a44a0a12df9f3847345e7 Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FloatingIPsTestJSON-507180901-project Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: exception: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b'} Sep 27 01:35:30.137123 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:35:30.138023 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b could not be found Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbb970f9-810f-4380-bb2b-3a966119570a'] Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b. Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.139309 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:30.140611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:30.144073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.144073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.146186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Returning 404 to user: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:30.147306 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d63fed31-9e5d-4359-b9fe-1bc1e3ce8d2c tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b" status: 404 len: 111 microversion: 2.1 time: 0.127840 Sep 27 01:35:30.148640 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 600/1155] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:35:30 2022] GET /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:30.158882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:30.161275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.162671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:30.171368 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25f10a68-002b-4de0-aa8e-8a01785ab769 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1472 microversion: 2.1 time: 0.200918 Sep 27 01:35:30.173586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.175023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.175735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.177535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.179097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.180001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.188633 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 556/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:29 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:30.207778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Calling method '.version_select at 0x7f24d6262dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.276873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b could not be found", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:35:30.277694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] HTTP exception thrown: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Request method failure captured: Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b HTTP/1.1 Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlNaDvk467IEwuT7Bq4mUytIUTXqE8CTm_ExqUV-PmySs1IWwCaarUQAzCjyD0vMvifG9jcKrtJovb8CMgP3GGa5jeu-Nha6JmJ4SNpdY_w2p_lAM6Kk0VeITFUEdFefzTBvI0XMy6g8KSEq3yzMBBt4h3Ygs5VSpjdXCGW9fJfA2_c Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c519658e8cd54334bc0e9cfb4801dbfc Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:30.282468 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c519658e8cd54334bc0e9cfb4801dbfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c519658e8cd54334bc0e9cfb4801dbfc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c519658e8cd54334bc0e9cfb4801dbfc Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsTestJSON-507180901 Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsTestJSON-507180901-project Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 61165fcc640a44a0a12df9f3847345e7 Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsTestJSON-507180901-project Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: exception: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b'} Sep 27 01:35:30.284303 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:35:30.285440 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b could not be found Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c88fbdba-290f-4e57-a6ac-e7f85bac2726'] Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b. Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.286767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:30.288228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:30.290763 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b Sep 27 01:35:30.290763 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:30.290763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] Returning 404 to user: Floating IP not found for ID 56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:30.290763 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d996e68-7d9e-41e0-ac7e-9bff5454456f tempest-FloatingIPsTestJSON-507180901 tempest-FloatingIPsTestJSON-507180901-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b" status: 404 len: 111 microversion: 2.1 time: 0.097524 Sep 27 01:35:30.297096 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 557/1157] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:35:30 2022] DELETE /compute/v2.1/os-floating-ips/56ef3ef4-395d-4e9e-a9ee-da0a2b0e888b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:30.307414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-unplugged", "status": "completed", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:30.331256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.332676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.335131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.351797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] Creating event network-vif-unplugged:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:35:30.358523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d448b7ec-9db9-445c-aec1-eaf4ff824a16 req-b89ee484-6504-4438-a44d-ea3b2f46882f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060086 Sep 27 01:35:30.361198 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 558/1158] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:30.366451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.367167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:30.373970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.374461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.374994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.375818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.376289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.376740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.552292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:30.565000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:30.567475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:30.568932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56f0e914-9800-4069-895d-5821a2c43212 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1362 microversion: 2.25 time: 0.415064 Sep 27 01:35:30.570688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 601/1159] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:30 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:30.579890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd751e1f-0877-451b-8a83-3bbd8620f463", "name": "network-vif-deleted", "tag": "84aa3138-ded6-4164-a5c3-4ea57647dc07"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:30.594879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.595718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.596483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.616772 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] Creating event network-vif-deleted:84aa3138-ded6-4164-a5c3-4ea57647dc07 for instance dd751e1f-0877-451b-8a83-3bbd8620f463 on n-h1-859358-1 Sep 27 01:35:30.623373 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0ec9cf3c-9bc2-49ec-899b-77f11082294d req-c8a883a5-375b-47ad-a90d-7eee139926c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047111 Sep 27 01:35:30.625066 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 602/1160] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:30.631954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.633709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:30.650185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.650859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.651489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.653681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.654304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.655086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.709565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.710108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.710592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.711047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lazy-loading 'fault' on Instance uuid dd751e1f-0877-451b-8a83-3bbd8620f463 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:30.801235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:30.813832 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72bff830-b1b2-4ba3-b3a2-bf8fcf367c1c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.450375 Sep 27 01:35:30.829449 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 559/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:30 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:30.829449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:30.829449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:30.835237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.835237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.835237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.835926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:30.836749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:30.837131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:30.863651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:31.124052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.134113 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83934fcc-fd62-4c03-a7b7-a1338444eb52 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 200 len: 1306 microversion: 2.1 time: 0.507090 Sep 27 01:35:31.151251 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 603/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:30 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 1306 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:31.158183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:31.159092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:31.166687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.168170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.168836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.169780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.170552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.171685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.408754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.418455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c34de827-8f98-4491-9d7a-a6b6bb4ddbc0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.599795 Sep 27 01:35:31.419040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 560/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:30 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:31.440054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:31.440917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:31.447130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.447618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.448398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.449262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.449903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.450337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.514821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.525059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f056dfe-e4ee-49d0-922f-5da380e76974 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.372281 Sep 27 01:35:31.525694 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 604/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:31 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:31.600245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:31.602088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:31.609023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.609555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.609982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.610884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.611530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.611958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.616684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:31.811479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.837183 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d54b8a2-9a0d-406f-bd3a-a5bb14217176 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1472 microversion: 2.1 time: 0.398748 Sep 27 01:35:31.838597 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 561/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:31 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:31.847180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:31.849869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:31.861143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.863351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.864319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.865402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.866099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.866647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:31.905948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.923547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.925863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:31.928020 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20f8e5f3-6e1a-4c61-914d-faf268f847e6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1559 microversion: 2.25 time: 0.332269 Sep 27 01:35:31.951726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 605/1166] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:31 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1559 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:31.956823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:31.957917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:31.995325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:31.996194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:31.997539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.000341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.003528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.006033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.288991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:32.307611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6ac3c8b-821f-40ea-93ac-4292e5dd9f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.459854 Sep 27 01:35:32.321425 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 562/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:31 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:32.335215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.335843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: dd751e1f-0877-451b-8a83-3bbd8620f463] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.343381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.344104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.345247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.346026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.346999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.347586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.369653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] HTTP exception thrown: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Request method failure captured: Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 HTTP/1.1 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLsNMo5HFef244arXBuJ6IApVWow42Qk-DcHmb0gxhlh9ysemg3iiAuTyBarvx_MtUw8X17e6LHjp6oPi6SIQafW-0t5qdQX4OmbXPq2R5H7lO1hssLnbcqEZp4cn3KWq7XsFuRPPTTdKIEa_Ul-nZ2diOjyRCYMNaQ-Hx_pp60qZI Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d8306b6829dd47f28c763765aa7895a5 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:32.371746 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8306b6829dd47f28c763765aa7895a5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d8306b6829dd47f28c763765aa7895a5 Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListImageFiltersTestJSON-1324479339-project Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 98a950fcfbd24116b873d5be27643e9a Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListImageFiltersTestJSON-1324479339-project Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. Sep 27 01:35:32.373084 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'dd751e1f-0877-451b-8a83-3bbd8620f463'} Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:32.373909 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. Sep 27 01:35:32.375116 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:32.377877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Returning 404 to user: Instance dd751e1f-0877-451b-8a83-3bbd8620f463 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:32.379063 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-984dff73-28b6-4c18-87fe-cc76869547aa tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463" status: 404 len: 111 microversion: 2.1 time: 0.056508 Sep 27 01:35:32.381148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 563/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/dd751e1f-0877-451b-8a83-3bbd8620f463 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:32.384328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:32.396857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.398925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.412113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.412864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.412995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52260d54-ef7e-4067-9475-c460955b38bf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 2052 microversion: 2.25 time: 0.459771 Sep 27 01:35:32.413718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.414667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.415622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.416278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.424656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 606/1169] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:31 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 2052 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:32.443819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.444507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.449090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:32.463377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.463901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.464353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.465092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.465612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.466363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.571291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05a524dc-53d1-494e-8ad8-e744c132e04d tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 204 len: 0 microversion: 2.1 time: 0.183758 Sep 27 01:35:32.574512 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 564/1170] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:32 2022] DELETE /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:32.579794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.580496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.586439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.587202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.587633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.588325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.588766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.589404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.666751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:32.680321 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b24d4f54-25ed-4d42-a02b-e339566d1507 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 2052 microversion: 2.25 time: 0.243095 Sep 27 01:35:32.680886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 607/1171] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 2052 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:32.685563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.686561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.693063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.693753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.694711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.696071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.696682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.697270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.800613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:32.812052 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-134c6d82-474f-485a-b7a8-0662cf3563db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.236212 Sep 27 01:35:32.816910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 565/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:32.822950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.823738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.834367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.835139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.838836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:32.842902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.847053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.847551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.848132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.849139 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6deceb5f-e000-4b15-a18a-d7a780794fd5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.167047 Sep 27 01:35:32.850257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 608/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:32.855825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "name": "network-vif-unplugged", "status": "completed", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}, {"server_uuid": "feccfde8-cbbf-407f-a831-72c824bdc146", "name": "network-vif-deleted", "tag": "0cc906f8-dad8-4b29-97a9-b9280a59b413"}, {"name": "network-changed", "server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:32.866949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.867417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.867843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.882857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Creating event network-vif-unplugged:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h2-859358-1 Sep 27 01:35:32.883516 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Creating event network-vif-deleted:0cc906f8-dad8-4b29-97a9-b9280a59b413 for instance feccfde8-cbbf-407f-a831-72c824bdc146 on n-h2-859358-1 Sep 27 01:35:32.884115 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Creating event network-changed:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h2-859358-1 Sep 27 01:35:32.895770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] Instance cab455d9-d484-4e83-9e97-e17788aaffa7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:35:32.909220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-319f76c2-e528-4fda-b63e-fd69ac9bff2a req-bcd4b477-b909-49f2-ab79-831611d2fd8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.057000 Sep 27 01:35:32.909880 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 609/1174] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:32.915383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.918956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.919435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.919869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.920592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.921039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.921498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.952512 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8298ba7d-e0df-4477-b4fc-c8d541f3f670 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041247 Sep 27 01:35:32.959787 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 610/1175] 10.222.0.52 () {60 vars in 1217 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:35:32.959787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:32.959787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:32.965378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:32.966847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.967341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.967778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:32.968498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:32.968954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:32.969409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.005548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.006372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.006933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.007483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid feccfde8-cbbf-407f-a831-72c824bdc146 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:33.053442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:33.061475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec8b8439-5567-49c0-ad9d-671ccb8cc153 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1307 microversion: 2.1 time: 0.106875 Sep 27 01:35:33.062052 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 611/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:33.067185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:33.067651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:33.074181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.075059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.075680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.076539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.077376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.077794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.082058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:33.111005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d73a60d-9774-407b-9809-bb42e95f9631 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1473 microversion: 2.1 time: 0.292607 Sep 27 01:35:33.112194 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 566/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:32 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:33.156436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b097401-ddc7-40ad-8023-b35fb38c3271 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317/action" status: 202 len: 0 microversion: 2.25 time: 0.093096 Sep 27 01:35:33.156998 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 612/1178] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:35:33 2022] POST /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:33.166089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:33.166702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:33.172984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.173517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.173949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.174707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.175159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.175596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.334269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:33.334977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:33.341715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.342202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.342634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.343331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.343786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.344218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.366523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:33.379580 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9544efde-d426-42ff-9541-a2085e2b68f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 2057 microversion: 2.25 time: 0.217922 Sep 27 01:35:33.380310 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 567/1179] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:33 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 2057 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:33.489237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:33.497886 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-96665648-dbcd-4f4f-a11f-5420b96cfc43 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.167924 Sep 27 01:35:33.499423 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 613/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:33 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:33.838175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:33.838899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:33.846183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.846756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.847734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.848800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.849378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.849914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.873744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:33.874765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:33.881082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.881965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.883138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:33.884059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:33.884802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:33.885895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.030542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:34.053282 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75bda56b-30c2-42e3-b5f2-e8f61a26764a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.170771 Sep 27 01:35:34.072332 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 614/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:33 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:34.085134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-plugged", "status": "completed", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:34.101835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.102688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.103359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.117799 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] Creating event network-vif-plugged:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:35:34.124649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-46698bf7-ac40-4890-8630-45f2a07f28ee req-8eaf30a1-7651-4abc-b274-33c26d7e41ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050638 Sep 27 01:35:34.126398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 615/1182] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:34.134048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:34.135318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:34.143213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.143790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.144212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.144919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.145389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.145810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.183477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.183962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.184394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.184841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid feccfde8-cbbf-407f-a831-72c824bdc146 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:34.241398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:34.252853 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b9abb06-8436-40ae-9ecf-60308444c0df tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1307 microversion: 2.1 time: 0.124979 Sep 27 01:35:34.253900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 616/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:34 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:34.258794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:34.259412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:34.266938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.267491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.281544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.282629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.286851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.287385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.404295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:34.412461 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7026f9fd-94c5-448e-9357-52a826862b82 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.578419 Sep 27 01:35:34.413048 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 568/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:33 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:34.420585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:34.421202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:34.427244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.427738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.428157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.429446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.429904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.430334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.741937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:34.755940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c32107ca-48f5-41d1-a041-0c664a6be9ea tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 2037 microversion: 2.25 time: 0.341323 Sep 27 01:35:34.773579 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 569/1185] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:34 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 2037 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:34.773579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:34.773579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:34.779856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.780437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.780911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.783580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.783580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.783580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.871942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:34.888794 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c4bc9ea-ffbc-4e14-aac4-6f2a8cb60e59 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1473 microversion: 2.1 time: 0.633879 Sep 27 01:35:34.889322 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 617/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:34 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1473 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:34.909484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-859358-1", "block_migration": "auto"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:34.911953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:34.921527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.922022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.922456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.923164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:34.923611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:34.924035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:34.969957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'flavor' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:34.989830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Going to try to live migrate instance to n-h2-859358-1 {{(pid=128778) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:35:35.086883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:35.096979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9730ac7-ea5b-480c-97d2-d7eeeee900a1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.337285 Sep 27 01:35:35.101607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 570/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:34 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:35.107462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:35.108266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:35.127910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:35.130188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.131336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.132785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.134033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.134722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.135369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.358683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:35.375917 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3138a4d2-4a82-46c4-8528-b350a4932a6c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.272799 Sep 27 01:35:35.389576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 571/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:35 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:35.395924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:35.396833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:35.406983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.408352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.409175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.410965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.411872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.412467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.499229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.499837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.500293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.503422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid feccfde8-cbbf-407f-a831-72c824bdc146 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:35.598661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:35.608530 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b2cbcce-02ae-4e46-938d-0cbba3776b69 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 200 len: 1307 microversion: 2.1 time: 0.217371 Sep 27 01:35:35.621365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 572/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:35 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:35.621365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:35.621365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:35.622134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.623209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.624448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.625298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.625927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.626487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.810842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:35.820470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ed2fb3d-bc23-4e3e-bfd0-732e098d6be0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.209433 Sep 27 01:35:35.826925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 573/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:35 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:35.835707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bf7f4-0be9-4d85-9546-9a839b401b6b", "name": "network-vif-deleted", "tag": "ca642d7f-6f4c-4b35-990a-9797519a5194"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:35.862665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.869485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.870158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.919777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] Creating event network-vif-deleted:ca642d7f-6f4c-4b35-990a-9797519a5194 for instance f51bf7f4-0be9-4d85-9546-9a839b401b6b on n-h1-859358-1 Sep 27 01:35:35.932265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1f48ffb0-e292-41e2-8918-781824788629 req-9e67aa78-b2d6-4d35-bc52-ad4e7e64a186 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101639 Sep 27 01:35:35.934169 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 574/1191] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:35.961278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:35.963317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:35.983817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.986040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:35.986657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:35.998454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:35.999454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.001246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.046693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:36.089452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.090052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.090636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.091136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lazy-loading 'fault' on Instance uuid f51bf7f4-0be9-4d85-9546-9a839b401b6b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:36.178398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98a950fcfbd24116b873d5be27643e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8306b6829dd47f28c763765aa7895a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:36.189691 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac32e5e6-8ef5-4534-9055-3ab73e0dbbfd tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 200 len: 1308 microversion: 2.1 time: 0.246086 Sep 27 01:35:36.190491 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 575/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:35 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:36.194774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:36.195373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:36.212191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.213703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.214299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.215317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.216590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.217205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.362654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:36.375467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae5c6230-320a-4dd5-af34-de8db55f861d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.183392 Sep 27 01:35:36.376304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 576/1193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:36 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:36.401284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:36.402253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:36.410702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.411191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.411671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.412526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.413329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.413650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.659994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:36.679405 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c4ba8e4-5cf5-4885-95f3-177712d74ed1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1475 microversion: 2.1 time: 0.278465 Sep 27 01:35:36.680041 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 577/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:36 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:36.695322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:36.695934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: feccfde8-cbbf-407f-a831-72c824bdc146] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:36.705301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.706168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.706730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.707439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.707889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.708306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.723033 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 HTTP/1.1 Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:36.724971 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. Sep 27 01:35:36.726414 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'feccfde8-cbbf-407f-a831-72c824bdc146'} Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:36.727168 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. Sep 27 01:35:36.728367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:36.730982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance feccfde8-cbbf-407f-a831-72c824bdc146 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:36.732074 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24b3fdcd-937d-4927-9411-ba9ea30d28c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146" status: 404 len: 111 microversion: 2.1 time: 0.048686 Sep 27 01:35:36.735985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 578/1195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:36 2022] GET /compute/v2.1/servers/feccfde8-cbbf-407f-a831-72c824bdc146 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:36.740958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:36.742218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:36.748352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.749085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.749809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.750720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.751447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.752141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.792354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:36.892927 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bf7c734-b010-4dec-a9a7-a9b0bcb981a3 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 204 len: 0 microversion: 2.1 time: 0.155384 Sep 27 01:35:36.893875 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 579/1196] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:36 2022] DELETE /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:36.900271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:36.901110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:36.907148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.908115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.908890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:36.909710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:36.910250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:36.910756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.093015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.103649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5478a0f-d4ea-4227-b4f3-fec47a13fd44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.207701 Sep 27 01:35:37.107378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 580/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:36 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:37.113140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.114951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:37.121984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.122442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.122963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.123864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.124788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.125435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.159780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84270852-40cc-4b68-a047-eb64cc723829 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317/action" status: 202 len: 0 microversion: 2.25 time: 2.269315 Sep 27 01:35:37.160491 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 618/1198] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:35:34 2022] POST /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317/action => generated 0 bytes in 2271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:37.170273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.171022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:37.184415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.185807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.186599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.187524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.188056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.188580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.194531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:37.293093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.301534 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5390f0d4-e5c8-4904-b948-f87dbb778114 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1473 microversion: 2.1 time: 0.195584 Sep 27 01:35:37.302361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 581/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:37.307694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.308375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] [instance: f51bf7f4-0be9-4d85-9546-9a839b401b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:37.314188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.314730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.315410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.316162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.316674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.317161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.331123 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] HTTP exception thrown: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Request method failure captured: Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b HTTP/1.1 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLsNMo5HFef244arXBuJ6IApVWow42Qk-DcHmb0gxhlh9ysemg3iiAuTyBarvx_MtUw8X17e6LHjp6oPi6SIQafW-0t5qdQX4OmbXPq2R5H7lO1hssLnbcqEZp4cn3KWq7XsFuRPPTTdKIEa_Ul-nZ2diOjyRCYMNaQ-Hx_pp60qZI Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d8306b6829dd47f28c763765aa7895a5 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:37.332995 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d8306b6829dd47f28c763765aa7895a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d8306b6829dd47f28c763765aa7895a5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d8306b6829dd47f28c763765aa7895a5 Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1324479339 Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListImageFiltersTestJSON-1324479339-project Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 98a950fcfbd24116b873d5be27643e9a Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListImageFiltersTestJSON-1324479339-project Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. Sep 27 01:35:37.334354 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f51bf7f4-0be9-4d85-9546-9a839b401b6b'} Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:37.335277 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. Sep 27 01:35:37.336710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:37.338723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Returning 404 to user: Instance f51bf7f4-0be9-4d85-9546-9a839b401b6b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:37.339586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-677c9b67-ecf3-447c-a7d6-8f58cd8d5b56 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b" status: 404 len: 111 microversion: 2.1 time: 0.036105 Sep 27 01:35:37.340209 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 582/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] GET /compute/v2.1/servers/f51bf7f4-0be9-4d85-9546-9a839b401b6b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:37.348496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2cfe26e9-88a3-4f31-a61f-5b63811e2346 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d614d550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.382377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.391479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.393185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.397402 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74652769-ce9f-4bda-b631-5c3e92c36b5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.231847 Sep 27 01:35:37.398468 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 619/1201] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:37 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:37.405293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.405936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:37.417247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.417766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.418314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.419090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.419543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.419962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.599092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.607000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eefa5400-5ccd-4b1b-b860-e2c9886c04ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.207157 Sep 27 01:35:37.607565 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 620/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:37.704634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.706456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:37.714425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.715259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.715922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.716806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:37.717374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:37.717887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:37.807172 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2cfe26e9-88a3-4f31-a61f-5b63811e2346 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b" status: 204 len: 0 microversion: 2.1 time: 0.462713 Sep 27 01:35:37.807910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 583/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] DELETE /compute/v2.1/images/fdb36f17-7740-476b-b7ca-2809e45a727b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:37.815718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e619ffc0-8a48-4800-8401-0c3469fae599 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6165ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:37.873892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:37.882862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b56bfdc3-449e-4375-8922-32e225de7bff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1473 microversion: 2.1 time: 0.182915 Sep 27 01:35:37.884079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 621/1204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:38.127651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.128165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:38.134325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.135030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.135462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.136149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.136601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.137018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.277885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.286713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aadfa297-9472-46de-a5ef-49c6c5490a87 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.162851 Sep 27 01:35:38.287430 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 622/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:38 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:38.305632 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e619ffc0-8a48-4800-8401-0c3469fae599 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92" status: 204 len: 0 microversion: 2.1 time: 0.493496 Sep 27 01:35:38.306323 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 584/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:37 2022] DELETE /compute/v2.1/images/87ff73d6-4743-4332-af53-5d1ac1cc8b92 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:35:38.314758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fca7be29-02b1-43a5-ab6b-ad580f8bb2a6 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] Calling method '.version_select at 0x7f24d6241b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.328490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.330039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:38.337057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.337870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.338308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.339179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.339643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.340071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.567645 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fca7be29-02b1-43a5-ab6b-ad580f8bb2a6 tempest-ListImageFiltersTestJSON-1324479339 tempest-ListImageFiltersTestJSON-1324479339-project] 10.222.0.52 "DELETE /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319" status: 204 len: 0 microversion: 2.1 time: 0.256987 Sep 27 01:35:38.568455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 623/1207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:38 2022] DELETE /compute/v2.1/images/a34674d7-16be-4fd3-be6a-e1f087c37319 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:35:38.582289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.584350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:38.596021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.598897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.600034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.603546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.606154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.606299 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62e72a2b-6733-4c59-9b6d-43d3805b4824 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1473 microversion: 2.1 time: 0.284880 Sep 27 01:35:38.606876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.609504 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 585/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:38 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:38.625941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.634112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.635922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:38.644573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.645068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.645552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.646248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.646703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.647130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.858509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.868895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79636b38-1923-44a4-bf5b-fc8d5a194888 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1476 microversion: 2.1 time: 0.242462 Sep 27 01:35:38.883356 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 586/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:38 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:38.907060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:38.908213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:38.915960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.916706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.918077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.919268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:38.920127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:38.920468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.920727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:38.931544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.934042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:38.935432 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-147b3d61-e768-40e8-b2b7-309bba195c9e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.365119 Sep 27 01:35:38.948688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 624/1210] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:38 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:39.112984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:39.127496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8aeff98-2352-4b60-b669-8262d209ad71 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1473 microversion: 2.1 time: 0.224514 Sep 27 01:35:39.128812 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 587/1211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:38 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:39.317398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:39.318795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:39.327036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:39.327693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:39.328277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:39.329464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:39.330070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:39.331023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:39.631763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:39.632377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:39.644599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:39.650982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:39.651731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:39.652635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:39.653257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:39.653922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:39.990914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.020177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c36ac5bc-8737-4452-b8d4-02d22a1cf3e6 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1473 microversion: 2.1 time: 0.392399 Sep 27 01:35:40.040916 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 588/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:39 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:40.044971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:40.045620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:40.066451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.066944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.067397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.068677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.069703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.070149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.166455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.178344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a3ecba3-70d2-4dc9-bd31-8024d6db8f7a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.870459 Sep 27 01:35:40.179251 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 625/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:39 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:40.189474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:40.190618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:40.212006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.212988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.213458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.214173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.214621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.215031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.678048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.688982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-168d54c7-f299-4468-af68-d50b010d5777 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1462 microversion: 2.1 time: 0.647745 Sep 27 01:35:40.690211 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 589/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:40 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1462 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:40.706883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:40.708049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:40.714893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.715584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.716111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.716921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:40.717585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:40.718101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:40.744168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.756021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.758175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.759363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e44fddfc-48d7-4e9d-872c-76ee491d305c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.578820 Sep 27 01:35:40.760468 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 626/1215] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:40 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:40.957600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:40.978223 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-736e8e70-e21d-4672-aa2a-41640d6741e3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1473 microversion: 2.1 time: 0.286454 Sep 27 01:35:40.995617 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 590/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:40 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:41.010807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b41540-3ef8-45d5-872b-f2327c6ff302", "name": "network-vif-deleted", "tag": "18a35574-3c52-4fd2-b25b-83bc820fef07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:41.026000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.026697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.027318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.043627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] Creating event network-vif-deleted:18a35574-3c52-4fd2-b25b-83bc820fef07 for instance 70b41540-3ef8-45d5-872b-f2327c6ff302 on n-h2-859358-1 Sep 27 01:35:41.047499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c39a4cf-298b-4734-848b-d1dd37028b62 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] Calling method '.version_select at 0x7f24d620f1f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.049863 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4dadde30-5077-4a49-99a0-fced23d20be6 req-d1d2aa6c-8ae2-4f84-8c27-b9d2723ec3c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050477 Sep 27 01:35:41.050472 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 591/1217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:41.055767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.056470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.063206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.063900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.064500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.065373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.066417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.067025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.115799 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c39a4cf-298b-4734-848b-d1dd37028b62 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] 10.222.0.52 "GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27" status: 200 len: 784 microversion: 2.1 time: 0.323449 Sep 27 01:35:41.116414 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 627/1218] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:35:40 2022] GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27 => generated 784 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:41.138115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.139164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.145959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.146938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.150394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.151409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.152105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.152747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.243985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:41.252625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd77cf36-af06-4780-a151-0d1e851c347b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1462 microversion: 2.1 time: 0.200748 Sep 27 01:35:41.254071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 592/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1462 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:41.260045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-847a8cc0-05b8-478d-94b5-8991450e1629 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] Calling method '.version_select at 0x7f24d61021f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.264174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:41.289654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3116b613-bcd2-4ac2-baaf-4149d9baa673 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1431 microversion: 2.1 time: 0.166390 Sep 27 01:35:41.290466 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 628/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1431 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:41.295102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.295745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.311529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.312188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.315650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.316524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.316880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.317313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.331935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-847a8cc0-05b8-478d-94b5-8991450e1629 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.076322 Sep 27 01:35:41.333414 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 593/1221] 10.222.0.52 () {58 vars in 1122 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/images => generated 445 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:41.338187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:41.341649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.349647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.350365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.350977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.351964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.353064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.353690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.451090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:41.452082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:41.452668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:41.453295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:41.453857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:41.467638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:41.536057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:41.545953 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-025decd3-89fd-4c0c-86ec-fca5ab91c840 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.254555 Sep 27 01:35:41.546901 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 629/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:41.563557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.570027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.570525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.570968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.571725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.572142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.572572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.580083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88c4392b-8be9-499c-8f90-11d37e231971 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] Calling method '.version_select at 0x7f24d62ccc10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.619886 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a20de81f-7053-4bd0-9f20-49bb44831df8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 1066 microversion: 2.1 time: 0.285311 Sep 27 01:35:41.620965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 594/1223] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:41 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 1066 bytes in 287 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 27 01:35:41.639903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.640682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.650399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.650621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.651314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.652358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.653059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.653612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.672910 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88c4392b-8be9-499c-8f90-11d37e231971 tempest-ListImagesTestJSON-1169186756 tempest-ListImagesTestJSON-1169186756-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.123590 Sep 27 01:35:41.674407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 630/1224] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:41.787314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:41.788710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:41.796798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.797649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.798981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.799987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:41.800633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:41.801287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:41.878298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:41.888626 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0e221be-5e10-4ec6-a605-45d586c938fb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.252523 Sep 27 01:35:41.890282 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 595/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:42.004098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:42.004879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:42.013039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.015226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.017004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.017849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.018653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.020749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.095890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.118595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.120384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.124084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84ac83dd-122c-4341-93ac-296dad9812b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.341922 Sep 27 01:35:42.124675 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 631/1226] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:42.221260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.230825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d14b251a-4b61-424d-b6c0-47f0013806dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1473 microversion: 2.1 time: 0.230500 Sep 27 01:35:42.236402 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 596/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:41 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:42.238294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "name": "network-vif-plugged", "status": "completed", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:42.257601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.258712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.260098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.302234 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] Creating event network-vif-plugged:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h2-859358-1 Sep 27 01:35:42.311239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a701fda8-a436-4457-bdb0-518e8b326678 req-bb9a7470-4592-4bdc-8912-17e8ec6fadc6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078096 Sep 27 01:35:42.313990 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 632/1228] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:42.317279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:42.317939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:42.332444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.332963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.333643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.335861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.336501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.337603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.433644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.458615 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5529de30-959f-4bee-87e4-56117332b2dd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1431 microversion: 2.1 time: 0.145276 Sep 27 01:35:42.462021 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 597/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:42 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1431 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:42.576046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:42.576752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:42.583594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.584090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.584529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.585282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.585763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.586371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.790795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:42.804472 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24853882-8e6d-4434-898f-5d65c81c2ca7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.233550 Sep 27 01:35:42.806465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 633/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:42 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:42.915676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:42.916883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:42.927745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.930180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.930863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:42.932318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:42.932792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:42.933231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.150841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:43.151782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:43.159695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:43.162054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.163497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.164105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.164980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.166838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.167958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.190820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.202292 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67920daf-b132-4201-bde5-8aa495fd55bb tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.291531 Sep 27 01:35:43.202901 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 598/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:42 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:43.261470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:43.262554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:43.269944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.270805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.271245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.271980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.273006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.273529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.333328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.344783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.346624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.348059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-874ca6ad-857d-4846-abcc-cd8abf6f266e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.201715 Sep 27 01:35:43.362690 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 634/1232] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:43 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:35:43.485078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:43.485727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:43.499833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.499833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.499833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.500513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.500969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.511993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.541031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.556416 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4be61b21-6d64-4d88-9419-66299c510c94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1473 microversion: 2.1 time: 0.301548 Sep 27 01:35:43.559310 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 599/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:43 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:43.792036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:43.808507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cfdca1e0-1e5c-474b-b453-8d75504469bd tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1302 microversion: 2.1 time: 0.327939 Sep 27 01:35:43.822616 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 635/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:43 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1302 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:43.828103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:43.830042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:43.836496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.837255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.838149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:43.839090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:43.840042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:43.840701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.087510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:44.104846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d3e8699-5b6c-4069-82a9-150b4372a7f9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.280365 Sep 27 01:35:44.106483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 600/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:43 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:44.236300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:44.237934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:44.261114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.270533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.271331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.272270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.273101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.274038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.376018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:44.376547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:44.386979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.397103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.400662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.401839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.402895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.403878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.940320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:44.952003 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0ac374b-5109-4a56-a9a5-25c78d21cca2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.729392 Sep 27 01:35:44.952874 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 636/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:44 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:44.980056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:44.980857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:44.992044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.993626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.994235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:44.995139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:44.995820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:44.996439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.208797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.217674 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4b65d46-5c25-45da-aef3-485f8cc31e8e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1470 microversion: 2.1 time: 0.243619 Sep 27 01:35:45.218555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 637/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:44 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:45.223192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:45.223983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:45.230845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.231541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.232149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.233027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.233664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.234250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.299086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.299601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.300055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.300493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 70b41540-3ef8-45d5-872b-f2327c6ff302 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:45.347449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.357599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.359065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.362937 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5e4f4ca-3b68-4b20-aade-3a0e2a89ad79 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.990949 Sep 27 01:35:45.363841 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 601/1238] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:44 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:45.370116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:45.370732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:45.381935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.382778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.383571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.384770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.385837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.386702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.391321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.406525 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95a79a13-6799-40d2-82c6-97c8fe42c19d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1307 microversion: 2.1 time: 0.185231 Sep 27 01:35:45.407143 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 638/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:45 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:45.427265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:45.427764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:45.439610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.440458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.441109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.442311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.443033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.443863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.450057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:45.558112 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee812c9d-c1ff-498a-a758-60c4ed115fd3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7/action" status: 204 len: 0 microversion: 2.1 time: 0.147801 Sep 27 01:35:45.558947 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 639/1240] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:35:45 2022] POST /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7/action => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:45.568240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:45.569187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:45.576295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.577036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.577711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.578864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:45.579508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:45.580125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:45.704267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:45.716648 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bd69690-6810-4b64-8421-c08c43f33bea tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1361 microversion: 2.1 time: 0.351696 Sep 27 01:35:45.717857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 602/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:45 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:45.986385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:45.987156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:46.003673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.004525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.005151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.006009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.006660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.007275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.281170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:46.290779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:46.296650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17bfa80b-9de3-4871-bad4-18e62c338af6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1470 microversion: 2.1 time: 0.733403 Sep 27 01:35:46.298665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 640/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:45 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:46.299264 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bda99750-4c5a-476d-87d2-f334d4eac795 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.325074 Sep 27 01:35:46.299829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 603/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:45 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:46.393328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:46.394108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:46.405179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.405731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.406162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.406887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.407337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.408075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.434057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:46.434726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:46.448047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.448542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.448975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.449710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.450155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.458385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.510706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.511860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.513237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.514476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 70b41540-3ef8-45d5-872b-f2327c6ff302 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:46.590262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:46.605528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1056e5ef-3f5b-407c-9ada-357736c0c614 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 200 len: 1307 microversion: 2.1 time: 0.175139 Sep 27 01:35:46.607016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 604/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:46 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:46.740380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:46.741648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:46.751377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.753155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.754776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.758673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:46.758673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:46.759183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:46.945203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:46.954821 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1086a71e-fc99-43c9-8381-939334c57c71 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1545 microversion: 2.1 time: 0.218326 Sep 27 01:35:46.955321 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 605/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:46 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1545 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:47.004105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:47.013230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:47.014982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:47.016656 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da7051e6-ea69-475b-8599-8a4990366f28 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.627429 Sep 27 01:35:47.017782 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 641/1246] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:46 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:47.022928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:47.023628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:47.029981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.030663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.031236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.032074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.032973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.033583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.118702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-43254783", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "78245f35-4202-475f-b7e8-8ba979a9ec94"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:47.177943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] validate_networks() for [('78245f35-4202-475f-b7e8-8ba979a9ec94', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:35:47.240193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98b5e750-7303-4615-9cc1-4acbb62a0e97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221115 Sep 27 01:35:47.241059 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 642/1247] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:35:47 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:47.328438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:47.330383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:47.338464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.339218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.340110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.341392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.342007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.342582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.776833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:47.790674 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-394ec8e6-d6fb-4ec2-bcf1-262b0dd9de48 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1470 microversion: 2.1 time: 0.465730 Sep 27 01:35:47.792527 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 643/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:47 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:47.798673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:47.799546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:47.820843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.822869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.823657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.825495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.826200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.826878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.892869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:47.893892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:47.894577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:47.895162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:47.895747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:47.919920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.920412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.920853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.921612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:47.922062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:47.922491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:47.941329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Getting quotas for project c64c2a706bbf4339ba69a2f801fbd8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:47.948127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Getting quotas for user 777fd527300048e7a57d681764a36e6f and project c64c2a706bbf4339ba69a2f801fbd8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:47.987372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:35:47.995888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:35:48.075612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a0e5509-e17a-4d80-96a0-236ed498ed7d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118695 Sep 27 01:35:48.077193 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 606/1249] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:35:48.089416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.090597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 70b41540-3ef8-45d5-872b-f2327c6ff302] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.099582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.100494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.101259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.116124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.116678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.117156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.148348 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 HTTP/1.1 Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:48.150104 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. Sep 27 01:35:48.151873 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '70b41540-3ef8-45d5-872b-f2327c6ff302'} Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:48.153018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. Sep 27 01:35:48.154790 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:48.156410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 70b41540-3ef8-45d5-872b-f2327c6ff302 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:48.156410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-403e9d2c-09d9-40c8-b4bc-13d25ee2af18 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302" status: 404 len: 111 microversion: 2.1 time: 0.073006 Sep 27 01:35:48.156410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 607/1250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:48 2022] GET /compute/v2.1/servers/70b41540-3ef8-45d5-872b-f2327c6ff302 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:48.159215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.159837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.178866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.179367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.179808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.180525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.180982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.181437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.533679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:48.548538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:48.563940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:48.565182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-172c9c0f-b7c7-48a7-8b3e-e5c0efbbf4ee tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.412198 Sep 27 01:35:48.577939 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 608/1251] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:48 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:48.584746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-165918c4-e0dc-437b-b13e-78c2eadde064 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.585380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-165918c4-e0dc-437b-b13e-78c2eadde064 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.600796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:48.681050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:48.690682 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de798ddb-fc3d-4c85-89ca-8160d319151b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.896872 Sep 27 01:35:48.696155 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 644/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:47 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:48.713202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.713202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.721321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.724194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.724635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.726161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.726615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.727214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.754248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:48.798633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-165918c4-e0dc-437b-b13e-78c2eadde064 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:48.815885 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-165918c4-e0dc-437b-b13e-78c2eadde064 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1230 microversion: 2.1 time: 0.233292 Sep 27 01:35:48.835346 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 609/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:48 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1230 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:48.843436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe00e739-4be2-4555-9c66-8908657ba317", "name": "network-vif-unplugged", "status": "completed", "tag": "846b5a4d-457b-4be0-b262-66e080ae9d57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:48.865931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.867039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.867807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.900877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] Creating event network-vif-unplugged:846b5a4d-457b-4be0-b262-66e080ae9d57 for instance fe00e739-4be2-4555-9c66-8908657ba317 on n-h1-859358-1 Sep 27 01:35:48.918834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2ee481c6-83ca-4513-bcb1-22d247d11914 req-5269bce2-04ce-4a85-a4d5-dec76855e872 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082088 Sep 27 01:35:48.919450 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 610/1254] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:48.933013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.936096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.951736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c863b554-febf-4a0d-a1fa-af79f2f1fc74 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 204 len: 0 microversion: 2.1 time: 0.251222 Sep 27 01:35:48.953056 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 645/1255] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:48 2022] DELETE /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:48.956117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.956887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.957600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.958549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.959216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.960258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.965559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:48.971270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:48.985448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.986937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.988747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:48.990866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:48.992717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:48.995550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.045809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:49.237843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:49.252386 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9072791f-9b8d-49b6-a54d-b8104a60fe77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1470 microversion: 2.1 time: 0.331657 Sep 27 01:35:49.253646 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 611/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:48 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:49.275419 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89efb3eb-2af6-4075-9c8c-40757f9287c8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 204 len: 0 microversion: 2.1 time: 0.316441 Sep 27 01:35:49.277130 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 646/1257] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:48 2022] DELETE /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:49.285183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:49.286117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:49.295062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:49.297674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.300253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.301194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.302849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.304666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.305217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.323145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.323635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.324966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.338639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] Creating event network-changed:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h2-859358-1 Sep 27 01:35:49.347932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fe0c5664-a068-472b-b6c2-443297fbef49 req-f70c927d-50c0-4932-932d-592d78cab203 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058012 Sep 27 01:35:49.350946 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 647/1258] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:49.354123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:49.602275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:49.606877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:49.607682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:49.620795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7a3024a-6b78-4f9c-a458-1cb0f1d51ced tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1473 microversion: 2.1 time: 0.338106 Sep 27 01:35:49.624052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.626924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.628658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.634723 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 612/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:49 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:49.636423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.637152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.639967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.720434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:49.721358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:49.733395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.734995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.737613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.738643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.742111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.742888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.950921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:49.970354 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3946f0e7-06f9-4f63-b12e-f9ecefeab07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.247171 Sep 27 01:35:49.971582 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 613/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:49 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:49.978338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:49.979258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:49.986394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.987238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.988565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:49.989557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:49.990247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:49.991544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.015792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.039883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.061567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.063208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ad39bcf-e59d-4903-963c-4a88c52d4cfc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.462445 Sep 27 01:35:50.075411 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 648/1261] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:49 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:50.090522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.101804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac272435-ad7b-4eeb-abab-764120c751ab tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1234 microversion: 2.1 time: 0.128148 Sep 27 01:35:50.105906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 614/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:49 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1234 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:50.277148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:50.277833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:50.289146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:50.291957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:50.292441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.295891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:50.296773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:50.297215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.607186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.620501 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99c6ee3b-f67a-411d-833a-90cc0feffc17 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1470 microversion: 2.1 time: 0.346760 Sep 27 01:35:50.621107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 649/1263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:50 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:50.653602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:50.654331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:50.671211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:50.672690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:50.673820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.674724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:50.675302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:50.675980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.906749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:50.940508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49210dd1-3670-4149-82c4-8c55cb945a2a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1473 microversion: 2.1 time: 0.292330 Sep 27 01:35:50.941143 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 615/1264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:50 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:50.971346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe00e739-4be2-4555-9c66-8908657ba317", "tag": "846b5a4d-457b-4be0-b262-66e080ae9d57"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:50.984874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:50.985496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:50.985795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:50.994815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:50.995431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:51.019562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.020338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.020968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:51.022262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.027766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] Creating event network-changed:846b5a4d-457b-4be0-b262-66e080ae9d57 for instance fe00e739-4be2-4555-9c66-8908657ba317 on n-h1-859358-1 Sep 27 01:35:51.030046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.030509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:51.041485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-42a78532-9e64-471a-88f2-b6d2c789e758 req-79668108-9b4b-4f78-9d31-46e71122a197 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073550 Sep 27 01:35:51.042361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 650/1265] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:51.093770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:51.094764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:51.105364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.107536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.109230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:51.110245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.112861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.113573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:51.449869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:51.505963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50809cb3-9f66-4537-aab3-b31162379498 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.511744 Sep 27 01:35:51.510068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 616/1266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:50 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:51.518997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:51.520534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:51.542376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.543508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.544444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:51.545416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:51.546081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:51.546705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.002969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:52.014720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:52.020559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:52.024549 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8ba54cd-513f-4698-93f8-8f3e4ca2e0a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.934629 Sep 27 01:35:52.027298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 651/1267] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:51 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:52.041098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:52.044490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:52.058648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.061093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.061766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.062695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.065662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.066680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.350146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:52.359624 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c56f7bda-aae6-4f0a-b9f4-0de4b473833f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1282 microversion: 2.1 time: 0.847633 Sep 27 01:35:52.366349 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 617/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:51 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1282 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:52.371341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "name": "network-vif-plugged", "status": "completed", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:52.388289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.388773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.389207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.423903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] Creating event network-vif-plugged:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h2-859358-1 Sep 27 01:35:52.434361 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f275ed1a-0d2d-4e8c-9b02-ef90f8409167 req-c7399ece-002f-4084-8b17-2a5092000e78 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066544 Sep 27 01:35:52.435237 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 618/1269] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:52.441047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:52.442673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:52.450642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.451394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.452024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.452928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.458486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.459214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.785254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:52.816224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a0996af-2450-4bb1-8899-deed46a7dd5a tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1473 microversion: 2.1 time: 0.379352 Sep 27 01:35:52.817141 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 619/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:52 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1473 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:52.828201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:52.830092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:52.850320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.851149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.852131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.855102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:52.855801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:52.856486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:52.989247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:53.002362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:53.018609 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3be1d6f3-d1b6-4081-b7cc-ed17f2acb118 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1462 microversion: 2.1 time: 0.986731 Sep 27 01:35:53.035041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 652/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:52 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1462 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:53.046301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:53.047588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:53.055873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.056460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.056785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.057698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.058518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.059105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.213029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:53.224979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e0b72c9-141d-42cd-9670-328e6efeb5fd tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.406243 Sep 27 01:35:53.229392 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 620/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:52 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:53.235777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:53.237144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:53.253779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.255148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.258234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.259306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.264821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.266436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.593068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f83ba15a-d876-48ae-b705-cfd64f6c785e tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1613 microversion: 2.1 time: 0.552757 Sep 27 01:35:53.594497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 653/1273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:53 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1613 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:53.601086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:53.602764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:53.608753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:53.623229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:53.652445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:53.663404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:53.664137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.664869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.667037 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-320fc069-46df-4b04-a18c-8ecc8ce03f17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.435626 Sep 27 01:35:53.669082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.673799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.674147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 621/1274] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:53 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:53.677600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.678845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.692670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fb68859-d487-4bbd-a6ef-8ac3df765f92 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '.version_select at 0x7f24d62525e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:53.739898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb68859-d487-4bbd-a6ef-8ac3df765f92 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.746963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb68859-d487-4bbd-a6ef-8ac3df765f92 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.747652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb68859-d487-4bbd-a6ef-8ac3df765f92 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.767246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fb68859-d487-4bbd-a6ef-8ac3df765f92 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.091803 Sep 27 01:35:53.771201 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 622/1275] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:35:53 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:53.780834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9950be27-4e7c-42ea-b32e-90972afe3d31", "name": "network-vif-deleted", "tag": "2b4b6147-9cf6-4c0a-ab8e-9072a427c434"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:53.825143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.827192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.828248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.875666 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] Creating event network-vif-deleted:2b4b6147-9cf6-4c0a-ab8e-9072a427c434 for instance 9950be27-4e7c-42ea-b32e-90972afe3d31 on n-h1-859358-1 Sep 27 01:35:53.889608 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0e087d12-3188-4cf8-9b2c-04b0a7338cc7 req-f1e30703-9715-4f63-889f-ae3da5d3e12c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111294 Sep 27 01:35:53.892376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 623/1276] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:53.904527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:53.905546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:53.925581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.926631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.927401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.929181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.930195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.931609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.983912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:53.987553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:53.988369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:53.989093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 9950be27-4e7c-42ea-b32e-90972afe3d31 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:54.070751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:54.099011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e9bf329-5e5c-498d-8add-c4113e065e04 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1288 microversion: 2.1 time: 0.502926 Sep 27 01:35:54.101460 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 654/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:53 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1288 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:54.109477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-939989841", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:54.124093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:54.167001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d003520-5f46-4cf4-a4ea-69d62b4152c5 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 200 len: 1307 microversion: 2.1 time: 0.268502 Sep 27 01:35:54.171003 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 624/1278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:53 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:54.271154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:54.276341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:54.305238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:35:54.309387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.310368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.312690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.314047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.316427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.319098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.694986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:54.714350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a89aaa5-b3cf-48f1-9926-549529088f37 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.466528 Sep 27 01:35:54.715070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 625/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:54 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:54.720224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:54.721091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:54.733042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.738188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.738931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.739857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.740984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.741596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.764830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:35:54.765704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:35:54.766616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:35:54.767839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:35:54.768971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:35:54.786412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.787209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.788173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.807524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:54.808272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:54.808878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:54.859235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:54.879511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:54.901091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:35:54.904013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:35:55.000027 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49cb2875-64ce-4847-8310-64345f92f223 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897184 Sep 27 01:35:55.004385 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 655/1280] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:35:55.026492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e530fc2-1f90-46e7-a80c-b728526e3a19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:55.027139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e530fc2-1f90-46e7-a80c-b728526e3a19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:55.140280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e530fc2-1f90-46e7-a80c-b728526e3a19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.152487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e530fc2-1f90-46e7-a80c-b728526e3a19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1212 microversion: 2.1 time: 0.143670 Sep 27 01:35:55.154350 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 656/1281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:55 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:55.165798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:55.166536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:55.181667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.182165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.182592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.183303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.183761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.184182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.292693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.306129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.307605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.308841 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3998565-78fa-4a01-a453-1d208f266654 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.592365 Sep 27 01:35:55.309432 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 626/1282] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:54 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:55.325239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:55.325931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 9950be27-4e7c-42ea-b32e-90972afe3d31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:55.348453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.349274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.350690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.351661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.352589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.353543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.378051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 HTTP/1.1 Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:35:55.379815 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. Sep 27 01:35:55.381281 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '9950be27-4e7c-42ea-b32e-90972afe3d31'} Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:55.382048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. Sep 27 01:35:55.384567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:35:55.386510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 9950be27-4e7c-42ea-b32e-90972afe3d31 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:55.386510 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f4564d4-dc3b-44fd-9627-4740bd033be8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31" status: 404 len: 111 microversion: 2.1 time: 0.064784 Sep 27 01:35:55.386510 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 627/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:55 2022] GET /compute/v2.1/servers/9950be27-4e7c-42ea-b32e-90972afe3d31 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:55.392850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:55.393518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:55.414250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.414878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.415388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.419709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.420382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.420938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.531304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.531717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.534372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.535340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 7712ee57-f899-4f07-8845-13195e4ed128 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:35:55.541376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.550570 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad049fbb-399f-483b-a28e-b6ef5528e3cb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.392975 Sep 27 01:35:55.560055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 657/1284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:55 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:55.645705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:55.662790 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c157174d-85b9-4cf2-bffb-a536c57c1539 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 200 len: 1307 microversion: 2.1 time: 0.275896 Sep 27 01:35:55.663621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 628/1285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:55 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:55.742203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:55.742898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:55.755073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.755668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.756213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.757110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:55.757808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:55.758413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:55.994208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7712ee57-f899-4f07-8845-13195e4ed128", "name": "network-vif-deleted", "tag": "fed7f93a-ba1d-4770-bc7d-03775dec547a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:56.025857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.026662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.027255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.063586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:56.066792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] Creating event network-vif-deleted:fed7f93a-ba1d-4770-bc7d-03775dec547a for instance 7712ee57-f899-4f07-8845-13195e4ed128 on n-h2-859358-1 Sep 27 01:35:56.074470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c94e490d-acb3-4a7c-83d8-b67d883c5c6a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.336592 Sep 27 01:35:56.082965 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f35ec3a0-cbba-46a1-a48e-b9839a30c95c req-e7ae1fc2-1c1a-4d3e-9e3a-df3d3a97c91c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092948 Sep 27 01:35:56.083537 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 629/1286] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:35:56.097543 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 658/1287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:55 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:56.189525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:56.190350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:56.198382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.199134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.199787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.200675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.201154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.201955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.339109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:56.340067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:56.351755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.358077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.362856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.363846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.364515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.365145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.406686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:56.424918 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a800b6f-8914-4642-974e-a3706db1f7de tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1216 microversion: 2.1 time: 0.249124 Sep 27 01:35:56.425775 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 630/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:56 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:56.586829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:56.587462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:56.613449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.614226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.616493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.617793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.619506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.620561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.755534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:56.767999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:56.769726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:56.771215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cdede30e-234b-4633-8f9c-82685fb112c6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.438751 Sep 27 01:35:56.772344 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 659/1289] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:56 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:56.777898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb38bbad-8d85-4f27-a355-630ebf4250b8", "tag": "48fcefe7-b816-429a-9355-fdad5583f619"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:56.788803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.789563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.790376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.803120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] Creating event network-changed:48fcefe7-b816-429a-9355-fdad5583f619 for instance eb38bbad-8d85-4f27-a355-630ebf4250b8 on n-h1-859358-1 Sep 27 01:35:56.808103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a6dc3fc5-a867-4b9d-8d88-8468443f5096 req-5f79146d-e447-4162-bd53-fea775688eaf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034290 Sep 27 01:35:56.808946 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 660/1290] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:56.814387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:56.815071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 7712ee57-f899-4f07-8845-13195e4ed128] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:56.822701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.823519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.823903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.824622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:56.825081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:56.825554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:56.840174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 HTTP/1.1 Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:35:56.841912 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. Sep 27 01:35:56.843491 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7712ee57-f899-4f07-8845-13195e4ed128'} Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:35:56.844557 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. Sep 27 01:35:56.846542 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:35:56.848958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 7712ee57-f899-4f07-8845-13195e4ed128 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:35:56.848958 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d4436ea-0fae-44d9-a526-0d741d1caf3b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128" status: 404 len: 111 microversion: 2.1 time: 0.036834 Sep 27 01:35:56.848958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 661/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:56 2022] GET /compute/v2.1/servers/7712ee57-f899-4f07-8845-13195e4ed128 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:35:56.908756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Action: 'create', calling method: .version_select at 0x7f24d6224ee0>, body: {"keypair": {"name": "tempest-keypair-220363177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwu4LN/CW6wk5VW4ep8PdoHtgWLee/k+jEplvrhx/vQa/S8gPxPrS0CsibBfAKXPSksrwL1U04C3zzwQ5vbfa7lKpjm52lwVSrMfO3iJlX44UdgFXY13wnpTkc1TvFnSQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:35:56.926068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:35:56.932783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for user df457f1df01e4d778adb762d77bbad15 and project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:35:56.949524 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 01:35:57.297789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:57.301301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:57.306924 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee670dd0-1f43-4e95-8d33-3d949254c32f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.727509 Sep 27 01:35:57.308141 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 631/1292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:56 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:57.312956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-20bf7676-d66d-4d1e-b313-0ac6d245dd29 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:57.355620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-20bf7676-d66d-4d1e-b313-0ac6d245dd29 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/e1941332-c20c-4962-952c-dc23db4cbc95" status: 204 len: 0 microversion: 2.1 time: 0.045179 Sep 27 01:35:57.356245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 632/1293] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:35:57 2022] DELETE /compute/v2.1/os-server-groups/e1941332-c20c-4962-952c-dc23db4cbc95 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:57.366718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:57.367546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:57.375747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.376310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.376756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.379126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.379606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.380040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.676658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:57.690272 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9592548b-3e6c-441c-821c-f9bdd6f2b551 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.330924 Sep 27 01:35:57.691190 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 633/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:57 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:57.701686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:57.705369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:57.716892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.717863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.718526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.720949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.721796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.722397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.758031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:57.899610 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e580bbe-fbcd-4889-9f4c-3a0baaccc414 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 204 len: 0 microversion: 2.1 time: 0.204644 Sep 27 01:35:57.900448 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 634/1295] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:57 2022] DELETE /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:57.907347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:57.908317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:57.933552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:57.936000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.936503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.937040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.937753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:57.938209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:57.938635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:57.957569 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34964. Sep 27 01:35:57.982676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b27dcdb-0c8a-4b11-bf8b-d2a3f5fc2c7e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.133981 Sep 27 01:35:57.983272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 662/1296] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:35:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:35:57.988314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:57.992465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:58.000610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.001356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.001797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.002511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.003756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.004560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.085144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.098847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-420c0ec2-56d0-4bdb-9da6-282bb3bebe2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1270 microversion: 2.1 time: 0.195757 Sep 27 01:35:58.100417 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 635/1297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:57 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:58.109722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:58.110400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:58.163661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.165416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.167070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.174772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.176883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.178622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.231522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.235125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:35:58.245223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.246742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.252408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-58eb0440-4ded-4823-a206-8e9feba58418 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.267768 Sep 27 01:35:58.253777 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 663/1298] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:57 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:35:58.335912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:58.336785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:58.352598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.352598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.352598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.353901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.355469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.356542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.425173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-081129ee-e6a1-4d37-a88f-cc458951db9b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 204 len: 0 microversion: 2.1 time: 0.316382 Sep 27 01:35:58.429563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 636/1299] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:35:58 2022] DELETE /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:35:58.440205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:58.440937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:58.469157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.469684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.470125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.470853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.471312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.471739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.588104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.597138 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-11b8cc2d-44de-40dd-a783-db604d1c59ba tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.266758 Sep 27 01:35:58.597783 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 664/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:58 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:58.717753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:58.721413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:58.729921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.730620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.731055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.735230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:58.735919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:58.744800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:58.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:35:58.944448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:58.956182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ce30424-6060-45a5-ac47-8d6a0d556309 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1474 microversion: 2.1 time: 0.524419 Sep 27 01:35:58.958256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 637/1301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:58 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1474 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:59.126092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:59.126985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:59.140551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.141750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.143526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.145818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.148602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.152629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.364933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:59.382501 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1eb982a-e674-470f-9855-88780eaeb07a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.670893 Sep 27 01:35:59.398678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 665/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:58 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:35:59.398678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:59.398678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:59.398678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.399318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.399318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.399318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.399318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.400181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.535342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:59.547036 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3da0b287-9207-43ed-b74b-44505e03ad4b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.425232 Sep 27 01:35:59.561870 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 638/1303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:59 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:59.624549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:59.625501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:59.633858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.634610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.635210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.636096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.636743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.637520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.817567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:35:59.826265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-979f410c-0873-471f-8857-9fff2a910441 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.206000 Sep 27 01:35:59.826852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 639/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:59 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:35:59.985493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:35:59.986631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:35:59.993996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.994789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.995516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:35:59.996480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:35:59.997458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:35:59.997990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.058835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.070191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.071776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.073295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-233a2e68-03e4-46a2-b771-19ec2d04138a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.688876 Sep 27 01:36:00.074823 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 666/1305] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:35:59 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:00.180136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.189352 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6019cce5-eff9-4cbc-a476-c96c1dcac170 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1474 microversion: 2.1 time: 0.207670 Sep 27 01:36:00.190268 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 640/1306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:35:59 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:00.246652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da48f3bc-f212-407c-a5d5-a5c3e4f348e6", "tag": "ad59b064-b492-4320-b5ca-1c700cff84b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:00.256876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.257625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.258215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.271776 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] Creating event network-changed:ad59b064-b492-4320-b5ca-1c700cff84b4 for instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 on n-h1-859358-1 Sep 27 01:36:00.277676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-47987c6d-13d7-4160-928d-ff98c065b8d4 req-eb3f8afc-e156-406c-b247-46114dd9d0b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034368 Sep 27 01:36:00.278654 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 667/1307] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:00.406511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:00.407442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:00.414898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.416274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.416912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.418264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.418982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.420657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.573085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:00.574515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:00.582703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.583656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.584471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.586028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.586673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.587277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.588476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.597995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2f37c08-3bab-4ff9-93fa-5892645ea811 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.195358 Sep 27 01:36:00.622293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 641/1308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:00 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:00.857776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:00.858625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:00.874675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.876123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.876768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.878154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:00.878781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:00.879214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:00.959009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:00.967622 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4afcd09e-04e9-4068-9b6c-d65abdb95342 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.399842 Sep 27 01:36:00.968341 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 668/1309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:00 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:01.018565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.026339 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78e99f1f-27e6-4d5b-93f7-b4954862121c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.182046 Sep 27 01:36:01.026836 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 642/1310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:00 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:01.100697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:01.101465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:01.107980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.108463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.108893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.109610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.110067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.110486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.213232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:01.213939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:01.220597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.221080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.221589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.222369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.223139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.223574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.366688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.382517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.386182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.387625 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-935940e0-339c-481e-b823-4442cff66629 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.291419 Sep 27 01:36:01.388199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 669/1311] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:01 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:01.394208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-176138541", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "006b4f7a-2213-4a0b-b56b-05fa458d24c0"}], "security_groups": [{"name": "tempest-securitygroup--386493075"}], "key_name": "tempest-keypair-220363177", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:01.409573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.418919 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6b551dd-3f52-4732-92db-ff3eec664078 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1474 microversion: 2.1 time: 0.209385 Sep 27 01:36:01.419692 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 643/1312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:01 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1474 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:01.508933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] validate_networks() for [('006b4f7a-2213-4a0b-b56b-05fa458d24c0', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:36:01.624701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:01.626099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:01.634740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.635455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.636462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.638368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.639020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.639742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:01.836919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:01.845845 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f211ca3-a91a-4410-aedc-ea59cea807ba tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.224967 Sep 27 01:36:01.848649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 644/1313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:01 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:01.990653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:01.991272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:01.997889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:01.998616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:01.999212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.000089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.000705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.001318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.302356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:02.315142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46ce4370-f51a-4603-a3a9-c2aeb2e52320 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.328389 Sep 27 01:36:02.315727 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 645/1314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:01 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:02.321066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:02.321920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:02.330197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.330953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.331614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.332676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.333306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.333993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.338806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:02.371725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:02.378288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for user df457f1df01e4d778adb762d77bbad15 and project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:02.396067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:36:02.396526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:36:02.397006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:36:02.397451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:36:02.398041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:36:02.412219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.413244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.413758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.416498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.416498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.416498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.440910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:02.448776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Getting quotas for user df457f1df01e4d778adb762d77bbad15 and project a82ea25736b24f8baa526f4ff1ef8c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:02.464568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:36:02.467340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:36:02.540120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-851b4a1a-5049-4bde-b9c9-7128f5821d9d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.150574 Sep 27 01:36:02.547739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 670/1315] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:36:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:36:02.554199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:02.555104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:02.565250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.566202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.566809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.568510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.569132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.569568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:02.569917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.583402 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a32eef3-1ab5-4240-8267-c4edd4d63713 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.265947 Sep 27 01:36:02.596783 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 646/1316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:02 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:02.608607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:02.609599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:02.617181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.617978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.618594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:02.619462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:02.620175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:02.620796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.043910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.072206 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23787a6d-23d8-4a80-8921-f5549fbb37b7 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1474 microversion: 2.1 time: 0.473232 Sep 27 01:36:03.072397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.075799 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 647/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:02 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1474 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:03.103488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d6ffe10a-4831-4898-9445-dc44b7bef279 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:03.104537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d6ffe10a-4831-4898-9445-dc44b7bef279 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:03.106955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.109580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.111577 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db2ea25b-dbf4-4056-bd03-4efbe305a286 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1569 microversion: 2.25 time: 0.562114 Sep 27 01:36:03.113008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:03.134231 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 671/1318] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:02 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1569 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:03.145906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:03.148301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:03.163240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.163724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.164142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.164858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.165500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.166272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.187051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d6ffe10a-4831-4898-9445-dc44b7bef279 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.196496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d6ffe10a-4831-4898-9445-dc44b7bef279 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1276 microversion: 2.1 time: 0.119240 Sep 27 01:36:03.210203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 648/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:03 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:03.219289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8674bdeb-64df-430e-8087-236f01a4ad4a", "name": "network-vif-deleted", "tag": "693ae5ec-e710-4404-b8fb-3f41b65a6229"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:03.234228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.234967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.235644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.249361 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] Creating event network-vif-deleted:693ae5ec-e710-4404-b8fb-3f41b65a6229 for instance 8674bdeb-64df-430e-8087-236f01a4ad4a on n-h2-859358-1 Sep 27 01:36:03.255676 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e2e3b4bf-251b-4abf-a41c-1220d909a85f req-8bd21ce4-40ab-47e3-b383-d1c7b5de0606 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043689 Sep 27 01:36:03.256574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 649/1320] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:03.342715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:03.345779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:03.372548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.374167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.378427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.379546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.380035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.382104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.724824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:03.741501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7168047-6240-4477-b18c-ac43658ea7a0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.403627 Sep 27 01:36:03.778436 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 650/1321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:03 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:03.789253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3c75af-947a-4b65-906e-a940e974380a", "name": "network-vif-deleted", "tag": "d3e883a5-cf98-42f6-8759-aee348355ab9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:03.816657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.817167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.822935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.847471 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] Creating event network-vif-deleted:d3e883a5-cf98-42f6-8759-aee348355ab9 for instance 8a3c75af-947a-4b65-906e-a940e974380a on n-h2-859358-1 Sep 27 01:36:03.863825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6c47ffd2-b886-45dc-8d83-edd83a4b5718 req-ef9c7093-daa2-47da-b872-f0d6c2b8c8ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080555 Sep 27 01:36:03.868734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 651/1322] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:03.887716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:03.889185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:03.903134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.903624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.907346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:03.910274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:03.912698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:03.913544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.055085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.063088 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-10af3c3c-e88b-41cb-a5cf-96591b7668e8 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.926605 Sep 27 01:36:04.068637 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 672/1323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:03 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:04.078523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38bbad-8d85-4f27-a355-630ebf4250b8", "name": "network-vif-plugged", "status": "completed", "tag": "48fcefe7-b816-429a-9355-fdad5583f619"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:04.103979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.106242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.106723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.107155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.112410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a27f97fd-ace3-4212-b22c-69ad76e7da18 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.242339 Sep 27 01:36:04.113153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 652/1324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:03 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:04.118976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.119536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:04.126802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.127963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.128430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.129144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.129652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.130085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.139296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] Creating event network-vif-plugged:48fcefe7-b816-429a-9355-fdad5583f619 for instance eb38bbad-8d85-4f27-a355-630ebf4250b8 on n-h1-859358-1 Sep 27 01:36:04.144086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b74cafba-711c-4e5e-bbd0-ed060a0d37cd req-733d872e-c79c-4dc0-b8d3-729037c69e8e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073903 Sep 27 01:36:04.144674 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 673/1325] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:04.150234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.150930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:04.157804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.158452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.158887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.159607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.160066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.160497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.167009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.167696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.168127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.168572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid 8a3c75af-947a-4b65-906e-a940e974380a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:04.216993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.226559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1556fa9b-3e07-4f20-a2ce-4c17d502cdf8 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 200 len: 1309 microversion: 2.1 time: 0.112316 Sep 27 01:36:04.227915 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 653/1326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:04.238513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.239726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:04.248157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.248900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.249909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.250957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.251772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.252781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.328584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.336462 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fc8c12f-9f29-421d-9eb1-c1a01365cfe9 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1328 microversion: 2.1 time: 0.107121 Sep 27 01:36:04.337037 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 654/1327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:04.358809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.368158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.369689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:04.370783 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f253246-ecd8-4e82-b4c9-97b35ebe8b9d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1544 microversion: 2.25 time: 0.224617 Sep 27 01:36:04.371560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 674/1328] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1544 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:04.398371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac72ed83-82f6-4766-b100-2b33c2199419 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '.version_select at 0x7f24d62525e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.402064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac72ed83-82f6-4766-b100-2b33c2199419 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.402682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac72ed83-82f6-4766-b100-2b33c2199419 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.403648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac72ed83-82f6-4766-b100-2b33c2199419 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.414305 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac72ed83-82f6-4766-b100-2b33c2199419 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2364 microversion: 2.25 time: 0.019825 Sep 27 01:36:04.421393 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 655/1329] 10.222.0.52 () {60 vars in 1184 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/os-migrations => generated 2364 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:04.431168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.431840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:04.437798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.438359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.438810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.439776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.440233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.440651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.459709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:04.618219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid fe00e739-4be2-4555-9c66-8908657ba317 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:04.631796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d4e2107-b625-4aa5-8307-4eec2a70c903 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 2037 microversion: 2.25 time: 0.205010 Sep 27 01:36:04.632273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 675/1330] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 2037 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:36:04.667802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-538f7cbf-e095-4aa6-aa73-8379965b0a8e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: .version_select at 0x7f24d6a05dc0>, body: {"keypair": {"name": "tempest-keypair-1838919657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEs4eKUcGCjDdXPdMtT8od7lfMpOm1EythFyvEdgV738nMrzQ/3GDt8KZ6TUK7o3V+Ctq0mO0yVDhPhxqIOJTOlwtpv1ActgXaeQD83DwwWO/pd+0+Sfap6nhD8a4NPVA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:04.683282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-538f7cbf-e095-4aa6-aa73-8379965b0a8e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for project d07021c27c9b4371950fd1b930cdec82. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:04.689672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-538f7cbf-e095-4aa6-aa73-8379965b0a8e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for user 5591a6d007e9465a9ec1a856483feb6d and project d07021c27c9b4371950fd1b930cdec82. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:04.713258 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-538f7cbf-e095-4aa6-aa73-8379965b0a8e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.049322 Sep 27 01:36:04.713880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 656/1331] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:36:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:36:04.768577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:04.769263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:04.783190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.784020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.785036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:04.786082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:04.787845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:04.789042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.018171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:05.028899 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e8ae700-41a0-41d3-840d-c29bc7b3491b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.264727 Sep 27 01:36:05.030365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 676/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:04 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:05.089328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.090127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.097050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.097653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.098151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.099089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.099660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.100197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.142454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.143393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.155429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.156561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.157012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.158051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.158659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.159090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.310411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:05.317216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:05.321317 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0446401a-1de1-4949-aa2d-a60767e0121f tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1330 microversion: 2.1 time: 0.188895 Sep 27 01:36:05.322535 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 677/1333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:05.327104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.327734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8a3c75af-947a-4b65-906e-a940e974380a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.333802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.334288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.334851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.335531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.336102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.336539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.340491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b39a3b1c-9bb1-4eeb-a4d8-f7f7f56d1048 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.256459 Sep 27 01:36:05.341160 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 657/1334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:05.355702 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a HTTP/1.1 Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:05.357648 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. Sep 27 01:36:05.359041 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8a3c75af-947a-4b65-906e-a940e974380a'} Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:05.359807 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. Sep 27 01:36:05.361031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.362184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 8a3c75af-947a-4b65-906e-a940e974380a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:05.362184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4df9b197-5b62-40a6-b872-8d0451ecd92c tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a" status: 404 len: 111 microversion: 2.1 time: 0.035578 Sep 27 01:36:05.364505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 678/1335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/8a3c75af-947a-4b65-906e-a940e974380a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:05.369469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.370119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: 8674bdeb-64df-430e-8087-236f01a4ad4a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.374773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.375142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:05.375407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.377403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.378351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.379398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.381114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.381916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.382853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.394089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.396434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.396889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.397665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.398334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.399003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.401867 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a HTTP/1.1 Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:05.403828 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. Sep 27 01:36:05.405369 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8674bdeb-64df-430e-8087-236f01a4ad4a'} Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:05.406232 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. Sep 27 01:36:05.407692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:05.409280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance 8674bdeb-64df-430e-8087-236f01a4ad4a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:05.409280 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47c53943-bb7f-43af-86e5-01de85962b9d tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a" status: 404 len: 111 microversion: 2.1 time: 0.040421 Sep 27 01:36:05.409577 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 679/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/8674bdeb-64df-430e-8087-236f01a4ad4a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:05.415618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-07d15f87-e01a-4f97-be17-deda0a6472fb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.460201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-07d15f87-e01a-4f97-be17-deda0a6472fb tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/5e7f8592-ec73-4530-a83a-74cdd658ea7c" status: 204 len: 0 microversion: 2.1 time: 0.047307 Sep 27 01:36:05.460797 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 680/1337] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:36:05 2022] DELETE /compute/v2.1/os-server-groups/5e7f8592-ec73-4530-a83a-74cdd658ea7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:05.471301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.471953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.479385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.480055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.480544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.481372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.482104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.482631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.505269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:05.514289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b333459-b70b-40d0-b1ae-e61dd4448f6f tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1334 microversion: 2.1 time: 0.157537 Sep 27 01:36:05.528916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:05.533232 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 658/1338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1334 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:05.632856 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3355bcbb-9371-4624-bc64-709c5b842d4b tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 204 len: 0 microversion: 2.1 time: 0.165654 Sep 27 01:36:05.637535 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 681/1339] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:05 2022] DELETE /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:05.643671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:05.644309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:05.651616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.652318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.653036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.653854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:05.654385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:05.654896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:05.815497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:05.826912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b350821d-23ef-4b0a-ab5b-a92394bda706 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1473 microversion: 2.1 time: 0.187871 Sep 27 01:36:05.829378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 659/1340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:05 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1473 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:06.055916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:06.057989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:06.065550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.066132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.066628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.067410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.067983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.068468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.313208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:06.321443 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18a60fc8-0e7b-41c2-878d-f86173d830a3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.271164 Sep 27 01:36:06.322018 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 682/1341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:06 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:06.344039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:06.344653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:06.351157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.351636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.352179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.352869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.353315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.353757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.363911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:06.364617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:06.371394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.372008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.372626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.373679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.374394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.375284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.493616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:06.502444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76597064-5b17-4ece-af9e-288d5e89032c tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1534 microversion: 2.1 time: 0.162103 Sep 27 01:36:06.504126 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 660/1342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:06 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1534 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:06.532824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f1a0cc5-caeb-4b89-84d8-36d155c90be7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'create', calling method: .version_select at 0x7f24d64c74c0>, body: {"pool": "b8f11bf3-51fd-4e1e-a46c-b0820e13f97a"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:06.567184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:06.576012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-076f4bbe-5be2-443f-8ccd-6bf23414f852 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.215573 Sep 27 01:36:06.576601 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 683/1343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:06 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:06.587029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:06.587352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:06.595624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.596117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.596554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.597330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:06.597812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:06.598240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:06.667364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:06.675071 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-caf9355e-f564-4d06-9272-7a2319716e15 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1334 microversion: 2.1 time: 0.097516 Sep 27 01:36:06.675648 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 684/1344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:06 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:06.680767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1554762284", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "239c95d9-c168-4521-87d2-b79ab3af1a31"}], "security_groups": [{"name": "tempest-securitygroup--1007141859"}], "key_name": "tempest-keypair-1838919657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:06.848965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] validate_networks() for [('239c95d9-c168-4521-87d2-b79ab3af1a31', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:36:07.540909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:36:07.541726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:36:07.542832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:36:07.543631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:36:07.544426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:36:07.555082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:07.555948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:07.556629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:07.557619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:07.558305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:07.559004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:07.579745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:07.585978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for user 5591a6d007e9465a9ec1a856483feb6d and project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:07.601274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:36:07.604284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:36:07.687768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5cf0402-4556-4792-9d95-f7451b27bab8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.011021 Sep 27 01:36:07.695655 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 685/1345] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:36:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:36:07.701472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:07.702391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:07.709478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:07.710350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:07.711047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:07.712062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:07.712747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:07.713440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:07.996018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.005424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3cb15499-9360-4628-849a-d98a9cfbb502 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1473 microversion: 2.1 time: 0.308233 Sep 27 01:36:08.007157 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 686/1346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:07 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:08.012846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:08.014010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:08.021238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.022866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.023555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.025549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.026648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.027773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.301710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.309835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e4b93b8b-aafc-426b-ae22-abd0e84e3668 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.301324 Sep 27 01:36:08.310414 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 687/1347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:08 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:08.316161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da48f3bc-f212-407c-a5d5-a5c3e4f348e6", "name": "network-vif-plugged", "status": "completed", "tag": "ad59b064-b492-4320-b5ca-1c700cff84b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:08.327027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.327784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.328372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.341101 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] Creating event network-vif-plugged:ad59b064-b492-4320-b5ca-1c700cff84b4 for instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 on n-h1-859358-1 Sep 27 01:36:08.347967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cfcfc54c-5dcd-4a5a-a17e-ac69b9f28a47 req-37120f5e-a84f-4fad-99c2-641191c4fb72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Sep 27 01:36:08.350726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 688/1348] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:08.358496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:08.359396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:08.367055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.367781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.368370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.369230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.369893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.370528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.605606 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f1a0cc5-caeb-4b89-84d8-36d155c90be7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.080172 Sep 27 01:36:08.606198 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 661/1349] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:36:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:08.617731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:08.618445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:08.626000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.626751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.627471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.628704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.629471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.630698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.730749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.739929 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9941a576-105e-47a4-a33b-d1ef2807f2c5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.387585 Sep 27 01:36:08.740758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 689/1350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:08 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:08.745868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:08.746734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:08.753221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.753831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.754336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.755165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.756293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.756738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.817588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.826858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0bd07ae-b7c2-4fe3-9490-36c1df67c988 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.218997 Sep 27 01:36:08.842827 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 662/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:08 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:08.842827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cb4d2f-dfde-4d66-9438-99dba5838034", "name": "network-vif-deleted", "tag": "c1d1798b-bf55-466d-842f-abe50bd83009"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:08.852360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.854618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.855329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.856398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.860823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.862301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:08.863426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9025d12-75d4-4127-a5bf-7f7580d5ca94 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1338 microversion: 2.25 time: 0.121504 Sep 27 01:36:08.869860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] Creating event network-vif-deleted:c1d1798b-bf55-466d-842f-abe50bd83009 for instance a2cb4d2f-dfde-4d66-9438-99dba5838034 on n-h1-859358-1 Sep 27 01:36:08.875780 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6fc8aec4-322b-4668-b5db-88fd3b57baa9 req-3ac396c0-d246-42dc-80d3-052e9e86ea7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042465 Sep 27 01:36:08.876368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 663/1352] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:08.877790 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 690/1353] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:08 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:08.896943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: .version_select at 0x7f24d7fbcb80>, body: {"addFloatingIp": {"address": "172.25.2.82"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:08.900979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:08.909207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.909207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.909674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.910409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:08.910866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:08.911596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:08.993863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:36:08.994282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquired lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:36:09.020422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d29f457-5d6b-4f68-9f92-ddf67b69d22c", "tag": "2263659c-0909-467d-996a-764b5ebe3bac"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:09.033014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.037743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.038200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.060134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] Creating event network-changed:2263659c-0909-467d-996a-764b5ebe3bac for instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c on n-h1-859358-1 Sep 27 01:36:09.066784 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-81fc197c-b6ee-4614-b53b-354c1abc1ac0 req-1f21f839-d694-46b8-a749-bb014c087558 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050820 Sep 27 01:36:09.070192 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 664/1354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:36:09.077421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:09.078585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:09.087349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.088329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.089492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.090715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.091503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.092434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.137542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.138739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.139453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.140145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lazy-loading 'fault' on Instance uuid a2cb4d2f-dfde-4d66-9438-99dba5838034 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:09.181981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771bb2e636e942f5ad824bc251cc2ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40ffb6379f0428c8e370a8220fd7d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:09.190023 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92c9c7ad-2879-4bb5-9418-0c4d7eb23acf tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 200 len: 1307 microversion: 2.1 time: 0.117614 Sep 27 01:36:09.191109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 665/1355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:09 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:09.332125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:09.332800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:09.338987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.339498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.339932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.340635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.341093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.341573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.473124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:09.481551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8c29a3f-ac9f-48a7-acfc-1536e338876b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1312 microversion: 2.1 time: 0.153356 Sep 27 01:36:09.482127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 666/1356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:09 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:09.764154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:09.764910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:09.772158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.772651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.773085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:09.773855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:09.774305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:09.774817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.078313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.089118 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c222c01-8331-4662-86fc-89ca65ae741f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.328915 Sep 27 01:36:10.089864 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 667/1357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:09 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:10.094656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:10.095505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:10.101770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.102521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.103255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.104103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.104659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.105189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.127390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:10.324504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.333127 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1af0542-2777-4cd3-bbb8-6aeee0c7f80a tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.242032 Sep 27 01:36:10.334565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 668/1358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:10 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:10.339644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:10.340521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:10.347242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.347862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.348409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.349321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.349889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.350415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.429870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.440267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.441999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.443954 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf66b721-d394-45cd-bfb3-3b0681ca7395 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1344 microversion: 2.25 time: 0.108205 Sep 27 01:36:10.444675 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 669/1359] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:10 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:10.449878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:10.450818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] [instance: a2cb4d2f-dfde-4d66-9438-99dba5838034] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:10.458116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.458850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.459455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.460515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.461248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.461920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.477035 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] HTTP exception thrown: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Request method failure captured: Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 HTTP/1.1 Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKsFN0xERIJcQi-rm5RRHbtll01mdk8MiW1bmBO6ZVSjErhbLjlImvEMpMVeldTB2wgHrYMG7f8mtvNlscT9LuKBKQ2sxskQu9J3uCrX2aZSNIfWPJirApc9z3NlJS29yOL2ac8WwRGZ7ybYkOcRClRJnpIC0kvGg1pOpJZ_nmQ1ic Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:10.479326 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b40ffb6379f0428c8e370a8220fd7d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b40ffb6379f0428c8e370a8220fd7d1f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: b40ffb6379f0428c8e370a8220fd7d1f Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219828076 Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 771bb2e636e942f5ad824bc251cc2ba3 Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersOnMultiNodesTest-1219828076-project Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. Sep 27 01:36:10.480735 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a2cb4d2f-dfde-4d66-9438-99dba5838034'} Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:10.481756 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. Sep 27 01:36:10.483256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:10.484605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] Returning 404 to user: Instance a2cb4d2f-dfde-4d66-9438-99dba5838034 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:10.484605 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c7e4a68-697c-456a-86c4-edb352d0d720 tempest-ServersOnMultiNodesTest-1219828076 tempest-ServersOnMultiNodesTest-1219828076-project] 10.222.0.52 "GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034" status: 404 len: 111 microversion: 2.1 time: 0.034992 Sep 27 01:36:10.484605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 670/1360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:10 2022] GET /compute/v2.1/servers/a2cb4d2f-dfde-4d66-9438-99dba5838034 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:10.504071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:10.506458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:10.514129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.514750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.515258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.515973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.516491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.517142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.760074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.771843 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0b3198c-dfb9-45b9-b39f-df8ac7a2fed3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1462 microversion: 2.1 time: 0.271483 Sep 27 01:36:10.787681 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 671/1361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:10 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1462 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:10.810301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:10.813563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:10.820338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.821062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.821930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.822816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:10.823428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:10.824011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:10.961598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:10.969706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 01:36:10.980500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:36:10.981075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:36:10.981717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:36:10.982782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:36:10.983476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:36:11.070505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:36:11.195257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fd8480b-434d-41ac-bcc4-10ab223cd62a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6/action" status: 202 len: 0 microversion: 2.1 time: 0.388806 Sep 27 01:36:11.199004 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 672/1362] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:10 2022] POST /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:36:11.203710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb38bbad-8d85-4f27-a355-630ebf4250b8", "tag": "48fcefe7-b816-429a-9355-fdad5583f619"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:11.218139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.219135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.219571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.233644 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] Creating event network-changed:48fcefe7-b816-429a-9355-fdad5583f619 for instance eb38bbad-8d85-4f27-a355-630ebf4250b8 on n-h1-859358-1 Sep 27 01:36:11.240306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a98ce508-fa5e-486b-82c7-b5275055c042 req-399ab394-9510-47aa-b52c-18bb6eb0d7f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039967 Sep 27 01:36:11.241372 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 673/1363] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:11.249152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:11.249665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:11.259096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.259699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.260205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.261182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.261880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.262494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.475778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:11.486206 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac5fd83b-c2cc-498d-b9c7-4d6eee0beb76 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.243561 Sep 27 01:36:11.503089 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 674/1364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:11 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:11.509888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:11.510694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:11.517642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.518300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.518983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.519843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.520453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.521592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.887020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:11.899696 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb125927-9f01-402f-a946-fc1392b64ca5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1471 microversion: 2.1 time: 0.395043 Sep 27 01:36:11.914146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 675/1365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:11 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:11.923220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:11.923842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:11.932404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.932978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.933692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:11.934480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:11.934937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:11.935434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.189752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:12.204422 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ca0b211-815a-42b4-827f-e40f46c3261c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.288260 Sep 27 01:36:12.207002 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 676/1366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:11 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:12.215307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:12.216238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:12.227326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.228035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.228659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.229583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.230192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.230775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.668216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:12.680176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:12.683638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:12.686581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-661916d4-094b-404c-8693-102aea00eb7b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.476449 Sep 27 01:36:12.687284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 677/1367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:12 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:12.698124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:12.728499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.730062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.732772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.773732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] Creating event network-changed:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h2-859358-1 Sep 27 01:36:12.779931 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f52fc93c-0973-4616-89e4-07c9f01b01bb req-d6a6e50e-05d0-4e42-af83-a7cabf9bbcc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090829 Sep 27 01:36:12.781166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 678/1368] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:12.787490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:12.788550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:12.796115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.796895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.797707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.798787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.799882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.800523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.890519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Updating instance_info_cache with network_info: [{"id": "48fcefe7-b816-429a-9355-fdad5583f619", "address": "fa:16:3e:8b:23:a5", "network": {"id": "78245f35-4202-475f-b7e8-8ba979a9ec94", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1500490979-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64c2a706bbf4339ba69a2f801fbd8cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48fcefe7-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:36:12.942447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Releasing lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:36:12.943888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e80f54a2-ad55-410b-b352-3b8581c0ac2b tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 202 len: 0 microversion: 2.1 time: 4.064614 Sep 27 01:36:12.954209 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 691/1369] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:08 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 0 bytes in 4067 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:36:12.964840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:12.965759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:12.980929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.982564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.983499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:12.984807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:12.985568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:12.986232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:13.124673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:13.142945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c873602-8aa0-42c9-824b-865f07223799 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.360287 Sep 27 01:36:13.162698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 679/1370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:12 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:13.172500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-548f24e9-6693-4848-8408-52bb08a9f551 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'create', calling method: .version_select at 0x7f24d651fe50>, body: {"pool": "b8f11bf3-51fd-4e1e-a46c-b0820e13f97a"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:13.215429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:13.224154 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95e4debf-92f5-434d-94af-a0dc8d55529b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1471 microversion: 2.1 time: 0.268331 Sep 27 01:36:13.225331 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 692/1371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:12 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:13.237571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:13.238551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:13.245369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:13.245879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:13.246307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:13.247135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:13.247815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:13.248325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:13.252798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:13.441548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:13.453619 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32a0092d-fcc7-4aa1-8146-9039e0416400 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.226922 Sep 27 01:36:13.466088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 693/1372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:13 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:13.715034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:13.715937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:13.723149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:13.723900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:13.724513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:13.725213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:13.725842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:13.727063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.029899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.041073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.042571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.043685 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c97760b7-e22a-46f0-9c19-188ab0ba0ff1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.332633 Sep 27 01:36:14.044249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 694/1373] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:13 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:36:14.195613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c40dbcd0-ba01-4511-bfd8-ee6fd431717c tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:14.204273 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c40dbcd0-ba01-4511-bfd8-ee6fd431717c tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.158799 Sep 27 01:36:14.204861 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 695/1374] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:36:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:14.209955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:14.210752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:14.218157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.218836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.219783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.220650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.222608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.223299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.549966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-548f24e9-6693-4848-8408-52bb08a9f551 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.384895 Sep 27 01:36:14.550914 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 680/1375] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:36:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:14.557558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:14.558454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:14.566105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.566691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.567221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.568057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.568733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.569230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.696140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.696671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:14.704494 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0423a261-bbc3-40af-ab02-d456ea495d64 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.497872 Sep 27 01:36:14.704907 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 696/1376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:14 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:14.711985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:14.712743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:14.718926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.719590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.720288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.721181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.721661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.722248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.736179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.745800 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6933eb5b-9b3f-40a4-b620-e11a5fbd035e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1471 microversion: 2.1 time: 0.193427 Sep 27 01:36:14.747807 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 681/1377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:14 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:14.753799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: .version_select at 0x7f24d86213a0>, body: {"addFloatingIp": {"address": "172.25.2.14"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:14.757051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:14.765128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.765733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.766241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.767175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:14.767643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:14.768072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:14.838672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:36:14.839081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquired lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:36:14.875764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:14.883459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df50e424-9a20-4928-a78d-1485f98a77f0 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.177220 Sep 27 01:36:14.884023 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 697/1378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:14 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:14.888724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-368031000", "imageRef": "cadf2547-f621-4224-a5d1-fc09a7cd2572", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:15.127253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:36:15.251740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a.", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:36:15.252336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Releasing lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:36:15.252911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.252911 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Request method failure captured: Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action HTTP/1.1 Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 45 Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlNy41uAvv04eWwfJppNNA-Q_IqbzmllhsCZ48B5vuXPSaE7PfNZcJmdq35uGty8jP97AZ0Et50eB6owpNcO5LsceumoEQd5lKMxPICncrgDLGqSKuegD2lkbIHUctXjGUrieNnU3ikonu7oI4awC-7z0fvVKpY-dTrjgkkJz4LiKjQ Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:15.255198 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64c2a706bbf4339ba69a2f801fbd8cc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 777fd527300048e7a57d681764a36e6f Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: {"addFloatingIp": {"address": "172.25.2.14"}} Sep 27 01:36:15.256666 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'eb38bbad-8d85-4f27-a355-630ebf4250b8', 'body': {'addFloatingIp': {'address': '172.25.2.14'}}} Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.257477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:36:15.258600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.259616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:15.260778 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Returning 400 to user: Cannot associate floating IP 172.25.2.14 (d1da54cb-507e-44f7-a454-6675e717c0fd) with port 48fcefe7-b816-429a-9355-fdad5583f619 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network b8f11bf3-51fd-4e1e-a46c-b0820e13f97a. Sep 27 01:36:15.263683 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8f045322-d796-498c-9c3a-b13148c8f928'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:15.265181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-174ca4e3-5c56-4ef2-8127-6e59cfe7f7d7 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 400 len: 380 microversion: 2.1 time: 0.507379 Sep 27 01:36:15.265181 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 682/1379] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:14 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 380 bytes in 509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:36:15.265181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:15.265181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:15.269369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.269890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.270329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.271584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.272038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.272466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.322477 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] Request method failure captured: Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 142 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlONkYDjlY8H-BuyZbE5y1KO8poDXl1HxfhLB62v97aAS7LIYuj_Opl1JdEJGNz39X81PKClLVEhvo8yY2ySjYqxApFFrfFRv20rqURrOgiwKFrCMhs8g2UdvAkBVEKA8Y2lvDou1VEOrqxxSeVdXebV8C9QcLQNDAOhZKNXZd9omnc Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 99e400b5599a4ca7adf802082364a471 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FlavorsV2NegativeTest-1747751122 Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:15.324308 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99e400b5599a4ca7adf802082364a471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99e400b5599a4ca7adf802082364a471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99e400b5599a4ca7adf802082364a471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99e400b5599a4ca7adf802082364a471", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FlavorsV2NegativeTest-1747751122 Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 99e400b5599a4ca7adf802082364a471 Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1747751122 Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FlavorsV2NegativeTest-1747751122-project Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 804baca5254345ea9a22b750c39d4743 Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FlavorsV2NegativeTest-1747751122-project Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-368031000", "imageRef": "cadf2547-f621-4224-a5d1-fc09a7cd2572", "flavorRef": "452"}} Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:15.326032 n-d-859358-1 devstack@n-api.service[128778]: exception: Flavor's memory is too small for requested image. Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-368031000', 'imageRef': 'cadf2547-f621-4224-a5d1-fc09a7cd2572', 'flavorRef': '452'}}} Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.326936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:15.328566 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-685b750c-792b-4c20-b9db-3ecc2430a185 tempest-FlavorsV2NegativeTest-1747751122 tempest-FlavorsV2NegativeTest-1747751122-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.440590 Sep 27 01:36:15.329903 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 698/1380] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:36:14 2022] POST /compute/v2.1/servers => generated 93 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:36:15.331953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2bccf78-adc4-4186-815b-c8ec9b3c6fbb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '.version_select at 0x7f24d616e8b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:15.429615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:15.440682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:15.442313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:15.444253 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26df926d-c40d-46ca-b8c6-68c6510a0672 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.185851 Sep 27 01:36:15.444850 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 683/1381] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:15 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:15.694087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d29f457-5d6b-4f68-9f92-ddf67b69d22c", "name": "network-vif-plugged", "status": "completed", "tag": "2263659c-0909-467d-996a-764b5ebe3bac"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:15.704431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.704910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.705398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.719871 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] Creating event network-vif-plugged:2263659c-0909-467d-996a-764b5ebe3bac for instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c on n-h1-859358-1 Sep 27 01:36:15.725300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-02ebcc82-8034-4bfe-84c9-401cafc3528b req-ebbecf1d-da5f-4021-88e5-11a1fe5cd766 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035425 Sep 27 01:36:15.726201 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 684/1382] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:36:15.731864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:15.732685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:15.739922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.740743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.741442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.742579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.743255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.744518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.906924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:15.915987 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2d0c14e-b672-4f69-875b-b956704f591c tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.188469 Sep 27 01:36:15.917148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 685/1383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:15 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:15.921962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:15.922759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:15.929435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.930228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.930831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:15.931706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:15.932327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:15.932918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.226010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2bccf78-adc4-4186-815b-c8ec9b3c6fbb tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/d1da54cb-507e-44f7-a454-6675e717c0fd" status: 202 len: 0 microversion: 2.1 time: 0.898240 Sep 27 01:36:16.226588 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 699/1384] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:36:15 2022] DELETE /compute/v2.1/os-floating-ips/d1da54cb-507e-44f7-a454-6675e717c0fd => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:36:16.232093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:16.232716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:16.240251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.240746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.241193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.241933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.242396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.242826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.379397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:16.386103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:16.387293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f691f6a-16cd-48de-b1d6-e6b88ccb8e07 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1401 microversion: 2.1 time: 0.159387 Sep 27 01:36:16.387867 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 700/1385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:16 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1401 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:16.397690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e31bbad-2d91-4974-88bf-027070635eed tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.476916 Sep 27 01:36:16.397690 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 686/1386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:15 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:16.401690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: .version_select at 0x7f24d86210d0>, body: {"removeFloatingIp": {"address": "172.25.2.82"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:16.470957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:16.471582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:16.478045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.478535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.479019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.479782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.480241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.480668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.600838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:16.607483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.608251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.608691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.609638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.610105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.610536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.618945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:16.641367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:16.643025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:16.644630 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b110a230-ee01-49f2-8be4-e281e7745bb2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.177817 Sep 27 01:36:16.645225 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 701/1387] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:16 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:16.897591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:36:16.898066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquired lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:36:16.941708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:16.943143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:16.957022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.957476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.958928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:16.961076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:16.961567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:16.961993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.110781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:17.120411 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9afdb189-790f-4f21-b7ea-3d3b93b9e8a3 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1471 microversion: 2.1 time: 0.184468 Sep 27 01:36:17.121191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 702/1388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:16 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:17.413314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:17.414582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:17.421762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.422355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.422863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.423640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.424171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.424672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.570333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:17.585435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:17.595301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a532b82-f3c6-40bb-acc2-5c65383224c6 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1588 microversion: 2.1 time: 0.186638 Sep 27 01:36:17.596301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 703/1389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:17 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1588 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:17.601303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:17.602428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:17.604853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=28 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:17.605203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Building network info cache for instance {{(pid=128779) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:36:17.610881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.611695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:17.612500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.613040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.613800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.614875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.615368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.775111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:17.784833 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d90ed31f-1cfb-4a66-9d1f-51b777c8fe8b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.187506 Sep 27 01:36:17.797962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 704/1390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:17 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:17.806766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb38bbad-8d85-4f27-a355-630ebf4250b8", "tag": "48fcefe7-b816-429a-9355-fdad5583f619"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:17.819235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.819724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.820158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.835943 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] Creating event network-changed:48fcefe7-b816-429a-9355-fdad5583f619 for instance eb38bbad-8d85-4f27-a355-630ebf4250b8 on n-h1-859358-1 Sep 27 01:36:17.842308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c6d7250f-7dcc-47e5-9373-2f31b99083ae req-93519417-5deb-4c15-a30f-255908d87d0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043059 Sep 27 01:36:17.842901 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 705/1391] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:17.848340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:17.849481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:17.855913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.856608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.857212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.858278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.858884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:17.859465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:17.976989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29657faa-8345-4d32-8da8-7b081c4b37b2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132577 Sep 27 01:36:17.978043 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 706/1392] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:36:17 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:17.983584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:17.984318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:17.996362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:17.999750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.000299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:18.004467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:18.006088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.006760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:18.471716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:18.485612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:18.491113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:18.496193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86bb0c5b-444b-4a1c-9dc9-4d0537dcaac1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.513613 Sep 27 01:36:18.497395 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 707/1393] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:17 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:18.507463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:18.508158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:18.523061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:18.533657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.535218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:18.537119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:18.537849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.538573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:18.655699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Updating instance_info_cache with network_info: [{"id": "48fcefe7-b816-429a-9355-fdad5583f619", "address": "fa:16:3e:8b:23:a5", "network": {"id": "78245f35-4202-475f-b7e8-8ba979a9ec94", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1500490979-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c64c2a706bbf4339ba69a2f801fbd8cc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48fcefe7-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:36:18.706954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Releasing lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:36:18.708946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd229640-9550-4b86-9ef1-9766a4008ae3 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 202 len: 0 microversion: 2.1 time: 2.311571 Sep 27 01:36:18.710662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 687/1394] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:16 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 0 bytes in 2314 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:36:18.723788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5f97182-4884-4181-a088-82749c2340bc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '.version_select at 0x7f24d6bbb5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:18.940574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:18.952656 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2cc4755-8936-44a1-9fd2-707a7bf1eb81 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.453970 Sep 27 01:36:18.953846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 708/1395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:18 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:18.962725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:18.963528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:18.976359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:18.977144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.977796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:18.978735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:18.979338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:18.980297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:19.323440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:19.343532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae699471-ef60-42a4-8701-3762813ac956 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.386218 Sep 27 01:36:19.344457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 709/1396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:18 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:19.522095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:19.522784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:19.529123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:19.529649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:19.530081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:19.530990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:19.531437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:19.531861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:19.718626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:19.730647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:19.732578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:19.733757 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-acdd7872-15c4-4eeb-8ba2-e571de41ef54 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.216328 Sep 27 01:36:19.734310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 710/1397] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:19 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:36:19.862815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:19.863553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:19.870514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:19.871148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:19.871719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:19.872969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:19.873616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:19.874800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.386378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:20.395944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e870e89c-96da-433e-950d-1e64ecdbce4c tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1588 microversion: 2.1 time: 0.539168 Sep 27 01:36:20.397522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 711/1398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:19 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1588 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:20.402519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d29f457-5d6b-4f68-9f92-ddf67b69d22c", "tag": "2263659c-0909-467d-996a-764b5ebe3bac"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:20.413647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.414406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.414980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.433456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] Creating event network-changed:2263659c-0909-467d-996a-764b5ebe3bac for instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c on n-h1-859358-1 Sep 27 01:36:20.438681 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-767e53f2-f158-4c01-b5fb-0011e8023e90 req-790344f3-2a7b-406a-b302-113709d58ab6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039711 Sep 27 01:36:20.439529 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 712/1399] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:20.449702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:20.450645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:20.470754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5f97182-4884-4181-a088-82749c2340bc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/b322569c-c63a-4e8f-8909-893f2cd426dd" status: 202 len: 0 microversion: 2.1 time: 1.756141 Sep 27 01:36:20.471448 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 688/1400] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:36:18 2022] DELETE /compute/v2.1/os-floating-ips/b322569c-c63a-4e8f-8909-893f2cd426dd => generated 0 bytes in 1758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:36:20.472055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.472899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.473478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.474351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.474990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.475580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.483059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:20.483935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:20.499817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.500604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.501279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.504586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.505793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.506389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.793906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:20.803571 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0011fb8-4eb1-47df-8365-5c5a126ef916 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.357944 Sep 27 01:36:20.823343 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 713/1401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:20 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:20.842830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41f3a3ac-028f-4c5c-b7ec-ec7a6ffad6bd tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41f3a3ac-028f-4c5c-b7ec-ec7a6ffad6bd tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Request method failure captured: Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action HTTP/1.1 Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 34 Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlNy41uAvv04eWwfJppNNA-Q_IqbzmllhsCZ48B5vuXPSaE7PfNZcJmdq35uGty8jP97AZ0Et50eB6owpNcO5LsceumoEQd5lKMxPICncrgDLGqSKuegD2lkbIHUctXjGUrieNnU3ikonu7oI4awC-7z0fvVKpY-dTrjgkkJz4LiKjQ Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:20.851224 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64c2a706bbf4339ba69a2f801fbd8cc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 777fd527300048e7a57d681764a36e6f Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: {"addFloatingIp": {"address": ""}} Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:36:20.853125 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'eb38bbad-8d85-4f27-a355-630ebf4250b8', 'body': {'addFloatingIp': {'address': ''}}} Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:20.854183 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:36:20.855918 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:36:20.857368 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 27 01:36:20.857368 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:20.866560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41f3a3ac-028f-4c5c-b7ec-ec7a6ffad6bd tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:20.867913 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41f3a3ac-028f-4c5c-b7ec-ec7a6ffad6bd tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 400 len: 142 microversion: 2.1 time: 0.043282 Sep 27 01:36:20.868764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 714/1402] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:20 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 142 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:36:20.879998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:20.880597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:20.891129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.900289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.901008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.901969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.902600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.903082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.920453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:20.927720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:20.942526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-800dee3a-44e9-4d91-a1d1-af2bd0955adc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.463511 Sep 27 01:36:20.943572 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 689/1403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:20 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:20.948662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:20.952716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:20.962710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.963501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.964118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:20.965142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:20.965801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:20.966399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.024299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:36:21.025096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquired lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:36:21.191222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Releasing lock "refresh_cache-eb38bbad-8d85-4f27-a355-630ebf4250b8" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:36:21.191785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] HTTP exception thrown: floating IP not found Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Request method failure captured: Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action HTTP/1.1 Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 41 Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlNy41uAvv04eWwfJppNNA-Q_IqbzmllhsCZ48B5vuXPSaE7PfNZcJmdq35uGty8jP97AZ0Et50eB6owpNcO5LsceumoEQd5lKMxPICncrgDLGqSKuegD2lkbIHUctXjGUrieNnU3ikonu7oI4awC-7z0fvVKpY-dTrjgkkJz4LiKjQ Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:21.193808 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64c2a706bbf4339ba69a2f801fbd8cc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 777fd527300048e7a57d681764a36e6f Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: exception: floating IP not found Sep 27 01:36:21.195154 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'eb38bbad-8d85-4f27-a355-630ebf4250b8', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:21.196039 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 27 01:36:21.197228 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.199637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Returning 404 to user: floating IP not found {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:21.199637 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d5c1115-9f17-447f-b57d-61ce4f7d093d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 404 len: 67 microversion: 2.1 time: 0.250500 Sep 27 01:36:21.199637 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 690/1404] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:20 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 67 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:36:21.206670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-152751d2-6e78-40ea-9461-6ebade6f0134 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:21.242971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:21.254753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:21.256748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:21.269554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d9fee4c-ad37-4379-93e5-e709e691d058 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.399453 Sep 27 01:36:21.271021 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 715/1405] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:20 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:21.310341 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-152751d2-6e78-40ea-9461-6ebade6f0134 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-152751d2-6e78-40ea-9461-6ebade6f0134 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Request method failure captured: Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action HTTP/1.1 Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 44 Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlNy41uAvv04eWwfJppNNA-Q_IqbzmllhsCZ48B5vuXPSaE7PfNZcJmdq35uGty8jP97AZ0Et50eB6owpNcO5LsceumoEQd5lKMxPICncrgDLGqSKuegD2lkbIHUctXjGUrieNnU3ikonu7oI4awC-7z0fvVKpY-dTrjgkkJz4LiKjQ Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:21.312277 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64c2a706bbf4339ba69a2f801fbd8cc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 777fd527300048e7a57d681764a36e6f Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:36:21.313840 n-d-859358-1 devstack@n-api.service[128779]: exception: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'eb38bbad-8d85-4f27-a355-630ebf4250b8', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:21.314664 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 27 01:36:21.315944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:21.319364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-152751d2-6e78-40ea-9461-6ebade6f0134 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:21.320448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-152751d2-6e78-40ea-9461-6ebade6f0134 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action" status: 404 len: 88 microversion: 2.1 time: 0.117613 Sep 27 01:36:21.321071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 691/1406] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:21 2022] POST /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8/action => generated 88 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:36:21.333725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:21.337847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:21.360806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.361888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.362619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.363767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.364489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.365143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.396441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:21.509712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:21.539578 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-671affba-a251-429d-89b5-ad9db787a0dc tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 204 len: 0 microversion: 2.1 time: 0.212251 Sep 27 01:36:21.543889 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 716/1407] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:21 2022] DELETE /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:21.550897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:21.552576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:21.560779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.561579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.562040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.562768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.563432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.564299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.654475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "name": "network-vif-plugged", "status": "completed", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:21.668032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.668770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.669441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.682582 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] Creating event network-vif-plugged:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h2-859358-1 Sep 27 01:36:21.688017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-94506d97-12bc-403e-85b8-9d93f16e36fd req-8673b257-c207-4788-8ad5-255863a19ebe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037492 Sep 27 01:36:21.689189 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 717/1408] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:36:21.766238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:21.777181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-787d75da-6594-4ba3-a472-15eec1b4cb1d tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1540 microversion: 2.1 time: 0.232226 Sep 27 01:36:21.778117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 692/1409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:21 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:21.833374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:21.834441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:21.843019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.843597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.844092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.845353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.845791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.846283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.970299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:21.971312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:21.977876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:21.979682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.980571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.981254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:21.982662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:21.983452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:21.984128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:22.035600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:22.044914 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06ed95ac-c733-42ac-b4a5-8cbe3de1c572 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.217777 Sep 27 01:36:22.045800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 718/1410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:21 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:22.230970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:22.239829 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb90574e-7df8-4198-bbff-5527c0bf0b3d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.272881 Sep 27 01:36:22.240403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 693/1411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:21 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:22.296359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:22.297239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:22.304610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:22.305356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:22.305990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:22.306853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:22.307457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:22.308168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:22.445290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:22.456443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:22.461692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:22.464274 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6808dbb2-3d93-4471-ab62-2351a3a3b0ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.172050 Sep 27 01:36:22.465406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 719/1412] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:22 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:22.803281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:22.804667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:22.812655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:22.813307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:22.814029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:22.814812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:22.815358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:22.815857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.043217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.051863 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0be95398-7241-46f9-acfc-933653e670b9 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1540 microversion: 2.1 time: 0.252520 Sep 27 01:36:23.063476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 694/1413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:22 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:23.070561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:23.071190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:23.077823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.078519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.079442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.079709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.080471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.080752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.262538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:23.263161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:23.269162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.270104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.270405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.271553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.272036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.272718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.433159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.436295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.447675 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad26d634-b32b-4527-84f7-6e84cc830940 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.188903 Sep 27 01:36:23.454364 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb2024ca-d862-4b19-b27a-11d95b74d47f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.389405 Sep 27 01:36:23.468656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 720/1415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:23 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:23.469020 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 695/1415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:23 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:23.496864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:23.498048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:23.516993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.517296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.517970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.519063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.519843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.520516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.694964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.705548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.707921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:23.709592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d239da1-4c9c-4110-ac84-0c5d067a56f9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.218399 Sep 27 01:36:23.710938 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 696/1416] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:23 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:23.717374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-unplugged", "status": "completed", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:23.728402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:23.729196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:23.729864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:23.743424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] Creating event network-vif-unplugged:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:36:23.749288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-74257942-6f47-4195-b76d-3aee99487282 req-80dfd9f0-80f1-4e7b-ac0b-c9b99d8525d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035830 Sep 27 01:36:23.750677 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 721/1417] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:24.040876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38bbad-8d85-4f27-a355-630ebf4250b8", "name": "network-vif-deleted", "tag": "48fcefe7-b816-429a-9355-fdad5583f619"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:24.060143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.064459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.066013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.075913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.076792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.090967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.096736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.097483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.100019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.104879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] Creating event network-vif-deleted:48fcefe7-b816-429a-9355-fdad5583f619 for instance eb38bbad-8d85-4f27-a355-630ebf4250b8 on n-h1-859358-1 Sep 27 01:36:24.105826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.107211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.137239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c31dc68d-4075-403d-a6dd-7dd7763b6450 req-327ff71c-9ce5-4267-a428-92c922b9b880 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102480 Sep 27 01:36:24.138147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 697/1418] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:24.253933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '777fd527300048e7a57d681764a36e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64c2a706bbf4339ba69a2f801fbd8cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:24.266814 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-309be5cb-f9ee-468f-bd68-562252e3de53 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 200 len: 1315 microversion: 2.1 time: 0.195277 Sep 27 01:36:24.282630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 722/1419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:24 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:24.422527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.423213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.436215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.437429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.437879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.438639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.439290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.439747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.491159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.491791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.502758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.503257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.503690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.504412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.505419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.505854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.511145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:24.633260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f87b274-e0d2-464a-87fa-53c61471cd1e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 204 len: 0 microversion: 2.1 time: 0.223461 Sep 27 01:36:24.638094 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 698/1420] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:24 2022] DELETE /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:24.644666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.646978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.654337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.654963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.656777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.658134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.659442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.660125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.819974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:24.832115 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-553bb740-d0fc-4a4b-9241-973bcc53af94 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.355941 Sep 27 01:36:24.841895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 723/1421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:24 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:24.852912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.854298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.858227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:24.862249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.862839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.863339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.864644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.865167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.865681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.866521 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4327ff48-7aab-4ebd-883f-5ed877671fb2 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.226861 Sep 27 01:36:24.867471 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 699/1422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:24 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:24.885989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:24.886622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:24.898202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.898687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.899133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:24.899839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:24.900289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:24.900726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.056602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:25.068991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:25.071382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:25.073049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-027e4e73-0dde-4eb3-9ba7-a6d328d0f040 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.204358 Sep 27 01:36:25.074223 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 700/1423] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:24 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:25.147147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:25.155666 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-635030ab-d767-4ee7-bc28-b206158943d7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1712 microversion: 2.1 time: 0.312167 Sep 27 01:36:25.156251 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 724/1424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:24 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1712 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:25.295534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:25.303222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] [instance: eb38bbad-8d85-4f27-a355-630ebf4250b8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:25.327033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.327535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.327996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.328708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.329166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.329633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.352293 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] HTTP exception thrown: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Request method failure captured: Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 HTTP/1.1 Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlNy41uAvv04eWwfJppNNA-Q_IqbzmllhsCZ48B5vuXPSaE7PfNZcJmdq35uGty8jP97AZ0Et50eB6owpNcO5LsceumoEQd5lKMxPICncrgDLGqSKuegD2lkbIHUctXjGUrieNnU3ikonu7oI4awC-7z0fvVKpY-dTrjgkkJz4LiKjQ Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:25.354002 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64c2a706bbf4339ba69a2f801fbd8cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64c2a706bbf4339ba69a2f801fbd8cc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c64c2a706bbf4339ba69a2f801fbd8cc Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074 Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 777fd527300048e7a57d681764a36e6f Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. Sep 27 01:36:25.355513 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'eb38bbad-8d85-4f27-a355-630ebf4250b8'} Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:25.356280 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. Sep 27 01:36:25.358394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.362188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] Returning 404 to user: Instance eb38bbad-8d85-4f27-a355-630ebf4250b8 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:25.363241 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49b75c2b-3e92-4d5c-8e37-2fef08dcf5c8 tempest-FloatingIPsAssociationNegativeTestJSON-500965074 tempest-FloatingIPsAssociationNegativeTestJSON-500965074-project] 10.222.0.52 "GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8" status: 404 len: 111 microversion: 2.1 time: 0.071998 Sep 27 01:36:25.363874 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 701/1425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:25 2022] GET /compute/v2.1/servers/eb38bbad-8d85-4f27-a355-630ebf4250b8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:25.677110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d59a7a16-73e3-49e2-b344-af1fa0407d60 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Calling method '.version_select at 0x7f24d61fa1f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:25.725921 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d59a7a16-73e3-49e2-b344-af1fa0407d60 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.168236 Sep 27 01:36:25.726502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 725/1426] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:36:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:36:25.739628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a04cc6d-c19a-48b1-955b-a2bc235d28a7 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Action: 'create', calling method: .version_select at 0x7f24d6ce28b0>, body: {"pool": "non_exist_pool"} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:25.857263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:25.858994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:25.864753 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2a04cc6d-c19a-48b1-955b-a2bc235d28a7 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] HTTP exception thrown: Floating IP pool not found. Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a04cc6d-c19a-48b1-955b-a2bc235d28a7 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Request method failure captured: Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 26 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOZyoPUtcvnzfHf2Do4AeDapGn5Fp2pazBXd0Q-6S0CAGVWhPlc63ybTAvXZM4ZZJO9S7fgDciIMnPOWHDXkCUtcGU7j5rs9Qzz_WXSZd08tDRcJaDjVS940rCAme9pB77u7POnPoLIU0OOxYGI_SnyXBc0L_GuMOnc1fdGHyfJZPk Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2a71d0d4676d4dceb5bf62d5d7d0f736 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:25.866304 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a71d0d4676d4dceb5bf62d5d7d0f736", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2a71d0d4676d4dceb5bf62d5d7d0f736 Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsNegativeTestJSON-976762845-project Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4a917bc44b6c4cb6ba5b81b45fc9e58f Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-976762845-project Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: {"pool": "non_exist_pool"} Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: exception: Floating IP pool not found. Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 27 01:36:25.867869 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:25.869042 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a04cc6d-c19a-48b1-955b-a2bc235d28a7 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Returning 404 to user: Floating IP pool not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:25.870662 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a04cc6d-c19a-48b1-955b-a2bc235d28a7 tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.134820 Sep 27 01:36:25.876525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 702/1427] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:36:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:36:25.876620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.876620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.876620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.876620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.881652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.881940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Calling method '.version_select at 0x7f24d6d8b670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:25.882110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.960843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0f012812-25ca-45fd-b233-f528c435bd6a could not be found", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:36:25.961589 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] HTTP exception thrown: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Request method failure captured: Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-floating-ips/0f012812-25ca-45fd-b233-f528c435bd6a HTTP/1.1 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOZyoPUtcvnzfHf2Do4AeDapGn5Fp2pazBXd0Q-6S0CAGVWhPlc63ybTAvXZM4ZZJO9S7fgDciIMnPOWHDXkCUtcGU7j5rs9Qzz_WXSZd08tDRcJaDjVS940rCAme9pB77u7POnPoLIU0OOxYGI_SnyXBc0L_GuMOnc1fdGHyfJZPk Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2a71d0d4676d4dceb5bf62d5d7d0f736 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:25.963702 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a71d0d4676d4dceb5bf62d5d7d0f736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a71d0d4676d4dceb5bf62d5d7d0f736", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2a71d0d4676d4dceb5bf62d5d7d0f736 Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-976762845 Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsNegativeTestJSON-976762845-project Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4a917bc44b6c4cb6ba5b81b45fc9e58f Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-976762845-project Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: exception: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0f012812-25ca-45fd-b233-f528c435bd6a'} Sep 27 01:36:25.965406 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:36:25.966755 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0f012812-25ca-45fd-b233-f528c435bd6a could not be found Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f911427b-c993-4ce8-8db4-3ac73a6f8d51'] Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a. Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.967962 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:25.969367 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:25.970729 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a Sep 27 01:36:25.970729 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:25.970729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] Returning 404 to user: Floating IP not found for ID 0f012812-25ca-45fd-b233-f528c435bd6a {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:25.970729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f395d961-7097-41b6-afb7-5ca21b06e3ca tempest-FloatingIPsNegativeTestJSON-976762845 tempest-FloatingIPsNegativeTestJSON-976762845-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/0f012812-25ca-45fd-b233-f528c435bd6a" status: 404 len: 111 microversion: 2.1 time: 0.088528 Sep 27 01:36:25.970729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 703/1428] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:36:25 2022] DELETE /compute/v2.1/os-floating-ips/0f012812-25ca-45fd-b233-f528c435bd6a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:25.975140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:25.976013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:25.990466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.991016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.991407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:25.992411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:25.992875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:25.993307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.052151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.066361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ca1a0e4-a261-4f2f-9964-cb305bbbc2bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.212763 Sep 27 01:36:26.070413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 726/1429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:25 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:26.098444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:26.099052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:26.105759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:26.106460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:26.106898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.107594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:26.108209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:26.108809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.270666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.279230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.280668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.284735 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbd3fbd9-33a6-430d-adfc-7eee79c8df14 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1412 microversion: 2.25 time: 0.190417 Sep 27 01:36:26.285686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 727/1430] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:26 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1412 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:36:26.290503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:26.291179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:26.297575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:26.298091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:26.298603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.299304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:26.300486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:26.301200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.350507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.359900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d40c622-871b-4114-8105-81abb5401254 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.391705 Sep 27 01:36:26.361254 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 704/1431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:25 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:26.448510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:26.461793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7362a629-2f23-4ccc-a195-37a22f5c8ec7 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1712 microversion: 2.1 time: 0.174469 Sep 27 01:36:26.462794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 728/1432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:26 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1712 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:26.839438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-plugged", "status": "completed", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:26.860021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:26.861585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:26.863478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:26.881390 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] Creating event network-vif-plugged:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:36:26.888021 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f8724566-c9f7-4bfd-8624-e73cb1cdcb80 req-1cfdfc62-b739-4e35-aadd-92f6852e65a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062061 Sep 27 01:36:26.889223 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 705/1433] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:36:27.093682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:27.094548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:27.101385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.102122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.102715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.103577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.104184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.104754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.290440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.299174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e524d5ac-e900-436e-baee-d438bdb4b654 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.209409 Sep 27 01:36:27.300298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 729/1434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:27 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:27.315997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:27.316702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:27.324360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.325145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.325773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.326611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.327195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.327770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.386760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:27.387320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:27.393562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.394298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.394996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.396405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.396856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.397496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.551194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.561089 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56393954-5b4f-4915-954b-d322b61a0246 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.178052 Sep 27 01:36:27.563250 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 730/1435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:27 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:27.571276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:27.572110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:27.580081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.580776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.581460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.583508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.584135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.584859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.709845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.721782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.724360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.726000 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54c47c8f-7694-432d-81b2-bf146bb57bb6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1608 microversion: 2.25 time: 0.415068 Sep 27 01:36:27.727365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 706/1436] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:36:27 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1608 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:27.746766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:27.750920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:27.751747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:27.756955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74f7174e-1aea-4349-bcf4-a63e30fb2263 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1712 microversion: 2.1 time: 0.192461 Sep 27 01:36:27.758969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.759634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.760219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.761090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:27.761724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:27.762435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:27.768355 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 731/1437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:27 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1712 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:28.017959 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cf73727-83d0-4708-9278-8975221d3ed6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.270933 Sep 27 01:36:28.019276 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 707/1438] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:36:27 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:36:28.324531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:28.325363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:28.340297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.341600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.342253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:28.343345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.344135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.350484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:28.601178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:28.603442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:28.617883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.619961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.620419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:28.621798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.622271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.622709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:28.666849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:28.671425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:28.679703 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-489b6311-d7d7-434e-a4da-27c2bbfb3cec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.359553 Sep 27 01:36:28.681661 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 732/1439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:28 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:28.783091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:28.783623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:28.790658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.791375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.792133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:28.793061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:28.793749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:28.794416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:29.163788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:29.166480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:29.179838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89a52f64-a942-42c2-b5cc-c389e2f1c2ca tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1477 microversion: 2.1 time: 0.586941 Sep 27 01:36:29.185489 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 708/1440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:28 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:29.447605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:29.479687 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-101ed00b-acca-40b9-aae0-e0f668e96bbe tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1712 microversion: 2.1 time: 0.701552 Sep 27 01:36:29.480277 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 733/1441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:28 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1712 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:29.703840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:29.708336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:29.708954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:29.718505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:29.718998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:29.719641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:29.720139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:29.720531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:29.721043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:29.721201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:29.721694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:29.722138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:29.736407 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] Creating event network-changed:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h2-859358-1 Sep 27 01:36:29.743142 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0eecb690-1042-4ffd-b34b-65fc7eb6161c req-98fe9f06-ff33-4692-aaee-b86458df789a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037784 Sep 27 01:36:29.743952 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 734/1442] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:30.034978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e1c64ff-e97c-4523-865b-7788bf200424", "name": "network-vif-deleted", "tag": "0d0834fa-4ab7-4e82-b401-50506eedac01"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:30.080968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.081479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.081915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.097806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] Creating event network-vif-deleted:0d0834fa-4ab7-4e82-b401-50506eedac01 for instance 7e1c64ff-e97c-4523-865b-7788bf200424 on n-h2-859358-1 Sep 27 01:36:30.115006 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-74cbb5f8-8dec-42d3-b55e-25aae60bc53f req-10663966-a7c2-4e84-adbe-4aeaf9708e6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089966 Sep 27 01:36:30.122485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 735/1443] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:30.182011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:30.192043 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b9f288d-a57d-48fb-aa73-0e3888220f19 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.492033 Sep 27 01:36:30.203798 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 709/1444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:29 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:30.211503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:30.212524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:30.220772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.223047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.224456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.230364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.231063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.231673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.505409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:30.506040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:30.526102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.528125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.528732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.532727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.535970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.536619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.569029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:30.580059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4215f96e-2f2d-48fa-b222-f46a029fb0b1 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1462 microversion: 2.1 time: 0.372079 Sep 27 01:36:30.594201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 736/1445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:30 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1462 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:30.623726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:30.628906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:30.630523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.631011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.631446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.631898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lazy-loading 'fault' on Instance uuid 7e1c64ff-e97c-4523-865b-7788bf200424 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:30.659181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.660182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.661086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.662809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.663664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.664384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.758978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2089ee58706a4b1da251c4256b9673c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5f6fe6f6b14b978d83872c917e4dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:30.769497 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c748254a-ed46-4248-b9c3-dbf37302026e tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 200 len: 1354 microversion: 2.1 time: 0.269338 Sep 27 01:36:30.772433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 710/1446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:30 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 1354 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:30.826798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2b322fd-ddd6-4ee0-ac0d-648b6ce0a054 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 0 microversion: 2.1 time: 0.209368 Sep 27 01:36:30.828691 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 737/1447] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:30 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:36:30.838488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:30.840349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:30.847621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.848235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.848584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.849305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.857643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.858379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.920609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:30.921097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:30.921776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:30.922426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lazy-loading 'fault' on Instance uuid 938f5884-2b74-4b26-beae-a4bd7951634e {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:31.218481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:31.219472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:31.253366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.254025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.256460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.257348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.257929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.258557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.505371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:31.533265 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2af847d-8c22-4bd1-93e8-6cb3c039b75a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.319034 Sep 27 01:36:31.553590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 738/1448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:31 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:31.801847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:31.802661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:31.811368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.812970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.814799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.815780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.816453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.817744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.826673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4578ba21-d997-4799-b41e-0f85b39fa209 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1596 microversion: 2.1 time: 0.993215 Sep 27 01:36:31.835545 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 HTTP/1.1 Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:31.837672 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:31.839104 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7e1c64ff-e97c-4523-865b-7788bf200424'} Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:31.839894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:31.841083 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.842211 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 711/1449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:30 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1596 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:31.843620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:31.845736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47bc5b61-a59f-4366-9ab9-c13029d28294 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 404 len: 111 microversion: 2.1 time: 0.047979 Sep 27 01:36:31.846847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 739/1450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:31 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:36:31.849176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:31.851977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:31.855231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:31.855640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:31.862074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.862578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.863020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.863787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.864259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.864676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.864980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.865513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.865956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.866674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.867136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.867569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.885803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff HTTP/1.1 Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:31.888501 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.890148 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '11a6eb49-ab9d-4843-8172-8da71781c9ff'} Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:31.891204 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.892661 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.896648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:31.897760 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f489b3e0-702b-4907-8d11-8e4ab21efb9f tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 404 len: 111 microversion: 2.1 time: 0.046794 Sep 27 01:36:31.898488 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 740/1451] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:31 2022] DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:36:31.928617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:31.929244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:31.944868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.945403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.946143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.947217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:31.948517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:31.948977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:31.989770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff HTTP/1.1 Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:31.991606 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.993328 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '11a6eb49-ab9d-4843-8172-8da71781c9ff'} Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:31.994398 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:31.996020 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:31.997503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:31.997680 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c55a845-5f62-494e-a7f0-2a7e71db02a8 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 404 len: 111 microversion: 2.1 time: 0.094030 Sep 27 01:36:32.005886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 741/1452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:31 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:32.016348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7cb406a-6855-436d-a723-765afb202cec tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '.version_select at 0x7f24d64fadc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.017418 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5618c78c-51a0-4567-b1d0-6036a58d8d37 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action" status: 202 len: 0 microversion: 2.1 time: 0.171981 Sep 27 01:36:32.020965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 712/1453] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:31 2022] POST /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:36:32.031338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.032564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:32.038910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.039673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.040369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.041295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.042029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.042562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.053767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7cb406a-6855-436d-a723-765afb202cec tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096786391" status: 202 len: 0 microversion: 2.1 time: 0.044698 Sep 27 01:36:32.058844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 742/1454] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096786391 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:36:32.375714 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce05c83e-ed9f-4c12-9625-a798540d4375 tempest-ServersAdminTestJSON-549735505 tempest-ServersAdminTestJSON-549735505-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1613 microversion: 2.1 time: 0.350532 Sep 27 01:36:32.376303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 713/1455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:32 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1613 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:32.404078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.405636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:32.415864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.416358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.416793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.417724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.418169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.418590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.447782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:32.564466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.565139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:32.574639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a66dce74-d63e-43e5-b08e-975a74dc9aaf tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "DELETE /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 204 len: 0 microversion: 2.1 time: 0.177662 Sep 27 01:36:32.575088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.575610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.576063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.576509 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 743/1456] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:32 2022] DELETE /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:32.576815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.577327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.581760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.589165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.590231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:32.600100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.601221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.601895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.603181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:32.603867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:32.604788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:32.814744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:32.823370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b509a063-c8e1-493a-b932-e3f93331f3ce tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1469 microversion: 2.1 time: 0.242657 Sep 27 01:36:32.824491 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 744/1457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:32 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:32.954456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-073b3b91-9739-48dc-bb72-94c2e0229bc1 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:32.971995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-073b3b91-9739-48dc-bb72-94c2e0229bc1 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2126956575" status: 202 len: 0 microversion: 2.1 time: 0.021228 Sep 27 01:36:32.972550 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 745/1458] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:36:32 2022] DELETE /compute/v2.1/flavors/2126956575 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:36:32.998797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e1f228f-16ea-4f8b-9e75-4c5a5014b6c4 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.021485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e1f228f-16ea-4f8b-9e75-4c5a5014b6c4 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.026681 Sep 27 01:36:33.022240 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 746/1459] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:36:32 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:33.045483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74e746a6-0767-45f0-bf85-a0ce6a0437d4 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.052162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:33.065897 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcae4c67-dc42-4481-9da2-09340796959e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.505408 Sep 27 01:36:33.069756 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 714/1460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:32 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:33.071564 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74e746a6-0767-45f0-bf85-a0ce6a0437d4 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1941996725" status: 202 len: 0 microversion: 2.1 time: 0.031472 Sep 27 01:36:33.077571 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 747/1461] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:36:33 2022] DELETE /compute/v2.1/flavors/1941996725 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:36:33.085469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5dcf012-0f8f-44e9-8f70-69b5ec651dc9 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.107919 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5dcf012-0f8f-44e9-8f70-69b5ec651dc9 tempest-ServersWithSpecificFlavorTestJSON-1164741005 tempest-ServersWithSpecificFlavorTestJSON-1164741005-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028157 Sep 27 01:36:33.109878 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 715/1462] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:36:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:33.141063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.141684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:33.148265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.148754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.149187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.150559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.150699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.151080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.165916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 HTTP/1.1 Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:33.167727 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.169165 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7e1c64ff-e97c-4523-865b-7788bf200424'} Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:33.170206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.171645 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.173100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:33.173100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b76715a-4c67-4169-874d-c5f34bec2efa tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 404 len: 111 microversion: 2.1 time: 0.032043 Sep 27 01:36:33.173257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 748/1463] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:33 2022] DELETE /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:33.180570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.181584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 7e1c64ff-e97c-4523-865b-7788bf200424] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:33.188630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.189213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.189706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.190418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.190923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.191377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.205934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 HTTP/1.1 Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:33.208138 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.209615 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7e1c64ff-e97c-4523-865b-7788bf200424'} Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:33.210448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. Sep 27 01:36:33.212504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.213850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 7e1c64ff-e97c-4523-865b-7788bf200424 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:33.213850 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6802c30-7d91-4b64-b03f-c104a857d850 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424" status: 404 len: 111 microversion: 2.1 time: 0.035165 Sep 27 01:36:33.213850 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 716/1464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:33 2022] GET /compute/v2.1/servers/7e1c64ff-e97c-4523-865b-7788bf200424 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:33.219855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.220358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:33.227051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.227534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.228089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.228796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.229248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.229694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.246967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff HTTP/1.1 Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:33.249687 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.251284 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '11a6eb49-ab9d-4843-8172-8da71781c9ff'} Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:33.252597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.254638 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.256260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:33.256801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4eb86fd-57c2-4df8-834d-794f2ae36dc9 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 404 len: 111 microversion: 2.1 time: 0.041296 Sep 27 01:36:33.257843 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 749/1465] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:33 2022] DELETE /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:33.267104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.267729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] [instance: 11a6eb49-ab9d-4843-8172-8da71781c9ff] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:33.274422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.274913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.275364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.276115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.276570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.277047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.296300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] HTTP exception thrown: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Request method failure captured: Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff HTTP/1.1 Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlKH4vSVJQYK1BfwbvwrOM53-6duzSfFJZ2r6TxIRElzTvHlnYPSOQ7XDWBtRpIf7qO6pvhw5G_494s-jCeJ8GNNnyWEJcvP9a66CEFjy7wSigD3LzP4hCRz5N31OkBx8a0DojWuDP36KOIllAys0aA2MC80nnF2W3F50xpBF45G18w Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:33.310217 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb5f6fe6f6b14b978d83872c917e4dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb5f6fe6f6b14b978d83872c917e4dcc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: eb5f6fe6f6b14b978d83872c917e4dcc Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224 Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2089ee58706a4b1da251c4256b9673c8 Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1660140224-project Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.311607 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '11a6eb49-ab9d-4843-8172-8da71781c9ff'} Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:33.312337 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. Sep 27 01:36:33.313642 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:33.314747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] Returning 404 to user: Instance 11a6eb49-ab9d-4843-8172-8da71781c9ff could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:33.315568 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bc7dbe6-8673-4734-8707-554827d4ee67 tempest-ServersWithSpecificFlavorTestJSON-1660140224 tempest-ServersWithSpecificFlavorTestJSON-1660140224-project] 10.222.0.52 "GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff" status: 404 len: 111 microversion: 2.1 time: 0.053507 Sep 27 01:36:33.320046 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 717/1466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:33 2022] GET /compute/v2.1/servers/11a6eb49-ab9d-4843-8172-8da71781c9ff => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:33.851409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:33.852916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:33.859662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.860408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.861012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:33.861912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:33.862540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:33.868354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:34.103249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:34.104722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:34.123394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:34.124158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:34.124831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:34.125841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:34.126790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:34.127504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:34.205264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:34.227948 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b1d9f15-f63d-492d-998e-8f77af143f55 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1469 microversion: 2.1 time: 0.380299 Sep 27 01:36:34.228528 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 750/1467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:33 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:34.312138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:34.320170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc05162f-4928-4290-b703-5bb4d44b2bd4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.230004 Sep 27 01:36:34.329714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 718/1468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:34 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:35.252588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:35.253878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:35.262405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:35.262894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:35.263326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:35.265408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:35.266309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:35.266678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:35.344299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:35.345057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:35.353395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:35.354123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:35.355119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:35.356893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:35.357535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:35.358228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:35.510314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:35.521139 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7857fd37-4c10-453f-ba12-35eb658f2131 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.180831 Sep 27 01:36:35.533603 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 719/1469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:35 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:35.846479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:35.859963 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95affdd5-b839-4aa9-a1c2-d8134234943f tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1469 microversion: 2.1 time: 0.611538 Sep 27 01:36:35.860829 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 751/1470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:35 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1469 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:36.076979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf55516-0542-4bd6-a7c7-724352d08290", "name": "network-vif-deleted", "tag": "b142c4e8-b593-4811-ace7-28a420e570e7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:36.090532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.091288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.092342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.120001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] Creating event network-vif-deleted:b142c4e8-b593-4811-ace7-28a420e570e7 for instance edf55516-0542-4bd6-a7c7-724352d08290 on n-h2-859358-1 Sep 27 01:36:36.127481 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8750a6e4-a230-467e-b400-a4194f7e2557 req-bf1db487-9af4-4ced-9e35-e83cff44114a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056340 Sep 27 01:36:36.128492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 720/1471] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:36.545635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:36.546167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:36.554784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.555278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.560521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.561380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.561870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.562307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.865864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:36.875043 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12f0073b-dd04-4631-a13c-1284ed87aea9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.333434 Sep 27 01:36:36.893369 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 752/1472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:36 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:36.902160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:36.903137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:36.911467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.912107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.912873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.913929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.914411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.915571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.951513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:36.952025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:36.952746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:36.953666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lazy-loading 'fault' on Instance uuid edf55516-0542-4bd6-a7c7-724352d08290 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:37.038386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:37.054969 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cece6cac-f88c-4413-b00c-ad4c6cdfe619 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 200 len: 1303 microversion: 2.1 time: 0.157911 Sep 27 01:36:37.056758 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 721/1473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:36 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:37.701000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1336623324", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:37.766291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:36:37.906520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:37.908004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:37.925079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:37.926911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:37.927567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:37.928478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:37.929741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:37.930393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.222068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:38.231545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0cecd89c-5524-4551-85e7-59cd3c182b5a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.330944 Sep 27 01:36:38.253845 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 722/1474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:37 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:38.260404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:38.266518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: edf55516-0542-4bd6-a7c7-724352d08290] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:38.279016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.279816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.280296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.281124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.281612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.282031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.321916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] HTTP exception thrown: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Request method failure captured: Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 HTTP/1.1 Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMFbRZZ9ZVU2yqkCyMLzgfTyVzj1rpmYiSCgHSG23xbwxM6VfadCZmzi9GBxNLAKvzzMdweydGWejjpgkW3Br5c3BaBtQaVj3pvpG8qXhYh_GnOtA07BiYsJ-0O3QMLSB65r2P6PH_p3xeA-FfSWbPkooW_sxdLx7Jda3BCBf5PV1I Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:36:38.331122 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5671347af8a2476cb85feb2e14b6a30c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 3f9556a6309d40c3950ea3696323ade4 Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. Sep 27 01:36:38.333020 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'edf55516-0542-4bd6-a7c7-724352d08290'} Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:38.333864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. Sep 27 01:36:38.335107 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:36:38.340340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Returning 404 to user: Instance edf55516-0542-4bd6-a7c7-724352d08290 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:38.343569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-239d6833-c430-4b18-bed6-3b33e3c5ab86 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290" status: 404 len: 111 microversion: 2.1 time: 0.088345 Sep 27 01:36:38.344701 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 723/1475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:38 2022] GET /compute/v2.1/servers/edf55516-0542-4bd6-a7c7-724352d08290 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:38.353216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:38.357536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:38.378838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.379424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.382678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.383625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.384355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.385022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.424309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:38.458873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:36:38.459889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:36:38.459889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:36:38.460144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:36:38.460546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:36:38.499955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.502466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.504018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.508475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.510005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.512434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.543101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:38.571513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Getting quotas for project 759424e147c64aa6a741c7b540198227. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:38.584601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:38.587434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Getting quotas for user 93fd46cbb43d4f82876c64f17b03f310 and project 759424e147c64aa6a741c7b540198227. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:38.618561 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d32d0d86-0c6a-4d77-b4ff-88f6ca8e002a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 204 len: 0 microversion: 2.1 time: 0.268827 Sep 27 01:36:38.619090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 724/1476] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:38 2022] DELETE /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:38.628588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:38.630060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:38.646572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.647308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.649535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.650436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:38.652702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:36:38.653474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:38.654072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:38.662974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:36:38.794405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2682fc96-8bc1-4570-9eda-e02fc3391620 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281597 Sep 27 01:36:38.795379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 753/1477] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:36:38.807189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08f2b6f2-0571-428a-84b7-9900ddc53ee5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:38.807812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08f2b6f2-0571-428a-84b7-9900ddc53ee5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:38.940587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08f2b6f2-0571-428a-84b7-9900ddc53ee5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:38.951292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08f2b6f2-0571-428a-84b7-9900ddc53ee5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1217 microversion: 2.1 time: 0.148595 Sep 27 01:36:38.957430 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 754/1478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:38 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:39.002662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:39.011030 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4ad89a8-b84e-4cd1-8eeb-884c367f11ef tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1469 microversion: 2.1 time: 0.387208 Sep 27 01:36:39.012463 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 725/1479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:38 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:39.266290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:39.266908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:39.274895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:39.275163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:39.275602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:39.276307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:39.276766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:39.277193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:39.626361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:39.642169 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-40ced085-372b-43e2-b393-b4b2939002aa tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.378178 Sep 27 01:36:39.653401 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 755/1480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:39 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:39.977299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:39.977962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:39.985448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:39.985943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:39.986377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:39.987084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:39.987536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:39.988026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:40.036019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:40.036626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:40.051445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:40.051962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:40.052398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:40.053176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:40.053762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:40.054365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:40.077654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:40.091621 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a47e6dfb-6514-4cb8-9f32-bcf30958d697 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1269 microversion: 2.1 time: 0.120324 Sep 27 01:36:40.096132 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 726/1481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:39 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:40.101599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:40.258084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:40.268378 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-762c3d07-d707-4f42-a342-92b7c3333810 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1469 microversion: 2.1 time: 0.235911 Sep 27 01:36:40.270199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 756/1482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:40 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:40.668219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:40.669134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:40.680374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:40.683425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:40.684114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:40.687176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:40.688201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:40.689298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:41.116422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:41.124217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:41.130841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:41.142673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4facd430-7b29-4dc9-a7d4-cb62c7bcfa60 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.480278 Sep 27 01:36:41.144022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:41.146440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:41.147479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:41.147898 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 727/1483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:40 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:41.148939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:41.150123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:41.150766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:41.294294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:41.294907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:41.303639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:41.305565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:41.306233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:41.306833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:41.311852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f2830e5-8b93-40ad-943b-ae3c277cd2f9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1275 microversion: 2.1 time: 0.200859 Sep 27 01:36:41.325380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:41.325380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:41.325380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:41.326431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 757/1484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:41 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:41.628197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:41.642119 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ded958d3-612c-4a6c-84d1-24404e719af5 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1469 microversion: 2.1 time: 0.350917 Sep 27 01:36:41.665721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 728/1485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:41 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:42.117323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a", "name": "network-vif-deleted", "tag": "1d7d0d3c-2b96-412e-abd5-81b20e85977e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:42.139008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.139651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.139915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.161733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] Creating event network-vif-deleted:1d7d0d3c-2b96-412e-abd5-81b20e85977e for instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a on n-h2-859358-1 Sep 27 01:36:42.169970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:42.170587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:42.182488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.182979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.183120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-93129231-ef56-4b29-ad24-add7a8eba3cb req-5bd87e9f-3dde-4551-a7cf-1d087d124cc6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070171 Sep 27 01:36:42.184060 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 758/1486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:42.185926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.186676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.187146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.193520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.340149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:42.341132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:42.352934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.354375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.355491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.356835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.357524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.358140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.861036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:42.873173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f120d43-375b-46ba-afda-fbb769bee89c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.538939 Sep 27 01:36:42.875495 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 759/1487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:42 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:42.895041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:42.895963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:42.904893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.906704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.907759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.909914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.910925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.913961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.966244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:42.976937 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ce8b624-833c-430d-82c1-d2c3c98a689d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.810687 Sep 27 01:36:42.978340 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 729/1488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:42 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:42.994868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:42.995704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:42.996361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:42.996988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lazy-loading 'fault' on Instance uuid 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:43.084533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:43.099267 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-402c3707-6305-493e-8dc9-9e4640146d92 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 200 len: 1304 microversion: 2.1 time: 0.221499 Sep 27 01:36:43.100594 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 760/1489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:42 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 1304 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:43.906099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:43.907539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:43.928182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:43.931438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:43.932329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:43.935277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:43.940326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:43.940965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.007373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:44.008000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:44.016836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.017424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.017934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.018711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.019795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.020299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.296205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:44.308798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1476e05-1ca4-4859-bc29-c8cdf8476fc9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.306662 Sep 27 01:36:44.311802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 761/1490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:44 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:44.328994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:44.329794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:44.349285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.349990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.350598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.351488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.355235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.355892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.394870 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] HTTP exception thrown: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Request method failure captured: Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a HTTP/1.1 Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlMFbRZZ9ZVU2yqkCyMLzgfTyVzj1rpmYiSCgHSG23xbwxM6VfadCZmzi9GBxNLAKvzzMdweydGWejjpgkW3Br5c3BaBtQaVj3pvpG8qXhYh_GnOtA07BiYsJ-0O3QMLSB65r2P6PH_p3xeA-FfSWbPkooW_sxdLx7Jda3BCBf5PV1I Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:44.396827 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5671347af8a2476cb85feb2e14b6a30c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 3f9556a6309d40c3950ea3696323ade4 Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. Sep 27 01:36:44.398485 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a'} Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:44.399402 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. Sep 27 01:36:44.400869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:44.403389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Returning 404 to user: Instance 88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:44.404447 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed2a70ce-18e9-4475-8b5a-3bf3c27d913d tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a" status: 404 len: 111 microversion: 2.1 time: 0.091111 Sep 27 01:36:44.405537 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 762/1491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:44 2022] GET /compute/v2.1/servers/88abd3f0-54c3-4ca4-aa7c-a62cf76c1f5a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:44.413553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:44.432173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.432862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.434782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.465924 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] Creating event network-changed:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:36:44.473940 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2ac55f41-faed-4e8b-b883-00ff156c44c7 req-90389df1-ac2e-4f76-b4e4-e987fd2d582d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066693 Sep 27 01:36:44.475030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 763/1492] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:44.486530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:44.490364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:44.511544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.512275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.513560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.519439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.520355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.521097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.560922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:44.573899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:44.600697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a102fe95-fc01-451e-8f88-a4fd257c776e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.701356 Sep 27 01:36:44.605951 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 730/1493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:43 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:44.716906 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aae098bd-8d1f-4919-915b-4b4f39126d7a tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "DELETE /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 204 len: 0 microversion: 2.1 time: 0.237051 Sep 27 01:36:44.717371 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 764/1494] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:44 2022] DELETE /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:44.727860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:44.728968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:44.749994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.753839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.754584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:44.756241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:44.759391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:44.760056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:45.076332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:45.085584 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60025f91-d863-45d2-9136-b76746b9db32 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1468 microversion: 2.1 time: 0.362280 Sep 27 01:36:45.101361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 731/1495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:44 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:45.337373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:45.338113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:45.344662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:45.345155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:45.345621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:45.346330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:45.346813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:45.347272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:45.515697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:45.524401 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33aa1830-3a31-4589-9f0b-aec4a801033b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.191292 Sep 27 01:36:45.527665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 765/1496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:45 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:45.591231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-456434808", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "000fc94f-7507-45b3-9ea2-31850bf995b1"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:45.632329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:45.633210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:45.644887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:45.645787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:45.646556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:45.647637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:45.648330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:45.649002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:45.666796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] validate_networks() for [('000fc94f-7507-45b3-9ea2-31850bf995b1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:36:45.888251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:45.897433 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8c401a21-6d88-4a56-9f91-e6cce94affbf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.270379 Sep 27 01:36:45.898467 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 766/1497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:45 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:46.110220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:46.111212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:46.118553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.119278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.119891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.120775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.121409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.124401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.385915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:36:46.386966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:36:46.387568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:36:46.388074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:36:46.388790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:36:46.399348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.399911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.400569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.401552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.402210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.402728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.420802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:46.424945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:46.428032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for user e50d446d60b54188900a6f653787667d and project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:46.432926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:46.439375 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-734af1a6-f343-4982-8efc-4e2587cd7273 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1468 microversion: 2.1 time: 0.334273 Sep 27 01:36:46.441473 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 767/1498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:46 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:46.446795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:36:46.449368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:36:46.501289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0946fead-0ba9-4578-a121-bd9bf1fa4838 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014875 Sep 27 01:36:46.505493 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 732/1499] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:36:46.518879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc05a12a-145d-4190-85cd-ea98f81c0c0b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:46.520406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dc05a12a-145d-4190-85cd-ea98f81c0c0b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:46.550475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:46.551086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:46.561306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.562021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.562658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.573547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.574335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.574959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.647194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dc05a12a-145d-4190-85cd-ea98f81c0c0b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:46.662812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc05a12a-145d-4190-85cd-ea98f81c0c0b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1224 microversion: 2.1 time: 0.148078 Sep 27 01:36:46.663391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 768/1500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:46 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:46.928797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:46.930159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:46.947113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.950175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.951274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:46.953903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:46.955011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:46.955683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:47.152964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:47.161972 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c33b2a7-11b4-4e62-9188-ba70b17a5117 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1476 microversion: 2.1 time: 0.615388 Sep 27 01:36:47.177377 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 733/1501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:46 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:47.434545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:47.455982 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ef5a74c-5247-475f-82f4-c74844d3987d tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.537185 Sep 27 01:36:47.465942 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 769/1502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:46 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:47.470229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:47.471042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:47.480286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:47.481934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:47.482475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:47.486684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:47.487285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:47.488354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:47.688361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:47.688980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:47.703161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:47.703660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:47.704097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:47.704811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:47.705261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:47.705717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:47.841440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:47.856529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afbcaea6-fb02-4183-a516-60c1a0f1340e tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1468 microversion: 2.1 time: 0.392143 Sep 27 01:36:47.857554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 734/1503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:47 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:47.918798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:47.923462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f5884-2b74-4b26-beae-a4bd7951634e", "name": "network-vif-deleted", "tag": "380c3e30-7483-47b4-b418-cf38eb16f13a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:47.930977 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6bd6c3e8-3d90-44a5-b1c1-3b170b82f191 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1220 microversion: 2.1 time: 0.246655 Sep 27 01:36:47.946394 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 770/1504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:47 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1220 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:47.979260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:47.979856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:47.980318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.036288 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] Creating event network-vif-deleted:380c3e30-7483-47b4-b418-cf38eb16f13a for instance 938f5884-2b74-4b26-beae-a4bd7951634e on n-h2-859358-1 Sep 27 01:36:48.054934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-90e5e3fe-8114-4aef-9aa8-ee052d482aa1 req-9523d1f1-5cf5-4219-8890-b0178ada805c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132464 Sep 27 01:36:48.055877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 735/1505] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:48.194455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:48.194927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:48.220747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.221945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.222937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.223842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.224346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.226202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.493382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:48.494506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:48.507502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.508160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.508799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.509730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.510678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.511067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.544363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:48.549324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:48.565166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f723e891-9bee-425d-8ebd-1f4c7bca32bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1475 microversion: 2.1 time: 0.375772 Sep 27 01:36:48.567518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 771/1506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:48 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:48.736027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:48.757225 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13bba196-257d-4e0e-a67e-bcbad2557f45 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.268583 Sep 27 01:36:48.761083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 736/1507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:48 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:48.889221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:48.891269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:48.906038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.906812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.907934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.908915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.909600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.910306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.960533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:48.961151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:48.961502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.962288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.962942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.963608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lazy-loading 'fault' on Instance uuid 938f5884-2b74-4b26-beae-a4bd7951634e {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:36:48.975273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.975769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.976207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:48.976917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:48.977400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:48.977827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:49.123900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:49.133769 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3a53c2f-7937-4018-8312-1f9fc6815b16 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1294 microversion: 2.1 time: 0.178264 Sep 27 01:36:49.147203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 737/1508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:48 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:49.177436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9556a6309d40c3950ea3696323ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5671347af8a2476cb85feb2e14b6a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:49.185765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e1d941d-57ad-4eda-91f5-5f96ffe71511 tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 200 len: 1303 microversion: 2.1 time: 0.303311 Sep 27 01:36:49.186346 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 772/1509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:48 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:49.592535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:49.594101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:49.603767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:49.604643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:49.605325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:49.608122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:49.609009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:49.609751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:49.796474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:49.797113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:49.816636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:49.817131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:49.817643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:49.818354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:49.818804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:49.819235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:49.852182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:49.872636 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98388efc-37e7-4311-929d-01ecb7ac397d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1473 microversion: 2.1 time: 0.279708 Sep 27 01:36:49.873565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 738/1510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:49 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:50.143871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-plugged", "status": "completed", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:50.158991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.160158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.161092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.178587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] Creating event network-vif-plugged:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:36:50.184368 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0598e40b-0bb5-460a-938e-d89301d0a3c6 req-23b79142-761e-4d2c-9f2f-52bbf520bb90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048004 Sep 27 01:36:50.185595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 739/1511] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:50.193956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:50.195211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:50.203306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.204241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.205117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.206172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.206881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.207481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.343075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:50.347738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:50.355499 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35723cee-33ee-4e3e-bd6c-0bb7d2848945 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.573917 Sep 27 01:36:50.360981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 773/1512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:49 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:50.371049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:50.371684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] [instance: 938f5884-2b74-4b26-beae-a4bd7951634e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:50.406380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.406885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.407590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.408318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.408784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.409218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.449947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:50.466795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-edfb3259-ba6b-4cbd-a05d-a7017ba1568b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.279720 Sep 27 01:36:50.481570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 740/1513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:50 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:50.489716 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] HTTP exception thrown: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Request method failure captured: Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e HTTP/1.1 Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlMFbRZZ9ZVU2yqkCyMLzgfTyVzj1rpmYiSCgHSG23xbwxM6VfadCZmzi9GBxNLAKvzzMdweydGWejjpgkW3Br5c3BaBtQaVj3pvpG8qXhYh_GnOtA07BiYsJ-0O3QMLSB65r2P6PH_p3xeA-FfSWbPkooW_sxdLx7Jda3BCBf5PV1I Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:36:50.493361 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5671347af8a2476cb85feb2e14b6a30c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5671347af8a2476cb85feb2e14b6a30c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 5671347af8a2476cb85feb2e14b6a30c Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminTestJSON-2109174948 Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 3f9556a6309d40c3950ea3696323ade4 Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminTestJSON-2109174948-project Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. Sep 27 01:36:50.494914 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '938f5884-2b74-4b26-beae-a4bd7951634e'} Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:36:50.495765 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. Sep 27 01:36:50.499376 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:36:50.505920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] Returning 404 to user: Instance 938f5884-2b74-4b26-beae-a4bd7951634e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:36:50.507273 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-094d1435-6375-48de-b77a-cc009d84a04b tempest-ServersAdminTestJSON-2109174948 tempest-ServersAdminTestJSON-2109174948-project] 10.222.0.52 "GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e" status: 404 len: 111 microversion: 2.1 time: 0.145191 Sep 27 01:36:50.509739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 774/1514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:50 2022] GET /compute/v2.1/servers/938f5884-2b74-4b26-beae-a4bd7951634e => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:36:50.898688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:50.899312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:50.906281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.907557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.908184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:50.909083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:50.910105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:50.910708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:51.112523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:51.122157 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3300a8b0-bb56-42ec-ba1f-a8c344f82a4f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1473 microversion: 2.1 time: 0.227359 Sep 27 01:36:51.122984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 741/1515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:50 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:51.385657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:51.387006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:51.399559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:51.400064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:51.400496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:51.401215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:51.401691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:51.402117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:51.492578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:51.493372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:51.502935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:51.504328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:51.505312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:51.507183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:51.507938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:51.509367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:51.669151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:51.678828 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56bc78c4-9756-48ee-a8cc-3841f080d473 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1317 microversion: 2.1 time: 0.297281 Sep 27 01:36:51.686385 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 775/1516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:51 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:51.716917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:51.731901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-323095d8-ec44-446b-88d9-3475136da9f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.242889 Sep 27 01:36:51.732851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 742/1517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:51 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:51.863839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea686962-1bd1-49fa-bf7d-da81a8da7783 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-143737505", "id": 1301426320, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:51.885818 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea686962-1bd1-49fa-bf7d-da81a8da7783 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.175274 Sep 27 01:36:51.886698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 776/1518] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:36:51 2022] POST /compute/v2.1/flavors => generated 448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:36:52.100011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90cbf0a6-7d70-4486-b642-fd600b4e1c1c tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.110183 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90cbf0a6-7d70-4486-b642-fd600b4e1c1c tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] 10.222.0.52 "GET /compute/v2.1/flavors/1301426320" status: 200 len: 448 microversion: 2.55 time: 0.212027 Sep 27 01:36:52.111142 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 743/1519] 10.222.0.52 () {60 vars in 1199 bytes} [Tue Sep 27 01:36:51 2022] GET /compute/v2.1/flavors/1301426320 => generated 448 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:36:52.128562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14447e9c-bee5-4278-a27a-40cc5f17415b tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] Action: 'update', calling method: .version_select at 0x7f24d81cfb80>, body: {"flavor": {"description": "new"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:52.148140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.148906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:52.183591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.184105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.185617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.186359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.187008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.187633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.215898 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-14447e9c-bee5-4278-a27a-40cc5f17415b tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1301426320" status: 200 len: 449 microversion: 2.55 time: 0.092001 Sep 27 01:36:52.221380 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 777/1520] 10.222.0.52 () {62 vars in 1219 bytes} [Tue Sep 27 01:36:52 2022] PUT /compute/v2.1/flavors/1301426320 => generated 449 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:36:52.221774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da48f3bc-f212-407c-a5d5-a5c3e4f348e6", "name": "network-vif-unplugged", "status": "completed", "tag": "ad59b064-b492-4320-b5ca-1c700cff84b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:52.232362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.232937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.233502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.239963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:52.248782 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Creating event network-vif-unplugged:ad59b064-b492-4320-b5ca-1c700cff84b4 for instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 on n-h1-859358-1 Sep 27 01:36:52.255648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:36:52.263097 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-136a97f2-72ca-4331-ac27-316ed97b5179 req-bba027f9-e11b-4451-abe2-9d91a92cdb60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044367 Sep 27 01:36:52.264863 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 778/1521] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:52.272465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d98ee411-0a10-411e-be88-dac07915c937 tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.302873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d98ee411-0a10-411e-be88-dac07915c937 tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.035667 Sep 27 01:36:52.303650 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 779/1522] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:52.326189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60a2a9ad-f7fb-4051-a32e-953a55852a7b tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.352892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60a2a9ad-f7fb-4051-a32e-953a55852a7b tempest-FlavorsV255TestJSON-967187201 tempest-FlavorsV255TestJSON-967187201-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.030475 Sep 27 01:36:52.358039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 780/1523] 10.222.0.52 () {60 vars in 1166 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:52.372751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c5be88b-078d-4279-a047-0396d21eafc7 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.397189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c5be88b-078d-4279-a047-0396d21eafc7 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1301426320" status: 202 len: 0 microversion: 2.55 time: 0.027981 Sep 27 01:36:52.403057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 781/1524] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Sep 27 01:36:52 2022] DELETE /compute/v2.1/flavors/1301426320 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:36:52.406337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:52.415337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4950ab0d-d02d-4228-a9d2-683c0b555feb", "tag": "d8d0ed60-5db1-44c0-9b40-75a2a90d5719"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:52.416236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52afe739-eeb9-46a5-87fb-2e67eaf3f56c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1470 microversion: 2.1 time: 0.273359 Sep 27 01:36:52.417116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 744/1525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:52.422258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d0f7a33-0e0e-4459-a407-25fafa13eb53 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.446473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d0f7a33-0e0e-4459-a407-25fafa13eb53 tempest-FlavorsV255TestJSON-210166976 tempest-FlavorsV255TestJSON-210166976-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.027916 Sep 27 01:36:52.447365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 745/1526] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:36:52.452776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.452953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:52.453263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.453456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:52.453721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.469248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.469784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.470219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.470927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.471385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.471810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.494793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] Creating event network-changed:d8d0ed60-5db1-44c0-9b40-75a2a90d5719 for instance 4950ab0d-d02d-4228-a9d2-683c0b555feb on n-h1-859358-1 Sep 27 01:36:52.504372 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e102633d-0467-4c9b-9479-3decdc735430 req-70936b53-9f8c-4227-bcb0-7fe48d4c789e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099762 Sep 27 01:36:52.505620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 782/1527] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:52.572014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5dea2fc-7439-43bc-bc1c-a875495ab67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6/action" status: 204 len: 0 microversion: 2.1 time: 0.123298 Sep 27 01:36:52.572789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 746/1528] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:52 2022] POST /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6/action => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:52.582162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.583110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:52.592762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.594286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.594932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.596013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.598113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.599169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.709699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.710421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:52.733157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.733690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.738103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.738956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.739685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.740219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.954956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:52.968560 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-951b58f1-b75a-4601-b6d8-314fcc7981ca tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1467 microversion: 2.1 time: 0.264075 Sep 27 01:36:52.969459 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 747/1529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1467 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:52.976399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:52.977004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:52.983280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.984039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.984810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:52.985736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:52.986380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:52.987017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:53.149073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:53.159140 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-477e52ae-b247-4a0e-9e72-7119e0a631e4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.186236 Sep 27 01:36:53.176384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 748/1530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:53.183230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1348817251", "metadata": {"image_type": "test"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:53.187785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:53.195895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:53.196743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:53.197538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:53.198471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:53.199129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:53.199771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:53.234455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:53.239088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Getting quotas for project 759424e147c64aa6a741c7b540198227. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:53.246150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Getting quotas for user 93fd46cbb43d4f82876c64f17b03f310 and project 759424e147c64aa6a741c7b540198227. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:53.246361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3206253b-6647-4a4b-91f4-5ca0842c68a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1470 microversion: 2.1 time: 0.668497 Sep 27 01:36:53.247005 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 783/1531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:52 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1470 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:53.497197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ce6d673-75bb-4aab-9e18-f9c41d431fba tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "POST /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5/action" status: 202 len: 0 microversion: 2.1 time: 0.318583 Sep 27 01:36:53.501389 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 749/1532] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:36:53 2022] POST /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:36:53.509941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-267b3de0-149f-4ed4-a393-03b61b4f5b0c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d653bf70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:53.559310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-267b3de0-149f-4ed4-a393-03b61b4f5b0c tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.053594 Sep 27 01:36:53.560366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 784/1533] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:53 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:54.182944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:54.184466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:54.202989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:54.203602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:54.204267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:54.205451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:54.206776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:54.207800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:54.274442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:54.274442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:54.280373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:54.281184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:54.281750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:54.282876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:54.283467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:54.284129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:54.388500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:54.398777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac6dbef0-75b2-4643-81a7-3a1b9a5cf5ca tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.220432 Sep 27 01:36:54.399576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 750/1534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:54 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:54.575813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0718a8e-18b4-4999-82ad-3ec19d0bab29 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6800040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:54.784616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:54.794733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b7ced9e-677c-45c1-90ca-09dbc7d7f394 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1470 microversion: 2.1 time: 0.528285 Sep 27 01:36:54.795393 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 785/1535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:54 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1470 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:54.882520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0718a8e-18b4-4999-82ad-3ec19d0bab29 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.310541 Sep 27 01:36:54.890850 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 751/1536] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:54 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:36:55.421226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:55.422180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:55.430858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:55.431521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:55.432505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:55.434232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:55.435765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:55.436378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:55.795125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:55.807802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05ae3b92-1a26-4036-bb21-12330c440a43 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.389732 Sep 27 01:36:55.807988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 786/1537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:55 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:55.822368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:55.823747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:55.850511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:55.851991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:55.853886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:55.854903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:55.858545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:55.859217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:55.900698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03ad7e8b-6754-4675-a776-7c646f149d32 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6519d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:55.976999 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03ad7e8b-6754-4675-a776-7c646f149d32 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.081203 Sep 27 01:36:55.979608 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 787/1538] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:55 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:56.155402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da48f3bc-f212-407c-a5d5-a5c3e4f348e6", "name": "network-vif-plugged", "status": "completed", "tag": "ad59b064-b492-4320-b5ca-1c700cff84b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:56.173195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:56.176605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:56.177076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:56.177621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:56.206624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:56.214487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] Creating event network-vif-plugged:ad59b064-b492-4320-b5ca-1c700cff84b4 for instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 on n-h1-859358-1 Sep 27 01:36:56.217441 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4de66e8a-72b1-4975-84c0-05f36da0a4d5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1470 microversion: 2.1 time: 0.402933 Sep 27 01:36:56.218032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 752/1539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:55 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:56.246386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6f01ee3f-634c-4dcc-88b5-fa9eb3b0b13e req-603412e7-3c94-473f-ac9d-a0a4f7007f9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094724 Sep 27 01:36:56.247283 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 788/1540] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:36:56.833718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:56.834683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:56.837141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:56.838521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:56.851839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:56.852395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:56.853215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:56.854063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:56.854615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:56.855117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:56.973243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:36:57.040189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:57.048777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ae7533f-e39f-420a-a2d5-2ce2e7a4e820 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.221410 Sep 27 01:36:57.050513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 753/1541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:56 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:57.055472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e4d622d-a514-4473-87cd-fe5b67809bd9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d66e1d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.105624 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e4d622d-a514-4473-87cd-fe5b67809bd9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.053571 Sep 27 01:36:57.110245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 754/1542] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:57.150275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4baad09-9d0f-4d24-a922-03cbfbc830ae tempest-InstanceUsageAuditLogTestJSON-727697149 tempest-InstanceUsageAuditLogTestJSON-727697149-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.173938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e4baad09-9d0f-4d24-a922-03cbfbc830ae tempest-InstanceUsageAuditLogTestJSON-727697149 tempest-InstanceUsageAuditLogTestJSON-727697149-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-27 01:36:56" status: 200 len: 318 microversion: 2.1 time: 0.202019 Sep 27 01:36:57.174593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 789/1543] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:36:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-27%2001%3A36%3A56 => generated 318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:57.188210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90fe36f5-9025-40f1-a56a-291bd71bc5e5 tempest-InstanceUsageAuditLogTestJSON-727697149 tempest-InstanceUsageAuditLogTestJSON-727697149-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.207350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90fe36f5-9025-40f1-a56a-291bd71bc5e5 tempest-InstanceUsageAuditLogTestJSON-727697149 tempest-InstanceUsageAuditLogTestJSON-727697149-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.022926 Sep 27 01:36:57.207925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 755/1544] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:57.249073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.250672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:57.261521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.262158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.262770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.263722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.264871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.265469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.507582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:57.530987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6600f9f1-b123-4ee2-a2ee-37bf5c335e1b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1462 microversion: 2.1 time: 0.288622 Sep 27 01:36:57.532677 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 790/1545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1462 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:57.556585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.557205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:57.567782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.568287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.568719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.569458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.573654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.576156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.686112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.695268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:57.697597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Searching by: {'deleted': False, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:36:57.710327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.711714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.715132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.716079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:57.719315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:57.720198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:57.825133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:36:57.934197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61f618cd-ec76-4e0f-bbb9-6c8b35cef0d7 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.252793 Sep 27 01:36:57.935054 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 791/1546] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/servers => generated 339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:57.954586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:57.980004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:57.984653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Searching by: {'deleted': False, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:36:58.008083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:58.010824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:58.014189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:58.015339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:58.017947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:58.019862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:58.054085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:58.064733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-325d547a-d1a4-46fc-b382-b98a198d578e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1462 microversion: 2.1 time: 0.513082 Sep 27 01:36:58.068188 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 756/1547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1462 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:58.074590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:36:58.081927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:58.086101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:58.099159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:58.099997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:58.101293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:58.102317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:58.103088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:58.103761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:58.294086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:58.302985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:58.303699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:58.310274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:58.552011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:36:58.563916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-864d2435-f426-4e4c-a7cc-c7031e9f57ff tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.492780 Sep 27 01:36:58.566893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 757/1548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:58 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:58.593735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fa6ea63-065b-40fa-9b79-3cf2086d96a9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'create', calling method: .version_select at 0x7f24d6853280>, body: {"keypair": {"name": "tempest-keypair-2017587959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB/OFqYG4cDfIiuPRLuMlF58p+HPpWQ5AAFXMZl8fo5cRmPKG2EAI8RAKOm500J8kcH1qpZsd+PDv4pIr1siK7ZSR+nASlU91lhDT+8fHU0H2eoJ6WpgKjgEg9Qxh3Jfg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:36:58.640516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7fa6ea63-065b-40fa-9b79-3cf2086d96a9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:36:58.648636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7fa6ea63-065b-40fa-9b79-3cf2086d96a9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:36:58.688991 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fa6ea63-065b-40fa-9b79-3cf2086d96a9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104967 Sep 27 01:36:58.690307 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 758/1549] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:36:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:58.705783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a37f101-25e7-43c8-8710-06a6abac55de tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d66e1700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:58.782551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a37f101-25e7-43c8-8710-06a6abac55de tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.080650 Sep 27 01:36:58.785802 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 759/1550] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:58 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:59.245880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4eca7c9-3c14-43d6-8920-e726700f456b tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.301203 Sep 27 01:36:59.247177 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 792/1551] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:36:57 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:36:59.284813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f9f8e62-d1dc-4cdb-a572-4584f865c962 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:59.309877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f9f8e62-d1dc-4cdb-a572-4584f865c962 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033428 Sep 27 01:36:59.311978 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 760/1552] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:36:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:36:59.594996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:59.595765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:59.613463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:59.614008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:59.618279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:59.626034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:59.627459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:59.631209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:59.668215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:36:59.669223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:36:59.678442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:59.706253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:59.706746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:59.707506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:36:59.708441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:36:59.708874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:36:59.776655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:36:59.935176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89188a6e-0635-4142-9071-2d3ceb3b4b78 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 204 len: 0 microversion: 2.1 time: 0.270633 Sep 27 01:36:59.936880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 761/1553] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:36:59 2022] DELETE /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:36:59.950313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5e2d8c7-f35e-4051-80e0-2b74512128a2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6d5fa60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:00.024072 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5e2d8c7-f35e-4051-80e0-2b74512128a2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.084267 Sep 27 01:37:00.045843 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 762/1554] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:36:59 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:00.063156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:00.069306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:00.091320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:00.092328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:00.093331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:00.094289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:00.094932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:00.096009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:00.347297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:00.380522 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f86a609-4cd4-4e24-bbd2-887b76b4b702 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.790096 Sep 27 01:37:00.388658 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 793/1555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:36:59 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:00.405203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:00.422766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cb0772d-ccf9-4e47-8156-2927776333de tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1713 microversion: 2.1 time: 0.374276 Sep 27 01:37:00.423675 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 763/1556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:00 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1713 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:01.046902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1ddd2a4-420b-41ea-a4e0-687a49aa4203 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d629cc10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:01.177163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1ddd2a4-420b-41ea-a4e0-687a49aa4203 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.135064 Sep 27 01:37:01.178015 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 794/1557] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:01 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:01.412549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:01.419389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:01.435452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:01.435942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:01.436371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:01.437080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:01.437568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:01.447912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:01.450233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:01.459108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:01.466197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:01.466683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:01.477570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:01.480243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:01.488118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:01.489914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:01.546787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:02.070421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:02.086025 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60c8f420-6227-4b35-8ee5-a079a8f19303 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.677421 Sep 27 01:37:02.086623 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 764/1558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:01 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:02.164057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1cacf9f-6caf-4979-8d91-5e781359bbe1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '.version_select at 0x7f24d685e9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:02.168822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1cacf9f-6caf-4979-8d91-5e781359bbe1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:02.169547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1cacf9f-6caf-4979-8d91-5e781359bbe1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:02.170181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1cacf9f-6caf-4979-8d91-5e781359bbe1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:02.199834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1cacf9f-6caf-4979-8d91-5e781359bbe1 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.043093 Sep 27 01:37:02.203948 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 765/1559] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:37:02 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:02.215839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d94c0c2c-1db7-4f1a-97ed-7f59679304d4 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6d5fca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:02.298877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d94c0c2c-1db7-4f1a-97ed-7f59679304d4 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.093965 Sep 27 01:37:02.299607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 766/1560] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:02 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:02.310130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92fc0d56-661b-4f1f-878f-0701f2c8332d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:02.327107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92fc0d56-661b-4f1f-878f-0701f2c8332d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026330 Sep 27 01:37:02.329350 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 767/1561] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:37:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:02.342469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f07c9df-e82c-428f-828e-83d73fc1717d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1278903022", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:02.387576 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f07c9df-e82c-428f-828e-83d73fc1717d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.048378 Sep 27 01:37:02.388762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 768/1562] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Sep 27 01:37:02 2022] POST /compute/v2.1/flavors => generated 499 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:37:02.402148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c13ec28d-71ed-446f-b98f-d40cfeb36865 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:02.411460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:02.422860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c13ec28d-71ed-446f-b98f-d40cfeb36865 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024721 Sep 27 01:37:02.425664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-764c1125-630c-4404-bff2-8d3da8a73ed2 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1713 microversion: 2.1 time: 0.978879 Sep 27 01:37:02.426466 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 795/1563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:01 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1713 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:02.427165 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 769/1564] 10.222.0.52 () {58 vars in 1182 bytes} [Tue Sep 27 01:37:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:37:02.484717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-plugged", "status": "completed", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:02.509923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:02.510659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:02.511492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:02.529638 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] Creating event network-vif-plugged:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:37:02.545460 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-738f7c4f-918c-491b-9eef-9d508c7913a9 req-ebf31300-3705-4bcd-8bf8-daad78e6073f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063521 Sep 27 01:37:02.552866 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 770/1565] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:02.693597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1244006362", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "b7b2c07a-aeb7-459b-a1ef-086d8b1071ec"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:02.803635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:03.115923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:03.116968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:03.130907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.132989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.135434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.136683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.139543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.140187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.292688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:03.293191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:03.293765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:03.294174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:03.294592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:03.312187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.316677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.317238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.318073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.318741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.319331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.371732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:03.381661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:03.405930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:03.407780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:03.410004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:03.426860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bacf178-abee-419b-b189-22e7908acc65 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.312692 Sep 27 01:37:03.429638 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 771/1566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:03 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:03.444837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fb4c280-69d5-45aa-9d38-1c8031a76fad tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d613f160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:03.489965 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e73451a-4da2-4cbe-9e3c-534ac017b5da tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801490 Sep 27 01:37:03.497815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 796/1567] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:03.503387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:03.504180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:03.533355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.534408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.534857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.535226 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fb4c280-69d5-45aa-9d38-1c8031a76fad tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.104016 Sep 27 01:37:03.535568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:03.536021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:03.536370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 772/1568] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:03 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:03.543547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3071d559-b299-4acd-b836-cf814012e67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:03.544374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3071d559-b299-4acd-b836-cf814012e67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:03.559639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:03.570632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:03.680441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3071d559-b299-4acd-b836-cf814012e67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:03.693566 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3071d559-b299-4acd-b836-cf814012e67f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1279 microversion: 2.1 time: 0.152749 Sep 27 01:37:03.696192 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 773/1569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:03 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:04.219920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:04.228537 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc71f6f5-9e31-42a9-9e3e-56126360f8ee tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1713 microversion: 2.1 time: 0.729366 Sep 27 01:37:04.236641 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 797/1570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:03 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1713 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:04.272048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a22b5bfb-959d-4d64-bdad-3264c76ff3e8 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.279163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a22b5bfb-959d-4d64-bdad-3264c76ff3e8 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a22b5bfb-959d-4d64-bdad-3264c76ff3e8 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin] Request method failure captured: Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlO_5iC9Bphwxp0CgqiXmHKQE8tct4sRA0ZV0Y_NQl9kzc_5fv6_lqpILssIj5YFvIwfB269OOJm4YnGRjcHTmEeX4UUonjx5SntO35VEfC0zQw_EocsGSjxZf1iBUylT5udW_eGt9De9BOkh_S35nz_ASzsDvwYPCDlcpudl6-3Bi8 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4d149aacb3124af9ade784758bc55b5f Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:37:04.295437 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d149aacb3124af9ade784758bc55b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d149aacb3124af9ade784758bc55b5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d149aacb3124af9ade784758bc55b5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d149aacb3124af9ade784758bc55b5f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4d149aacb3124af9ade784758bc55b5f Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a9bea4cb25c34a398ad54caca111035c Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid timestamp for date invalid_time Sep 27 01:37:04.297597 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'invalid_time'} Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:04.298696 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 27 01:37:04.300425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.303694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a22b5bfb-959d-4d64-bdad-3264c76ff3e8 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:04.304855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a22b5bfb-959d-4d64-bdad-3264c76ff3e8 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598 tempest-InstanceUsageAuditLogNegativeTestJSON-290574598-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.333736 Sep 27 01:37:04.306979 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 774/1571] 10.222.0.52 () {58 vars in 1224 bytes} [Tue Sep 27 01:37:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:37:04.452371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.453309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:04.464167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:04.464669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:04.465103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:04.465841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:04.466300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:04.466723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:04.535032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-570d724b-7160-453f-bd48-d3ee1a0cc5e6 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.537202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-570d724b-7160-453f-bd48-d3ee1a0cc5e6 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '84314f8325564ad382f90e8bdf182b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308415485f574572a5d1e0c741626957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-570d724b-7160-453f-bd48-d3ee1a0cc5e6 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Request method failure captured: Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlO-9Hr4ipvEURjtHpJ08gxIEypjYsF6l94lpcc88vxXsKfQNUWOID2IyWvD9kWvLITD9SZpgRSQm7PN4x7Ez7pkyqVTJGZSxNc_SaEVJ8m2xivYTaZ4tRQH12X-wSHG5yUGfL4-KppGzIwj8uSW5B18JvhomvbnAJymwxbSuwYBaGg Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 308415485f574572a5d1e0c741626957 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:04.541899 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/308415485f574572a5d1e0c741626957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/308415485f574572a5d1e0c741626957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/308415485f574572a5d1e0c741626957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_308415485f574572a5d1e0c741626957", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 308415485f574572a5d1e0c741626957 Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 84314f8325564ad382f90e8bdf182b34 Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:04.543308 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:37:04.544062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 27 01:37:04.547458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.550939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-570d724b-7160-453f-bd48-d3ee1a0cc5e6 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:04.554908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-570d724b-7160-453f-bd48-d3ee1a0cc5e6 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.242043 Sep 27 01:37:04.557122 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 798/1572] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 01:37:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:04.571623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-127c7352-1208-4044-9b53-1ee5697f45ea tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d653b310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.686429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-127c7352-1208-4044-9b53-1ee5697f45ea tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.126872 Sep 27 01:37:04.692936 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 799/1573] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:04 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:04.698697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4f1e518-c0d2-4f95-a0e4-467e4dc3f33d tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.710024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4f1e518-c0d2-4f95-a0e4-467e4dc3f33d tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '84314f8325564ad382f90e8bdf182b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308415485f574572a5d1e0c741626957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4f1e518-c0d2-4f95-a0e4-467e4dc3f33d tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Request method failure captured: Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-27%2001:37:04 HTTP/1.1 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlO-9Hr4ipvEURjtHpJ08gxIEypjYsF6l94lpcc88vxXsKfQNUWOID2IyWvD9kWvLITD9SZpgRSQm7PN4x7Ez7pkyqVTJGZSxNc_SaEVJ8m2xivYTaZ4tRQH12X-wSHG5yUGfL4-KppGzIwj8uSW5B18JvhomvbnAJymwxbSuwYBaGg Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 308415485f574572a5d1e0c741626957 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:04.721445 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/308415485f574572a5d1e0c741626957"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/308415485f574572a5d1e0c741626957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/308415485f574572a5d1e0c741626957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_308415485f574572a5d1e0c741626957", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 308415485f574572a5d1e0c741626957 Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 84314f8325564ad382f90e8bdf182b34 Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:04.723268 n-d-859358-1 devstack@n-api.service[128778]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2022-09-27 01:37:04'} Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:37:04.724133 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 27 01:37:04.725678 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:04.731132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4f1e518-c0d2-4f95-a0e4-467e4dc3f33d tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:04.735861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b4f1e518-c0d2-4f95-a0e4-467e4dc3f33d tempest-InstanceUsageAuditLogNegativeTestJSON-153683592 tempest-InstanceUsageAuditLogNegativeTestJSON-153683592-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-27 01:37:04" status: 403 len: 128 microversion: 2.1 time: 0.040818 Sep 27 01:37:04.744546 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 800/1574] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:37:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-27%2001%3A37%3A04 => generated 128 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:04.801152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4950ab0d-d02d-4228-a9d2-683c0b555feb", "name": "network-vif-plugged", "status": "completed", "tag": "d8d0ed60-5db1-44c0-9b40-75a2a90d5719"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:04.835938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:04.843919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:04.844506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:04.874654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] Creating event network-vif-plugged:d8d0ed60-5db1-44c0-9b40-75a2a90d5719 for instance 4950ab0d-d02d-4228-a9d2-683c0b555feb on n-h1-859358-1 Sep 27 01:37:04.887333 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-02b33f80-1d89-44bb-9c77-3a228fce829f req-cb11886e-82f3-4cb1-a6cc-c8e3e0570fa1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138687 Sep 27 01:37:04.892943 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 801/1575] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:04.899820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:04.905621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c0a0010-613f-478c-b982-a9e79ae31a3c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:04.909130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c0a0010-613f-478c-b982-a9e79ae31a3c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:04.913747 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5da7cf05-8c6b-4e42-9af7-84e289ddad79 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.461749 Sep 27 01:37:04.914671 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 775/1576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:04 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:05.055409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b76c51db-69d4-44fa-b61e-68a2c84d6445 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Action: 'create', calling method: .version_select at 0x7f24d66f2dc0>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:05.069048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c0a0010-613f-478c-b982-a9e79ae31a3c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:05.095545 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c0a0010-613f-478c-b982-a9e79ae31a3c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1279 microversion: 2.1 time: 0.194096 Sep 27 01:37:05.097386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 802/1577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:04 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:05.103608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d29f457-5d6b-4f68-9f92-ddf67b69d22c", "name": "network-vif-deleted", "tag": "2263659c-0909-467d-996a-764b5ebe3bac"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:05.146610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:05.147178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:05.147647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:05.188167 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] Creating event network-vif-deleted:2263659c-0909-467d-996a-764b5ebe3bac for instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c on n-h1-859358-1 Sep 27 01:37:05.210672 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a0c8ad05-6eb7-4c44-a94d-c0cda1814bf2 req-ef29e888-aa70-441d-af03-01ca0190049f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111944 Sep 27 01:37:05.225981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 803/1578] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:05.264165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:05.265358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:05.282953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:05.283468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:05.285535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:05.288532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:05.289033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:05.291491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:05.507289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:05.525470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-376b3783-d69d-4943-b2f0-a1e689b30557 tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1361 microversion: 2.1 time: 0.269012 Sep 27 01:37:05.526857 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 804/1579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:05 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:05.706560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76705e70-0612-4d7b-895f-b062b8101526 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64c9310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:05.793310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76705e70-0612-4d7b-895f-b062b8101526 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.091223 Sep 27 01:37:05.794736 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 805/1580] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:05 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:05.941923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:05.942548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:05.966164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:05.967036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:05.967490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:05.970069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:05.970539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:05.971127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.420944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:06.441429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9bc8a38-cf3a-48ec-b769-9cab9d7764bf tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1324 microversion: 2.1 time: 0.504989 Sep 27 01:37:06.442984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 806/1581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:05 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:06.479280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:06.480218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:06.494682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:06.495453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:06.496125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.497058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:06.498109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:06.498710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.703356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:06.714191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:06.739848 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e676c69a-59b7-43ef-a9f4-9b3207038589 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1339 microversion: 2.1 time: 0.295182 Sep 27 01:37:06.770887 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 807/1582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:06 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1339 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:06.796396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:06.798888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:06.818475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:06.818952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:06.825618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.826893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:06.828179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:06.828780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.890909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:06.891939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:06.892679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:06.893361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lazy-loading 'fault' on Instance uuid 0d29f457-5d6b-4f68-9f92-ddf67b69d22c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:37:07.096473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df457f1df01e4d778adb762d77bbad15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82ea25736b24f8baa526f4ff1ef8c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:07.112207 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c3bb37e-a9c9-4b31-8dc3-75cf8abc054d tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 200 len: 1366 microversion: 2.1 time: 0.339926 Sep 27 01:37:07.131625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 808/1583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:06 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:07.145979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c8636bd-08aa-40b3-8644-3680265c65ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6931700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:07.228278 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c8636bd-08aa-40b3-8644-3680265c65ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.091274 Sep 27 01:37:07.229213 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 809/1584] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:07 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:07.474137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:07.476329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:07.487979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:07.490299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:07.491470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:07.493761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:07.495740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:07.496309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:07.764108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:07.830246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d76c1188-1ba0-44e7-af78-1c897be7f212 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.358754 Sep 27 01:37:07.831085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 810/1585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:07 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:07.842939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:07.843592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:07.898333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:07.900739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:07.903710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:07.907368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:07.912256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:07.915505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:08.063757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:08.078986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f63296e-4125-4328-8d22-04c7007e2546 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1337 microversion: 2.1 time: 0.246288 Sep 27 01:37:08.081307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 811/1586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:07 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1337 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:08.092006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:08.096425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:08.110959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:08.111453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:08.111929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:08.114756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:08.124581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:08.125414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:08.153430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b76c51db-69d4-44fa-b61e-68a2c84d6445 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.237396 Sep 27 01:37:08.166242 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 776/1587] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:37:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:08.184433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:08.185488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] [instance: 0d29f457-5d6b-4f68-9f92-ddf67b69d22c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:08.201371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:08.203434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:08.204224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:08.208746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:08.209596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:08.210324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:08.232856 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] HTTP exception thrown: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Request method failure captured: Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c HTTP/1.1 Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlN8ypi_TWvX39Sts6kGsCejrIgJQ-Njw1lSICNylvGSty-mI_1_PpPfBv3b84K2E8XzasdqiZflfE-hG2WhijA7ddvN-4ZK6RasUbNhMZWkOS4369G3DPtDyweoLpZdgRxND6TzACOj6OwuCFw11bsgZt6cr5sx55a0SABMTHjIOkA Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a82ea25736b24f8baa526f4ff1ef8c8e Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestManualDisk-158350314 Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:37:08.235250 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a82ea25736b24f8baa526f4ff1ef8c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a82ea25736b24f8baa526f4ff1ef8c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a82ea25736b24f8baa526f4ff1ef8c8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a82ea25736b24f8baa526f4ff1ef8c8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestManualDisk-158350314 Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a82ea25736b24f8baa526f4ff1ef8c8e Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestManualDisk-158350314 Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestManualDisk-158350314-project Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: df457f1df01e4d778adb762d77bbad15 Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestManualDisk-158350314-project Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. Sep 27 01:37:08.238277 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0d29f457-5d6b-4f68-9f92-ddf67b69d22c'} Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:08.239146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. Sep 27 01:37:08.242722 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:08.244089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Returning 404 to user: Instance 0d29f457-5d6b-4f68-9f92-ddf67b69d22c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:08.244089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3f643fd-5633-4023-8d5f-3dc2b1559b0e tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c" status: 404 len: 111 microversion: 2.1 time: 0.075849 Sep 27 01:37:08.245231 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 777/1588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:08 2022] GET /compute/v2.1/servers/0d29f457-5d6b-4f68-9f92-ddf67b69d22c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:08.250282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b69ed43f-fbcd-4c5a-8bf9-e0df8fba72fd tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Action: 'create', calling method: .version_select at 0x7f24d66f2dc0>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:08.815681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:08.838584 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-152d4a8d-1cbf-4adb-a9fd-a166db95d4b4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.755348 Sep 27 01:37:08.842712 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 812/1589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:08 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:08.856122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae03519f-1d30-4201-b8bb-869cc0e83fa9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d68ceb80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:08.930120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae03519f-1d30-4201-b8bb-869cc0e83fa9 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.086358 Sep 27 01:37:08.930727 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 813/1590] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:08 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:08.946071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-710912a1-d941-487d-bc3f-bbb233ed94bc tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] Calling method '.version_select at 0x7f24d669b940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:08.980822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-710912a1-d941-487d-bc3f-bbb233ed94bc tempest-ServersTestManualDisk-158350314 tempest-ServersTestManualDisk-158350314-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220363177" status: 202 len: 0 microversion: 2.1 time: 0.038759 Sep 27 01:37:08.981609 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 814/1591] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220363177 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:08.987498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86092f67-198a-45d6-b4f2-f86a519943b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1436861764", "metadata": {"": ""}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86092f67-198a-45d6-b4f2-f86a519943b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action HTTP/1.1 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 107 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:09.000130 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1436861764", "metadata": {"": ""}}} Sep 27 01:37:09.001981 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1436861764', 'metadata': {'': ''}}}} Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'': ''} Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:09.003060 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.005046 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86092f67-198a-45d6-b4f2-f86a519943b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86092f67-198a-45d6-b4f2-f86a519943b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action" status: 400 len: 170 microversion: 2.1 time: 0.018812 Sep 27 01:37:09.006677 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 815/1592] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Sep 27 01:37:08 2022] POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:37:09.017403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:09.018539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:09.037911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:09.038403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:09.041577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:09.050134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:09.051020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:09.053007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:09.656703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:09.670393 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a151a867-d4b0-45af-9dec-01f6ceda948f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.660388 Sep 27 01:37:09.670963 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 816/1593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:09 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:09.691767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:09.692736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:09.704815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:09.710268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:09.711912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:09.713389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:09.714357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:09.715370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:10.109732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:10.126416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1729af18-9ba2-48a8-96c7-a6fb5772be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.451931 Sep 27 01:37:10.127654 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 817/1594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:09 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:10.132711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:10.133687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:10.141292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:10.142607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:10.143215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:10.144097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:10.144708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:10.145319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:10.591230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:10.601511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-730d941c-205a-46a8-86d7-ccc92c20ff60 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.472623 Sep 27 01:37:10.602589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 818/1595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:10 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:10.609128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d20587b-2552-4e59-924b-38738a905ac2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64e0790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:10.687657 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d20587b-2552-4e59-924b-38738a905ac2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.084051 Sep 27 01:37:10.688254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 819/1596] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:10 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:10.702939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:10.744548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:10.746935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:10.747606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:10.784536 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] Creating event network-changed:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:37:10.805270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-49b5e3ab-e736-4734-aa0b-5e3c46860f9d req-f3cbd98d-0624-4d19-a6ba-b94c02600624 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115782 Sep 27 01:37:10.810531 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 820/1597] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:10.820175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-117ae0e4-ecbd-47bd-ad59-b8f171828511 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-747764934", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-117ae0e4-ecbd-47bd-ad59-b8f171828511 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action HTTP/1.1 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 618 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:10.824587 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:10.826380 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:37:10.827156 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-747764934", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 27 01:37:10.827156 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:10.827156 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-747764934', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 27 01:37:10.827456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:10.828295 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.829824 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:37:10.831986 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:10.832726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-117ae0e4-ecbd-47bd-ad59-b8f171828511 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:10.854312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-117ae0e4-ecbd-47bd-ad59-b8f171828511 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action" status: 400 len: 938 microversion: 2.1 time: 0.040716 Sep 27 01:37:10.855847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 821/1598] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Sep 27 01:37:10 2022] POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action => generated 938 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:37:10.865942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:10.869037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:10.898584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:10.899143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:10.900934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:10.903950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:10.904543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:10.905193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:11.493654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:11.504160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5fb50c3-1f69-4e7d-9564-123e32f40f7f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.640616 Sep 27 01:37:11.504770 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 822/1599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:10 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:11.522559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:11.523524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:11.539645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:11.540416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:11.541014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:11.541940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:11.542547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:11.543128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:11.633255 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b69ed43f-fbcd-4c5a-8bf9-e0df8fba72fd tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.386551 Sep 27 01:37:11.634267 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 778/1600] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:37:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:11.641431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:11.642319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:11.664267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:11.675409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:11.681532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:11.681532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:11.681532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:11.681532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:11.863162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:11.878430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d532c0f4-0a8d-4c52-ae4e-c0c107142a53 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.242970 Sep 27 01:37:11.897373 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 779/1601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:11 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:11.897373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bc713a4-38e0-4815-b1f3-0875ac68f09b tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Action: 'create', calling method: .version_select at 0x7f24d6127a60>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:11.985824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:12.004661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f5dd1d63-84ae-4bc4-a8e8-07bbbf0f4f91 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.483871 Sep 27 01:37:12.014433 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 823/1602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:11 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:12.027799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-568ce377-25d7-4508-aca8-9ac5622f024b tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d669bf70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:12.103491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-568ce377-25d7-4508-aca8-9ac5622f024b tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.081664 Sep 27 01:37:12.104383 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 824/1603] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:12 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:12.111501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1665bec7-4717-47c1-ba63-54aa3c0df3cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1665bec7-4717-47c1-ba63-54aa3c0df3cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action HTTP/1.1 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 285 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:12.120376 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:37:12.122050 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:37:12.122904 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:37:12.123647 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:37:12.125132 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:37:12.126261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:37:12.126261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:12.127879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1665bec7-4717-47c1-ba63-54aa3c0df3cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:12.129692 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1665bec7-4717-47c1-ba63-54aa3c0df3cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action" status: 400 len: 619 microversion: 2.1 time: 0.024176 Sep 27 01:37:12.130798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 825/1604] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Sep 27 01:37:12 2022] POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:37:12.148478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:12.153016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:12.161310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:12.162120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:12.162886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:12.163825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:12.164496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:12.165257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:12.509570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:12.524713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9ca7231-6e6c-4c8d-b100-85e0798cb75e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.389985 Sep 27 01:37:12.530422 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 826/1605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:12 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:12.748409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1025086508", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:12.838500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:13.148290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:13.149077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:13.149754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:13.150290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:13.150884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:13.166435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.167156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.167344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.168075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.169323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.169323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.191654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Getting quotas for project b1c10c2b652d4ca0b0dfbea0905c7fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:13.198193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Getting quotas for user bc091bc870454f15a072c907b630ee9a and project b1c10c2b652d4ca0b0dfbea0905c7fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:13.214387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:13.218045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:13.298173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74fc9285-ec1c-4e34-9a57-9032d591c7d1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765522 Sep 27 01:37:13.301730 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 827/1606] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:13.357612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:13.358534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:13.381304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.385738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.386798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.387975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.391432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.392006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.630592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bc713a4-38e0-4815-b1f3-0875ac68f09b tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.746853 Sep 27 01:37:13.631547 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 780/1607] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:37:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:13.637157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:13.637881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:13.646237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.647105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.647753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.648688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:13.649519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:13.650723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:13.688791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:13.710009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:13.719094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a80819e-0825-409a-9abf-43fcb0747569 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.412652 Sep 27 01:37:13.721445 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 828/1608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:13 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:13.726006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7af61425-8fd3-41ec-8237-e3e0b8b0a088 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64c9af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:13.808110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7af61425-8fd3-41ec-8237-e3e0b8b0a088 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.085526 Sep 27 01:37:13.809407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 829/1609] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:13 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:13.815089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f393f1c3-49e6-4406-b353-5d43d642b5ac tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:13.816519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f393f1c3-49e6-4406-b353-5d43d642b5ac tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:13.908273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:13.920979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79e8f611-9acf-434f-86c6-93783afd00cc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.288288 Sep 27 01:37:13.925521 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 781/1610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:13 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:13.942089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-901ea200-3000-4b7f-a9da-fa0d0d88b095 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Action: 'create', calling method: .version_select at 0x7f24d5fc2700>, body: {"pool": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:13.982488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f393f1c3-49e6-4406-b353-5d43d642b5ac tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:13.992486 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f393f1c3-49e6-4406-b353-5d43d642b5ac tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1222 microversion: 2.1 time: 0.181683 Sep 27 01:37:13.993378 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 830/1611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:13 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:13.999633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2146375196"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:14.002485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:14.015558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.016559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.017232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:14.018492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.019176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.019832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:14.378780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-029f5c1b-8df8-47c5-a157-09e0298a8017 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action" status: 202 len: 0 microversion: 2.1 time: 0.383398 Sep 27 01:37:14.380109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 831/1612] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:13 2022] POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:37:14.392242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-169965490"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:14.396882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:14.410241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.410748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.411194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:14.412257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.412919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.413660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:14.511539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Cannot 'createImage' instance 4950ab0d-d02d-4228-a9d2-683c0b555feb while it is in task_state image_snapshot_pending Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action HTTP/1.1 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 84 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:14.513647 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-169965490"}} Sep 27 01:37:14.515489 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'createImage' instance 4950ab0d-d02d-4228-a9d2-683c0b555feb while it is in task_state image_snapshot_pending Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-169965490'}}} Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:14.516403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4950ab0d-d02d-4228-a9d2-683c0b555feb while it is in task_state image_snapshot_pending Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4950ab0d-d02d-4228-a9d2-683c0b555feb while it is in task_state image_snapshot_pending Sep 27 01:37:14.518468 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:14.522904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 409 to user: Cannot 'createImage' instance 4950ab0d-d02d-4228-a9d2-683c0b555feb while it is in task_state image_snapshot_pending {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:14.527560 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99a5b946-8e53-432a-9329-072ed751051d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action" status: 409 len: 167 microversion: 2.1 time: 0.140483 Sep 27 01:37:14.528759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 832/1613] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:14 2022] POST /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb/action => generated 167 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:37:14.544285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afa98457-93dd-4d4f-90a2-5b26887aa58d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24d64faaf0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:14.764682 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afa98457-93dd-4d4f-90a2-5b26887aa58d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/images/8c0533a1-ad73-46d0-8880-cd343b9a5b27" status: 204 len: 0 microversion: 2.1 time: 0.231157 Sep 27 01:37:14.765606 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 833/1614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:14 2022] DELETE /compute/v2.1/images/8c0533a1-ad73-46d0-8880-cd343b9a5b27 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:37:14.776259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:14.776785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:14.780166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:14.796103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.797006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.797884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:14.802611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:14.803115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:14.803569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:15.163066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:15.175679 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3a44397-9d42-4d8f-ad35-9e63dab04c08 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1532 microversion: 2.1 time: 0.403656 Sep 27 01:37:15.176472 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 834/1615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:14 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1532 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:15.185006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-43673f70-f2e2-4059-98ad-7e6af9fb40d4 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64faaf0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:15.301539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-43673f70-f2e2-4059-98ad-7e6af9fb40d4 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.119645 Sep 27 01:37:15.303398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 835/1616] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:15 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:15.323480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:15.324129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:15.349479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:15.349976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:15.350413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:15.351129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:15.351581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:15.352006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:15.367812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:15.596311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:15.606295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2ba8c69-bba8-4448-8558-7e7b5996394b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.301782 Sep 27 01:37:15.609120 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 836/1617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:15 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:15.618281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:15.619185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:15.628391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:15.629183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:15.630040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:15.631115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:15.632470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:15.633088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:15.738679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:15.749889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28ef1112-c454-4eb6-844d-5024f3a504b2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1274 microversion: 2.1 time: 0.138713 Sep 27 01:37:15.750480 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 837/1618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:15 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:16.212092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:16.212695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:16.225821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:16.226330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:16.230178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:16.232499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:16.232940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:16.237945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:16.521745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:16.558521 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af0487d3-b2d3-488d-a7f4-d951193f9f4c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1538 microversion: 2.1 time: 0.347858 Sep 27 01:37:16.569758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 838/1619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:16 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1538 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:16.582211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aa4af64a-5134-490e-903a-ea1722bb9516 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d62daaf0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:16.663885 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aa4af64a-5134-490e-903a-ea1722bb9516 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.086659 Sep 27 01:37:16.665564 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 839/1620] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:16 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:16.674740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:16.675627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:16.687368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:16.688809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:16.689912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:16.691480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:16.692791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:16.693618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:17.222515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:17.229312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-901ea200-3000-4b7f-a9da-fa0d0d88b095 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.298300 Sep 27 01:37:17.229944 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 782/1621] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:37:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:17.234537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:17.235562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:17.235682 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51f39f4e-0061-466f-9dc7-496bf84b661f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.567945 Sep 27 01:37:17.237222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 840/1622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:16 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:17.246971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03318a15-de38-423c-b47d-11ef6955271b tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d7ca73a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:17.259055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:17.259554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:17.259989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:17.260702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:17.261153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:17.261603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:17.379643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:17.389164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5b0b40d-345e-4fac-a33d-ffc8f3780ec6 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1280 microversion: 2.1 time: 0.157983 Sep 27 01:37:17.390143 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 783/1623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:17 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:17.587254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:17.589126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:17.600073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:17.605753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:17.606639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:17.610229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:17.611837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:17.612518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:17.868670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03318a15-de38-423c-b47d-11ef6955271b tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/d82dc6e8-2e5a-4823-8bd9-fcd93667f37a" status: 200 len: 142 microversion: 2.1 time: 0.628777 Sep 27 01:37:17.869258 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 841/1624] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:37:17 2022] GET /compute/v2.1/os-floating-ips/d82dc6e8-2e5a-4823-8bd9-fcd93667f37a => generated 142 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:17.876996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-358d228f-b3e4-4ad0-b6e3-87675d2b2b90 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6786d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:17.967272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-358d228f-b3e4-4ad0-b6e3-87675d2b2b90 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.096868 Sep 27 01:37:17.967865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 842/1625] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:17 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:18.110889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-plugged", "status": "completed", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:18.131966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:18.132457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:18.132893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:18.166459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] Creating event network-vif-plugged:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:37:18.183009 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5ee5400e-c5a7-4c90-8855-db9a2247ec3d req-d3d52612-4aa7-48f5-8118-031ec36d58c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204220 Sep 27 01:37:18.183629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 843/1626] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:18.194087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e766daa8-ead4-44ba-b833-bbade3574915 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d622b4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:18.632619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:18.646726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99dcc723-d5c0-42a9-bce9-78835801df5c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1538 microversion: 2.1 time: 1.061270 Sep 27 01:37:18.650949 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 784/1627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:17 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1538 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:18.657843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:18.659308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:18.685091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:18.686361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:18.689743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:18.693817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:18.695907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:18.699413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:19.038465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:19.050799 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-499ad64a-df1e-4a81-b8a0-0c500231612f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1379 microversion: 2.1 time: 0.398424 Sep 27 01:37:19.053154 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 785/1628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:18 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1379 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:19.079619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:19.083723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:19.101829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:19.103420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:19.104151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:19.106910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:19.107456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:19.109451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:19.333948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:19.360153 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34a48204-637c-4b2d-aee7-bcba5369c9f9 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.283045 Sep 27 01:37:19.377803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 786/1629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:19 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:19.386191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96534a37-08c4-4b9e-a7d2-d4351ed4cfc0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d685e3a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:19.525464 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96534a37-08c4-4b9e-a7d2-d4351ed4cfc0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1424 microversion: 2.1 time: 0.145946 Sep 27 01:37:19.526051 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 787/1630] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:19 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:19.677712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:19.678511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:19.690048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:19.690790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:19.691227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:19.691925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:19.692537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:19.693323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:19.970474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:19.984026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37d6f5c9-de63-4b55-a2a6-51d08bf58f04 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1520 microversion: 2.1 time: 0.311378 Sep 27 01:37:20.001154 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 788/1631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:19 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:20.007695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.008544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:20.016578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.017299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.018474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.019645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.020250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.020697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.165140 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e766daa8-ead4-44ba-b833-bbade3574915 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/d82dc6e8-2e5a-4823-8bd9-fcd93667f37a" status: 202 len: 0 microversion: 2.1 time: 1.980222 Sep 27 01:37:20.166682 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 844/1632] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:37:18 2022] DELETE /compute/v2.1/os-floating-ips/d82dc6e8-2e5a-4823-8bd9-fcd93667f37a => generated 0 bytes in 1982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:20.177488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.178491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:20.185226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.186589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.194529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.195690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.197224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.197939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.268492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:37:20.282653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc13a7df-b622-4ed4-b3a6-a859d995a1d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1815 microversion: 2.1 time: 0.278109 Sep 27 01:37:20.283352 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 789/1633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1815 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:20.292902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.296925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:20.311761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.313890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.316570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.319081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.320223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.323126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.520812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93ed623d-cd26-4ef2-97a8-2c9e118c5932 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 204 len: 0 microversion: 2.1 time: 0.350539 Sep 27 01:37:20.529485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 845/1634] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:37:20 2022] DELETE /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:37:20.543875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0168bc33-04fa-433d-9e08-71a859385562 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d622b310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.610810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:20.629493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e10420c3-0338-4032-9fbb-8760512cad64 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1528 microversion: 2.1 time: 0.344102 Sep 27 01:37:20.645364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 790/1635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:20.645364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.645364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.645364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.646235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.646235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.646235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.646235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.680986 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d33347d-a862-435e-916d-bc3609467cdb tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046814 Sep 27 01:37:20.682317 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 791/1636] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:20.686784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4950ab0d-d02d-4228-a9d2-683c0b555feb", "name": "network-vif-plugged", "status": "completed", "tag": "d8d0ed60-5db1-44c0-9b40-75a2a90d5719"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:20.701083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.701944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.702044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.714168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] Creating event network-vif-plugged:d8d0ed60-5db1-44c0-9b40-75a2a90d5719 for instance 4950ab0d-d02d-4228-a9d2-683c0b555feb on n-h1-859358-1 Sep 27 01:37:20.720200 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1e9393f1-d51f-45c4-a7ec-a10efae735e4 req-8c7d7c80-a3e7-4144-9db8-d419d25fdc9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036358 Sep 27 01:37:20.721376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 792/1637] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:20.726372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5791490-cdec-4ce8-813e-cf5194db2306", "tag": "bd37dd7b-58f9-4534-8b5f-c590baadaad7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:20.737359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.738041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.738402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.755363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] Creating event network-changed:bd37dd7b-58f9-4534-8b5f-c590baadaad7 for instance b5791490-cdec-4ce8-813e-cf5194db2306 on n-h2-859358-1 Sep 27 01:37:20.760542 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-80ba7fe1-f0e8-425e-851b-f56d1f0c5332 req-64b36a3c-7926-4c1d-80b9-463bf24c24de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037865 Sep 27 01:37:20.761384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 793/1638] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:20.766522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.767512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:20.774069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.774754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.775526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.776449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.777096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.777741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.966481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0168bc33-04fa-433d-9e08-71a859385562 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.434508 Sep 27 01:37:20.967668 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 846/1639] 10.222.0.52 () {58 vars in 1164 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:37:20.974127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:20.975515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:20.977441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:20.986793 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a21c8bf-2899-4410-8ff8-f92f78bda634 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.223211 Sep 27 01:37:20.987989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.988725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.990842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.991955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:20.992630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:20.993286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:20.997955 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 794/1640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.010516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5574c741-7850-484d-b635-5dd857ce43d5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d62b4b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.064775 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5574c741-7850-484d-b635-5dd857ce43d5 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1433 microversion: 2.1 time: 0.063812 Sep 27 01:37:21.065988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 795/1641] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1433 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.076086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.076723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:21.090353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.090847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.091317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.093289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.093779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.094208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.286766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:21.296287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:21.300278 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f6aac84-022e-4ddd-b659-9a221583b170 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1526 microversion: 2.1 time: 0.331254 Sep 27 01:37:21.302087 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 847/1642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:20 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1526 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.306844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a74ba08-ef6f-413e-8771-998a1fdd9e52 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d622bca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.307144 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-182f7bdb-3c0a-4074-a9ce-422a8e22e2a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1528 microversion: 2.1 time: 0.238422 Sep 27 01:37:21.308054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 796/1643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.312593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a78f6a2-20fa-4f99-894e-aa348f1e7dc3 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d62b4700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.364778 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a78f6a2-20fa-4f99-894e-aa348f1e7dc3 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 200 len: 1433 microversion: 2.1 time: 0.055556 Sep 27 01:37:21.365810 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 797/1644] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 1433 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.378892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a32b680c-9e67-4973-a1a7-360268801c7d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.398051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a32b680c-9e67-4973-a1a7-360268801c7d tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/b7b2c07a-aeb7-459b-a1ef-086d8b1071ec" status: 202 len: 0 microversion: 2.1 time: 0.025803 Sep 27 01:37:21.401858 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 798/1645] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:37:21 2022] DELETE /compute/v2.1/flavors/b7b2c07a-aeb7-459b-a1ef-086d8b1071ec => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:21.406983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.408008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:21.415062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.415549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.415982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.416682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.417137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.417585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.605303 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a74ba08-ef6f-413e-8771-998a1fdd9e52 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.302013 Sep 27 01:37:21.607273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 848/1646] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:21.613748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93dd0d91-0a06-499a-9fe4-af249b5477d9 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.652015 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93dd0d91-0a06-499a-9fe4-af249b5477d9 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043257 Sep 27 01:37:21.653618 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 849/1647] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.659561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aee2e22f-70ec-41f8-a688-6f7f8e23e689 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d61fa820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.759471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:21.770305 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9223ead-4562-43d2-844f-6a2cd2989da0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1480 microversion: 2.1 time: 0.367353 Sep 27 01:37:21.786445 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 799/1648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1480 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:21.793732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:21.797102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:21.805045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.806949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.807808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.808905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.809792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.810495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.817427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:21.853887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:21.863513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Old instance type tempest-test_resize_flavor_-1278903022, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 01:37:21.874195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:21.875752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:21.875879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:21.876391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:21.877558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:21.958981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb977537-efa7-495d-b08d-79e53e6c57b7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559/action" status: 202 len: 0 microversion: 2.1 time: 0.171007 Sep 27 01:37:21.959940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 800/1649] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:21 2022] POST /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:21.970601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:21.971580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:21.982228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.982973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.983674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:21.984684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:21.985774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:21.987347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.204973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:22.215061 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72bd3a3f-4136-4bc4-a339-92c17aed8e4e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1537 microversion: 2.1 time: 0.250548 Sep 27 01:37:22.216042 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 801/1650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:21 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:22.221375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:22.222435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:22.231933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.232731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.233312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.234142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.234738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.235368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.402665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:22.415166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed496232-c7ad-4a6a-b4b6-9e325b138829 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.197832 Sep 27 01:37:22.416072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 802/1651] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:22 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:22.433918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:22.434573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:22.443290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.443785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.444223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.444992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.445643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.446089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.668548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:22.679802 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-951e0bd6-c2d7-4bf3-ae05-d8429e7c77b3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1526 microversion: 2.1 time: 0.262431 Sep 27 01:37:22.693586 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 803/1652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:22 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1526 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:22.798263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:22.799699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:22.815093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.815801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.816830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:22.823532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:22.824280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:22.824962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:23.058429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:23.070078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15ecc943-6d31-4237-84aa-5b7939f6b0ff tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1467 microversion: 2.1 time: 0.275857 Sep 27 01:37:23.071211 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 804/1653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:22 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1467 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:23.096893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecfa8714-6029-445a-93d5-cfb535747ef2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6853820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:23.161897 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecfa8714-6029-445a-93d5-cfb535747ef2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27" status: 200 len: 784 microversion: 2.1 time: 0.070126 Sep 27 01:37:23.165712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 805/1654] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:23 2022] GET /compute/v2.1/images/c7f94860-9c0a-4587-87f9-f17df944ca27 => generated 784 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:37:23.179027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:23.181894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53bc2d0c-2ce3-4967-a47b-6391e5c8eef7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:23.200440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53bc2d0c-2ce3-4967-a47b-6391e5c8eef7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025027 Sep 27 01:37:23.201920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 806/1655] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:37:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:37:23.215885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f2e65fc-a59b-495e-9e5e-7c685148c1fd tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6127280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:23.776215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aee2e22f-70ec-41f8-a688-6f7f8e23e689 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/19fe957c-cf44-45aa-90c1-4ea9701d5efe" status: 202 len: 0 microversion: 2.1 time: 2.121308 Sep 27 01:37:23.777040 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 850/1656] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:37:21 2022] DELETE /compute/v2.1/os-floating-ips/19fe957c-cf44-45aa-90c1-4ea9701d5efe => generated 0 bytes in 2123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:23.782978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:23.783694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:23.797864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:23.802319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:23.805188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:23.810190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:23.812293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:23.812965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:23.991847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=22 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:24.131171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:24.140449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09d701d1-8e16-4f0e-84f9-b5becd29b2a1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1537 microversion: 2.1 time: 0.362114 Sep 27 01:37:24.141040 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 851/1657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:23 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1537 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:24.153510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:24.153510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:24.157237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.173124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.176460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.178193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.178684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.179128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.257315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f2e65fc-a59b-495e-9e5e-7c685148c1fd tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "DELETE /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 204 len: 0 microversion: 2.1 time: 1.047539 Sep 27 01:37:24.257930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 807/1658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:23 2022] DELETE /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:37:24.263391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:24.264006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:24.270570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.271282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.271904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.274406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.279709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.280740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.342778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.343449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.344330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.345226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lazy-loading 'fault' on Instance uuid 4950ab0d-d02d-4228-a9d2-683c0b555feb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:37:24.420245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:24.424510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:24.432943 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e225903-7403-4300-a2ab-2e2a77693169 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 200 len: 1314 microversion: 2.1 time: 0.172285 Sep 27 01:37:24.434693 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 808/1659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:24 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:24.442475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6b0bb1c-dc55-447d-8d16-70330b3066fd", "device": "/dev/xvdb"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:24.445970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:24.452272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9418f2eb-53e5-43ec-9c8c-05881d1d3fdd tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.310138 Sep 27 01:37:24.468939 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 852/1660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:24 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:24.469915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.469915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.469915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.469915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:24.470962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:24.470962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:24.496733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7351b1ee-13ae-4a66-a835-5ceb08068330 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d69a2b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:24.992286 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d54ee705-ff48-41be-90f1-7b58952bbd88 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555054 Sep 27 01:37:24.993093 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 809/1661] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:37:24 2022] POST /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:25.000329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4950ab0d-d02d-4228-a9d2-683c0b555feb", "name": "network-vif-deleted", "tag": "d8d0ed60-5db1-44c0-9b40-75a2a90d5719"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:25.012958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.013603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.014305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.030306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] Creating event network-vif-deleted:d8d0ed60-5db1-44c0-9b40-75a2a90d5719 for instance 4950ab0d-d02d-4228-a9d2-683c0b555feb on n-h1-859358-1 Sep 27 01:37:25.070905 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bf96d50a-838d-4aff-8210-1431afa31bef req-94506371-898d-4e1e-9ef9-5c515eea3b7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075747 Sep 27 01:37:25.072262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 810/1662] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:25.079750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0ea047b-8334-4c35-98b8-c82171268e67 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5fa64c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:25.118613 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d0ea047b-8334-4c35-98b8-c82171268e67 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] HTTP exception thrown: Image not found. Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0ea047b-8334-4c35-98b8-c82171268e67 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Request method failure captured: Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 HTTP/1.1 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOlJG7d8Fb9QOKDyaK-6I-x7VgwrpoP1tLOTlTJBETGLAwprPXd_djC4A-VrHWRsgsRIMlq8EmocAwnbQsX5mGS4V-aXdWn4p_bB3DoUXWuz7oaBFrol3u3nRuUjRP7HRoNo3rpBebGGR91jBnsmn58XL9zSi9XuQZ0QWWS1QjzXBk Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:37:25.130442 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/759424e147c64aa6a741c7b540198227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_759424e147c64aa6a741c7b540198227", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 93fd46cbb43d4f82876c64f17b03f310 Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '60fb6598-d4d6-4172-8dba-0cfffcb843c6'} Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:25.132143 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60fb6598-d4d6-4172-8dba-0cfffcb843c6 Sep 27 01:37:25.133272 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:37:25.134772 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60fb6598-d4d6-4172-8dba-0cfffcb843c6 could not be found. Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:37:25.136244 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:37:25.137980 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.139874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0ea047b-8334-4c35-98b8-c82171268e67 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:25.140780 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0ea047b-8334-4c35-98b8-c82171268e67 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 404 len: 62 microversion: 2.1 time: 0.067213 Sep 27 01:37:25.141356 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 811/1663] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:25 2022] GET /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:37:25.148904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-unplugged", "status": "completed", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:25.164160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.164640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.165070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.178408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] Creating event network-vif-unplugged:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:37:25.183801 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0079511d-f1c2-47cb-a057-6fe853a06b6c req-c87a585c-1f66-49e5-b0d0-121c1e2508a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041290 Sep 27 01:37:25.184973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 812/1664] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:25.192957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-551557680"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:25.195862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:25.203070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.204030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.204624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.205577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.206205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.207058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.531017 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac69a4f5-d619-4e32-9722-485034cc5ce1 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "POST /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5/action" status: 202 len: 0 microversion: 2.1 time: 0.342406 Sep 27 01:37:25.533894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 813/1665] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:25 2022] POST /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:37:25.548872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:25.552132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:25.560703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.561734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.562483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.563677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.564412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.565060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.853054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:25.864480 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fd94351-05c0-45a4-ba1f-e853db9821ff tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1537 microversion: 2.1 time: 0.323741 Sep 27 01:37:25.878757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 814/1666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:25 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1537 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:25.893907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:25.894678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:25.903996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.906013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.907016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.910665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:25.911456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:25.919593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:25.967492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb HTTP/1.1 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:37:25.974080 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:37:25.975682 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb'} Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:25.976558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:37:25.978061 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:25.979435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:25.979435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e2f3d04-40d1-4d99-90cc-8cd183b0d313 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 404 len: 111 microversion: 2.1 time: 0.098592 Sep 27 01:37:25.979588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 815/1667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:25 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:25.993138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:25.994055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:26.000373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:26.000855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:26.002114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:26.003152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:26.003799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:26.004579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:26.195710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:26.209605 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86aa7eda-bf10-4243-8c53-456ae4d37eae tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.228949 Sep 27 01:37:26.210299 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 816/1668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:25 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:26.238368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d752643-4e2a-4135-927c-d577f66c18cd tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ec9940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:26.303573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d752643-4e2a-4135-927c-d577f66c18cd tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.092030 Sep 27 01:37:26.313570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 817/1669] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:26 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:26.329874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f66455d7-e07c-4ca8-b6d9-5262bfd6098f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'create', calling method: .version_select at 0x7f24d5fa6040>, body: {"keypair": {"name": "tempest-keypair-2140167231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBg3xDiEARdplK8SJYfqAZlLFUP1OoP8naGgSXAljFCCktSimScjfKQYRl1aEOTsdg4ZZEcFyMhz9Nn//1dMcfvE6kK3ZIOBRs9V6oWVG9yPKwcp2lErIjd8O2s+P+VOsw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:26.367565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f66455d7-e07c-4ca8-b6d9-5262bfd6098f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:26.373203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f66455d7-e07c-4ca8-b6d9-5262bfd6098f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for user e50d446d60b54188900a6f653787667d and project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:26.412154 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f66455d7-e07c-4ca8-b6d9-5262bfd6098f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086584 Sep 27 01:37:26.413040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 818/1670] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:26.638479 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7351b1ee-13ae-4a66-a835-5ceb08068330 tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/e9f890f6-9a6b-4265-8c6c-e611c2bffdbf" status: 202 len: 0 microversion: 2.1 time: 2.148278 Sep 27 01:37:26.641444 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 853/1671] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:37:24 2022] DELETE /compute/v2.1/os-floating-ips/e9f890f6-9a6b-4265-8c6c-e611c2bffdbf => generated 0 bytes in 2152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:26.648809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d124f272-585d-4e07-a9ad-aee3210a9e6f tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] Calling method '.version_select at 0x7f24d5fa6d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:26.903733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:26.907235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:26.918237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:26.922889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:26.925692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:26.926886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:26.929849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:26.930542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:27.268561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:27.279456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c40d09d-4636-456a-9a08-a3dfd87cfab3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1537 microversion: 2.1 time: 0.380591 Sep 27 01:37:27.282013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 854/1672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:26 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:27.290982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:27.298230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:27.312371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:27.314613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:27.316495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:27.317513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:27.319176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:27.320568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:27.663788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:27.687551 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9afe7693-b99d-48a6-9a24-2a824f40525b tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.403245 Sep 27 01:37:27.688254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 855/1673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:27 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:27.697324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e85db28e-0022-497c-9f71-d8226c0a26eb tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64e0790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:27.783844 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e85db28e-0022-497c-9f71-d8226c0a26eb tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.093268 Sep 27 01:37:27.785259 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 856/1674] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:27 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:28.270391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d124f272-585d-4e07-a9ad-aee3210a9e6f tempest-FloatingIPDetailsTestJSON-2110616684 tempest-FloatingIPDetailsTestJSON-2110616684-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/de022f23-6a1c-4ee9-b455-04c116503528" status: 202 len: 0 microversion: 2.1 time: 1.625607 Sep 27 01:37:28.272112 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 819/1675] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:37:26 2022] DELETE /compute/v2.1/os-floating-ips/de022f23-6a1c-4ee9-b455-04c116503528 => generated 0 bytes in 1628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:28.308282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:28.309415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:28.317214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:28.318020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:28.319465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:28.320436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:28.321081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:28.321715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:28.715078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:28.715957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:28.721846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:28.740550 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-264bd7ac-2259-40a6-960e-3bb51a3b5d32 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.436063 Sep 27 01:37:28.744283 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 857/1676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:28 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:28.746167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:28.746963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:28.747579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:28.754020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:28.754763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:28.755376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:28.801759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80dccfa2-2f2e-48ad-a6b7-58865b8fb7e6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d61d2280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:28.867533 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80dccfa2-2f2e-48ad-a6b7-58865b8fb7e6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.071258 Sep 27 01:37:28.872913 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 858/1677] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:28 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:29.322182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:29.336627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1c92383-f501-4cf6-ba6a-ab2e7b4d1dd1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.626730 Sep 27 01:37:29.338852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 820/1678] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:28 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:29.463061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1052068857", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:29.541778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:29.771789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:29.772487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:29.785544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:29.786054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:29.786787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:29.789586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:29.790082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:29.790530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:29.883735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:30.420147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:30.432117 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8938a5b1-3dd2-4472-8311-aa654ad7b73c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.666151 Sep 27 01:37:30.432692 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 821/1679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:29 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:30.449321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-176961d4-62e8-42b5-ad25-2b0f5bdc26c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5fa60d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:30.449879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:30.450431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:30.451037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:30.452082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:30.452594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:30.472888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:30.474499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:30.474950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:30.480883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:30.480883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:30.484014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:30.514544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-176961d4-62e8-42b5-ad25-2b0f5bdc26c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.080572 Sep 27 01:37:30.515453 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 822/1680] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:30 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:30.528348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5791490-cdec-4ce8-813e-cf5194db2306", "name": "network-vif-plugged", "status": "completed", "tag": "bd37dd7b-58f9-4534-8b5f-c590baadaad7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:30.544140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:30.560830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:30.569619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:30.570605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:30.574058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:30.615646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:30.618019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:30.619444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] Creating event network-vif-plugged:bd37dd7b-58f9-4534-8b5f-c590baadaad7 for instance b5791490-cdec-4ce8-813e-cf5194db2306 on n-h2-859358-1 Sep 27 01:37:30.636100 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b8e95cbf-69c8-4788-a521-4883e94847af req-b6011fbe-a742-448d-a6ee-56899f165140 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119151 Sep 27 01:37:30.636720 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 823/1681] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:30.657207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:30.660532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:30.680913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:30.706435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:30.712665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:30.713118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:30.713932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:30.714353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:30.714977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:30.790427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01ab7575-7e83-4dfe-abf9-208ec85201fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439312 Sep 27 01:37:30.791320 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 859/1682] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:30.804194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1cf789a8-cb03-4bc7-915a-1fc61ea13a9d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:30.809831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1cf789a8-cb03-4bc7-915a-1fc61ea13a9d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:30.912981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cf789a8-cb03-4bc7-915a-1fc61ea13a9d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:30.921477 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1cf789a8-cb03-4bc7-915a-1fc61ea13a9d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1215 microversion: 2.1 time: 0.121693 Sep 27 01:37:30.924841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 860/1683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:30 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:31.473122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:31.474794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:31.482950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:31.483781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:31.486398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:31.488139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:31.489786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:31.490999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:31.605066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:31.616270 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d95eed46-ad6f-482b-b460-834f1ab3ca78 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.971836 Sep 27 01:37:31.618589 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 824/1684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:30 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:31.626592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db79c915-8b13-4e9e-b428-3e60603dd840 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5fa6e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:31.727616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db79c915-8b13-4e9e-b428-3e60603dd840 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.107838 Sep 27 01:37:31.728959 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 825/1685] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:31 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:31.769502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-440844698", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:31.822787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:31.943651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] validate_networks() for [('000fc94f-7507-45b3-9ea2-31850bf995b1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:32.698080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:32.714145 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1008aa78-cd58-4d10-9274-6a0010fb78e1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 1.248838 Sep 27 01:37:32.714779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 861/1686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:31 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:32.730067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:32.743070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:32.756553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:32.758234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:32.758702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:32.760421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:32.764052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:32.764719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:32.920626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:32.947619 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8d2da9f0-733e-40b4-bfac-b749ca6036d9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1267 microversion: 2.1 time: 0.224228 Sep 27 01:37:32.972413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 862/1687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:32 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:32.987121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:32.989365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:33.006240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:33.007071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:33.009297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:33.024200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:33.025086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:33.028889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:33.737836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:33.751068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6545b978-ed38-48ec-a010-93234e8cdfa1 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1322 microversion: 2.1 time: 0.775432 Sep 27 01:37:33.767894 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 863/1688] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:32 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:33.773258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f6695bc-c551-48ca-bc37-8db30ff2a0d3 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d622bee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:33.855170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f6695bc-c551-48ca-bc37-8db30ff2a0d3 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.085496 Sep 27 01:37:33.877093 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 864/1689] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:33 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:33.888286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-plugged", "status": "completed", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:33.905673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:33.906891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:33.908194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:33.939312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] Creating event network-vif-plugged:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:37:33.948375 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2be5cc50-d210-4e74-8dac-c9579c1b84cf req-8ddb0156-6a25-4fa1-8727-3d6922290632 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069554 Sep 27 01:37:33.951573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 865/1690] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:33.963559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:33.968015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:33.992908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:33.996628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:33.997429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:33.998605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:34.001454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:34.002225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:34.030932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:34.304563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:34.305583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:34.306387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:34.307155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:34.307763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:34.328029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:34.329085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:34.331976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:34.333000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:34.334507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:34.336249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:34.384236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:34.402216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for user e50d446d60b54188900a6f653787667d and project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:34.455519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:34.474306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:34.596239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80fccc7e-7e3f-438b-9d2f-e62fd69140d4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.832841 Sep 27 01:37:34.599060 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 826/1691] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:34.609483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:34.613823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:34.630046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:34.631104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:34.633022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:34.636417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:34.637160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:34.638473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:34.809908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:34.823981 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8866a47a-ce46-4d3b-85b3-88230823f0db tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.869643 Sep 27 01:37:34.827922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 866/1692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:33 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:34.842903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e57e14b2-f291-4b94-a41f-423ee07c09b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:34.844052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e57e14b2-f291-4b94-a41f-423ee07c09b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:34.953483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e57e14b2-f291-4b94-a41f-423ee07c09b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:34.963211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e57e14b2-f291-4b94-a41f-423ee07c09b6 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1224 microversion: 2.1 time: 0.133917 Sep 27 01:37:34.966195 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 867/1693] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:34 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:34.977622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:34.978438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:35.001608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:35.002563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:35.005243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:35.006371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:35.009094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:35.009943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:35.163345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:35.192036 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c61e3bfd-d3c8-4c9b-aafb-ccfccd685026 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.590713 Sep 27 01:37:35.205398 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 827/1694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:34 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:35.205398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-227f9b82-be3f-4953-83ba-4e383b083f00 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5fc2310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:35.288681 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-227f9b82-be3f-4953-83ba-4e383b083f00 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.091859 Sep 27 01:37:35.289559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 828/1695] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:35 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:35.411451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:35.421588 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-894d71f4-407a-45a7-a172-862c139b6e23 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1472 microversion: 2.1 time: 0.453736 Sep 27 01:37:35.440450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 868/1696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:34 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:35.843949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:35.845950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] [instance: c8cf0a65-5fb9-4784-ba72-4f212646536e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:35.855563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:35.857584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:35.859281 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] HTTP exception thrown: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Request method failure captured: Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/c8cf0a65-5fb9-4784-ba72-4f212646536e/action HTTP/1.1 Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 15 Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPInnqkmjngZvK9XHAMBXdNYPF6KfJtd0W-dZ5qLm1JWIfy6Xk7fc6U0m4ye8IwhWKdUpYam5_HyE03IdXB3j7pUAzMRaiKaDvN2wkqD-3DZTtm9GosppHHIa60xONwsvC20SSZtm49YlwOojAwiLpzLyNpJaXrqdjkYHXTrvbQ8LE Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:37:35.866499 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e8c98bf4133414a8b17feddfee8f87d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 0656f69d8d5c4a5a8228882e4a0c477c Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: {"migrate": {}} Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:37:35.868524 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c8cf0a65-5fb9-4784-ba72-4f212646536e', 'body': {'migrate': {}}} Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:35.870090 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. Sep 27 01:37:35.871786 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:35.874522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Returning 404 to user: Instance c8cf0a65-5fb9-4784-ba72-4f212646536e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:35.875589 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e09e157a-3abb-4393-b7b4-7e8571a3d0db tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/c8cf0a65-5fb9-4784-ba72-4f212646536e/action" status: 404 len: 111 microversion: 2.1 time: 0.427196 Sep 27 01:37:35.890979 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 829/1697] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:35 2022] POST /compute/v2.1/servers/c8cf0a65-5fb9-4784-ba72-4f212646536e/action => generated 111 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:35.896671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:35.906940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:35.908394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:35.911291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:35.913570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:35.915593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:36.045587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:36.046184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:36.067395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:36.068151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:36.068765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:36.069815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:36.070439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:36.071026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:36.341002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:36.363434 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ad638d2-5d7e-402d-a8ff-fc9b8fe9037f tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1228 microversion: 2.1 time: 0.321013 Sep 27 01:37:36.364408 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 830/1698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:36 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1228 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:36.382417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:36.385962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:36.407204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:36.425945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:36.426376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:36.427137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:36.434234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:36.434702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:36.655649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:36.671040 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1facfcb-509e-46f4-a0dd-fd8121495846 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.820385 Sep 27 01:37:36.671624 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 869/1699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:35 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:36.696781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1535675154", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:36.846558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:37.117684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:37.155854 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83f621c9-c17a-40ec-8395-91954b10de7a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.789375 Sep 27 01:37:37.161980 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 831/1700] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:36 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:37.173236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9819911a-3926-45b2-bf83-648a971a1ad7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ec8d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:37.278526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9819911a-3926-45b2-bf83-648a971a1ad7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.114976 Sep 27 01:37:37.287822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 832/1701] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:37 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:37.392810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:37.397309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:37.403687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:37.404273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:37.404808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:37.405525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:37.406189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:37.413575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.414074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.414515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.417869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.418346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.418788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.427778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.430786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.432051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.433286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.435107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.437767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.497727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Getting quotas for project b1c10c2b652d4ca0b0dfbea0905c7fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:37.513432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Getting quotas for user bc091bc870454f15a072c907b630ee9a and project b1c10c2b652d4ca0b0dfbea0905c7fe3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:37.563200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:37.568496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:37.581221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:37.581633 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5488770c-b643-4504-b69a-985b841acc4a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1284 microversion: 2.1 time: 0.192037 Sep 27 01:37:37.582451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 833/1702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:37 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:37.700052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:37.700681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:37.709888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d8c659d-1375-4fd7-a816-824a42de2db0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027257 Sep 27 01:37:37.711841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.712338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.712774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.713516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:37.716801 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 870/1703] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:37.729778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9db52de1-e0fe-4e5f-ac81-86f41c9219ba tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:37.730393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9db52de1-e0fe-4e5f-ac81-86f41c9219ba tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:37.733692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:37.734512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:37.944219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9db52de1-e0fe-4e5f-ac81-86f41c9219ba tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:37.951462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9db52de1-e0fe-4e5f-ac81-86f41c9219ba tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1222 microversion: 2.1 time: 0.233268 Sep 27 01:37:37.965363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 871/1704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:37 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:38.183980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:38.193831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:38.212845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:38.212845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:38.212845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:38.213589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:38.214330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:38.214981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:38.246963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:38.258045 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-065af760-887a-4a3a-bbc9-250a7acec2bc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.561896 Sep 27 01:37:38.258963 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 834/1705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:37 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:38.297676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b694d7f-cc7a-4ea3-84fb-fb9509a16d53 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5f994c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:38.400654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b694d7f-cc7a-4ea3-84fb-fb9509a16d53 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.107314 Sep 27 01:37:38.412284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 835/1706] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:38 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:38.605638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:38.606199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:38.630741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:38.631645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:38.634535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:38.637357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:38.638733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:38.641142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:38.977283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:38.991758 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ed2c177-be22-489c-8237-c0e4dd8d99bb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1282 microversion: 2.1 time: 0.388861 Sep 27 01:37:38.992361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 836/1707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:38 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1282 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:39.005178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:39.010257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:39.034142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:39.038480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:39.043479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:39.044473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:39.045120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:39.046312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:39.159106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:39.173830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad490233-4698-447c-ab7f-81459910e02c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.992997 Sep 27 01:37:39.176236 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 872/1708] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:38 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:39.187370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6c388a-8a85-478e-afe9-7d820f1f2c78", "tag": "303c412c-5640-456a-b77c-cc3e7eefecdc"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:39.205407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:39.213045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:39.218650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:39.218844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5321e257-446c-4533-b2ed-a7acebd77953 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1226 microversion: 2.1 time: 0.224077 Sep 27 01:37:39.222056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:39.231986 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 837/1709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:38 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:39.250925 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] Creating event network-changed:303c412c-5640-456a-b77c-cc3e7eefecdc for instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 on n-h1-859358-1 Sep 27 01:37:39.260963 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-70ba8c09-93eb-4d12-bb54-5439ec86c414 req-c298ee7f-1d20-43fe-ac18-bbe1438328b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082693 Sep 27 01:37:39.262970 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 873/1710] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:39.297178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:39.300866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:39.331231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:39.331728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:39.332164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:39.339434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:39.341134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:39.343025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:39.419958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f82f5bc-6106-4f0f-911a-f82a9ce87939 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d61ea700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:39.525495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f82f5bc-6106-4f0f-911a-f82a9ce87939 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.107904 Sep 27 01:37:39.537660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 874/1711] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:39 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:39.720007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:39.728488 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4532fb7-9d46-4262-9070-1979d71999c6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.444168 Sep 27 01:37:39.733661 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 838/1712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:39 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:40.030283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:40.031046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:40.048553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.051558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.053611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.056941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.057867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.058316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.201982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:40.202915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:40.207435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:40.218320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-254fff29-285c-43c4-814f-2eb9652b7e97 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1282 microversion: 2.1 time: 0.193139 Sep 27 01:37:40.233942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.234219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.239611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.244735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.246067 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 875/1713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:40 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:40.246535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.247353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.257677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:40.262076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:40.270709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.271402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.272968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.273962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.274634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.275067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.468138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:40.489726 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-59018469-035e-45c3-8f74-e574a6aa24d2 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1274 microversion: 2.1 time: 0.230120 Sep 27 01:37:40.493681 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 876/1714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:40 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:40.545906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-546176d8-0c86-4aec-9196-40bd08420478 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d61d6310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:40.556406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:40.569493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bd7a8b4-a219-4902-ab2c-84700a1c6900 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.370697 Sep 27 01:37:40.571299 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 839/1715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:40 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:40.620048 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-546176d8-0c86-4aec-9196-40bd08420478 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.078247 Sep 27 01:37:40.620665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 877/1716] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:40 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:40.755400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:40.756031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:40.767479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.769800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.771336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:40.772256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:40.773723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:40.775233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.070256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:41.083447 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bdf7b88-5988-4103-ba95-cf9576e903f9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.333064 Sep 27 01:37:41.084033 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 840/1717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:40 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:41.249614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:41.252631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:41.259498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:41.261270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.262079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.262703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.263596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.264552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.265290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.520349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:41.521030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:41.528626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.534620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.535316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.536243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.536872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.537536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.700645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:41.716618 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4802408-2936-4917-be1c-7b2706419100 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1280 microversion: 2.1 time: 0.200673 Sep 27 01:37:41.719738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 841/1718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:41 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:41.740205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:41.741996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:41.755841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.756582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.757188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.758102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:41.759760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:41.760377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:41.897239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:41.905698 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5dc38afd-5586-46ce-8d73-a0accdc5ef81 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.661298 Sep 27 01:37:41.917690 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 878/1719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:41 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:41.927542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-72b3747a-5345-4380-8e7f-f8d996c1eece tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d669b430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:42.025365 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-72b3747a-5345-4380-8e7f-f8d996c1eece tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.106502 Sep 27 01:37:42.036949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 879/1720] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:41 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:42.049630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:42.058465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50251ef6-b936-4a17-8d1b-2a975eae1766 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.335892 Sep 27 01:37:42.062467 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 842/1721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:41 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:42.107190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:42.109303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:42.132554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.133128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.137412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.138224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.138691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.139208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.745048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:42.745852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:42.753715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.754487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.755154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.756047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.756668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.757604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.803898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:42.814139 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2478f3fd-0052-40ce-b995-518ebc8243fb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.711589 Sep 27 01:37:42.819950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 880/1722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:42 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:42.928888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:42.929921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:42.944873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.945775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.946465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.947405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:42.948019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:42.948640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:42.971031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:42.981242 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b7f297d-70a1-4155-946c-81100c7f4d0f tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.241896 Sep 27 01:37:42.982277 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 843/1723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:42 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:43.046750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da43ae11-8981-4a43-8a69-a78c4989f2bf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ec9700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:43.144312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da43ae11-8981-4a43-8a69-a78c4989f2bf tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.103821 Sep 27 01:37:43.146054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 844/1724] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:43 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:43.157841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:43.160724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:43.177547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:43.180639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:43.181305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:43.183105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:43.184829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:43.185491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:43.428684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:43.458751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ac5a445-2088-4564-9421-0208579f9b96 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.310904 Sep 27 01:37:43.482427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 845/1725] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:43 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:43.847286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:43.851256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:43.868244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:43.870679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:43.875482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:43.879430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:43.880324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:43.881855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:43.910345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:43.952503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:43.961759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a5adc25-53ee-45ca-bd0e-73e7f2c3a4da tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 1.036978 Sep 27 01:37:43.962348 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 881/1726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:42 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:44.005516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:44.006512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:44.021096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.024504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.025445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.027770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.028503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.029159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.114933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:44.131541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f8c9e07-3de1-4097-972c-ef7181c26f3e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.288254 Sep 27 01:37:44.132813 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 846/1727] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:43 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:44.160814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0eee0a43-c131-4afa-9156-45f4349cf8f6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ef13a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:44.244268 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0eee0a43-c131-4afa-9156-45f4349cf8f6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.088069 Sep 27 01:37:44.246495 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 847/1728] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:44 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:44.388779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:44.397898 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-223bafe0-621a-410f-a98f-dc37eaeae522 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.397165 Sep 27 01:37:44.402114 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 882/1729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:43 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:44.447907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:44.449069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:44.462512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76293ca5-5f28-433d-ac08-5bf509cdc482", "tag": "1d5aeba8-7dba-4fac-8c1c-de20a5299a11"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:44.490843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:44.491604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:44.517958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.529941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.530427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.531194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.532120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.532852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.541215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.541736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.542172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.593617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] Creating event network-changed:1d5aeba8-7dba-4fac-8c1c-de20a5299a11 for instance 76293ca5-5f28-433d-ac08-5bf509cdc482 on n-h1-859358-1 Sep 27 01:37:44.619532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5c768a32-13a4-47dc-b5f2-b5cb52dc3144 req-6f0c64e3-fee0-43d4-b8da-88ef331ae970 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172679 Sep 27 01:37:44.625563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 848/1730] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:44.902116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:44.904403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:44.912769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.913741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.914433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:44.915437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:44.916229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:44.916896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.270887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:45.287068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-275cec18-3ab4-49f7-b146-250b0248894b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.798169 Sep 27 01:37:45.288581 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 883/1731] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:44 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:45.303620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:45.304697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:45.325170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.327402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.327883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.328636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.329693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.330321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.579716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:45.588529 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6db20bc9-b2ce-42e8-be3e-fb3dc61e780e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.296910 Sep 27 01:37:45.589129 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 884/1732] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:45 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:45.609085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:45.609838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:45.623221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.623717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.624152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.626037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.626496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.626929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.901720 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-febbe918-a769-4e42-9f35-6086d1d0f2e6 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1861 microversion: 2.1 time: 1.005436 Sep 27 01:37:45.902314 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 849/1733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:44 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1861 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:45.921313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b66e52bb-29cf-4756-9721-7b19c1e6440e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ec8c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:45.939380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:45.948404 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-878e9602-8d57-4860-9811-6c539458b813 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.343100 Sep 27 01:37:45.949327 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 885/1734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:45 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:45.959229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:45.959840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:45.975089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.975778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.976396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.977535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:45.979295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:45.980418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:45.991705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b66e52bb-29cf-4756-9721-7b19c1e6440e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.088321 Sep 27 01:37:45.999800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 850/1735] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:45 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:45.999800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-859358-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:45.999800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:46.006512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.007004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.007450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:46.008188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.008652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.009088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:46.041844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lazy-loading 'flavor' on Instance uuid b400664e-737e-4b04-9697-ca1eb3fb4250 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:37:46.062126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Going to try to live migrate instance to n-h1-859358-1 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:37:46.272201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:46.282381 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a64a21a-fbcc-4ebf-bd78-ae436ac04fa4 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.331107 Sep 27 01:37:46.282966 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 886/1736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:45 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:46.312039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:46.312948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:46.324474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.331935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.332402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:46.333367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.333634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.334068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:46.877784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:46.890855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71d2ddde-95ab-418a-a9bc-1eadb2e1e96e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.582228 Sep 27 01:37:46.894501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 887/1737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:46 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:46.904421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:46.907686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:46.932714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.935598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.936165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:46.937002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:46.937711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:46.940843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:47.325186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:47.344105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26eeacc2-29f0-494e-8e43-98776f428fc4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.447991 Sep 27 01:37:47.344753 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 888/1738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:46 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:47.474739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:47.623146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28646fc1-df17-4ffb-86a9-714ac9860ff8", "tag": "a3bfdc2e-c817-48ab-a3aa-fc1f40140e61"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:47.636397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:47.637235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:47.638713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:47.658932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:47.663084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] Creating event network-changed:a3bfdc2e-c817-48ab-a3aa-fc1f40140e61 for instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 on n-h2-859358-1 Sep 27 01:37:47.670349 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-23efd9f8-2375-4e11-a012-5bcfe5e3b48c req-9c1dd8db-7d14-46db-a255-d18290075a4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324215 Sep 27 01:37:47.671878 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 889/1739] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:47.680936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c388a-8a85-478e-afe9-7d820f1f2c78", "name": "network-vif-plugged", "status": "completed", "tag": "303c412c-5640-456a-b77c-cc3e7eefecdc"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:47.697786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:47.699424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:47.699992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:47.718968 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] Creating event network-vif-plugged:303c412c-5640-456a-b77c-cc3e7eefecdc for instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 on n-h1-859358-1 Sep 27 01:37:47.732909 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7edb1355-ca10-4e11-bc71-6875ce48b397 req-8b77ce9f-f985-4581-8fea-3e0a35cc727c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057057 Sep 27 01:37:47.737241 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 890/1740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:47.770541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:47.776241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:47.802777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:47.806426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:47.807219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:47.808187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:47.808830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:47.809514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:47.953526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=18 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:48.123751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:48.140825 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6edd3cbf-ec26-4bfb-9065-b2d32b339fa9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.402183 Sep 27 01:37:48.142263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 891/1741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:47 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:48.147291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b264955-49f5-4d0a-a353-2f6cb3c89d20 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d61ea1f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:48.210190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b264955-49f5-4d0a-a353-2f6cb3c89d20 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.066644 Sep 27 01:37:48.211522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 892/1742] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:48 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:48.219722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:48.220647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:48.230508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.231292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.233031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:48.233996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.235667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.236365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:48.453658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:48.490574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-517789ec-307f-47d0-92e0-f7cade3e5ad8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.270719 Sep 27 01:37:48.491775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 893/1743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:48 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:48.499082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:48.499903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:48.509390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.510768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.511420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:48.512893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.514060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.514685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:48.841070 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c2944fc-af8a-428c-9e95-269289b36f61 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/action" status: 202 len: 0 microversion: 2.1 time: 2.847342 Sep 27 01:37:48.846742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 851/1744] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:45 2022] POST /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/action => generated 0 bytes in 2854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:37:48.851843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:48.852880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:48.868844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.869633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.870674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:48.874288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:48.883672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:48.884387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.065892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:49.075931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-78a373ce-dfbd-4eb8-921e-5aa5d56e9d0c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1315 microversion: 2.1 time: 0.582646 Sep 27 01:37:49.098563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 894/1745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:48 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:49.109569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:49.111120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:49.118600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.119381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.120015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.120890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.121546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.122167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.165753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:49.178215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f70d1c6-25a5-4307-bdfb-d034306551fa tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.329984 Sep 27 01:37:49.179116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 852/1746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:48 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:49.189648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:49.191470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:49.215584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.221504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.222261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.223375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.225034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.226122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.552722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:49.562427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f4ff859-44c0-46e0-9bb9-2fe3857f8a9e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.381116 Sep 27 01:37:49.583017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 853/1747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:49 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:49.596322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff5d5533-d287-4d25-a744-695db26dc4f2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5f07e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:49.603636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:49.618292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aa2f8c8b-32c7-4064-bd80-5de59fb52793 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.518319 Sep 27 01:37:49.658299 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 895/1748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:49 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:49.670165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:49.672282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:49.695363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.697525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.698706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.700033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:49.701190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:49.701815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:49.715071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff5d5533-d287-4d25-a744-695db26dc4f2 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.130459 Sep 27 01:37:49.717186 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 854/1749] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:49 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:50.114938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.116251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.131587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.132895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.133581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.135570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.136220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.136834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.249572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:50.263440 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6046b8ec-e2f3-45ac-90be-e9349956a8d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.602124 Sep 27 01:37:50.277892 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 896/1750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:49 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:50.286466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.287353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.295743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.296519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.297136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.298539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.299257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.299883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.360591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:50.368759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27f595a6-12fc-47a0-b839-7d53bbcb10e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1502 microversion: 2.1 time: 0.259597 Sep 27 01:37:50.371006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 855/1751] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:50 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:50.395039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.396096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.405241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.409321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.409921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.411119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.411758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.412430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.465877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:37:50.606219 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0ee4c89-da1d-4649-a773-7bb2f6e19422 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 204 len: 0 microversion: 2.1 time: 0.215252 Sep 27 01:37:50.607920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 856/1752] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:37:50 2022] DELETE /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:37:50.638392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.639629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.647227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.648626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.650298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.651362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.651978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.652565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.767498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:50.782367 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e90e80b0-0170-4c62-b49f-6b0bd4b3e2cc tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.502168 Sep 27 01:37:50.782964 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 897/1753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:50 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:50.788617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76293ca5-5f28-433d-ac08-5bf509cdc482", "name": "network-vif-plugged", "status": "completed", "tag": "1d5aeba8-7dba-4fac-8c1c-de20a5299a11"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:50.818580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.820514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.820954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.842852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] Creating event network-vif-plugged:1d5aeba8-7dba-4fac-8c1c-de20a5299a11 for instance 76293ca5-5f28-433d-ac08-5bf509cdc482 on n-h1-859358-1 Sep 27 01:37:50.860625 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-48ea89a4-adaa-4567-af16-f6898a58df45 req-e8e9c6bd-7613-4dab-88f2-55398b68cca9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075846 Sep 27 01:37:50.864204 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 898/1754] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:50.874726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.879300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.893153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.893371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.902178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.909271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.910016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.910822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.922242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:50.949720 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bae18778-567e-4ca2-9ad4-ed2ac2555df1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.313763 Sep 27 01:37:50.950502 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 857/1755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:50 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:50.979737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:50.980667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:50.988355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.989206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.989957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:50.990898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:50.991611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:50.992257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:51.342645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:51.351580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-324b86fd-00cd-4dd4-8243-89c87fc77ed2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1508 microversion: 2.1 time: 0.486117 Sep 27 01:37:51.354786 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 899/1756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:50 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:51.365510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:51.376627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-065c7db3-2930-4665-89ca-e6fa99d00c44 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.414202 Sep 27 01:37:51.376627 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 858/1757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:50 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:51.379452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0891201a-2e76-4138-bea6-627a90ed7bdb tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d6139d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:51.380865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:51.381511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:51.388116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:51.388597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:51.389226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:51.390145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:51.390750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:51.391891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:51.498552 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0891201a-2e76-4138-bea6-627a90ed7bdb tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.129766 Sep 27 01:37:51.499426 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 900/1758] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:51 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:51.808396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:51.809065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:51.827102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:51.827622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:51.828068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:51.828861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:51.841438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:51.842195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:51.927455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:51.942509 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38e2d176-f9e1-48cd-ab66-cb261a0de2d8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.565160 Sep 27 01:37:51.956970 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 859/1759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:51 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:51.995985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:51.996607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:52.039404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.047882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.047882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.047882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.051046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.053959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.535520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:52.543692 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a64f632-23bb-4bdd-9986-ff49e081bd90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1324 microversion: 2.1 time: 0.739347 Sep 27 01:37:52.561834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 901/1760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:51 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1324 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:37:52.572753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:52.574028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:52.590396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.594766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.595477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.596507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.597137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.599786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.908360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:52.916707 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b23c91b-ba16-417b-b2aa-a8bb56c30d68 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1508 microversion: 2.1 time: 0.351613 Sep 27 01:37:52.929617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 902/1761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:52 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:52.929617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:52.929617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:52.943372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.943885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.944333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.945073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:52.945589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:52.946027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:52.993938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:53.002503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4373d4d6-7e5c-46c2-9ba0-7432bf5d1c93 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 1.027352 Sep 27 01:37:53.011315 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 860/1762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:51 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:53.016925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4281328e-a477-49ff-a81e-1cbbafe417d6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5e860d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:53.115827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4281328e-a477-49ff-a81e-1cbbafe417d6 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.103341 Sep 27 01:37:53.116622 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 861/1763] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:53 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:53.128365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:53.128986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:53.147695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:53.148180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:53.153647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:53.154597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:53.157881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:53.159202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:53.238501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:53.265192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1edfdbc9-3148-4ef2-b12f-5345af94c77a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.346786 Sep 27 01:37:53.268072 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 903/1764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:52 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:53.380164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-250643586", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8c88e62c-74c5-4ff9-a7df-3a1b273be5ea"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:53.498018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] validate_networks() for [('8c88e62c-74c5-4ff9-a7df-3a1b273be5ea', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:53.511776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:53.519751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-417d94f9-e240-43ad-9d5d-21fdaeef7067 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.402251 Sep 27 01:37:53.537885 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 862/1765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:53 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:53.568528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:53.569416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:53.581820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:53.582663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:53.584459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:53.585545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:53.588396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:53.589115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:53.999643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:54.017840 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db38fe89-b485-42d2-9841-b5e7c5ec4643 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1521 microversion: 2.1 time: 0.453197 Sep 27 01:37:54.020519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 863/1766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:53 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:54.038074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:54.045420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:54.101083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.101637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.102079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.102907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.103357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.103780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.119953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:54.307756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:54.308329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:54.308600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:54.310309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:54.310753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:54.320010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:54.327228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.329493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.329946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.330692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.331151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.331625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.352554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49e6b801-12dc-4023-a784-1f146118953f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 200 len: 1466 microversion: 2.1 time: 0.323258 Sep 27 01:37:54.371575 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 864/1767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:54 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:54.379462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:54.380395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:54.389685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.392578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.393027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.394925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.398080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.399147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.424664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:54.431901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for user 72f64b5a7b76437c9f31cf277c601aa3 and project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:54.450632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:54.454155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:54.619166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5876866d-b812-44a0-8c96-c68daeda4efe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349363 Sep 27 01:37:54.631175 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 904/1768] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:54.681743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:54.682373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:54.707187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.711706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:54.723880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.727375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.728911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-57c3a4cd-cc25-48c0-974a-c385e235d1d3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.352121 Sep 27 01:37:54.729642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 865/1769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:54 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:54.731820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.732305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.732743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.748319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1d1b23a-43c8-4155-8619-ed70702f7cd7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5e86d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:54.842981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1d1b23a-43c8-4155-8619-ed70702f7cd7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1428 microversion: 2.1 time: 0.106787 Sep 27 01:37:54.843694 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 866/1770] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:54 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:54.874393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:54.875025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:54.900535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.901283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.903540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:54.904495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:54.908963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:54.909714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.098307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:55.112733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-484e506c-255e-4a9e-8b7e-e18a729b1c2e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1521 microversion: 2.1 time: 0.478621 Sep 27 01:37:55.113591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 905/1771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:54 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:55.129799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6c388a-8a85-478e-afe9-7d820f1f2c78", "name": "network-vif-deleted", "tag": "303c412c-5640-456a-b77c-cc3e7eefecdc"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:55.160546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.161882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.163037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.189203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:55.196213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] Creating event network-vif-deleted:303c412c-5640-456a-b77c-cc3e7eefecdc for instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 on n-h1-859358-1 Sep 27 01:37:55.197862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d63d8a22-23ca-4b73-9f57-65771bee7f8c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.352788 Sep 27 01:37:55.198447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 867/1772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:54 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:55.204521 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4c545011-a5fe-4c9e-8c6f-106f63404986 req-0c101b1d-930b-4fab-8538-58d37c62a857 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089167 Sep 27 01:37:55.206302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 906/1773] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:55.209958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:55.210684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.217608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d3ebe79-e994-4831-9083-e2cb286c98b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:55.219719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d3ebe79-e994-4831-9083-e2cb286c98b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.233660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.235237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.236361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.238134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.239679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.241062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.283242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3d3ebe79-e994-4831-9083-e2cb286c98b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:55.294205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d3ebe79-e994-4831-9083-e2cb286c98b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1207 microversion: 2.1 time: 0.086137 Sep 27 01:37:55.295589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 907/1774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:55 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1207 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:55.322305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1506215022"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:55.326051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.336106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.337139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.337816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.338914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.339572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.340175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.455764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:55.466834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74c1307c-a810-4a71-b0d8-d6e7ee46ca6d tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.266985 Sep 27 01:37:55.477943 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 868/1775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:55 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:55.494002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28646fc1-df17-4ffb-86a9-714ac9860ff8", "name": "network-vif-plugged", "status": "completed", "tag": "a3bfdc2e-c817-48ab-a3aa-fc1f40140e61"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:55.509079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.509682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.510182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.526222 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] Creating event network-vif-plugged:a3bfdc2e-c817-48ab-a3aa-fc1f40140e61 for instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 on n-h2-859358-1 Sep 27 01:37:55.533607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2a06ee0f-8b69-4139-aab4-7a41c4b9f122 req-d3c28cb2-36eb-489e-8226-bb67864e8b08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054260 Sep 27 01:37:55.534320 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 869/1776] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:37:55.541023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:55.542325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.551913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.552680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.553398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.555170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.555972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.557041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.803781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:37:55.820379 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9536d66-9dc0-4c42-9d1b-23d5158729de tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 2346 microversion: 2.25 time: 0.284524 Sep 27 01:37:55.821562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 870/1777] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:37:55 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 2346 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:37:55.826500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:55.827332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.829645 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f769da04-275f-473d-b374-957efe13b6c4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482/action" status: 202 len: 0 microversion: 2.1 time: 0.528501 Sep 27 01:37:55.830510 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 908/1778] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:37:55 2022] POST /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:37:55.842942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.843906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.844545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.845470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.847573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.848375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.852726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:55.855928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:55.869932 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 HTTP/1.1 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:37:55.872653 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:37:55.874534 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7d6c388a-8a85-478e-afe9-7d820f1f2c78'} Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:55.876100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:37:55.877835 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:37:55.879919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.879919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.879919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.883479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:55.884741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:55.885209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:55.895083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:55.896192 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15c6d5e3-aef7-45cd-af65-2cf1b095d7bb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 404 len: 111 microversion: 2.1 time: 0.073448 Sep 27 01:37:55.897411 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 871/1779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:55 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:37:55.911452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dddb7659-f54a-45eb-9ad7-c99c711bff26 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24d5ef13a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.167209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dddb7659-f54a-45eb-9ad7-c99c711bff26 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a" status: 204 len: 0 microversion: 2.1 time: 0.267961 Sep 27 01:37:56.171295 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 872/1780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:55 2022] DELETE /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:37:56.176516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.180177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.180410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:56.180659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.181092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:56.191484 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f6ff64e-efc7-430c-bbcd-38d5f059fd9f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.359540 Sep 27 01:37:56.192384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.192922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.193310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:56.206242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 909/1781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:55 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:56.213129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e2cb6f3c-07a8-4f9b-b80d-d648cdaa1a5e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d669b310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.233535 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb8db7b2-3464-4a00-b964-d8172747034d tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.061067 Sep 27 01:37:56.242139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 873/1782] 10.222.0.52 () {60 vars in 1217 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:37:56.248011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-852376645", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:37:56.282778 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e2cb6f3c-07a8-4f9b-b80d-d648cdaa1a5e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1437 microversion: 2.1 time: 0.075375 Sep 27 01:37:56.284107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 910/1783] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:56.288311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:56.304596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e072bd58-9df3-42fc-af37-d78e60b9f53b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24d630b790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.358620 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e072bd58-9df3-42fc-af37-d78e60b9f53b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Image not found. Sep 27 01:37:56.362926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e072bd58-9df3-42fc-af37-d78e60b9f53b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a HTTP/1.1 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:37:56.363999 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '37744633-6015-4cc4-a0a7-b7ddac6aa20a'} Sep 27 01:37:56.365765 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:37:56.366838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37744633-6015-4cc4-a0a7-b7ddac6aa20a Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:37:56.368410 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37744633-6015-4cc4-a0a7-b7ddac6aa20a could not be found. Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:37:56.370002 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:37:56.371486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e072bd58-9df3-42fc-af37-d78e60b9f53b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:37:56.373330 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e072bd58-9df3-42fc-af37-d78e60b9f53b tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a" status: 404 len: 62 microversion: 2.1 time: 0.086127 Sep 27 01:37:56.382191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 911/1784] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:37:56.384775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.390740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:56.406682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.408117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.411102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:56.412866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.414783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.415498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:56.746756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:56.750653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:37:56.763883 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d0bfe53-4e1e-4a2a-9544-f056ef4d9c02 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.381601 Sep 27 01:37:56.786108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 912/1785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:56.792775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90a19a7f-297e-4991-a5f7-223a9f2c29ae tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d64fa430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.862209 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90a19a7f-297e-4991-a5f7-223a9f2c29ae tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 200 len: 1437 microversion: 2.1 time: 0.074801 Sep 27 01:37:56.862870 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 913/1786] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:56.868937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:56.869594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:56.883056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.883562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.884003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:56.884726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:56.885171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:56.886012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.035905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:37:57.036425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:37:57.036983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:37:57.037488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:37:57.039616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:37:57.050634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.051377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.052093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.053290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.053511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.053907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.057748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:57.066390 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04a04a5b-96f8-4a8d-b34b-daa5500dddd7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1259 microversion: 2.1 time: 0.202431 Sep 27 01:37:57.081427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 914/1787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:56 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:57.081427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:57.081427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:57.092963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:37:57.103290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:37:57.107298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.114024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.114929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.115725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.116314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.116680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.127066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:37:57.130194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:37:57.312976 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-641c5fa2-3e32-43ff-85c3-e2a345cfa91b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069701 Sep 27 01:37:57.329798 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 874/1788] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:37:57.348064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:57.348698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:57.387665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.388183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.388626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.389367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.389875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.390304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.559636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:57.568617 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7126880-993b-42e3-a152-bbc5c9a66f38 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1539 microversion: 2.1 time: 0.497733 Sep 27 01:37:57.582171 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 915/1789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:57 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1539 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:57.591540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:57.592488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:57.599869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.600363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.600801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.601560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.602694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.603131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.811088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:57.820976 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-053e050a-8d39-413a-a45b-481b1402f9ac tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1467 microversion: 2.1 time: 0.237395 Sep 27 01:37:57.836999 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 916/1790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:57 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1467 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:57.851854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:57.855097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:57.855799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:57.863102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.864042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.864682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.865617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:57.866263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:57.866910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:57.872316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f621344b-6de5-4c7d-9d77-31c763c5608a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1322 microversion: 2.1 time: 0.540107 Sep 27 01:37:57.880660 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 875/1791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:57 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:57.896014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d66617cd-d9b2-4da5-a6d4-a10a41de100e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:57.896916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d66617cd-d9b2-4da5-a6d4-a10a41de100e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:58.195417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:58.208433 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eaeba908-bb43-417e-8476-75a4e0d5484f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.367624 Sep 27 01:37:58.209414 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 917/1792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:57 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:58.218232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:58.222925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:58.237802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.240327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.243114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:58.244201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.247223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.247975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:58.329696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d66617cd-d9b2-4da5-a6d4-a10a41de100e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:58.351185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d66617cd-d9b2-4da5-a6d4-a10a41de100e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1214 microversion: 2.1 time: 0.469101 Sep 27 01:37:58.357873 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 876/1793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:57 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1214 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:58.372107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f36010f-60e8-484b-b069-b0386a5d6d14 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d5ea5ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:58.643339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:58.652036 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1cddc9eb-1d8e-4037-9f13-aba53a87f8fe tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.439486 Sep 27 01:37:58.675524 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 918/1794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:58 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:58.694510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:58.695172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:58.710027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.711238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.711694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:58.712427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.712890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.713482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:58.940661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:58.954423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9289f89a-b8fa-49a1-bf1b-3086faad1928 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1265 microversion: 2.1 time: 0.275958 Sep 27 01:37:58.957589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 919/1795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:58 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:58.972948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:58.973821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:58.988044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.988533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.989317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:58.992811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:58.993666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:58.994118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.448828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:59.462344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91af0173-4e57-4463-a7cd-44fb0ea55677 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1534 microversion: 2.1 time: 0.502731 Sep 27 01:37:59.464099 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 920/1796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:58 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1534 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:59.480772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:59.483455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:59.498899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.499452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.500614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.502969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.505065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.506938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.567694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f36010f-60e8-484b-b069-b0386a5d6d14 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "DELETE /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c" status: 204 len: 0 microversion: 2.1 time: 1.207005 Sep 27 01:37:59.569181 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 877/1797] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:58 2022] DELETE /compute/v2.1/images/c123e558-609c-4fc8-ae93-1e3eddaf768c => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:37:59.576185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:59.576998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:59.591962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.592632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.599539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.600559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.601200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.601817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.877312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:37:59.903451 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63c756ef-89d5-4379-bf35-6038a2f77b73 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1471 microversion: 2.1 time: 0.436882 Sep 27 01:37:59.913286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 921/1798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:59 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:37:59.922534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:37:59.924281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:37:59.938231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.939098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.939788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:37:59.942011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:37:59.944838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:37:59.945660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:00.134010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:00.146470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b3b4579-3008-46a7-b148-48f6b13081e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1284 microversion: 2.1 time: 0.231763 Sep 27 01:38:00.148278 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 922/1799] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:59 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:00.168042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13e20a59-461e-47d1-9545-c08d939523c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '.version_select at 0x7f24d611c0d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:00.182529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:00.199857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14704118-7445-427a-b47b-67e9c2f6f506 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1542 microversion: 2.1 time: 0.628792 Sep 27 01:38:00.213944 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 878/1800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:37:59 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1542 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:00.233063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9040416c-e51a-4144-aee3-fe2589ed0b27", "device": "/dev/xvdb"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:00.235762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:00.243890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-13e20a59-461e-47d1-9545-c08d939523c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] HTTP exception thrown: Image not found. Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13e20a59-461e-47d1-9545-c08d939523c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Request method failure captured: Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 HTTP/1.1 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOlJG7d8Fb9QOKDyaK-6I-x7VgwrpoP1tLOTlTJBETGLAwprPXd_djC4A-VrHWRsgsRIMlq8EmocAwnbQsX5mGS4V-aXdWn4p_bB3DoUXWuz7oaBFrol3u3nRuUjRP7HRoNo3rpBebGGR91jBnsmn58XL9zSi9XuQZ0QWWS1QjzXBk Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:00.248866 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/759424e147c64aa6a741c7b540198227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_759424e147c64aa6a741c7b540198227", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 93fd46cbb43d4f82876c64f17b03f310 Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '60fb6598-d4d6-4172-8dba-0cfffcb843c6'} Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:00.250700 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60fb6598-d4d6-4172-8dba-0cfffcb843c6 to delete Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.251790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60fb6598-d4d6-4172-8dba-0cfffcb843c6 could not be found. Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:00.253212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:38:00.254838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:00.256044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13e20a59-461e-47d1-9545-c08d939523c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:00.257201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:00.257201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:00.257888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13e20a59-461e-47d1-9545-c08d939523c0 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "DELETE /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6" status: 404 len: 62 microversion: 2.1 time: 0.107690 Sep 27 01:38:00.258961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 923/1801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:00 2022] DELETE /compute/v2.1/images/60fb6598-d4d6-4172-8dba-0cfffcb843c6 => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:38:00.268630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:00.269599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:00.274010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:00.276064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:00.278356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:00.278924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:00.296866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:00.297609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:00.300702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:00.301830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:00.302410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:00.303236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:00.954924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:00.969737 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47638c03-c8ea-4c49-bdb9-1482b763ef93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.708907 Sep 27 01:38:00.970302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 924/1802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:00 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:00.982256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:00.982790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.005959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.006451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.006882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.007588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.008599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.009025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.061152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lazy-loading 'flavor' on Instance uuid 28646fc1-df17-4ffb-86a9-714ac9860ff8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:01.186239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c566ef7-9083-44be-b0eb-679386dfa442 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.970809 Sep 27 01:38:01.187227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 879/1803] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Sep 27 01:38:00 2022] POST /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:38:01.198038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:01.198961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.213919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.214543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.214865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.219817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.220599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.223442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.237842 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f605eda-0b4c-4f4a-8ef6-4ad8d3de19a1 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.261161 Sep 27 01:38:01.242093 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 925/1804] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:00 2022] POST /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:01.265093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:01.265758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.282558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.283064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.283501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.284222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.284676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.285149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.365616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:01.512738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:01.539855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e75afa0a-3d9e-4873-b49a-41ba9e2ec68a tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 204 len: 0 microversion: 2.1 time: 0.298867 Sep 27 01:38:01.545200 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 926/1805] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:01 2022] DELETE /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:01.553858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:01.554912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.563824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.565158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.565923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.567009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.567795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.568468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.759068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:01.770126 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf1bd027-f7ab-4bc5-b031-75acfe68b169 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.578663 Sep 27 01:38:01.772115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:01.784465 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a6d1613-1101-42e1-ba5e-6c8cf50a735d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1521 microversion: 2.1 time: 0.237613 Sep 27 01:38:01.785767 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 880/1806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:01 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:01.787177 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 927/1807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:01 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:01.794816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-unplugged", "status": "completed", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:01.797611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a652fc4e-ca56-44d1-a87b-0d683253f9e4", "tag": "ed39f3f2-6f56-49e8-8521-1a25e45dbfd3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:01.822112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.822650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.822795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.823178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.823607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.824741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.833364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:01.841900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] Creating event network-vif-unplugged:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:38:01.851488 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dd63a810-12ee-4f43-b290-5785bd248bff req-8b3b847e-22ab-4aa3-849d-918d8ebc6af9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064364 Sep 27 01:38:01.856200 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] Creating event network-changed:ed39f3f2-6f56-49e8-8521-1a25e45dbfd3 for instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 on n-h1-859358-1 Sep 27 01:38:01.856498 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 881/1808] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:01.863317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:01.864022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.884429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9bffd7a5-5dbd-479e-a5e7-c9a8ffeb6230 req-5a493723-9859-4108-b97f-62be2b7aaaaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095803 Sep 27 01:38:01.885776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.886248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.886680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.887047 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 928/1809] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:01.890307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.891386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.892611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.921710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:01.923983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:01.931995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.932759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.933407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:01.934307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:01.934939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:01.935537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.159758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:02.170857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30a7dc83-de75-46c8-b637-4d8f2a0d8399 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.310575 Sep 27 01:38:02.171546 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 882/1810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:01 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:02.181582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.181582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.195435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.196092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.196348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.197077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.197598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.198024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.212959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:02.221538 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f77d04f-4bf1-4954-bcfe-6ba5aef2f685 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1541 microversion: 2.1 time: 0.332093 Sep 27 01:38:02.222749 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 929/1811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:01 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1541 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:02.229376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.230366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.237743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.238404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.238945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.239767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.240335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.240870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.533371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:02.549295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5436b46a-76ff-44b8-a45f-d61de9771c28 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1473 microversion: 2.1 time: 0.325251 Sep 27 01:38:02.549938 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 930/1812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:02 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:02.562370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.562883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.580111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.580614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.585264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.586135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.586559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.586994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.653608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:02.724717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-394306e0-2617-41bd-83f2-e165f0337db8 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1630 microversion: 2.1 time: 0.548060 Sep 27 01:38:02.737376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 883/1813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:02 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1630 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:02.737376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.737376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.762473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.763450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.764605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.765637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.766319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.766813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.819332 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67b229bc-6e76-41cb-807a-367699975050 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 204 len: 0 microversion: 2.1 time: 0.268020 Sep 27 01:38:02.820281 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 931/1814] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:02 2022] DELETE /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:02.825701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.826647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.833527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.834248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.834897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.835801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.836418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.837009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.934478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:02.944230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28c8d644-1edc-4eb4-a6db-fb44b441ee92 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.216388 Sep 27 01:38:02.945425 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 884/1815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:02 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:02.950855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:02.951744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:02.960808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.961644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.962260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:02.963203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:02.963651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:02.964111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.036915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:03.057438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-400f7d05-9b5d-41fe-a61f-308ce4f39530 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.234540 Sep 27 01:38:03.060222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 932/1816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:02 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.139207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:03.148993 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90da6bf4-5a06-410d-b9b6-e362e0eda74a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1527 microversion: 2.1 time: 0.202459 Sep 27 01:38:03.149893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 885/1817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:02 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.200490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:03.201200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:03.207979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.208641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.209244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.209968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.211043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.211474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.248797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:03.250418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:03.256681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.257502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.258077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.258833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.259348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.259837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.276250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:03.414377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:03.422715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39223fc2-056c-46a3-8d36-90a1c0ff59c0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1473 microversion: 2.1 time: 0.178097 Sep 27 01:38:03.447040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 886/1818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:03 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1473 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.451685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:03.466182 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b4b5c783-7b27-4eed-a1e2-09ff93187af6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.269387 Sep 27 01:38:03.479552 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 933/1819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:03 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.573769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:03.574808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:03.581748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.582548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.583203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.584128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.584654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.585147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.732740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:03.742203 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75e805f2-099e-4457-86b0-e1245967bed7 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1473 microversion: 2.1 time: 0.172052 Sep 27 01:38:03.743184 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 887/1820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:03 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.749521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:03.751451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:03.759241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.760004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.760644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.761583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.762258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.763206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.868728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76293ca5-5f28-433d-ac08-5bf509cdc482", "name": "network-vif-plugged", "status": "completed", "tag": "1d5aeba8-7dba-4fac-8c1c-de20a5299a11"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:03.878828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.879302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.879925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.891256 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] Creating event network-vif-plugged:1d5aeba8-7dba-4fac-8c1c-de20a5299a11 for instance 76293ca5-5f28-433d-ac08-5bf509cdc482 on n-h1-859358-1 Sep 27 01:38:03.896334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bd381a0b-e064-4203-8664-710cb6dfc5ce req-7d502a62-c4db-46d3-83ad-0d8166bbf304 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 Sep 27 01:38:03.897242 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 888/1821] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:03.969062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:03.969794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:03.969988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc8499c1-cba1-4c98-a284-798badd3c175 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1613 microversion: 2.1 time: 0.223675 Sep 27 01:38:03.971129 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 934/1822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:03 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1613 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:03.979172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.979926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.980566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.981772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:03.982458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:03.983104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:03.991553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe47e343-1940-4339-b89c-6eba11c9670a", "tag": "a9f92cf6-0095-4ac6-8280-c566710efc2a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:04.013622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.014210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.014900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.027185 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] Creating event network-changed:a9f92cf6-0095-4ac6-8280-c566710efc2a for instance fe47e343-1940-4339-b89c-6eba11c9670a on n-h1-859358-1 Sep 27 01:38:04.092008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-06e60f65-bea7-44e2-b69a-50b6a0412a03 req-7266d443-0a81-416c-8328-dd3ae01c9dd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093956 Sep 27 01:38:04.093075 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 935/1823] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:04.099160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:04.099944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.115616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.116260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.116805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.117702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.118257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.118766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.201355 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] HTTP exception thrown: Cannot 'migrate' instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 while it is in vm_state suspended Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Request method failure captured: Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8/action HTTP/1.1 Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPInnqkmjngZvK9XHAMBXdNYPF6KfJtd0W-dZ5qLm1JWIfy6Xk7fc6U0m4ye8IwhWKdUpYam5_HyE03IdXB3j7pUAzMRaiKaDvN2wkqD-3DZTtm9GosppHHIa60xONwsvC20SSZtm49YlwOojAwiLpzLyNpJaXrqdjkYHXTrvbQ8LE Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:38:04.203574 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e8c98bf4133414a8b17feddfee8f87d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 0656f69d8d5c4a5a8228882e4a0c477c Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: {"migrate": {}} Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:04.205458 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'migrate' instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 while it is in vm_state suspended Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '28646fc1-df17-4ffb-86a9-714ac9860ff8', 'body': {'migrate': {}}} Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 in vm_state suspended. Cannot resize while the instance is in this state. Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.206812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 while it is in vm_state suspended Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.208664 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 while it is in vm_state suspended Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Returning 409 to user: Cannot 'migrate' instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 while it is in vm_state suspended {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-532afa33-71f2-43e0-be9e-34a4408bc671 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8/action" status: 409 len: 148 microversion: 2.1 time: 0.110732 Sep 27 01:38:04.210094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 936/1824] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:04 2022] POST /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8/action => generated 148 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:38:04.210753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.214504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.215123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.221700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.222178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.222612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.223316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.223645 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-353c7226-b4dc-495f-b503-8a431f6926db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.258895 Sep 27 01:38:04.223770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.224193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.224746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 889/1825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:03 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:04.238705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.242011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.258005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.258662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.258926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.259640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.260102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.260533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.355474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:04.385855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.394816 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a84d2761-ecc8-4426-8251-05e2f11ac5b3 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.187838 Sep 27 01:38:04.399496 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 937/1826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:04.400624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b2ad48c-dc25-4802-a618-d8b0c77e67e3 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b2ad48c-dc25-4802-a618-d8b0c77e67e3 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Request method failure captured: Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action HTTP/1.1 Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 39 Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPInnqkmjngZvK9XHAMBXdNYPF6KfJtd0W-dZ5qLm1JWIfy6Xk7fc6U0m4ye8IwhWKdUpYam5_HyE03IdXB3j7pUAzMRaiKaDvN2wkqD-3DZTtm9GosppHHIa60xONwsvC20SSZtm49YlwOojAwiLpzLyNpJaXrqdjkYHXTrvbQ8LE Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:38:04.406540 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e8c98bf4133414a8b17feddfee8f87d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 0656f69d8d5c4a5a8228882e4a0c477c Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: {"os-resetState": {"state": "invalid"}} Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:04.408323 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b5791490-cdec-4ce8-813e-cf5194db2306', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'invalid' Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:04.409459 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 27 01:38:04.411285 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.413806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.413937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b2ad48c-dc25-4802-a618-d8b0c77e67e3 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:04.414609 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b2ad48c-dc25-4802-a618-d8b0c77e67e3 tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action" status: 400 len: 144 microversion: 2.1 time: 0.017920 Sep 27 01:38:04.415867 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 938/1827] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:04 2022] POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:38:04.418694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26a243a1-48bd-48cc-9c7c-0d1107e9ccb2 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1527 microversion: 2.1 time: 0.188137 Sep 27 01:38:04.424507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f9835c9-9c52-4c65-ae2d-6bd9c7a3fb2e tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:04.424746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 890/1828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f9835c9-9c52-4c65-ae2d-6bd9c7a3fb2e tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Request method failure captured: Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action HTTP/1.1 Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 31 Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPInnqkmjngZvK9XHAMBXdNYPF6KfJtd0W-dZ5qLm1JWIfy6Xk7fc6U0m4ye8IwhWKdUpYam5_HyE03IdXB3j7pUAzMRaiKaDvN2wkqD-3DZTtm9GosppHHIa60xONwsvC20SSZtm49YlwOojAwiLpzLyNpJaXrqdjkYHXTrvbQ8LE Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:38:04.428413 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e8c98bf4133414a8b17feddfee8f87d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 0656f69d8d5c4a5a8228882e4a0c477c Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: {"os-resetState": {"state": 1}} Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:04.430081 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b5791490-cdec-4ce8-813e-cf5194db2306', 'body': {'os-resetState': {'state': 1}}} Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 1 Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:04.435110 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 27 01:38:04.436728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.438482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f9835c9-9c52-4c65-ae2d-6bd9c7a3fb2e tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:04.438482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f9835c9-9c52-4c65-ae2d-6bd9c7a3fb2e tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action" status: 400 len: 120 microversion: 2.1 time: 0.009481 Sep 27 01:38:04.438482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 939/1829] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:04 2022] POST /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:38:04.442225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:04.444479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Failed to fetch instance by id 999 {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:38:04.445003 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 27 01:38:04.447283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.447902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Request method failure captured: Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 37 Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPInnqkmjngZvK9XHAMBXdNYPF6KfJtd0W-dZ5qLm1JWIfy6Xk7fc6U0m4ye8IwhWKdUpYam5_HyE03IdXB3j7pUAzMRaiKaDvN2wkqD-3DZTtm9GosppHHIa60xONwsvC20SSZtm49YlwOojAwiLpzLyNpJaXrqdjkYHXTrvbQ8LE Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:38:04.456396 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e8c98bf4133414a8b17feddfee8f87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e8c98bf4133414a8b17feddfee8f87d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4e8c98bf4133414a8b17feddfee8f87d Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-530375335 Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 0656f69d8d5c4a5a8228882e4a0c477c Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-530375335-project-admin Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: {"os-resetState": {"state": "error"}} Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:04.458269 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 999 could not be found. Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:38:04.459306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:04.460930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:04.463685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.463685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.464200 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c852b1fe-8b55-447e-bafb-22ee89bbff8c tempest-ServersAdminNegativeTestJSON-530375335 tempest-ServersAdminNegativeTestJSON-530375335-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019112 Sep 27 01:38:04.464300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.464300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.464476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 891/1830] 10.222.0.52 () {60 vars in 1179 bytes} [Tue Sep 27 01:38:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:38:04.464587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.464587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.469633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.470544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.480141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.480774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.481210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.482060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.482516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.482941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.509700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:04.591873 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-402c26cf-0fbb-4604-9dd6-f591f31c80c0 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 204 len: 0 microversion: 2.1 time: 0.127108 Sep 27 01:38:04.595192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.600843 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 892/1831] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:04 2022] DELETE /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:04.606158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.606891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.608224 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d782364c-b9fe-410f-a8bd-554db208be63 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1473 microversion: 2.1 time: 0.165711 Sep 27 01:38:04.609357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 940/1832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:04.613092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.613634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.614139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.614846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.615305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.615738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.616319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.617079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.623871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.624578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.625847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.626761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.627224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.627657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.795756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.808208 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e051b5b7-c4a6-4ee6-a5f6-6941a3d96c79 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.205656 Sep 27 01:38:04.809490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 893/1833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:04.814663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:04.816006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:04.819341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.824291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.824782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.825222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.825963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:04.826423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:04.826990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:04.830322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8ff221a-6574-419d-a4da-03c1d311df95 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1468 microversion: 2.1 time: 0.218503 Sep 27 01:38:04.831201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 941/1834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:04.980737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:04.988702 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-098d9c34-7e45-4f3a-be20-9ec751f16b62 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1473 microversion: 2.1 time: 0.177981 Sep 27 01:38:04.989270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 894/1835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:04 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:05.247241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:05.247855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:05.254432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.254909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.255338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.256023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.256474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.256899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.293859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:05.393412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:05.401997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89bba1cd-f035-4aad-aa47-f058bf042cd9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.158663 Sep 27 01:38:05.402709 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 942/1836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:05 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:05.418068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:05.419277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:05.427140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.427787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.428326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.429202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.429847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.430338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.443690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:05.444506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:05.450952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.452134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.453398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.454338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.454886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.455524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.632231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:05.678051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b169778-0c4a-49d1-bde7-47e87a2dcc21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.258970 Sep 27 01:38:05.679511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 895/1837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:05 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:05.698832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:05.700013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:05.707722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.713503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.713959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.714734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.715198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.717303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.739616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:05.752900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8894c2e-ae96-4096-864f-037c1ceb13f3 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1527 microversion: 2.1 time: 0.312263 Sep 27 01:38:05.754240 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 943/1838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:05 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1527 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:05.833176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:05.833838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:05.854188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.854947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.855583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:05.856467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:05.857099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:05.857719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.207667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:06.222589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-251987a8-2fb1-4192-a2a0-44f5817bbd63 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.393656 Sep 27 01:38:06.224379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 944/1839] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:05 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:06.230568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:06.232195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:06.242734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.243524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.244719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.245633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.246305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.247057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.304695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:06.320093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e664dee-f55b-425a-bcdf-2de5139f43e4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1473 microversion: 2.1 time: 0.636225 Sep 27 01:38:06.337435 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 896/1840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:05 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1473 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:06.343338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-unplugged", "status": "completed", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:06.354156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.354638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.355065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.374359 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Creating event network-vif-unplugged:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:38:06.381721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] Instance baf2c8ab-7765-42ba-9f11-4583419c3559 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:38:06.388672 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3bdca73c-ebbe-4b6c-9d5f-6465c7560420 req-491bcd3c-ac4d-4357-91f8-24bd186104ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049808 Sep 27 01:38:06.390985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 897/1841] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:06.398267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:06.399167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:06.407595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.408331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.408958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.409889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.410488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.411149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.610398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:06.623237 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f5638f1-6bd6-4dbb-8a46-1eb96860a481 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1468 microversion: 2.1 time: 0.397517 Sep 27 01:38:06.623849 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 945/1842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:06 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:06.633532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:06.634480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:06.646031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.649317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.651461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.654271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.658805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.660422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.783935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:06.799154 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10bcb847-63da-4892-9350-045965b1c49e tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1473 microversion: 2.1 time: 0.406206 Sep 27 01:38:06.799750 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 898/1843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:06 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1473 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:06.804674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:06.805293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:06.820170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.821189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.821189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:06.830182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:06.830680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:06.831315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.069422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:07.153738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:07.158827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:07.171684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c83d808-e8b5-4908-94a8-c15b75da576d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.542460 Sep 27 01:38:07.173795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 946/1844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:06 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:07.182940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:07.183451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:07.190943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:07.191912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcd31c55-dff5-4828-9a3d-3d6659b6ad4c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.390783 Sep 27 01:38:07.192563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 899/1845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:06 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:07.209748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0aad33-ac28-477b-928a-2fe6414670b5", "name": "network-vif-deleted", "tag": "a76fbf4b-f56f-4d74-8455-49493544e8da"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:07.224504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.225840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.227377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.228873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.230057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.231465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.243302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.244382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.245043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.261077 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] Creating event network-vif-deleted:a76fbf4b-f56f-4d74-8455-49493544e8da for instance 4b0aad33-ac28-477b-928a-2fe6414670b5 on n-h1-859358-1 Sep 27 01:38:07.269825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ffcc947b-2cfb-4a1a-bc19-dda9991a731d req-58c8615d-cbac-4400-91c7-1629cc56e1f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075708 Sep 27 01:38:07.271369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 900/1846] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:07.290290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:07.291329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:07.302272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.302916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.303640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.305055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.305656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.306337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.609592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:07.618471 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1321a69-2fc2-4e13-b0af-50ddf5af0007 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1527 microversion: 2.1 time: 0.443425 Sep 27 01:38:07.622049 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 947/1847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:07 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1527 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:07.638907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:07.639712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:07.653004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.653480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.653916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.654842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.655474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.658829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.878316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:07.882786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:07.887821 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-42add6d5-d280-4caf-9252-8e470bbf111c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1470 microversion: 2.1 time: 0.264470 Sep 27 01:38:07.906557 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 948/1848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:07 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:07.906930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f967b23f-6bf3-4570-8d8c-cbd109461e16 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.623092 Sep 27 01:38:07.906930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 901/1849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:07 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:07.913982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:07.914768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:07.919810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:07.920607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:07.931421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.932108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.932647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.934054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.934617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.935148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.937690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.938367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.939812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:07.940704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:07.946289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:07.947016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.032589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.036595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.037249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.038881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lazy-loading 'fault' on Instance uuid 4b0aad33-ac28-477b-928a-2fe6414670b5 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:08.180609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:08.191632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-982339af-84dc-4b21-85e9-b50406518e37 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1468 microversion: 2.1 time: 0.300303 Sep 27 01:38:08.192587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 949/1850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:07 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:08.198432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93fd46cbb43d4f82876c64f17b03f310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759424e147c64aa6a741c7b540198227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:08.208360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ef93ec4-2522-4fcc-a5f8-056c3f221c25 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 200 len: 1307 microversion: 2.1 time: 0.309642 Sep 27 01:38:08.220788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:08.221360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:08.225378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 902/1851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:07 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:08.230386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76293ca5-5f28-433d-ac08-5bf509cdc482", "name": "network-vif-deleted", "tag": "1d5aeba8-7dba-4fac-8c1c-de20a5299a11"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:08.235491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.235985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.236416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.237127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.237613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.238037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.240755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.240755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.241215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.260097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] Creating event network-vif-deleted:1d5aeba8-7dba-4fac-8c1c-de20a5299a11 for instance 76293ca5-5f28-433d-ac08-5bf509cdc482 on n-h1-859358-1 Sep 27 01:38:08.266050 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bfb7cfcd-0130-4d9f-bd73-73f274d5c5e1 req-a770256c-5b5d-4236-868e-e98986fb3591 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039381 Sep 27 01:38:08.267739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 903/1852] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:08.277150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:08.278344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:08.290084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.292478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.293091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.293766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.294280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.294850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.306675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.307162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.307593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.308807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.309504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.309895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.318919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:08.336818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:08.344608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:08.345954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:08.479679 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0dd6c031-a892-4d35-9f4b-7f66981cd424 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559/action" status: 202 len: 0 microversion: 2.1 time: 0.284801 Sep 27 01:38:08.481458 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 950/1853] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:08 2022] POST /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:08.492093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:08.494529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:08.507429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.508678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.509515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.513942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.514892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.524823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:08.554951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.570662 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-053ad2f6-78e2-4e7d-a011-c960f1b130b3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.301046 Sep 27 01:38:08.590423 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 904/1854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:08 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:08.596003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:08.596710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:08.606850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.607803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.610714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.611728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.613154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.615042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.833041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:08.845410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1411ea4-ac16-463c-8295-ea83d6d07b79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.358454 Sep 27 01:38:08.846718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 951/1855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:08 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:08.851585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:08.857124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:08.873396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.874274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.875000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.876010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:08.876701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:08.878270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:08.968980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:08.990989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c737445-98b0-4894-865c-158d913288d9 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1485 microversion: 2.1 time: 0.142698 Sep 27 01:38:09.004171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:09.006424 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 952/1856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:08 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1485 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:09.013813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a652fc4e-ca56-44d1-a87b-0d683253f9e4", "name": "network-vif-plugged", "status": "completed", "tag": "ed39f3f2-6f56-49e8-8521-1a25e45dbfd3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:09.015650 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-303a713b-6530-41e8-bde4-7b3883c93095 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1469 microversion: 2.1 time: 0.423529 Sep 27 01:38:09.018304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 905/1857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:08 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1469 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:09.025318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:09.026177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:09.039551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.040395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.041180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.042126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.042813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.043401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.045817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.046337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.046776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.069646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] Creating event network-vif-plugged:ed39f3f2-6f56-49e8-8521-1a25e45dbfd3 for instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 on n-h1-859358-1 Sep 27 01:38:09.078630 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ef4a5439-a17f-4771-9caa-1d047c8fd8ee req-5a280065-4da3-475a-bed8-910bc8b012b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070273 Sep 27 01:38:09.084853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 953/1858] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:09.224235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:09.224963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:09.240892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.242315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.242869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.245294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.245466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.245879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.291041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.291734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.292501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.293267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lazy-loading 'fault' on Instance uuid 28646fc1-df17-4ffb-86a9-714ac9860ff8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:09.326542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:09.336362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-243354d2-69c4-484a-a3f9-3020db13275c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.316782 Sep 27 01:38:09.341490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 906/1859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:09 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:09.356477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:09.359300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] [instance: 4b0aad33-ac28-477b-928a-2fe6414670b5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:09.372987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.375925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.377861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.380575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.381808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.381965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:09.382951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.391233 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69a20e60-a470-4f5a-9961-df121c2ab8a8 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 200 len: 1312 microversion: 2.1 time: 0.177002 Sep 27 01:38:09.391802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 954/1860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:09 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:09.413803 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] HTTP exception thrown: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Request method failure captured: Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 HTTP/1.1 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOlJG7d8Fb9QOKDyaK-6I-x7VgwrpoP1tLOTlTJBETGLAwprPXd_djC4A-VrHWRsgsRIMlq8EmocAwnbQsX5mGS4V-aXdWn4p_bB3DoUXWuz7oaBFrol3u3nRuUjRP7HRoNo3rpBebGGR91jBnsmn58XL9zSi9XuQZ0QWWS1QjzXBk Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:09.419667 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/759424e147c64aa6a741c7b540198227"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/759424e147c64aa6a741c7b540198227"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_759424e147c64aa6a741c7b540198227", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 759424e147c64aa6a741c7b540198227 Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1206527811 Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 93fd46cbb43d4f82876c64f17b03f310 Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerTestJSON-1206527811-project Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. Sep 27 01:38:09.422068 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '4b0aad33-ac28-477b-928a-2fe6414670b5'} Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:09.423232 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. Sep 27 01:38:09.425409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:09.426916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] Returning 404 to user: Instance 4b0aad33-ac28-477b-928a-2fe6414670b5 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:09.426916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4135efa-a4c4-488f-8d94-75cb67a0b991 tempest-ImagesOneServerTestJSON-1206527811 tempest-ImagesOneServerTestJSON-1206527811-project] 10.222.0.52 "GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5" status: 404 len: 111 microversion: 2.1 time: 0.078543 Sep 27 01:38:09.426916 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 907/1861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:09 2022] GET /compute/v2.1/servers/4b0aad33-ac28-477b-928a-2fe6414670b5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:09.593064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:09.593738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:09.599800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.600284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.600707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.601418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.601866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.602283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.748074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:09.757199 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8bb61ea9-e62c-43bc-ac82-0276b87aadd0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.168093 Sep 27 01:38:09.758378 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 955/1862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:09 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:09.867934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:09.868552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:09.875775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.876341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.876844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:09.877580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:09.878030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:09.878449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.019745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.020390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.028679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.029808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.030250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.031714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.032164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.032583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.055971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.068831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccfd29e5-e921-4e91-83e6-ab3f68f84feb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1307 microversion: 2.1 time: 0.204707 Sep 27 01:38:10.072139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 908/1863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:09 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:10.079264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.079964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.080704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.081317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lazy-loading 'fault' on Instance uuid 76293ca5-5f28-433d-ac08-5bf509cdc482 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:10.089388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.090002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.098862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.100294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.101159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.102196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.102942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.103617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.163722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.172095 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ff4918d-3a8b-4813-aa4e-6575100eee90 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 200 len: 1314 microversion: 2.1 time: 0.157840 Sep 27 01:38:10.173389 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 956/1864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:10.307300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28646fc1-df17-4ffb-86a9-714ac9860ff8", "name": "network-vif-deleted", "tag": "a3bfdc2e-c817-48ab-a3aa-fc1f40140e61"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:10.319477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.319947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.320369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.334348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] Creating event network-vif-deleted:a3bfdc2e-c817-48ab-a3aa-fc1f40140e61 for instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 on n-h2-859358-1 Sep 27 01:38:10.340232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-54c98edf-3093-4c66-9ac8-e049abb20e10 req-7f5402bf-b013-4e88-8e07-9f15562b8efd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036923 Sep 27 01:38:10.341446 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 957/1865] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:38:10.344873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.354899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a3fa531-1ecb-42f1-bac5-5c0b05bb2718 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1469 microversion: 2.1 time: 0.280879 Sep 27 01:38:10.363541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.369505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.369907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 909/1866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:10.374893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.375627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.376145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.376889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.377761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.378374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.415349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.418399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: 28646fc1-df17-4ffb-86a9-714ac9860ff8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.424880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.425551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.426085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.426889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.427443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.427981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.443026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] HTTP exception thrown: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Request method failure captured: Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 HTTP/1.1 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPHrMRxVn8G5rYjr3psXuiwRety9i41dcCIjp3ADCr9OCAVG5L85LYBhr2ai3syNNPvXq153aEY8usRcORTb6tx9br9zfybkktQReu7IZZ5Ke8KroMzVwo_5-u2OjHCIWh2C7YeVj5sJVi3CXE0RvEGyZO_SJx4qsPc7_61H2QcbTE Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: b1c10c2b652d4ca0b0dfbea0905c7fe3 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:10.445265 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b1c10c2b652d4ca0b0dfbea0905c7fe3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: b1c10c2b652d4ca0b0dfbea0905c7fe3 Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-1361517816-project Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: bc091bc870454f15a072c907b630ee9a Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1361517816-project Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. Sep 27 01:38:10.446789 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '28646fc1-df17-4ffb-86a9-714ac9860ff8'} Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:10.447659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. Sep 27 01:38:10.449078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:10.451927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Returning 404 to user: Instance 28646fc1-df17-4ffb-86a9-714ac9860ff8 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:10.453266 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7363027f-b8a5-45ef-8b71-f34af040a256 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8" status: 404 len: 111 microversion: 2.1 time: 0.041039 Sep 27 01:38:10.454901 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 910/1867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/28646fc1-df17-4ffb-86a9-714ac9860ff8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:10.463900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.464530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.471852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.475279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.475279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.475658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.475843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.476274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.503264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:10.528826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.538255 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b5cc408-45f7-4d90-ae1b-d3fa98b62c2c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.181225 Sep 27 01:38:10.538898 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 958/1868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:10.604343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:10.607804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3cc128a-2bb7-4c0d-baf8-ccf58116d85a tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 204 len: 0 microversion: 2.1 time: 0.148077 Sep 27 01:38:10.608399 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 911/1869] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:10 2022] DELETE /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:38:10.616403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.617282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.623202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.624870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.625851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.626755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.627409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.627828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.774386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.780652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:10.781718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:10.783459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-19f080e9-d79b-4aea-af91-b2d3f196ed4e tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1478 microversion: 2.1 time: 0.170890 Sep 27 01:38:10.784884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 959/1870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:10.789987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.790500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.790929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.791648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:10.792096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:10.792516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:10.936603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:10.945995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-529941c0-48f7-42f2-863c-60ac19746396 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.169620 Sep 27 01:38:10.946563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 912/1871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:11.057365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1b19586-f20e-4eb9-b3e5-16f2e87ac170 tempest-ListImageFiltersNegativeTestJSON-1570831027 tempest-ListImageFiltersNegativeTestJSON-1570831027-project] Calling method '.version_select at 0x7f24d629c3a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.078776 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e1b19586-f20e-4eb9-b3e5-16f2e87ac170 tempest-ListImageFiltersNegativeTestJSON-1570831027 tempest-ListImageFiltersNegativeTestJSON-1570831027-project] HTTP exception thrown: Image not found. Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1b19586-f20e-4eb9-b3e5-16f2e87ac170 tempest-ListImageFiltersNegativeTestJSON-1570831027 tempest-ListImageFiltersNegativeTestJSON-1570831027-project] Request method failure captured: Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/images/ecdb15ae-9ce6-418b-940d-06457f5f490f HTTP/1.1 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlQCGuqIz_uyHXiXdXv52ryXVcGm2Ld2g3yJHBR5ciUp5k2GeXokU9UivY-dSRkO8S3CCdzQeCxQqumkmiC57PrXN5JgUvSI43CXyfuNE-nBPE-WEQd5WhR4q2KM6412_7EZJR2OTT95SgeL0ZVHBV231pkcrMwfUzg6zVeG8Of1_MI Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: eb6f7c3ae3994f109315e1a9a85d10b6 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1570831027 Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:11.080859 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb6f7c3ae3994f109315e1a9a85d10b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb6f7c3ae3994f109315e1a9a85d10b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb6f7c3ae3994f109315e1a9a85d10b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb6f7c3ae3994f109315e1a9a85d10b6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1570831027 Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: eb6f7c3ae3994f109315e1a9a85d10b6 Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1570831027 Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListImageFiltersNegativeTestJSON-1570831027-project Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 76ece5b9f56f412ca95ccc1ad9444178 Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1570831027-project Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ecdb15ae-9ce6-418b-940d-06457f5f490f'} Sep 27 01:38:11.082639 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:38:11.083744 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ecdb15ae-9ce6-418b-940d-06457f5f490f Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:38:11.084984 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ecdb15ae-9ce6-418b-940d-06457f5f490f could not be found. Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:38:11.087337 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.089535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1b19586-f20e-4eb9-b3e5-16f2e87ac170 tempest-ListImageFiltersNegativeTestJSON-1570831027 tempest-ListImageFiltersNegativeTestJSON-1570831027-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:11.090849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1b19586-f20e-4eb9-b3e5-16f2e87ac170 tempest-ListImageFiltersNegativeTestJSON-1570831027 tempest-ListImageFiltersNegativeTestJSON-1570831027-project] 10.222.0.52 "GET /compute/v2.1/images/ecdb15ae-9ce6-418b-940d-06457f5f490f" status: 404 len: 62 microversion: 2.1 time: 0.143214 Sep 27 01:38:11.090849 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 960/1872] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:10 2022] GET /compute/v2.1/images/ecdb15ae-9ce6-418b-940d-06457f5f490f => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:38:11.093816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.094440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.097840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-plugged", "status": "completed", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:11.101658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.102151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.102590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.103292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.103930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.104368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.108399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.109386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.109823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.121806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Creating event network-vif-plugged:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:38:11.127851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] Instance baf2c8ab-7765-42ba-9f11-4583419c3559 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:38:11.134075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c847d2a6-06b5-4de8-8142-916c6ea0f674 req-66a71760-8fd2-4f56-a505-d04125be8df2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Sep 27 01:38:11.134843 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 961/1873] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:11.200878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.201639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.209290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.209806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.210242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.210938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.211578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.212006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.225896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 HTTP/1.1 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:11.227546 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:11.229435 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '76293ca5-5f28-433d-ac08-5bf509cdc482'} Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:11.230442 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:11.232693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:11.234769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:11.234769 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e80602d-5673-428f-a002-164669da2190 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 404 len: 111 microversion: 2.1 time: 0.033967 Sep 27 01:38:11.239361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 962/1874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:11 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:11.250648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:11.258676 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-acb78267-bced-4637-984d-26f23cdce0c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1487 microversion: 2.1 time: 0.168964 Sep 27 01:38:11.259688 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 913/1875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:11 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1487 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:11.286159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:11.286748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.293217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.294062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.294514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.295222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.295677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.296266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.301871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:11.366888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1521557179", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:11.384823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4302eed3-7cfc-4fca-9656-0346ba6c3258 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4/action" status: 202 len: 0 microversion: 2.1 time: 0.103619 Sep 27 01:38:11.390815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 963/1876] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:11 2022] POST /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:11.396624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.397546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.407458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.407950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.408420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.409131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.409614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.410039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.435143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] validate_networks() for [('000fc94f-7507-45b3-9ea2-31850bf995b1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:38:11.603662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:11.616241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9419ea52-589f-4d7a-8b2c-146e9b1f84ca tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1469 microversion: 2.1 time: 0.226830 Sep 27 01:38:11.616917 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 964/1877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:11 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:11.629777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.630599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.637238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:11.639002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.639807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.640904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.641585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.642038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.642463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.807133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:11.815381 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-472d2a4a-00f3-4453-a032-4a149d0cb65e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1492 microversion: 2.1 time: 0.189917 Sep 27 01:38:11.816214 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 965/1878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:11 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1492 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:11.834944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:11.835393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:11.841253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.841760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.842188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.842875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.844016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.844441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.899846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:38:11.900986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:38:11.901892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:38:11.902521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:38:11.903256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:38:11.916823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.917744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.918472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.919676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:11.920422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:11.921732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:11.945816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:11.954298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Getting quotas for user e50d446d60b54188900a6f653787667d and project 595002a84ebe4d348e9cb926d792c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:11.981855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:38:11.984630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:38:12.001947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:12.011315 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fb44bd7-416a-4883-862f-4d95897ff9e3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.180451 Sep 27 01:38:12.011884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 966/1879] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:11 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:12.025285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.025924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:12.035018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.035534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.036346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.037186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.037837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.038803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.052397 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44a4bc75-7031-4086-9d7f-a947b0ecbb25 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.691369 Sep 27 01:38:12.053630 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 914/1880] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:38:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:38:12.063941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.064904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:12.084436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.084928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.085381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.086336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.086793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.087216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.228544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:12.240624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c366c35-f04b-45fc-9733-17dc77749778 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1478 microversion: 2.1 time: 0.227431 Sep 27 01:38:12.255138 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 967/1881] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1478 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:12.262407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:12.263614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6357d9ac-38f1-4a81-afe1-390605e9a796 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.264394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6357d9ac-38f1-4a81-afe1-390605e9a796 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:12.277083 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cc7d992-d8f5-4c6d-b11a-3dbc99a299ee tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.220002 Sep 27 01:38:12.278622 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 915/1882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:12.330509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6357d9ac-38f1-4a81-afe1-390605e9a796 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:12.337633 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6357d9ac-38f1-4a81-afe1-390605e9a796 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1225 microversion: 2.1 time: 0.081264 Sep 27 01:38:12.338205 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 968/1883] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:12.646596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.647353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:12.653652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.654385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.655052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.655864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.656715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.657162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.870801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:12.872771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.875602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.876944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.878063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.879032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.880271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.880727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2fd7e5a-6ffa-4c03-84cc-f3bb299a7365 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1469 microversion: 2.1 time: 0.238174 Sep 27 01:38:12.881237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.882132 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 916/1884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:12.894072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:12.895224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:12.903671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.904170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.904612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.906539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:12.907051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:12.907486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:12.936290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7191aa58-cbc4-4031-914e-e530c196cd46 tempest-AZV2TestJSON-1101054005 tempest-AZV2TestJSON-1101054005-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.188657 Sep 27 01:38:12.937627 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 969/1885] 10.222.0.52 () {58 vars in 1164 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:38:13.036056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:13.036940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:13.048100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.048596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.049035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.050592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.051054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.055015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.130777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:13.138516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cda33761-6b6f-4120-afaf-44524272d913 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 200 len: 1472 microversion: 2.1 time: 0.255333 Sep 27 01:38:13.153615 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 917/1886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:12 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:13.162381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1582478608"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:13.164753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:13.176066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.176471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.177116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.181598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.182291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.182957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.214060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:13.224914 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f23446e3-4c59-4327-9168-64ad0157e3c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.192594 Sep 27 01:38:13.225884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 970/1887] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:13 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:13.269237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:13.269875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:13.278516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.279182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.280209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.282608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.283263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.283796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.527641 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2e4b9a4-20d2-470e-99f8-ecbfe1269ca4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4/action" status: 202 len: 0 microversion: 2.1 time: 0.368348 Sep 27 01:38:13.529001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 918/1888] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:13 2022] POST /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 27 01:38:13.535308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:13.536554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:13.544864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.545816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.546568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.548591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.549294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.550064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.917971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:13.930170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66840dbb-a3bc-4b2f-a0ba-e67a2d4bb772 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.399675 Sep 27 01:38:13.931387 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 919/1889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:13 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:13.935765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:13.936543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:13.937835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:13.943946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.944644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.945242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.946463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.946919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.947349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.947478 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa0e1cb8-ffc5-4fe5-a91d-ff5e637f2519 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1478 microversion: 2.1 time: 0.683246 Sep 27 01:38:13.948136 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 971/1890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:13 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1478 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:13.955319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "name": "network-vif-unplugged", "status": "completed", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:13.971670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:13.972747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:13.973670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:13.980463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:13.989826 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] Creating event network-vif-unplugged:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h2-859358-1 Sep 27 01:38:14.001690 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9ea40106-4f0e-4aa8-8a8b-d65c43c07c37 req-d13a5701-8aba-4e10-91de-7cd26b26c3a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052261 Sep 27 01:38:14.003088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 972/1891] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:14.013198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3529f2c-4f72-490f-adf3-621e45839122 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d61d6310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:14.079066 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3529f2c-4f72-490f-adf3-621e45839122 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.074547 Sep 27 01:38:14.088406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 973/1892] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:14 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:14.088406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:14.099944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:14.102552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:14.110248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.110748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.111192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.112430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.112900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.113350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.114432 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c05655ad-ebd8-49e3-8296-211f4558e35e tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1221 microversion: 2.1 time: 0.181736 Sep 27 01:38:14.115021 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 920/1893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:13 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:14.247455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:14.248070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:14.262340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.263872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.264514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.265956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.266590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.267324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.364889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:14.374107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-107982ac-82ba-4e00-8854-dcee65bd282a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1469 microversion: 2.1 time: 0.290855 Sep 27 01:38:14.377312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 974/1894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:14 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:14.521732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:14.540806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1740876-56e3-4de6-beee-06cb0a000883 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.296041 Sep 27 01:38:14.542914 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 921/1895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:14 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:14.938074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5791490-cdec-4ce8-813e-cf5194db2306", "name": "network-vif-deleted", "tag": "bd37dd7b-58f9-4534-8b5f-c590baadaad7"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:14.949851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.950323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.954824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:14.956845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:14.961971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.970710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.971316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.972212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.974376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:14.975957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:14.977214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:14.980664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] Creating event network-vif-deleted:bd37dd7b-58f9-4534-8b5f-c590baadaad7 for instance b5791490-cdec-4ce8-813e-cf5194db2306 on n-h2-859358-1 Sep 27 01:38:14.986585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bd0e6f74-de20-4bbc-96b0-2519d1e94c7e req-a6107cdc-09f5-4600-88d8-1a31bbc86ecc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.435903 Sep 27 01:38:14.991453 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 975/1896] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:14.998145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:14.999549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:15.022194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.023218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.026341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.027769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.028772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.033371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.080065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.081288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.081849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.083178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lazy-loading 'fault' on Instance uuid b5791490-cdec-4ce8-813e-cf5194db2306 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:15.144104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:15.153386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-520d0683-9384-4d10-a026-5c447d0c378c tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1312 microversion: 2.1 time: 0.160494 Sep 27 01:38:15.154449 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 976/1897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:14 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.168988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf9d4af2-b9e1-4aad-8391-e234e70609e4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6ead30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:15.199174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:15.213596 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-423c484f-86ac-477a-ac74-53ca5d022c97 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.263197 Sep 27 01:38:15.226636 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 922/1898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:14 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.227554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf9d4af2-b9e1-4aad-8391-e234e70609e4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.071870 Sep 27 01:38:15.228128 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 977/1899] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:15 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.239061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:15.239739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:15.248535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.249018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.249999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.254078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.254078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.254078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.315160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe47e343-1940-4339-b89c-6eba11c9670a", "name": "network-vif-plugged", "status": "completed", "tag": "a9f92cf6-0095-4ac6-8280-c566710efc2a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:15.346795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.347290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.347730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.372181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:15.380647 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] Creating event network-vif-plugged:a9f92cf6-0095-4ac6-8280-c566710efc2a for instance fe47e343-1940-4339-b89c-6eba11c9670a on n-h1-859358-1 Sep 27 01:38:15.385375 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2abeb8fb-acde-4b9d-8602-c3d752cbd71c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1277 microversion: 2.1 time: 0.157516 Sep 27 01:38:15.398979 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-984c769b-8c24-44d0-a2cc-8f286ff7a4a0 req-e3b54cad-a7bb-42a9-8150-e9c93d992d74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096243 Sep 27 01:38:15.400273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 978/1900] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:15.401079 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 923/1901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:15 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.406531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:15.407254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:15.413622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.414262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.414706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.415416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.415878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.416304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.568839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:15.570427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:15.583405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.584058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.584598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.586179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.588324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.589442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.657723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:15.665370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-911e17e1-7fbc-4f38-a525-aebf6fc9d035 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1535 microversion: 2.1 time: 0.263579 Sep 27 01:38:15.665947 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 979/1902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:15 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.790309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:15.799953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4274a96a-91a5-46aa-ab53-61bc98dd269c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1314 microversion: 2.1 time: 0.235553 Sep 27 01:38:15.800823 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 924/1903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:15 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:15.870356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:15.871226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:15.878497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.879057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.879932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:15.880703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:15.881458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:15.881890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.027528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:16.042222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.043013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.043670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.057219 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] Creating event network-changed:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h2-859358-1 Sep 27 01:38:16.063243 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8b560077-5c3b-4a3d-a45a-38033870005a req-de580de3-5de6-48d6-903c-534e9af27c6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040455 Sep 27 01:38:16.064465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 925/1904] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:38:16.116647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:16.143450 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51ef626c-2156-4dd5-9e6a-c3c8a7c7f598 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 2424 microversion: 2.25 time: 0.277734 Sep 27 01:38:16.145725 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 980/1905] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:15 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 2424 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:16.173085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-859358-1", "block_migration": "auto"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:16.178581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:16.179335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:16.183412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:16.192281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.192774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.193465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.194355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.194978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.195579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.198332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.198915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.199597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.200942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.201516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.202760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.237950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'flavor' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:16.256825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Going to try to live migrate instance to n-h1-859358-1 {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:38:16.261953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.262451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.262964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.263426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lazy-loading 'fault' on Instance uuid b5791490-cdec-4ce8-813e-cf5194db2306 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:16.340856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc091bc870454f15a072c907b630ee9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c10c2b652d4ca0b0dfbea0905c7fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:16.351513 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6840fddd-8fa1-4a2d-a12d-dc2538e96b46 tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 200 len: 1312 microversion: 2.1 time: 0.176645 Sep 27 01:38:16.352109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 981/1906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:16 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:16.372865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:16.373518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:16.384642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.385144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.385599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.386967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.387640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.388312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.776525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:16.786123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77466690-568b-4a45-9be2-9b1acc82ad91 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.425066 Sep 27 01:38:16.804003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 982/1907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:16 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:16.810075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-553e5521-ba87-4102-afe4-6c022a3e338a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d69a2f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:16.865935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-553e5521-ba87-4102-afe4-6c022a3e338a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.060752 Sep 27 01:38:16.867316 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 983/1908] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:16 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:16.882736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:16.884292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:16.894882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.896392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.897036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.898153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:16.898785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:16.899388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:16.930620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:17.195172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:17.206051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0172720c-b317-4b48-8c58-56cf14d6ffea tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1283 microversion: 2.1 time: 0.337406 Sep 27 01:38:17.221532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 984/1909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:16 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1283 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:17.231430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:17.232367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:17.239813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:17.240494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:17.241089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:17.241990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:17.242684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:17.243411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:17.613475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:17.625654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9a39474-16fe-4931-b3db-66c6620b80f6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1535 microversion: 2.1 time: 0.402016 Sep 27 01:38:17.626308 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 985/1910] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:17 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1535 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:17.642783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:17.643831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:17.659810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:17.660314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:17.660749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:17.661531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:17.661985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:17.662409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:18.109827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:18.120900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9653124-0efd-427f-8b8d-fdeb2e91d075 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1500 microversion: 2.1 time: 0.492694 Sep 27 01:38:18.123648 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 986/1911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:17 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1500 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:18.136159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:18.137555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] [instance: b5791490-cdec-4ce8-813e-cf5194db2306] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:18.150797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:18.151293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:18.154513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:18.156522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:18.157566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:18.159899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:18.217889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] HTTP exception thrown: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Request method failure captured: Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 HTTP/1.1 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPHrMRxVn8G5rYjr3psXuiwRety9i41dcCIjp3ADCr9OCAVG5L85LYBhr2ai3syNNPvXq153aEY8usRcORTb6tx9br9zfybkktQReu7IZZ5Ke8KroMzVwo_5-u2OjHCIWh2C7YeVj5sJVi3CXE0RvEGyZO_SJx4qsPc7_61H2QcbTE Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: b1c10c2b652d4ca0b0dfbea0905c7fe3 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:18.231923 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1c10c2b652d4ca0b0dfbea0905c7fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b1c10c2b652d4ca0b0dfbea0905c7fe3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: b1c10c2b652d4ca0b0dfbea0905c7fe3 Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1361517816 Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-1361517816-project Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bc091bc870454f15a072c907b630ee9a Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1361517816-project Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. Sep 27 01:38:18.233948 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b5791490-cdec-4ce8-813e-cf5194db2306'} Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:18.235081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. Sep 27 01:38:18.237255 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:18.239832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] Returning 404 to user: Instance b5791490-cdec-4ce8-813e-cf5194db2306 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:18.239832 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d205c23-68ad-4682-a820-e4a092fd54aa tempest-ServersAdminNegativeTestJSON-1361517816 tempest-ServersAdminNegativeTestJSON-1361517816-project] 10.222.0.52 "GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306" status: 404 len: 111 microversion: 2.1 time: 0.106244 Sep 27 01:38:18.257823 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 987/1912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:18 2022] GET /compute/v2.1/servers/b5791490-cdec-4ce8-813e-cf5194db2306 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:18.275305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-unplugged", "status": "completed", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:18.332300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:18.334211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:18.336338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:18.381826 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Creating event network-vif-unplugged:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:38:18.408567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] Instance baf2c8ab-7765-42ba-9f11-4583419c3559 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:38:18.434216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4f543e1b-96d4-4b5a-88f6-8cdbf2afe003 req-2ed94719-9635-4842-af22-f74e49c4e8f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167449 Sep 27 01:38:18.437260 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 988/1913] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:18.595351 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d44a5eb-94f7-4e13-87e8-65af8a3458cf tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/action" status: 202 len: 0 microversion: 2.25 time: 2.426555 Sep 27 01:38:18.599577 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 926/1914] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:38:16 2022] POST /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/action => generated 0 bytes in 2432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:18.612535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9db3403-3fc4-4b8e-b12d-49dcb1cc738d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da748160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:18.729876 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9db3403-3fc4-4b8e-b12d-49dcb1cc738d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.124851 Sep 27 01:38:18.730751 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 927/1915] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:18 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:18.736780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:18.737673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:18.746217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:18.747281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:18.748179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:18.751402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:18.753371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:18.754017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.022051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.040119 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96ab351e-0f23-4f33-9d4b-3371196445de tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.303101 Sep 27 01:38:19.044833 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 928/1916] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:18 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:19.058634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:19.059460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:19.093665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.095654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.097243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.098034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.098496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.098921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.137680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:19.138823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:19.153303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.156340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.156801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.161867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.162911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.164518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.391516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.404794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.412938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.415762 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9dd3f9ad-a7ea-416e-a0eb-0a813be32a31 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.365071 Sep 27 01:38:19.416573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 929/1917] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:19 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:19.440744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:19.441454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:19.448317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.448807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.449233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.450196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:19.450659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:19.451089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:19.699910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.714253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5dbc9c9-995b-4c32-b245-8ee3cae4fddf tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 1.271798 Sep 27 01:38:19.715082 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 989/1918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:18 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:19.746245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd4a00ee-4d22-4416-b00d-47c997423076 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c5670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:19.837675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:19.841896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd4a00ee-4d22-4416-b00d-47c997423076 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.099457 Sep 27 01:38:19.848309 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-107e0337-f693-4c4e-8bd9-b8ade459c8e5 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1535 microversion: 2.1 time: 0.415058 Sep 27 01:38:19.849393 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 990/1919] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:19 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:19.854955 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 930/1920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:19 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1535 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:20.074949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:20.075965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:20.084132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.084907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.085617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.086564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.087240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.087844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.445019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:20.445595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:20.459217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.463766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.464240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.466755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.467288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.474064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.499340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:20.507833 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46e761fa-6540-4447-b185-92f4e07e6345 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.440789 Sep 27 01:38:20.515499 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 991/1921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:20 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:20.524707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a652fc4e-ca56-44d1-a87b-0d683253f9e4", "name": "network-vif-plugged", "status": "completed", "tag": "ed39f3f2-6f56-49e8-8521-1a25e45dbfd3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:20.550849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.557184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.557723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.585001 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] Creating event network-vif-plugged:ed39f3f2-6f56-49e8-8521-1a25e45dbfd3 for instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 on n-h1-859358-1 Sep 27 01:38:20.595201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-db8296d5-020e-4c85-9f20-000b0f052506 req-f2b84c10-d94f-43b5-89ad-ce641018695d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077820 Sep 27 01:38:20.595824 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 992/1922] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:20.745825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:20.746532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:20.751474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:20.758544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.763267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.768656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.768887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:20.769868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.770395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:20.770699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.771318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.771593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6551e73-cbec-4934-8a84-1eef7a27507e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.331585 Sep 27 01:38:20.774092 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 931/1923] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:20 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:20.865655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f51b312b-a134-4f5b-9585-adfe3d884a40 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6b7a60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:20.948653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f51b312b-a134-4f5b-9585-adfe3d884a40 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.085543 Sep 27 01:38:20.949482 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 932/1924] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:20 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:20.965680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:20.969953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:20.980953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.982155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.983044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:20.984478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:20.985298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:20.987945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:21.500693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:21.509239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-169dbde6-6b3c-4617-9ce9-ccb6c179afa3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1535 microversion: 2.1 time: 0.557658 Sep 27 01:38:21.516038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 933/1925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:20 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1535 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:21.528687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cded011-bc81-4c0c-83ba-caa32d6e4235"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:21.548456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:21.570971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:21.571528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:21.571991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:21.575873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:21.579223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:21.579778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:21.932890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:21.963096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:22.253438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:22.263246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76237d05-b53a-4d2e-8c4d-7b59955a90f1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 1.522584 Sep 27 01:38:22.278597 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 993/1926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:20 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:22.292015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:22.295899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:22.310114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:22.310994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:22.315047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:22.316319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:22.317980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:22.319160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:22.334824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:22.422192 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fcc928d-2db2-4e47-a105-2d8113c80d4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902037 Sep 27 01:38:22.442469 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 934/1927] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:38:21 2022] POST /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:22.478301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:22.482743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:22.519872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:22.521192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:22.523160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:22.526458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:22.527518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:22.535268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:22.893231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:22.951187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:22.963111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52fabaf0-97e9-4ff4-ba97-0b007052320d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.682954 Sep 27 01:38:22.965373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 994/1928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:22 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:22.976099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0313e160-f6fc-4e84-b0b8-816757721138 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d64fad30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:23.088907 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0313e160-f6fc-4e84-b0b8-816757721138 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.121163 Sep 27 01:38:23.089730 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 995/1929] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:22 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:23.121999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:23.125318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:23.151835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.159203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.164432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.166985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.168039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.168709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.251343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:23.272978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:23.279182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:23.281676 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-babc7e83-4c2c-4c63-93e8-60fd8bdf9889 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.827962 Sep 27 01:38:23.287928 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 935/1930] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:22 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:23.298807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:23.303836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:23.320738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.324342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.326580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.329854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.331177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.332203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.411246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:23.623546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:23.632207 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-524032ea-1b86-4611-bb75-0dba55e32552 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1528 microversion: 2.1 time: 0.541356 Sep 27 01:38:23.632802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 996/1931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:23 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1528 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:23.657640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26dedd0c-4282-418b-ac78-2e93cbe09c4c", "tag": "f5b64b72-cda2-4f90-851a-a7f262fedd10"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:23.695817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.699754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.700392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.735339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] Creating event network-changed:f5b64b72-cda2-4f90-851a-a7f262fedd10 for instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c on n-h2-859358-1 Sep 27 01:38:23.759238 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-451d3333-5136-4357-9e57-2e4d69a6f2ae req-0570c55b-07d9-49fd-b0ed-da0948970a96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114984 Sep 27 01:38:23.764908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 997/1932] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:23.778271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:23.779288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:23.800191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.804231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.804900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:23.805928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:23.822255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:23.823014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:24.071572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:24.085718 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ed5ab44-8da2-4113-b57c-28d7aece9674 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.795044 Sep 27 01:38:24.087193 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 936/1933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:23 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:24.103609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:24.106903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:24.122588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:24.123859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:24.124968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:24.127777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:24.128915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:24.132535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:24.780872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:24.793993 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0248f80-2254-4026-b668-129068967020 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.704167 Sep 27 01:38:24.795774 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 937/1934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:24 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:24.800414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89d4197b-a07f-4b2b-9a15-e0d762a9c9db tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6b7f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:24.897465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89d4197b-a07f-4b2b-9a15-e0d762a9c9db tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.100550 Sep 27 01:38:24.898327 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 938/1935] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:24 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:24.912513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:24.913372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:24.917033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:24.920374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:24.921094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:24.921752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:24.922658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:24.923285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:24.923891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:24.933910 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a05bbcd4-39cd-4886-ae76-4a51e37a41b3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1528 microversion: 2.1 time: 1.165297 Sep 27 01:38:24.937915 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 998/1936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:23 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1528 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:24.965318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4c10d91-78e9-4d2c-b4ab-60082fee3111 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:24.973839 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b4c10d91-78e9-4d2c-b4ab-60082fee3111 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] HTTP exception thrown: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4c10d91-78e9-4d2c-b4ab-60082fee3111 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Request method failure captured: Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/flavors/b7b2c07a-aeb7-459b-a1ef-086d8b1071ec HTTP/1.1 Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlMo3PfuyJO7VzQX1KnmYAr3sICDmNU5f4ovzIVm7vwHqvecwBa1u9_T4ahsv_Y84MbFXJkACv2Hac3mFtp3TfAGHq6gMa8GUy8XpbrT9G1e_MEXe69J32pxLly1Tt2W4IyK4Kc0PiJ23xs7UT22W_xA6ETzM5zvX4epvNPsdUwBT9E Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0e594c37169d4384a8a2db19ff852d2d Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MigrationsAdminTest-1940789038 Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:38:24.985133 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e594c37169d4384a8a2db19ff852d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e594c37169d4384a8a2db19ff852d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e594c37169d4384a8a2db19ff852d2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e594c37169d4384a8a2db19ff852d2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MigrationsAdminTest-1940789038 Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0e594c37169d4384a8a2db19ff852d2d Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MigrationsAdminTest-1940789038 Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MigrationsAdminTest-1940789038-project-admin Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 41a88f32357d4ef799c49031cfe12d26 Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MigrationsAdminTest-1940789038-project-admin Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: exception: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. Sep 27 01:38:24.987188 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b7b2c07a-aeb7-459b-a1ef-086d8b1071ec'} Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:24.988199 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. Sep 27 01:38:24.989949 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:24.993634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4c10d91-78e9-4d2c-b4ab-60082fee3111 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Returning 404 to user: Flavor b7b2c07a-aeb7-459b-a1ef-086d8b1071ec could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:24.994875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b4c10d91-78e9-4d2c-b4ab-60082fee3111 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/b7b2c07a-aeb7-459b-a1ef-086d8b1071ec" status: 404 len: 109 microversion: 2.1 time: 0.033401 Sep 27 01:38:24.995662 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 999/1937] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:24 2022] DELETE /compute/v2.1/flavors/b7b2c07a-aeb7-459b-a1ef-086d8b1071ec => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:38:25.116028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:25.116992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:25.136160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:25.141755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:25.142318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:25.149109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:25.149946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:25.152804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:25.290169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:25.310290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:25.314847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:25.320762 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d3f9296-e911-4eb9-93f8-74f670bb5e07 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.410252 Sep 27 01:38:25.322371 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 939/1938] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:24 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:25.335356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-609496525", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:25.441977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:38:25.715815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:25.732190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53e965aa-2a71-4e9a-8df2-472cf32bb220 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.621291 Sep 27 01:38:25.732836 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1000/1939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:25 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:25.820347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:25.820951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:25.827834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:25.828321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:25.828754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:25.829484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:25.829957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:25.830371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.033785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:38:26.034362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:38:26.034712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:38:26.035121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:38:26.035703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:38:26.055049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.056373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.059910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.063773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.067345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.071016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.119007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:26.126841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Getting quotas for user 82e4afc58d9c46faba5253e7e5542873 and project 058c7591ee264e86b5a9435827eb0095. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:26.148217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:38:26.150997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:38:26.292304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2040461e-0a1b-4818-9731-84000298def3 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967417 Sep 27 01:38:26.294109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 940/1940] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:38:26.307238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73f9e038-c42d-4578-b8a5-87df6b835ea9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c1430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:26.447187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73f9e038-c42d-4578-b8a5-87df6b835ea9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.144770 Sep 27 01:38:26.447867 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 941/1941] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:26 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:26.507892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:26.513859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c4e0e68-3f6e-4d22-92af-fb49c55b3b05 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:26.518761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c4e0e68-3f6e-4d22-92af-fb49c55b3b05 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:26.537051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7b6b4e71-2377-4659-8c02-87477264c780 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.720702 Sep 27 01:38:26.544641 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1001/1942] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:25 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:26.560300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:26.561751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:26.613772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.613772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.613772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.617132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.619347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.619997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.831184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c4e0e68-3f6e-4d22-92af-fb49c55b3b05 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:26.841372 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c4e0e68-3f6e-4d22-92af-fb49c55b3b05 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1212 microversion: 2.1 time: 0.343902 Sep 27 01:38:26.857721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 942/1943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:26 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1212 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:26.866094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:26.867835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:26.911774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.912480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.913388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:26.914349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:26.914919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:26.918313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:27.116067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:27.137373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:27.142351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:27.143962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd172794-e860-464d-9fcc-1e355de82a9b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.593581 Sep 27 01:38:27.158323 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1002/1944] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:26 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:27.463602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ed58be7-bf94-4e0f-a2c6-39b46a39dab0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c51f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:27.522119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:27.545760 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4544e0cd-09ec-44d1-ac4e-d14a11d5a0bb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.682825 Sep 27 01:38:27.548460 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 943/1945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:26 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:27.575517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:27.576137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:27.580754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ed58be7-bf94-4e0f-a2c6-39b46a39dab0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.120985 Sep 27 01:38:27.582442 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1003/1946] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:27 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:27.600371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:27.600884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:27.605195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:27.606249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:27.609231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:27.617720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:27.881728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:27.882762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:27.899993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:27.903130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:27.905142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:27.909383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:27.911096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:27.911778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.156576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:28.167744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53de8a6d-6456-4fc5-9647-658e1eec016f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1208 microversion: 2.1 time: 0.290936 Sep 27 01:38:28.170848 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1004/1947] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:27 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1208 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:28.179207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-plugged", "status": "completed", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:28.206727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:28.207566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:28.208246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.238264 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] Creating event network-vif-plugged:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:38:28.255721 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0c7f2dd1-9e55-4e28-accc-39cc4373e5e0 req-64c59d3b-8ae7-4a48-a672-f408115b79ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079776 Sep 27 01:38:28.257348 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1005/1948] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:28.262784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:28.267586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:28.280053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:28.281827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:28.283223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.284245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:28.287394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:28.288175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.644933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:28.662803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:28.665441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:28.667085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3b47310-729c-460b-a268-a10fb87cc645 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.408384 Sep 27 01:38:28.676798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1006/1949] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:28 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:28.690543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:28.691704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:28.705516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:28.707741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:28.708427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.713701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:28.714497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:28.715271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:28.756912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:28.767155 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04bdb693-fbc9-4c77-b78c-23f206fb5147 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 1.195533 Sep 27 01:38:28.771850 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 944/1950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:27 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:28.781537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b63b339c-973b-4b68-b837-f56a89404fce tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d66e1700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:28.854302 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b63b339c-973b-4b68-b837-f56a89404fce tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.081157 Sep 27 01:38:28.855166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 945/1951] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:28 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:29.200829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:29.201812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:29.230057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.231370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.233624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:29.238254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.239042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.240937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:29.424155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:29.436923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5b9fcc6-d9b9-436c-b84f-668f7fca9ba0 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.755693 Sep 27 01:38:29.439547 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1007/1952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:28 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:29.485999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:29.494342 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52c3e543-fdd6-465a-bdd0-ab0e18819eae tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1272 microversion: 2.1 time: 0.299805 Sep 27 01:38:29.509728 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 946/1953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:29 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:29.710601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:29.711400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:29.727357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.728640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.731926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:29.736990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.738839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.741097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:29.806386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:29.807689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:29.823313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:29.846768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.847863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.850276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:29.852374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:29.856381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:29.859884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:30.604678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:30.623415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:30.632303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:30.666275 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c0a37f3-4c03-48c2-83ea-6ce99cca7785 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.963562 Sep 27 01:38:30.669734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1008/1954] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:29 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:30.675194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e2ecb80-a291-42bd-98fa-8bf9fd560221 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c58b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:30.767461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e2ecb80-a291-42bd-98fa-8bf9fd560221 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.095859 Sep 27 01:38:30.768741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1009/1955] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:30 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:30.777451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:30.782175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:30.801816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:30.802591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:30.803186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:30.804060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:30.805112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:30.805746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:31.090869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:31.107197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9753779c-5a6e-4d55-9ea6-665361f5fefc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.336883 Sep 27 01:38:31.113287 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1010/1956] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:30 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:31.123203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:31.124705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:31.146395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:31.148692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:31.150521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:31.152862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:31.153643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:31.156514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:31.250016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:31.275122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a4b0e5b-3086-4a4a-8e44-0dd7aab86897 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 1.474478 Sep 27 01:38:31.292521 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 947/1957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:29 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:31.350818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:31.380632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94d451a7-2ad0-4163-9990-48e3108d5456 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1270 microversion: 2.1 time: 0.254324 Sep 27 01:38:31.382022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1011/1958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:31 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:31.613496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-886308268", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "41d3fd12-2d49-47ef-8d36-7babc9c9070d"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:31.691960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] validate_networks() for [('41d3fd12-2d49-47ef-8d36-7babc9c9070d', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:38:31.693288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:31.694233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:31.724348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:31.725108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:31.726649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:31.730449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:31.732147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:31.735743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.068269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:32.082020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:32.084156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:32.085642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29419f8e-6db2-4779-9c23-ed7b18c3b5ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.396692 Sep 27 01:38:32.086766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1012/1959] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:31 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:38:32.091566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff5ac4d6-be4e-4146-a3bb-b1977ef3f03f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6b1ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:32.152895 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff5ac4d6-be4e-4146-a3bb-b1977ef3f03f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.064810 Sep 27 01:38:32.153808 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1013/1960] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:32 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:32.159652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:32.160564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:32.179553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.179968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.180403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.188750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.189520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.191492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.591821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:32.612310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a813be57-28ab-4f9c-b5f6-a183deb57195 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.455961 Sep 27 01:38:32.612906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1014/1961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:32 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:32.619318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:32.619933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:32.627760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.628175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.628605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.629310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.629798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.630348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.926085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:32.937954 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b7bc210-b64e-497b-ad3a-2daabc1dda80 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.320525 Sep 27 01:38:32.939591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1015/1962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:32 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:32.944606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:32.945590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:32.952442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.953207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.953850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:32.954714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:32.955350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:32.956523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.034990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:33.043645 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eae8714f-9d95-4ffe-88dd-677a641c96bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1270 microversion: 2.1 time: 0.102733 Sep 27 01:38:33.045497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1016/1963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:32 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:33.050342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26dedd0c-4282-418b-ac78-2e93cbe09c4c", "name": "network-vif-plugged", "status": "completed", "tag": "f5b64b72-cda2-4f90-851a-a7f262fedd10"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:33.073270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.074553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.077437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.110504 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] Creating event network-vif-plugged:f5b64b72-cda2-4f90-851a-a7f262fedd10 for instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c on n-h2-859358-1 Sep 27 01:38:33.124133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-506c2a29-b769-4839-8af0-803570b0fed2 req-fa67ef58-7139-4b09-b13a-acac38bcacab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076392 Sep 27 01:38:33.125213 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1017/1964] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:33.133710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:33.138073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:33.151764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.154596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.156050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.158326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.158837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.159279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.432645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:33.447461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:33.450360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:33.451449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0df697c-26cd-4c3f-9412-d247161b0818 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.324780 Sep 27 01:38:33.452020 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1018/1965] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:33 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:33.466861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de63f7da-2eea-4815-800c-0f899a8ffe68 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6ea8b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:33.506863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:38:33.507365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:38:33.507774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:38:33.508192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:38:33.508610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:38:33.537616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.538413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.539342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.540367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.550376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.550914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.564574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de63f7da-2eea-4815-800c-0f899a8ffe68 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.107389 Sep 27 01:38:33.565543 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1019/1966] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:33 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:33.604480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:33.614771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:33.623254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for user 7c7cf1bdbba44c2e939151843c9ac187 and project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:33.641190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:33.641587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:33.643855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:33.644742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:38:33.648085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:38:33.655642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.663125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.663605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.665606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.666074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.669152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.745520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-452e7da4-b375-4174-9199-23e4d167868a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.445178 Sep 27 01:38:33.747585 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 948/1967] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:38:33.765834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d859a616-46ce-4dd3-9672-a114ec2ac128 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:33.766156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d859a616-46ce-4dd3-9672-a114ec2ac128 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:33.915575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:33.926176 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ef025001-60ad-4249-ac19-2c9200238f4d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.289829 Sep 27 01:38:33.946124 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1020/1968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:33 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:33.961720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:33.962608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:33.977278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.978303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.980157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:33.981156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:33.983549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:33.985557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:34.152007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d859a616-46ce-4dd3-9672-a114ec2ac128 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:34.182058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d859a616-46ce-4dd3-9672-a114ec2ac128 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1217 microversion: 2.1 time: 0.426222 Sep 27 01:38:34.184588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 949/1969] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:33 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1217 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:34.191576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:34.192480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:34.210627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:34.213821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:34.214679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:34.220175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:34.220918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:34.221916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:34.370213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:34.381803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5dac496-8b9c-4882-b0c4-cd77d526bcd4 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1325 microversion: 2.1 time: 0.424158 Sep 27 01:38:34.401974 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1021/1970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:33 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:34.479291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:34.480110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:34.494189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:34.497954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:34.502015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:34.503008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:34.508101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:34.508799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:34.875296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:34.891141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:34.892691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:34.893966 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d93ae15a-d2ed-4e55-8d7f-0875b6947b7f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.419425 Sep 27 01:38:34.915477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1022/1971] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:34 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:34.915477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99685fcf-50b0-4c6c-9bd9-ad7e58d9b34e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6b15e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:35.061996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99685fcf-50b0-4c6c-9bd9-ad7e58d9b34e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.160185 Sep 27 01:38:35.077329 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1023/1972] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:34 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:35.084134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:35.085058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:35.099163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.101802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.102536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:35.105683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.108341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.110204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:35.401793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:35.417689 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f43c323-e7d8-43c0-a82f-671b7ff6a4b7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 0.338082 Sep 27 01:38:35.439679 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1024/1973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:35 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:35.458449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:35.461713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:35.495956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.496791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.498012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:35.505856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.506804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.507987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:35.652927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:35.665846 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c680407b-ff07-4f71-9785-f425673d1f0c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1213 microversion: 2.1 time: 0.223303 Sep 27 01:38:35.666745 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1025/1974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:35 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:35.671632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:35.672562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:35.679305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.680096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.680777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:35.681770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:35.682498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:35.683174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:36.097787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:36.161613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbbb06a3-0570-4a22-b600-0ef0345b910a tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1522 microversion: 2.1 time: 0.439394 Sep 27 01:38:36.161613 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1026/1975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:35 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:36.161613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:36.161613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:36.174510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:36.175246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:36.176127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:36.177054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:36.177743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:36.178477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:36.521689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:36.556088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:36.557906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:36.564341 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4c33012-2859-441c-8ab9-749fbfcbb8ef tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.455234 Sep 27 01:38:36.577366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1027/1976] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:36 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:36.586563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dfa9a10c-1f1e-44b4-8485-849c901d7040 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6b1790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:36.696871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dfa9a10c-1f1e-44b4-8485-849c901d7040 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.120064 Sep 27 01:38:36.711604 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1028/1977] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:36 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:36.713998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:36.717670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:36.735740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:36.739917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:36.740534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:36.742627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:36.743236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:36.750045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:36.812597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:36.883490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:36.952457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:36.968724 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78516f35-6a68-48cb-9633-017af26cfc4d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 2.778926 Sep 27 01:38:36.971080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 950/1978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:34 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:37.014879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.016635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:37.032080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4060cb94-4a15-4462-800b-62047a448980 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 204 len: 0 microversion: 2.1 time: 0.326316 Sep 27 01:38:37.036100 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1029/1979] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:36 2022] DELETE /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:37.043094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.044143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.045034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.046338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.049504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.050222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.050592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:37.051024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.071110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.071685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.072236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.073066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.073780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.074485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.212447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:37.222959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-002b7013-d306-4187-bcf5-f2d17bfb4930 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1275 microversion: 2.1 time: 0.185168 Sep 27 01:38:37.223781 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1030/1980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:37 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:37.254422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.255095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:37.270043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.270480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.270918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.271640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.272099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.272531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.565966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:37.577643 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c654a263-e57b-4a3c-8056-83891dcfe792 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1528 microversion: 2.1 time: 0.338181 Sep 27 01:38:37.579344 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1031/1981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:37 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1528 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:37.593445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.594725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:37.606685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.607172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.607654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.608996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:37.609493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:37.609911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:37.823657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:37.836510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:37.838706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:37.840118 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de604270-744a-43d4-ba0e-4591dc033051 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.252440 Sep 27 01:38:37.841379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1032/1982] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:37 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:37.846106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4707b73-0598-4295-af37-28fbc26472f7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da658790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.915436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4707b73-0598-4295-af37-28fbc26472f7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.072711 Sep 27 01:38:37.917234 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1033/1983] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:37 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:37.994417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:37.999485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:38.013887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.014404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.014836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.015575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.015993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.016417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.143257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:38.158975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-546adff9-356d-4ae1-b1af-4574d9df3ac1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1720 microversion: 2.1 time: 1.179197 Sep 27 01:38:38.159544 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 951/1984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:36 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1720 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:38.248029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:38.249165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:38.269414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.270079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.270532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.271287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.271790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.272227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.379560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:38.392382 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e9e1cee-6235-48f6-948f-e11d4b802ea4 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.401278 Sep 27 01:38:38.409573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1034/1985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:37 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:38.601574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:38.603087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:38.613658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.616788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.619413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.622355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.626327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.627478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.659905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:38.668466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6cfe44a-ca90-41f3-bb86-037218c3de79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1275 microversion: 2.1 time: 0.425693 Sep 27 01:38:38.673695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 952/1986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:38 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1275 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:38.868156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:38.869040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:38.884642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.888378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.889224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:38.891250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:38.893138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:38.893916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:39.174988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:39.199933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2bcdb4c-189d-4a44-9588-0c4818c719d7 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1528 microversion: 2.1 time: 0.601641 Sep 27 01:38:39.202202 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1035/1987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:38 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1528 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:39.213633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd012cdf-f718-448d-a4e7-5c52624b42b1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d630b4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:39.330031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd012cdf-f718-448d-a4e7-5c52624b42b1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.125569 Sep 27 01:38:39.331980 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1036/1988] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:39 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:39.351574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:39.355161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:39.374074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:39.374724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:39.376670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:39.382107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:39.388437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:39.389865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.091582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.124370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.137907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.139865 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e853c6f3-445c-4cd7-ba4c-da85bea2565a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 1.276033 Sep 27 01:38:40.140449 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 953/1989] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:38 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:38:40.165195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.166851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:40.193037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.193037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.193260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.195792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.198240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.199005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.410480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.431023 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51e7dcbe-8767-42b3-ae35-925af5258658 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1710 microversion: 2.1 time: 1.089717 Sep 27 01:38:40.431848 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1037/1990] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:39 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1710 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.437987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.438932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:40.455527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.457622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.458350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.459306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.460063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.460669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.595816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.604644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1afbbe9-a90e-499b-9ef5-d5be57bcfa9d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1275 microversion: 2.1 time: 0.171293 Sep 27 01:38:40.618149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1038/1991] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.627064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.629830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:40.643769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.644270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.644680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.645412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.645868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.646284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.716379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.716902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.717381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.717904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lazy-loading 'fault' on Instance uuid 26dedd0c-4282-418b-ac78-2e93cbe09c4c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:40.771781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50d446d60b54188900a6f653787667d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595002a84ebe4d348e9cb926d792c1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.782132 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0bc3f79b-bc65-4e88-8f1e-a1e2ee2059f8 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 200 len: 1315 microversion: 2.1 time: 0.162259 Sep 27 01:38:40.798993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1039/1992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.803696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0741c224-e0c8-490f-82b3-e0c31a20b685 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d64fa310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.867151 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0741c224-e0c8-490f-82b3-e0c31a20b685 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.066980 Sep 27 01:38:40.868431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1040/1993] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.878925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26dedd0c-4282-418b-ac78-2e93cbe09c4c", "name": "network-vif-deleted", "tag": "f5b64b72-cda2-4f90-851a-a7f262fedd10"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:40.890942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.891436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.891843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.904983 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] Creating event network-vif-deleted:f5b64b72-cda2-4f90-851a-a7f262fedd10 for instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c on n-h2-859358-1 Sep 27 01:38:40.912705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8369bae8-fb2f-4f73-bd25-71266536da49 req-965191c0-a6df-4cf1-8c90-7db95cfc8c5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041111 Sep 27 01:38:40.918718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1041/1994] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:40.926965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c76aa28-207e-4035-a01b-6bb450a47120 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '.version_select at 0x7f24da678b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.933306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c76aa28-207e-4035-a01b-6bb450a47120 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.933837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c76aa28-207e-4035-a01b-6bb450a47120 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.934511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c76aa28-207e-4035-a01b-6bb450a47120 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.947171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:40.949489 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c76aa28-207e-4035-a01b-6bb450a47120 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3493 microversion: 2.1 time: 0.029251 Sep 27 01:38:40.950347 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1042/1995] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/os-migrations => generated 3493 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.972381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86f516e7-b3e3-4389-b65f-4a382af9e22f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.825063 Sep 27 01:38:40.972963 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 954/1996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:40.973646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:40.974674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:40.982132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.983466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.984153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:40.985035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:40.985760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:40.987015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.155479 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9b67bf4-d11a-4135-adb2-dc2c58d1b66c tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1861 microversion: 2.1 time: 0.189096 Sep 27 01:38:41.157423 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1043/1997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:40 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1861 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:41.182915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:41.183550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:41.190082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:41.191027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:41.197830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.200461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.200922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.202260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.202733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.203233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.205770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.206593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.211446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.212481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.213187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.213880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.408877 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-683ade9d-370b-40dc-a8d0-37a56b2ec1ac tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1861 microversion: 2.1 time: 0.228228 Sep 27 01:38:41.412640 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1044/1998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:41 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1861 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:41.506155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:41.506952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:41.516536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.517024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.517474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.519014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:41.519474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:41.519892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:41.727733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lazy-loading 'services' on Instance uuid b400664e-737e-4b04-9697-ca1eb3fb4250 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:38:42.012707 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb16bf6a-5f21-4a4c-8b5b-bbee59e1209f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments/d6b0bb1c-dc55-447d-8d16-70330b3066fd" status: 202 len: 0 microversion: 2.1 time: 0.511156 Sep 27 01:38:42.013151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1045/1999] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:38:41 2022] DELETE /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments/d6b0bb1c-dc55-447d-8d16-70330b3066fd => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:42.036453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.037496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.050243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.050801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.051274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.051993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.052440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.052861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.158627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:42.168211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:42.179448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:42.181078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0318ead6-ea9b-4800-9eb9-24a9f65972a3 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 1.004907 Sep 27 01:38:42.182190 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 955/2000] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:41 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:42.199243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.201160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 26dedd0c-4282-418b-ac78-2e93cbe09c4c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.208301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.208806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.209246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.209986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.210446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.210872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.237166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c HTTP/1.1 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:42.252059 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. Sep 27 01:38:42.254508 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '26dedd0c-4282-418b-ac78-2e93cbe09c4c'} Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:42.258782 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. Sep 27 01:38:42.260489 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.262068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 26dedd0c-4282-418b-ac78-2e93cbe09c4c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:42.262068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fb1a8e1-89d6-4bdf-a392-e660e96c66cb tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c" status: 404 len: 111 microversion: 2.1 time: 0.070216 Sep 27 01:38:42.262068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 956/2001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/servers/26dedd0c-4282-418b-ac78-2e93cbe09c4c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:42.262348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:42.287262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.287715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.288144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.312739 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] Creating event network-changed:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:38:42.335377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b29a63ff-8817-4d7b-adae-31431b81f2ce req-11ace8c7-0d36-483a-b8f3-6b1328258253 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079667 Sep 27 01:38:42.335979 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 957/2002] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:42.345698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21c49e32-2b61-423f-a2ad-ee3cb5606f6d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d5fa6820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.347400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:42.359122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d19b860f-4f8c-47a2-b35c-6de5b298a3ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.343012 Sep 27 01:38:42.359963 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1046/2003] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:42.364685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.365920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.373282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.374092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.374745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.375953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.377168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.380388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.424353 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21c49e32-2b61-423f-a2ad-ee3cb5606f6d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.084576 Sep 27 01:38:42.424926 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 958/2004] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:42.439535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.442285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.452683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.454146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.454770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.455733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.456422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.457044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.502022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f27b9517-6139-4ab0-b80e-c317981acb30 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074834 Sep 27 01:38:42.503229 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 959/2005] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:42.508008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12f21b0e-604e-49ea-9240-720295b5f06c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24d6d8b040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.532241 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-12f21b0e-604e-49ea-9240-720295b5f06c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Image not found. Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12f21b0e-604e-49ea-9240-720295b5f06c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a HTTP/1.1 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:42.534384 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '37744633-6015-4cc4-a0a7-b7ddac6aa20a'} Sep 27 01:38:42.536095 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 37744633-6015-4cc4-a0a7-b7ddac6aa20a to delete Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.537136 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37744633-6015-4cc4-a0a7-b7ddac6aa20a could not be found. Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:42.539236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:38:42.541060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.544947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12f21b0e-604e-49ea-9240-720295b5f06c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:42.544947 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12f21b0e-604e-49ea-9240-720295b5f06c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a" status: 404 len: 62 microversion: 2.1 time: 0.039839 Sep 27 01:38:42.544947 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 960/2006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:42 2022] DELETE /compute/v2.1/images/37744633-6015-4cc4-a0a7-b7ddac6aa20a => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:38:42.554690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.555427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.563078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.563944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.564651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.565678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.566381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.567134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.585127 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 HTTP/1.1 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:42.587654 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.589171 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '76293ca5-5f28-433d-ac08-5bf509cdc482'} Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:42.590082 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.591448 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.593563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:42.593563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5d8f1cb-6359-4d6c-bdf6-c57e6d7ca61d tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 404 len: 111 microversion: 2.1 time: 0.041841 Sep 27 01:38:42.593563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 961/2007] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:42 2022] DELETE /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:42.602561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.604147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 76293ca5-5f28-433d-ac08-5bf509cdc482] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:42.611129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.611868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:42.612332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.612705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.613982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:42.614448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:42.614882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:42.623711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a75c2da3-4d1c-4b90-829f-888173d7bb99 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.262379 Sep 27 01:38:42.637362 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1047/2008] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 HTTP/1.1 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:42.637572 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.639661 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '76293ca5-5f28-433d-ac08-5bf509cdc482'} Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:42.640592 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. Sep 27 01:38:42.645128 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:42.647806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 76293ca5-5f28-433d-ac08-5bf509cdc482 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:42.647806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31813c31-c61e-4994-adb6-429aca48fdde tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482" status: 404 len: 111 microversion: 2.1 time: 0.036416 Sep 27 01:38:42.647806 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 962/2009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:42 2022] GET /compute/v2.1/servers/76293ca5-5f28-433d-ac08-5bf509cdc482 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:42.648252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7700275-93f2-44b7-be21-c536d3427a45 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24da556ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:42.674723 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7700275-93f2-44b7-be21-c536d3427a45 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140167231" status: 202 len: 0 microversion: 2.1 time: 0.034375 Sep 27 01:38:42.676605 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1048/2010] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140167231 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:43.207708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:43.208302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:43.218335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.218823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.219270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:43.230898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.231660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.232855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:43.386134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:43.388098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:43.402488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.403263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.404618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:43.408262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.409511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.411621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:43.601105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:43.736386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:43.740698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:43.752228 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00f53778-785b-4a27-bce9-d289b8a7d60f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.373097 Sep 27 01:38:43.767808 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1049/2011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:43 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:43.767808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8318120-14c7-4e5f-b6e9-b7c08dba6514 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da56d670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:43.852651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8318120-14c7-4e5f-b6e9-b7c08dba6514 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1412 microversion: 2.1 time: 0.094947 Sep 27 01:38:43.860262 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1050/2012] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:43 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:43.890046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:43.901314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:43.952406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.952907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.953357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:43.957723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:43.965763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:43.973921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:43.983096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:43.987037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:43.991795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50bfa254-47e9-40c0-bbe5-d19eedb2ef03 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.787449 Sep 27 01:38:43.993883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:43.997012 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 963/2013] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:43 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:43.997268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.007869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.008497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.023895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.028513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.029648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.030414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.031143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.031573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.141085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2076296d-51b2-4570-86b1-3d00151ad58a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.279608 Sep 27 01:38:44.156030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1051/2014] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:43 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 197 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:44.166064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:44.246263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ca23d96-4cec-4b44-8347-762648ad14e5 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '.version_select at 0x7f24da5e3f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.290855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5ca23d96-4cec-4b44-8347-762648ad14e5 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Image not found. Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ca23d96-4cec-4b44-8347-762648ad14e5 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/images/8c0533a1-ad73-46d0-8880-cd343b9a5b27 HTTP/1.1 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:44.292700 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8c0533a1-ad73-46d0-8880-cd343b9a5b27'} Sep 27 01:38:44.294222 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c0533a1-ad73-46d0-8880-cd343b9a5b27 to delete Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.295326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c0533a1-ad73-46d0-8880-cd343b9a5b27 could not be found. Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:44.296619 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ca23d96-4cec-4b44-8347-762648ad14e5 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ca23d96-4cec-4b44-8347-762648ad14e5 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/images/8c0533a1-ad73-46d0-8880-cd343b9a5b27" status: 404 len: 62 microversion: 2.1 time: 0.052662 Sep 27 01:38:44.298052 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1052/2015] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:44 2022] DELETE /compute/v2.1/images/8c0533a1-ad73-46d0-8880-cd343b9a5b27 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:38:44.300620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.301124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.319274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.320430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.320968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.321837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.322324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.322829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.371620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:44.521352 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0fe4dc1-f5fc-478c-ab5c-3c1bf667b88d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 204 len: 0 microversion: 2.1 time: 0.225132 Sep 27 01:38:44.525620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1053/2016] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:44 2022] DELETE /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:44.529956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.530927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.538570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.539178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.539612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.540369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.540815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.542168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.562169 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb HTTP/1.1 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:38:44.564243 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.566325 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb'} Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:44.567476 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.569121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.570995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:44.570995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6813771-467d-488e-9a9a-201eaf9e8e7c tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 404 len: 111 microversion: 2.1 time: 0.046460 Sep 27 01:38:44.571707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1054/2017] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:44 2022] DELETE /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:44.577353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.578004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.584258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.584734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.585094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.587653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.588754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.588754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.708190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:44.718790 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0def958f-8170-4b68-8ba2-38bf9b84d061 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.720602 Sep 27 01:38:44.720145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 964/2018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:43 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:44.726914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.728469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] [instance: 4950ab0d-d02d-4228-a9d2-683c0b555feb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.737092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.737914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.739024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.740362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.741084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.745477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.745951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:44.757740 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0d8b703e-0adc-42c5-87dc-1287322ebe7b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1552 microversion: 2.1 time: 0.185080 Sep 27 01:38:44.759044 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1055/2019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:44 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1552 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:44.762004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] HTTP exception thrown: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Request method failure captured: Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb HTTP/1.1 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlOt7AVvGr6rCXZiuIZboRn6Cai8dDCfhL9LKqUo0Q-vobVkWEdhm7BWA6xYOLDrIjiTAC1lcYa51u2hLD6wcb4DdCfZ7fs5W-11dTV_y4tU70u5gVUUlL0dNRZ8mddCSB3baGsbZQrjXbBLpjj3-ImOCOlvZMmzhStS1j7pOuN6bwA Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:44.764908 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/595002a84ebe4d348e9cb926d792c1d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_595002a84ebe4d348e9cb926d792c1d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 595002a84ebe4d348e9cb926d792c1d2 Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-374621379 Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: e50d446d60b54188900a6f653787667d Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-374621379-project Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.766505 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '4950ab0d-d02d-4228-a9d2-683c0b555feb'} Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:44.767454 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. Sep 27 01:38:44.770795 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:44.781855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.782472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:44.788113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] Returning 404 to user: Instance 4950ab0d-d02d-4228-a9d2-683c0b555feb could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:44.789182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65e669de-796e-4ebb-91b5-7dba50145570 tempest-ImagesOneServerNegativeTestJSON-374621379 tempest-ImagesOneServerNegativeTestJSON-374621379-project] 10.222.0.52 "GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb" status: 404 len: 111 microversion: 2.1 time: 0.067341 Sep 27 01:38:44.789910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 965/2020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:44 2022] GET /compute/v2.1/servers/4950ab0d-d02d-4228-a9d2-683c0b555feb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:44.791375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.791844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.792272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.793127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:44.793705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:44.794023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:44.884649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3719ff99-77ee-48da-8e39-5c00c2cea2b0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6cc4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:44.950332 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3719ff99-77ee-48da-8e39-5c00c2cea2b0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1421 microversion: 2.1 time: 0.076065 Sep 27 01:38:44.951096 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 966/2021] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:44 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:44.965717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d2e677f-85c8-495c-ae01-5fb1aef17a05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6c251f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:45.035367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:45.066084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d2e677f-85c8-495c-ae01-5fb1aef17a05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 200 len: 1421 microversion: 2.1 time: 0.104293 Sep 27 01:38:45.066780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08cfd821-8506-4c57-a9a3-83e2a9ea5bf2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.288850 Sep 27 01:38:45.078217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 967/2022] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:38:44 2022] GET /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:45.083786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:45.084475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1056/2023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:44 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:38:45.085105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:45.092992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7031e1c2-fd6c-4cd1-ad74-28fd59945343 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da5c7d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:45.096945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:45.098066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:45.099136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:45.100208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:45.101495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:45.102143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:45.367215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:45.377047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:45.378526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:45.379717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cba88d0-5ce7-4c81-82ee-c95d6ce759ce tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.299766 Sep 27 01:38:45.396263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 968/2024] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:45 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:45.413211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:45.415529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:45.441812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:45.442312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:45.442751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:45.443520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:45.443997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:45.444409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:45.519056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-824f9ce5-710f-459a-ab65-5e9da85c9646 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123148 Sep 27 01:38:45.524894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 969/2025] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:45 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:45.632601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b75cff4-4398-4703-b19c-083daf650187 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da7124c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1976998997", "description": "tempest-description-621502131"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:46.108200 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7031e1c2-fd6c-4cd1-ad74-28fd59945343 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 204 len: 0 microversion: 2.1 time: 1.022352 Sep 27 01:38:46.112118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1057/2026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:45 2022] DELETE /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:46.117149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "772662d5-7c79-47c4-9d53-e8abb1d4e32f", "tag": "ad096b90-1e1b-4720-b23b-e1a59d2c0613"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:46.135672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.136156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.136644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.173982 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] Creating event network-changed:ad096b90-1e1b-4720-b23b-e1a59d2c0613 for instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f on n-h2-859358-1 Sep 27 01:38:46.182010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d5d5b105-f042-4430-969f-cad42d05701b req-b5094649-e432-4a36-9249-0f6d45a44303 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068346 Sep 27 01:38:46.184418 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1058/2027] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:46.199094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:46.200316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:46.209282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.212235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.214517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.217435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.219842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.220512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.495672 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b75cff4-4398-4703-b19c-083daf650187 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.969370 Sep 27 01:38:46.496851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 970/2028] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:46.502987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:46.503815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:46.521140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.521867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.524856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.526072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.526755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.529616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.640346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:46.649086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a5684c9-d9b8-4184-a309-7cb5e9a00cde tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.462523 Sep 27 01:38:46.652692 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1059/2029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:46 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:46.660429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:46.661046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:46.676063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.679499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.680126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.680704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.681169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.681625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.876378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:46.887967 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fde07419-4e8f-4ed7-bf51-fc9566845840 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1552 microversion: 2.1 time: 0.389183 Sep 27 01:38:46.889686 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 971/2030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:46 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1552 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:46.896263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:46.897074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:46.907052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.907868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.908539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.909756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:46.910448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:46.911220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:46.964498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:38:47.130096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:47.144286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fe8170ba-f51f-42b6-912a-f8db6609a6c8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.488517 Sep 27 01:38:47.147675 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1060/2031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:46 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:47.155879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:47.162353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:47.163244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cec0710d-7ab5-4098-ac89-053bba80007d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 204 len: 0 microversion: 2.1 time: 0.271794 Sep 27 01:38:47.164552 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 972/2032] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:38:46 2022] DELETE /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:38:47.172906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c45d6a28-d4eb-4c82-aec2-c35cad33c6c7 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da6cc790>, body: {"security_group_rule": {"parent_group_id": "a9ef5265-6fc4-4904-b2d1-4201621dbd98", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:47.182526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.183406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.185311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:47.190852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.191693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.192421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:47.610770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:47.623789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:47.627518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:47.632438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48eaeca8-3258-4a40-9b63-74ed7d21a14d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.483436 Sep 27 01:38:47.636041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1061/2033] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:47 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:47.650580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:47.653579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:47.666123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.667331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.673889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:47.675016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.675716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.676397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:47.778783 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-37c7f7a9-7621-46de-ac2f-568b7bebe99e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133560 Sep 27 01:38:47.779759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1062/2034] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:47 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:47.785470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-694990914", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8c88e62c-74c5-4ff9-a7df-3a1b273be5ea"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:47.897520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] validate_networks() for [('8c88e62c-74c5-4ff9-a7df-3a1b273be5ea', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:38:47.940593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c45d6a28-d4eb-4c82-aec2-c35cad33c6c7 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.774520 Sep 27 01:38:47.941575 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 973/2035] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:47.954320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:47.955781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:47.966162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.966700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.967146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:47.968004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:47.973983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:47.974793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:48.274349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:48.286768 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ccf1183-938b-4f93-8c75-ddd9d37ba25c tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.343879 Sep 27 01:38:48.304390 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 974/2036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:47 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:48.313632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:48.315351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:48.322250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:48.322740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:48.323176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:48.323886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:48.324612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:48.325051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:48.526259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:48.537680 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a82151c4-c138-4ac8-a92b-70546f7c32ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1552 microversion: 2.1 time: 0.232027 Sep 27 01:38:48.538312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 975/2037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:48 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:48.543064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0a176bb-9f4c-4495-bcaa-e4f554850728 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24d5fa61f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1686719661", "description": "tempest-description-1545810611"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:48.932147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0a176bb-9f4c-4495-bcaa-e4f554850728 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.392742 Sep 27 01:38:48.933069 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 976/2038] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:48 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:48.938193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:48.938813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:48.952847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:48.953514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:48.953807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:48.954516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:48.954966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:48.957661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:49.313102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:49.321956 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee2cbddd-6202-4993-b1c7-db5c97992ddf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.387688 Sep 27 01:38:49.322486 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 977/2039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:48 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:49.341408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:49.342330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:49.361118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:49.366616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:49.367348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:49.368370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:49.371162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:49.373898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.072721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:50.089968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:50.095540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:50.100384 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b80f3cbf-9ce6-47cc-9a07-1c58ef250c34 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.770726 Sep 27 01:38:50.105061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 978/2040] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:49 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:50.114521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:50.144241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:50.165772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.166537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.167175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.168784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.175833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.176573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.237889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3fab80d-f4ad-4f2a-ab2d-3786578aeb9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131426 Sep 27 01:38:50.238997 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 979/2041] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:50 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:50.244079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e9a53ab-abdd-48b1-89c0-dc806e28bb1d tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24d5f96f70>, body: {"security_group_rule": {"parent_group_id": "51c336bc-ca1f-4fe3-b259-06b62fabc9ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:50.359692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:38:50.360298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:38:50.361641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:38:50.362311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:38:50.362950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:38:50.375324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.377916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.378574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.379525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.380171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.380875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.407385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:50.414397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for user 72f64b5a7b76437c9f31cf277c601aa3 and project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:50.431778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:38:50.434601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:38:50.516116 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86083ef5-c7ae-4e1a-9f2c-ac5aca4ab231 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.734935 Sep 27 01:38:50.521289 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1063/2042] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:38:50.546104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:50.548002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:50.559584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:50.563910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.564756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.565497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:50.566546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:50.578999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:50.579851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.150574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e9a53ab-abdd-48b1-89c0-dc806e28bb1d tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.910146 Sep 27 01:38:51.151449 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 980/2043] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:50 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:51.157579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:51.159282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:51.180244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:51.188344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecb0ad24-82ab-4fee-ba47-974183100914 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.665227 Sep 27 01:38:51.188933 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1064/2044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:50 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:51.193326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.193868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.194307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.195021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.195666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.196279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.204036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:51.208440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:51.230473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.233173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.236421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.237572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.240277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.241731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.427061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:51.443877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-338b09c6-3b86-494e-82f3-16eeb26087fb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.290376 Sep 27 01:38:51.444898 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 981/2045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:51 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:51.453263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:51.454229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:51.477292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.478211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.478903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.480957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.482282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.482966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.702159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:51.712966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad204d72-c9f2-487d-b767-047835a36e97 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1211 microversion: 2.1 time: 0.266261 Sep 27 01:38:51.714077 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 982/2046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:51 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1211 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:51.720915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:51.721890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:51.723071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:51.730793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.730995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18565e55-9548-46aa-98c8-9df77077d29e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.540965 Sep 27 01:38:51.732333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.732991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1065/2047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:51 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:51.733722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.734553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:51.735272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:51.735970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:51.757951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1505f5a0-4b2c-4507-8314-1fca7f469bfe tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da5f0820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1699397204", "description": "tempest-description-1794921394"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:52.056709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:52.078963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:52.081844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:52.087559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08a0abd5-d84a-489d-8c7f-d40a86060183 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.372051 Sep 27 01:38:52.103851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 983/2048] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:51 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:52.127316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe47e343-1940-4339-b89c-6eba11c9670a", "name": "network-vif-deleted", "tag": "a9f92cf6-0095-4ac6-8280-c566710efc2a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:52.146014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.147729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.149133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.173765 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] Creating event network-vif-deleted:a9f92cf6-0095-4ac6-8280-c566710efc2a for instance fe47e343-1940-4339-b89c-6eba11c9670a on n-h1-859358-1 Sep 27 01:38:52.184519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0ee560fe-1328-4a4c-83ea-c4981f50d57a req-0438a156-fe52-4652-afa2-0b102f475663 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064381 Sep 27 01:38:52.185896 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 984/2049] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:52.197899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:52.202658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:52.212356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.215290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.215290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.216786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.217628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.218550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.299478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45fa9f74-eba1-4af5-a4be-f5d0a6e71ce7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109126 Sep 27 01:38:52.302566 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 985/2050] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:38:52 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:38:52.323707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a652fc4e-ca56-44d1-a87b-0d683253f9e4", "name": "network-vif-deleted", "tag": "ed39f3f2-6f56-49e8-8521-1a25e45dbfd3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:52.364173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.373858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.374718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.395019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:52.421075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1505f5a0-4b2c-4507-8314-1fca7f469bfe tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.686481 Sep 27 01:38:52.421834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1066/2051] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:52.428894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-plugged", "status": "completed", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:52.471902 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] Creating event network-vif-deleted:ed39f3f2-6f56-49e8-8521-1a25e45dbfd3 for instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 on n-h1-859358-1 Sep 27 01:38:52.486354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.489057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.489550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.491467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f23fab26-85f7-4b80-ad27-5e1e0723e502 req-86a266ee-c995-4c10-a7d5-de2c5ff62cfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183465 Sep 27 01:38:52.497940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 986/2052] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:52.518632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:52.521599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:52.536640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] Creating event network-vif-plugged:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:38:52.549684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a8b4cf6f-4254-4250-bd52-cb0ec1b3d6d6 req-b77484fc-4422-4ef4-88f2-d32c9cb3566c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126322 Sep 27 01:38:52.560578 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1067/2053] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:52.566313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.567266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.567756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.569123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.570014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.570488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.573881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4679a0b4-2b2b-4bcb-8a76-a43570442b9c tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da56de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2026787010", "description": "tempest-description-1365482460"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:52.893579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4679a0b4-2b2b-4bcb-8a76-a43570442b9c tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.330299 Sep 27 01:38:52.894805 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1068/2054] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:52.906940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:52.907709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:52.918934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.920481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.921169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.922115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.923370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.924164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.947036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:52.956483 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-655f9be5-a472-4917-8c53-f1e260b75e90 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.455836 Sep 27 01:38:52.973699 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 987/2055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:52 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:52.980409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:52.981379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:52.989843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.990666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.991554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:52.992520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:52.993219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:52.993921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.015925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.029031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-241c97ad-809c-4d53-848a-162be7dfeb05 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.130985 Sep 27 01:38:53.029678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1069/2056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:52 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:53.042573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:53.045394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:53.055754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:53.056279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:53.056725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.057581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:53.058042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:53.058478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.151387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.161443 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ce69a08-559d-4f1b-b6ff-9eea21975540 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1259 microversion: 2.1 time: 0.186047 Sep 27 01:38:53.162724 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 988/2057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:52 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:53.176213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99aff7fb-5cfa-4c96-bd51-84ea1031c971 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24d5f969d0>, body: {"security_group_rule": {"parent_group_id": "24a2fda3-b7af-4589-b6f6-91d26ac2586f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9aa98efb-c7e1-4202-b7bc-3d5dec9277ca"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:53.470072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.491536 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5bcd4043-75ec-423b-806c-b08d00f90464 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.458636 Sep 27 01:38:53.492256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1070/2058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:53 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:53.498942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:53.500386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:53.513239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:53.513981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:53.514526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.515682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:53.516352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:53.516891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.734590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.747343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.748802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:53.750118 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7914fbc0-cd07-4bfc-8fcc-72496947a759 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.256097 Sep 27 01:38:53.751134 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1071/2059] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:53 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:53.809839 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99aff7fb-5cfa-4c96-bd51-84ea1031c971 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.645595 Sep 27 01:38:53.810476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 989/2060] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:53 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:53.823675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc2c907a-d24d-4602-a822-f53ce2be4799 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da56d700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1416302759", "description": "tempest-description-905640074"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:53.984344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:53.985051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:53.994704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:53.995832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:53.997587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:53.998620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.001774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.002678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.095649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc2c907a-d24d-4602-a822-f53ce2be4799 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.275791 Sep 27 01:38:54.096766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1072/2061] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:54.113415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:54.114526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:54.123660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.124531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.125196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.126397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.127085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.128981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.156545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:54.258311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:54.271338 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7221dae9-07a2-438f-a86b-431e97b22381 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.162370 Sep 27 01:38:54.272407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1073/2062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:54 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:54.277697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af92f38a-90c4-4862-8901-f3fdbd79604b tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da56d310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1296170864", "description": "tempest-description-136496226"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:54.373007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:54.384155 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b6b8a9c-f725-4bae-ba50-263f7aafcc1e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1312 microversion: 2.1 time: 0.403772 Sep 27 01:38:54.399894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 990/2063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:53 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:54.411838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:54.412933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:54.422043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.422984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.423663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.424630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.426358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.427221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.678875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af92f38a-90c4-4862-8901-f3fdbd79604b tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.405153 Sep 27 01:38:54.679477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1074/2064] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:54 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:54.692498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:54.693126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:54.703134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.704127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.705515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.707364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:54.708602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:54.709244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:54.761100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:54.772365 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74403c6c-156a-41d9-bb7b-fb190314840e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.370966 Sep 27 01:38:54.772956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 991/2065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:54 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:54.952172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b873b91-3b51-494a-8662-463af16d19e4 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24d6774f70>, body: {"keypair": {"name": "tempest-keypair-554576589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLroVEwGP8aP6WRUJXxry1tilZsCtT3/Gk152kwmESXRm4obuwsV5sOpiRJuGV/IwgWb7xFt5oO6rX5mf0wiG4g+udFIQ3rTUcH5ZSkQ4b61lNfPZZTbT/fU/wEU5v1EOw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:54.975705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:54.978568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4b873b91-3b51-494a-8662-463af16d19e4 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:54.984896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f223df0e-9094-4cf3-b754-6f13d2fea169 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.304380 Sep 27 01:38:54.987162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4b873b91-3b51-494a-8662-463af16d19e4 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:54.993457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1075/2066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:54 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:55.003474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-272e1192-5fd1-4b1d-98f7-e2cb9b9b0d52 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da531160>, body: {"security_group_rule": {"parent_group_id": "a505ed44-9787-482f-9737-d98ecc833136", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1e58f182-afe2-4654-96bb-ef81bec85330"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:55.039926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b873b91-3b51-494a-8662-463af16d19e4 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263303 Sep 27 01:38:55.049146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 992/2067] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:55.053516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.058152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:55.061319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:55.067526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.069306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.070023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.071480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.072568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.073828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.355458 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-272e1192-5fd1-4b1d-98f7-e2cb9b9b0d52 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.364082 Sep 27 01:38:55.356145 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1076/2068] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:55.359318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:55.361100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772662d5-7c79-47c4-9d53-e8abb1d4e32f", "name": "network-vif-plugged", "status": "completed", "tag": "ad096b90-1e1b-4720-b23b-e1a59d2c0613"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:55.373188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.373927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.375087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.376889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:55.379099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:55.380958 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-743fced7-8013-4bb2-802e-493fa0fe64d9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.333399 Sep 27 01:38:55.382087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 993/2069] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:55.388652 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] Creating event network-vif-plugged:ad096b90-1e1b-4720-b23b-e1a59d2c0613 for instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f on n-h2-859358-1 Sep 27 01:38:55.394348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-53dbdf22-39e5-43c5-bd3f-77b6f59cda0b req-661f21bd-df84-4d0f-962e-3eca06e2ccfa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Sep 27 01:38:55.400041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1077/2070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:55.402094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce47c00b-8e38-4a55-a1a9-c483afffbc78 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24d67745e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.407681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.408741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:55.415590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.416526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.416957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce47c00b-8e38-4a55-a1a9-c483afffbc78 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-554576589" status: 200 len: 497 microversion: 2.1 time: 0.033194 Sep 27 01:38:55.417552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.418434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.419145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.419738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.424139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 994/2071] 10.222.0.52 () {58 vars in 1215 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-554576589 => generated 497 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:55.430486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9272c271-3289-48ee-aa13-225944b750b9 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d5f994c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.489154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:55.498440 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-076c9d1a-97a7-4e75-aee4-5f7477dd98b8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.096840 Sep 27 01:38:55.499022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1078/2072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:55.504314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.504950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:55.519509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.519909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.521223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.522021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.522532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.523184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.736502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:55.746094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8787308b-8123-4580-8f3d-09aac1bdd8e8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1462 microversion: 2.1 time: 0.245281 Sep 27 01:38:55.764829 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1079/2073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1462 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:55.770268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26bcac8d-5537-4321-b78b-8fd511dd6477 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24da556af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.803109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26bcac8d-5537-4321-b78b-8fd511dd6477 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554576589" status: 202 len: 0 microversion: 2.1 time: 0.036759 Sep 27 01:38:55.804134 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1080/2074] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554576589 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:55.809212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.810588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:55.817189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.817723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.818159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.819305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.819620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.820247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.845645 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9272c271-3289-48ee-aa13-225944b750b9 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1e58f182-afe2-4654-96bb-ef81bec85330" status: 202 len: 0 microversion: 2.1 time: 0.419765 Sep 27 01:38:55.847291 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 995/2075] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:55 2022] DELETE /compute/v2.1/os-security-groups/1e58f182-afe2-4654-96bb-ef81bec85330 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:55.855816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:55.856928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:55.866724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.867547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.868176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.869076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.869739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.870361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.965194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1679ff99-15bb-49a9-8c25-1697e496403f tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1613 microversion: 2.1 time: 0.159088 Sep 27 01:38:55.966468 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1081/2076] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:55.974826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ab2782-bd65-42dc-adf5-20c04bac9113", "tag": "0119ebdb-334a-4237-ac56-e48b77e13bd5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:55.986201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:55.986675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:55.987096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:55.999004 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] Creating event network-changed:0119ebdb-334a-4237-ac56-e48b77e13bd5 for instance 75ab2782-bd65-42dc-adf5-20c04bac9113 on n-h2-859358-1 Sep 27 01:38:56.004016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-35e7edde-fcf6-4145-a510-5753dd9bf863 req-b4665490-4a60-43f9-8aaa-486a568e14f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034973 Sep 27 01:38:56.004610 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1082/2077] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:56.020052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6960f55-25ae-45c7-8e97-fc01283b17eb tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24da531700>, body: {"keypair": {"name": "tempest-keypair-184849149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnTqsObPHSamk5hSYn3iDnaS/leg0GhXb8ENwdFCAQRALaIpCBUafq1hzRPX+/uffPe35RWLeX/qhhkr8AIROCdpSRbc75bd9NVmAA5JTneeJfTZXzT6Vu8GWb63I25iA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:56.043195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a6960f55-25ae-45c7-8e97-fc01283b17eb tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:56.050852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.052824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a6960f55-25ae-45c7-8e97-fc01283b17eb tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:56.060513 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe8eba13-864c-4213-8877-490d44347193 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.210964 Sep 27 01:38:56.073928 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 996/2078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:55 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:56.080470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6960f55-25ae-45c7-8e97-fc01283b17eb tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072340 Sep 27 01:38:56.080470 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1083/2079] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:56.082789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f5e9b3f-bb6b-4d02-beb1-ce973b6a7daf tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d6774670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.084329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:56.085166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:56.091622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.092035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.092470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.093173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.093654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.094080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.124560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '41a88f32357d4ef799c49031cfe12d26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e594c37169d4384a8a2db19ff852d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.125274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] flavor_id is None. Assuming migration. {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 27 01:38:56.125740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 01:38:56.134405 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f5e9b3f-bb6b-4d02-beb1-ce973b6a7daf tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/a505ed44-9787-482f-9737-d98ecc833136" status: 200 len: 247 microversion: 2.1 time: 0.058998 Sep 27 01:38:56.144268 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 997/2080] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:38:56 2022] GET /compute/v2.1/os-security-groups/a505ed44-9787-482f-9737-d98ecc833136 => generated 247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:56.148806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.149247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:56.155935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.156426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.156861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.157593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.158057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.158484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.298146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.307414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4cc02c4-4335-4bde-a862-38b6eb2e6f38 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1317 microversion: 2.1 time: 0.162579 Sep 27 01:38:56.318983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 998/2081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:56 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:56.325679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f8c73bd-a658-45f7-a8a0-a6baba026dbd tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24d68bf310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.348080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f8c73bd-a658-45f7-a8a0-a6baba026dbd tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184849149" status: 202 len: 0 microversion: 2.1 time: 0.027201 Sep 27 01:38:56.349050 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 999/2082] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184849149 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:56.354212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4af8147-378c-4798-a33c-1b81e9e7b83d tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24d5f99160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1497495363", "description": "tempest-description-1873294208"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:56.436668 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94b92f0c-e9d5-4e3e-9a9f-4b16189f95dd tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e/action" status: 202 len: 0 microversion: 2.1 time: 0.356155 Sep 27 01:38:56.437612 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1084/2083] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:56 2022] POST /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:56.442395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6598a47-87e7-49d0-a53d-9edbc55b0617 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24da556430>, body: {"keypair": {"name": "tempest-keypair-1883542355", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:56.460520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d6598a47-87e7-49d0-a53d-9edbc55b0617 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:56.467784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d6598a47-87e7-49d0-a53d-9edbc55b0617 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:56.496724 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6598a47-87e7-49d0-a53d-9edbc55b0617 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.057788 Sep 27 01:38:56.497704 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1085/2084] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:56 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:56.507063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.508295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:56.514956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.517167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.517167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.517167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.517580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.518021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.582769 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4af8147-378c-4798-a33c-1b81e9e7b83d tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.232466 Sep 27 01:38:56.583552 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1000/2085] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:38:56 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:56.588104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.588714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:56.601998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.602811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.603404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.604286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.604902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.605519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.699306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.709841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.711561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.713079 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-668d2702-0bad-4d64-ac64-edc5fedbe80b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.214129 Sep 27 01:38:56.714298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1086/2086] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:56 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:56.720081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-970f4a2d-1846-4247-85d9-5074d4214846 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24da5c7820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.749869 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-970f4a2d-1846-4247-85d9-5074d4214846 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883542355" status: 202 len: 0 microversion: 2.1 time: 0.034120 Sep 27 01:38:56.751277 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1087/2087] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883542355 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:56.766021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:56.766998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:56.774269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.775115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.775803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.776719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:56.777642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:56.778254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:56.865773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:56.874693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac1a766b-ce66-4649-8a8b-c57e008b2c8f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.122139 Sep 27 01:38:56.885945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1088/2088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:56 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:56.899722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6fec5425-9396-4bb0-8b05-6b4aea2d6388 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da531670>, body: {"security_group_rule": {"parent_group_id": "793b8d8d-54f2-4d42-a8ad-94f33f37a60b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:57.203223 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6fec5425-9396-4bb0-8b05-6b4aea2d6388 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.306380 Sep 27 01:38:57.206152 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1089/2089] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.226222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af780928-9c4c-41c9-8455-095737b1149f tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24da5c7af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1321195900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEdTZvwlHRPovHwyyeVJvwCDn3xHsOlAwKpLx5TYm+3f3ZedcG+uz54OZDMjQtVexZDb90KFDt0y3Xkw8zyHqqA8hxIN4/ggQRiZBKHXKE2X57RJdyNOiVhGd9fu+z8bg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:57.241795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:57.250573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be7f96fc-53f4-40b0-b34b-1e21844685a8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1471 microversion: 2.1 time: 0.666015 Sep 27 01:38:57.260748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-af780928-9c4c-41c9-8455-095737b1149f tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:57.261247 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1001/2090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:56 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1471 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:57.268279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:57.269063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-af780928-9c4c-41c9-8455-095737b1149f tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:57.269325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:57.285495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.285990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.286425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.287339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.288925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.294117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.304239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af780928-9c4c-41c9-8455-095737b1149f tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.096670 Sep 27 01:38:57.315707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1090/2091] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.328490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3875191f-0f4e-406a-a4ac-b61493fa0237 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Action: 'create', calling method: .version_select at 0x7f24da531e50>, body: {"security_group_rule": {"parent_group_id": "793b8d8d-54f2-4d42-a8ad-94f33f37a60b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:57.580305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:57.592888 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ab0ea4b-8fbc-45ce-8a41-1c4c283e16a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.329965 Sep 27 01:38:57.598529 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1002/2092] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:57 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:57.603613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3875191f-0f4e-406a-a4ac-b61493fa0237 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.292822 Sep 27 01:38:57.607234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fea60b86-85fd-419f-914f-ec6ef8382108 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24d68001f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1548520062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZ/4GH8sL6QgJdtnvkx2SRpaTGD7Cmvkp9VUwcpvDrkA7y8+lYsLm4Ei7xX3Q1RTe9R2yb0qb/ZPX7CNCA8KN7k/XhB6zvexP+okhFQtNY83o1J4xWs9lMuUQBB1laeUQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:57.611781 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1091/2093] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:38:57 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.617029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:57.617682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:57.631767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.632266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.632700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.633451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.633908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.634333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.640749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-fea60b86-85fd-419f-914f-ec6ef8382108 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:57.647102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-fea60b86-85fd-419f-914f-ec6ef8382108 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:57.677784 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fea60b86-85fd-419f-914f-ec6ef8382108 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.077927 Sep 27 01:38:57.687892 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1003/2094] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.687892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f34af00-7098-4dc4-acb3-8d3db11b1397 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d7117f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:57.809815 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f34af00-7098-4dc4-acb3-8d3db11b1397 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/793b8d8d-54f2-4d42-a8ad-94f33f37a60b" status: 200 len: 665 microversion: 2.1 time: 0.130385 Sep 27 01:38:57.810754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1004/2095] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:38:57 2022] GET /compute/v2.1/os-security-groups/793b8d8d-54f2-4d42-a8ad-94f33f37a60b => generated 665 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.816026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a207c0bc-0ff8-4ca2-ad21-20317a224be1 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Action: 'create', calling method: .version_select at 0x7f24d66f2e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-142865306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEj8xIWEhyph/Yb6AX7NcKwIDr7IQKBn1cqCU6VAcjPa8laYfUx0iuRB3ZzNYJ62Hv/3i7KWB+SZuFP5oCGHW0dL2CsjHToP7+qvPQF+lnsLZk/Ox73ITVglOWRFJIlFQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:57.845418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:57.852972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a207c0bc-0ff8-4ca2-ad21-20317a224be1 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:38:57.857892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a58a77a-2b40-40e6-8512-ac3180992203 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1507 microversion: 2.1 time: 0.244707 Sep 27 01:38:57.858799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1092/2096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:57 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:57.863076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a207c0bc-0ff8-4ca2-ad21-20317a224be1 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Getting quotas for user 0be00220c9af4ffbb7e876788ad6dff4 and project f174535d80b64492b98416897d7a6d5d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:38:57.867393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:57.868831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:57.877280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.878051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.878682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.879607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:57.880282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:57.880875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:57.921157 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a207c0bc-0ff8-4ca2-ad21-20317a224be1 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.109202 Sep 27 01:38:57.926936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1005/2097] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:38:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:38:57.926936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fbed1b9-62b3-403a-94a9-4e23ac96ede1 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d5fa68b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.053009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.062575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.063994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.066443 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d29245d-4ccb-4ca1-98bd-012b710158b2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.206374 Sep 27 01:38:58.067002 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1093/2098] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:57 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:58.072747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.073366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.079976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.080458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.080884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.081606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.082077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.082828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.281501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.291193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f68ac850-62b9-42c7-88e5-9d863987a69b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1507 microversion: 2.1 time: 0.223047 Sep 27 01:38:58.306273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1094/2099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:58 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:58.316263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.317055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.335567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.338519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.339266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.341903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.343363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.344009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.430597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.444585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da518dff-c060-43fe-93af-68bdaf170d98 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.136828 Sep 27 01:38:58.445911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1095/2100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:58 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:58.472478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ba5e3ede-207d-457a-8f73-fab18d931517 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24da531c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.478406 n-d-859358-1 devstack@n-api.service[128778]: WARNING oslo_db.sqlalchemy.utils [None req-ba5e3ede-207d-457a-8f73-fab18d931517 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:38:58.482200 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fbed1b9-62b3-403a-94a9-4e23ac96ede1 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/00786c07-7149-4177-8ec5-0a0338618eca" status: 202 len: 0 microversion: 2.1 time: 0.559244 Sep 27 01:38:58.482704 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1006/2101] 10.222.0.52 () {58 vars in 1287 bytes} [Tue Sep 27 01:38:57 2022] DELETE /compute/v2.1/os-security-group-rules/00786c07-7149-4177-8ec5-0a0338618eca => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:58.489374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.490003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.493443 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ba5e3ede-207d-457a-8f73-fab18d931517 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.045213 Sep 27 01:38:58.494515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1096/2102] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:38:58 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:58.515852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:38:58.516804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.517303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.517820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.518536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.518986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.519412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.519793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.541471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.543062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.544715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.545964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.546599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.547302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.650268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:38:58.651521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:38:58.652193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:38:58.652778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:38:58.653700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:38:58.734528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:58.744617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a185e978-dd25-4854-b943-6cfbbae6698d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1471 microversion: 2.1 time: 0.260871 Sep 27 01:38:58.745190 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1007/2103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:58 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:58.752009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-808794e6-3eff-428d-b7a1-c743d045f4c9 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d6d8b310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.752671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.767287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.768145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.768800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.769874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.771230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.772021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.799753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:58.807960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e30ffcf-0ab4-48ee-9761-b59f784a5984 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "POST /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f/action" status: 202 len: 1109 microversion: 2.1 time: 0.312006 Sep 27 01:38:58.810214 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1097/2104] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:38:58 2022] POST /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f/action => generated 1109 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 27 01:38:58.816147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d274a201-e6d3-45dd-a116-c9efff482973 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24da544ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.844241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d274a201-e6d3-45dd-a116-c9efff482973 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-142865306" status: 202 len: 0 microversion: 2.1 time: 0.031937 Sep 27 01:38:58.845451 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1098/2105] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-142865306 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:58.851044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:58.852015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:58.859761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.860692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.861998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:58.862998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:58.863657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:58.865032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.032897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.042919 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb634d68-14eb-455c-aa86-498a088f9366 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.196180 Sep 27 01:38:59.043563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1099/2106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:58 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:59.049133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.049851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:59.055032 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-808794e6-3eff-428d-b7a1-c743d045f4c9 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/793b8d8d-54f2-4d42-a8ad-94f33f37a60b" status: 202 len: 0 microversion: 2.1 time: 0.306491 Sep 27 01:38:59.055589 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1008/2107] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:58 2022] DELETE /compute/v2.1/os-security-groups/793b8d8d-54f2-4d42-a8ad-94f33f37a60b => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:59.061483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be1e95d1-47f4-44a6-9711-ef85208da432 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24d6adf430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.070465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:38:59.073376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.075232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.077685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.078480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.080969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.081519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.106118 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be1e95d1-47f4-44a6-9711-ef85208da432 tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1548520062" status: 202 len: 0 microversion: 2.1 time: 0.048655 Sep 27 01:38:59.107459 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1009/2108] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1548520062 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:59.114449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d66f2940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.139112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:38:59.140078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Neutron security group 1e58f182-afe2-4654-96bb-ef81bec85330 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:38:59.140907 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] HTTP exception thrown: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.140907 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Request method failure captured: Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/1e58f182-afe2-4654-96bb-ef81bec85330 HTTP/1.1 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlQkifAWbktgbhelcC6n0SGNmeklj7S3wAkp4lMROk6dGGDKB1Nep1p1VKs_QaJlYMBNeCXW5ATVLjMReX7TWoH649E90JP831q0eurTiC9X6aFWh_eNbCKwnRWHYdLRXzUtf5W4YpE1xiDhvmiAzIo34Gn1Mp2dXgk--3wNM0MMYic Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: e2463c6cef4540458e0f3adf0f181932 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1929610068 Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:38:59.152175 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e2463c6cef4540458e0f3adf0f181932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e2463c6cef4540458e0f3adf0f181932"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e2463c6cef4540458e0f3adf0f181932"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e2463c6cef4540458e0f3adf0f181932", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1929610068 Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: e2463c6cef4540458e0f3adf0f181932 Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1929610068 Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesTestJSON-1929610068-project Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cfcd99b19d9c4d8aa0121dad9d486d3e Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1929610068-project Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.154153 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '1e58f182-afe2-4654-96bb-ef81bec85330'} Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:38:59.155174 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.156876 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:38:59.158829 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Returning 404 to user: Security group 1e58f182-afe2-4654-96bb-ef81bec85330 does not exist Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-731929af-11a3-4fc1-a051-30450ffbffbf'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6354a26c-4d9a-4d45-ab85-d83354b81538 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1e58f182-afe2-4654-96bb-ef81bec85330" status: 404 len: 194 microversion: 2.1 time: 0.046420 Sep 27 01:38:59.160670 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1010/2109] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-security-groups/1e58f182-afe2-4654-96bb-ef81bec85330 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:38:59.166449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.167153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:59.174172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.174739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.175330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.176091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.176718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.177212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.243385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.253153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e90d307-e240-48cb-97c7-923c0fd9086a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.207551 Sep 27 01:38:59.253789 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1100/2110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:59 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:59.275641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71acf956-fad5-4db3-afde-a5944b3037cd tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] Calling method '.version_select at 0x7f24da544f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.301550 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71acf956-fad5-4db3-afde-a5944b3037cd tempest-KeyPairsV2TestJSON-1633888752 tempest-KeyPairsV2TestJSON-1633888752-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1321195900" status: 202 len: 0 microversion: 2.1 time: 0.030405 Sep 27 01:38:59.306173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1101/2111] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1321195900 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:59.308569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2af7ded7-8af6-44a3-9bfd-daadf737c3cf tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24da56d430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.354675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.366904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.369661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.371079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77343762-303c-41ec-8503-1c9bf36d9081 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.213721 Sep 27 01:38:59.372116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1011/2112] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:38:59 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:38:59.472660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.473283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:59.480327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.480819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.481258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.482958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.484065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.484751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.574475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:38:59.575656 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2af7ded7-8af6-44a3-9bfd-daadf737c3cf tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a505ed44-9787-482f-9737-d98ecc833136" status: 202 len: 0 microversion: 2.1 time: 0.272390 Sep 27 01:38:59.577276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1102/2113] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-security-groups/a505ed44-9787-482f-9737-d98ecc833136 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:59.587478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bd3b35c-4561-463d-a68f-8bc14738cf38 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24da5568b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.592587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4d8bb70-9e88-4f4e-91b3-813a3b682ab3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1345 microversion: 2.1 time: 0.123680 Sep 27 01:38:59.593451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1012/2114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:59 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:38:59.768836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:38:59.769561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:38:59.775766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.776831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.777768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.782787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:38:59.783418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:38:59.783868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:38:59.808644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3bd3b35c-4561-463d-a68f-8bc14738cf38 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9aa98efb-c7e1-4202-b7bc-3d5dec9277ca" status: 202 len: 0 microversion: 2.1 time: 0.227320 Sep 27 01:38:59.809974 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1103/2115] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-security-groups/9aa98efb-c7e1-4202-b7bc-3d5dec9277ca => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:38:59.820053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0bcb98f5-7146-4db7-a1a7-dd6a5555ae8e tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d5be2790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.062826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.072511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0bcb98f5-7146-4db7-a1a7-dd6a5555ae8e tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/24a2fda3-b7af-4589-b6f6-91d26ac2586f" status: 202 len: 0 microversion: 2.1 time: 0.258127 Sep 27 01:39:00.073292 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1104/2116] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:38:59 2022] DELETE /compute/v2.1/os-security-groups/24a2fda3-b7af-4589-b6f6-91d26ac2586f => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:00.079645 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc403318-e360-46e1-af3c-b77a6b48fa70 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1471 microversion: 2.1 time: 0.314348 Sep 27 01:39:00.080451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1013/2117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:38:59 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:00.086352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6993777d-cc9b-4f50-ad76-2ae555dbc4a3 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24d5f9c670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.093220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.094343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:00.101874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.102713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.103480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.104540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.105390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.106743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.295260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.305022 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-540d2aad-0951-4823-8098-edea74ac5084 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.225351 Sep 27 01:39:00.306589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1105/2118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:00 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:00.314149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.315428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:00.323162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.323689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.324175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.325868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.326678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.327164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.395554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:00.512950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.523731 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fffb9fb2-8f81-4ef5-b60d-a1fd7ac550ec tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.215794 Sep 27 01:39:00.526238 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1106/2119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:00 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:00.567197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.567826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:00.573984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.574508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.574966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.575781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.577308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.578111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.630544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6993777d-cc9b-4f50-ad76-2ae555dbc4a3 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/51c336bc-ca1f-4fe3-b259-06b62fabc9ac" status: 202 len: 0 microversion: 2.1 time: 0.548840 Sep 27 01:39:00.631112 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1014/2120] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:39:00 2022] DELETE /compute/v2.1/os-security-groups/51c336bc-ca1f-4fe3-b259-06b62fabc9ac => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:00.636663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.637902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:00.647627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.648499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.649163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.650098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.650723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.651434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.720653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:00.721470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:00.722106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:00.722815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'fault' on Instance uuid fe47e343-1940-4339-b89c-6eba11c9670a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:00.788022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.799758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.801495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.802727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:00.803601 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa9e376a-6553-423c-983f-00541afc8798 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.277234 Sep 27 01:39:00.804935 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1107/2121] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:00 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:00.810915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82820339-68f3-4ecb-8cd7-ffdfeea33e23 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] Calling method '.version_select at 0x7f24da5315e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:00.823939 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11a27c15-8ff9-43ba-995d-04e00c6728f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 200 len: 1350 microversion: 2.1 time: 0.191519 Sep 27 01:39:00.827456 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1015/2122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:00 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 1350 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:01.118886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:01.119633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:01.132215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.137309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82820339-68f3-4ecb-8cd7-ffdfeea33e23 tempest-SecurityGroupRulesTestJSON-1929610068 tempest-SecurityGroupRulesTestJSON-1929610068-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a9ef5265-6fc4-4904-b2d1-4201621dbd98" status: 202 len: 0 microversion: 2.1 time: 0.330200 Sep 27 01:39:01.143613 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1108/2123] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:39:00 2022] DELETE /compute/v2.1/os-security-groups/a9ef5265-6fc4-4904-b2d1-4201621dbd98 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:01.143932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.143932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.143932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.143932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.144260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.335356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:01.336005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:01.350245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.350979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.352103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.354433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.356647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.357097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.596595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:01.607706 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7395f088-5496-496c-ae1f-077a267bab05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.276656 Sep 27 01:39:01.609123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1109/2124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:01 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:01.614309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:01.615151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:01.623298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.623958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.624483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.625500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.626218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.626869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.637568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:01.651447 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f523e43f-55ab-4011-b50f-ad6f610c4a77 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1471 microversion: 2.1 time: 0.539549 Sep 27 01:39:01.652030 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1016/2125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:01 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:01.832804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:01.834245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:01.848886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.849816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.850473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.851508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.852173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.853898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.918076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:01.930798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f8b104e-93c0-4b2c-a583-a760781f28ca tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.320033 Sep 27 01:39:01.931750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1110/2126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:01 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:01.937648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:01.938555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:01.949911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.956246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.956772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.957555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:01.958469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:01.959075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:01.978652 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a HTTP/1.1 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:39:01.980683 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:01.983102 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'fe47e343-1940-4339-b89c-6eba11c9670a'} Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:39:01.984157 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:01.985881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:01.990740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:39:01.992156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3d278be-32a8-4713-b2f3-397cfb458253 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 404 len: 111 microversion: 2.1 time: 0.058881 Sep 27 01:39:01.993978 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1111/2127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:01 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:39:02.388994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:02.391327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:02.401627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.402393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.403935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.417370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.417502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.417864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.474863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a/os-volume_attachments HTTP/1.1 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:39:02.485379 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:02.487328 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': 'fe47e343-1940-4339-b89c-6eba11c9670a'} Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:39:02.488313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:39:02.489996 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:02.495589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:39:02.498034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e3b6828-713e-4e1a-986f-9c5978358789 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.113083 Sep 27 01:39:02.506344 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1112/2128] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:39:02 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a/os-volume_attachments => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:39:02.634460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:02.635078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:02.657753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.658420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.658880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.659636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.660093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.673113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.760332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:02.783763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:02.786081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:02.787511 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b390070-d542-479c-8026-3175718938d6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.960824 Sep 27 01:39:02.788308 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1017/2129] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:01 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:02.796941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:02.799652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:02.815604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.816681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.817302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.829675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:02.830447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:02.831106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:02.844586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:03.003873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:03.017684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6f469ed-101b-4925-9737-3ad094e7c4aa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.387797 Sep 27 01:39:03.018288 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1113/2130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:02 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:03.040667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2117194729", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:03.120791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:03.315508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:03.334771 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1cf95d6-15d8-445a-baee-6e080378b188 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1471 microversion: 2.1 time: 0.544681 Sep 27 01:39:03.335991 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1018/2131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:02 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:03.343478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:03.344680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:03.351340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:03.352055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:03.352676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:03.366626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:03.367143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:03.367672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:03.711650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:03.719577 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcd56f38-959e-48f3-994d-3e9539060e90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.382046 Sep 27 01:39:03.722786 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1019/2132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:03 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:03.820968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:03.821639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:03.834800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:03.836357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:03.836823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:03.839806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:03.842117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:03.843133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.144468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:04.157786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:04.160221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:04.162563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b39c16e8-df6f-4515-9165-c737cb7d067c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.347970 Sep 27 01:39:04.164069 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1020/2133] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:03 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:04.169898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:04.170540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:04.181470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.186075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.187488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.192045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.194149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.195450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.546887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:04.548222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:04.548222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:04.548548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:04.548652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:04.565033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:04.571750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.572422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.573132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.574071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.575819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.576398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.580236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd0c33a9-ad28-4c07-968f-8df2d8776c5b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.414099 Sep 27 01:39:04.581193 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1021/2134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:04 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:04.597714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:04.598958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:04.609273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.610244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.610948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.612185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.612890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.613968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.627873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:04.644863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:04.687714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:04.697743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:04.795077 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f40ac12b-29f3-46d2-aad4-50975fb43b94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758907 Sep 27 01:39:04.798160 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1114/2135] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:04.808312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:04.808945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:04.818732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.819237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.819677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.821274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:04.822413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:04.823051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:04.962923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:04.975598 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06d7ec9e-938c-4aed-a845-2e491442dbe6 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.393147 Sep 27 01:39:04.983036 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1022/2136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:04 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:04.998871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-294e3f0d-7cc3-410e-a312-f7a74c7a4aa4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:05.006642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-294e3f0d-7cc3-410e-a312-f7a74c7a4aa4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:05.184276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:05.198055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-775b6c37-4308-4a4d-8d09-5f613feefb50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.398227 Sep 27 01:39:05.201095 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1115/2137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:04 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:05.247451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:05.250796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:05.276956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.277823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.279172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.280127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.281015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.281838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.697010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:05.710302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:05.710664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-294e3f0d-7cc3-410e-a312-f7a74c7a4aa4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:05.711852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:05.721380 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6722af92-ee03-4ac9-8b21-d39fdb4d9b43 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.519102 Sep 27 01:39:05.722236 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1116/2138] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:05 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:05.727531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab2782-bd65-42dc-adf5-20c04bac9113", "name": "network-vif-plugged", "status": "completed", "tag": "0119ebdb-334a-4237-ac56-e48b77e13bd5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:05.733844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-294e3f0d-7cc3-410e-a312-f7a74c7a4aa4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 200 len: 1215 microversion: 2.1 time: 0.749466 Sep 27 01:39:05.734973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1023/2139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:04 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 1215 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:05.749086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.749602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.753912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.759752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:05.760643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:05.769208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] Creating event network-vif-plugged:0119ebdb-334a-4237-ac56-e48b77e13bd5 for instance 75ab2782-bd65-42dc-adf5-20c04bac9113 on n-h2-859358-1 Sep 27 01:39:05.778629 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-123e2565-a97c-40d1-88d5-27f8fb07b29f req-aa547872-b6d6-4d8a-b6ef-daaa462dbc07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054848 Sep 27 01:39:05.780037 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1117/2140] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:05.786187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:05.786941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:05.794821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.795322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.795760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.796486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.796942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.797395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.803924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.811894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.812347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.813107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.819783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.820350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.839693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:39:05.856968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:05.857757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:05.859393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:05.945494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'flavor' on Instance uuid 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:06.077051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'system_metadata' on Instance uuid 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:06.195728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'metadata' on Instance uuid 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:06.397939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:06.398722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:06.399228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:06.553069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:06.614319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7deb2c5-beea-42e7-b438-75c75b38c44f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 204 len: 0 microversion: 2.1 time: 0.831776 Sep 27 01:39:06.615769 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1118/2141] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:39:05 2022] DELETE /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:39:06.622262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:06.623483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:06.634493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:06.635425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:06.636203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:06.637961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:06.638662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:06.639309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:06.669767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:06.685857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7333e61-8ac7-4efe-ae35-7ad381c0ea33 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.949396 Sep 27 01:39:06.690499 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1024/2142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:05 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:06.714699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:06.718588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:06.738613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:06.739155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:06.740752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:06.741526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:06.742491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:06.743117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.200156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.210215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-510f2fdb-7a81-4ede-a4a1-96080896fb46 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.592778 Sep 27 01:39:07.229523 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1119/2143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:06 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:07.239103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:07.240304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:07.247879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.248739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.249499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.250730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.251419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.252313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.263835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.278704 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12d978e0-ba56-41e8-8252-51a1ec38935f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.581452 Sep 27 01:39:07.305109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1025/2144] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:06 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:07.324083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:07.324083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:07.339245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.339880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.344875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.345705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.346474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.347334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.364205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.376816 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e04e0b2d-cf70-4d0e-8b80-49c76ff86c06 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 200 len: 1217 microversion: 2.1 time: 0.141276 Sep 27 01:39:07.377650 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1120/2145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:07 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:07.719693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:07.720881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:07.739093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.740651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.741278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.742853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:07.743497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:07.746161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:07.849501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.860835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.867905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:07.875210 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-445341e3-65d0-4b34-8d9e-3d4ed4a9fa15 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.568299 Sep 27 01:39:07.908200 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1026/2146] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:07 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:08.241925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:08.242986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:08.263606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.265708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.266317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.270875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.271472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.272042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.539728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:08.552123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4270007e-024a-481d-8e49-de6d1427d6d8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1307 microversion: 2.1 time: 0.835674 Sep 27 01:39:08.565360 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1121/2147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:07 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1307 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:08.565360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:08.565360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:08.570080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.570080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.570080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.570447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.570666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.571099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.869604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:08.890181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d94a46b-47af-47cf-a411-51d8868fb1c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.652062 Sep 27 01:39:08.890411 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1027/2148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:08 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:08.904424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:08.905058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:08.927911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.929063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.929063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.931643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:08.936336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:08.936747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:08.975573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:08.992493 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c328189-7c39-4125-a225-24ab1f2df084 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.438103 Sep 27 01:39:09.018166 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1122/2149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:08 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:09.022977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:09.023588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:09.039982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:09.043815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:09.044543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:09.046063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:09.047415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:09.050103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:09.225117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:09.237644 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0558f757-fbb3-4734-80fa-93e554798e4c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 200 len: 1217 microversion: 2.1 time: 0.342880 Sep 27 01:39:09.238303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1028/2150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:08 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 1217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:09.578180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:09.578819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:09.588529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:09.593452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:09.594240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:09.595246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:09.597257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:09.601324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:10.119404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:10.130168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bd87ad4-ecda-4781-b12d-86b1cae55613 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1487 microversion: 2.1 time: 0.556077 Sep 27 01:39:10.132129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1029/2151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:09 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1487 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:10.140352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "name": "network-vif-unplugged", "status": "completed", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:10.165856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:10.166342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:10.166780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:10.190252 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] Creating event network-vif-unplugged:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h2-859358-1 Sep 27 01:39:10.203444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-35c0d5b8-ac7c-418d-ba19-ac0867441104 req-8551a57a-0671-4cef-9eed-3e5459afd781 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067038 Sep 27 01:39:10.203965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1030/2152] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:10.217156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:10.218170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:10.246231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:10.247412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:10.248025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:10.248973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:10.249636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:10.250246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:10.503735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:10.521213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:10.525392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:10.526855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9ba9950-c576-45e5-8e0a-c96957038d74 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 1.507630 Sep 27 01:39:10.528654 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1123/2153] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:09 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:10.534642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:10.535588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:10.543298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:10.544119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:10.544804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:10.546402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:10.547088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:10.547760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.080034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:11.092125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dda58037-f770-4549-b097-23f0a3c995bd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.886604 Sep 27 01:39:11.101217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1031/2154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:10 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:11.106867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:11.142675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.144347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.146225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.203662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:11.213803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6c89281-7481-4158-b7d0-55416a1860db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.682090 Sep 27 01:39:11.215042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1124/2155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:10 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:11.231272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:11.240604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:11.257663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.258214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.258860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.259753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.262520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.263155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.333843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:39:11.349985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.350472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.350907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.351361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'fault' on Instance uuid 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:11.444309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:11.467506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4970143-0cdd-4192-ae55-d879ccf22027 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 200 len: 1221 microversion: 2.1 time: 0.233288 Sep 27 01:39:11.468371 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1125/2156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:11 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:11.479586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01347c35-89eb-4233-b5fb-136008c9d9a2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113/action" status: 202 len: 0 microversion: 2.1 time: 0.376863 Sep 27 01:39:11.491128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:11.491835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:11.499157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.499973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.501570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1032/2157] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:39:11 2022] POST /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:11.506080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.510052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.510761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.511396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.562490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:11.563203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:11.579714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.581876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.584167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:11.585145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:11.588739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:11.589473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.024314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.063275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.064767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.066727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6631fdb-9e5f-46c6-8d79-d5a20d8fa6ea tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.509099 Sep 27 01:39:12.070582 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1033/2158] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:11 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:12.115128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:12.116090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:12.124403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.126199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.126905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.127351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.128064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.129890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.130336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.134879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbed947e-8b9e-4575-9b62-821ddfa343bb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.647537 Sep 27 01:39:12.139397 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1126/2159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:11 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:12.240975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:12.242004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:12.250516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.251393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.252069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.253057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.253798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.254612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.493104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.512362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc60b5ea-6959-43ef-a9ee-e6d42bb3c75b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.401057 Sep 27 01:39:12.514735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1034/2160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:12 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:12.521927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:12.522769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:12.531336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.532679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.533415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.534571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.535412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.536220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.564810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 HTTP/1.1 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:39:12.567108 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:39:12.568990 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765'} Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:39:12.570524 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:39:12.572109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:39:12.575053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:39:12.575053 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f16822b-6eb9-4bfd-bb71-44641c68a6e4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 404 len: 111 microversion: 2.1 time: 0.052490 Sep 27 01:39:12.582778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1035/2161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:12 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:39:12.600899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:12.624424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:12.628030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:12.629532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:12.635338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:12.667808 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] Creating event network-changed:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h2-859358-1 Sep 27 01:39:12.683913 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b975649a-b4ff-4d66-90ce-01b845d48bc4 req-c3143481-340e-4297-9b0c-2b0fcaefefa9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099333 Sep 27 01:39:12.689251 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1036/2162] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:12.737958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1633136497", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:12.753987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:12.757141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:12.765840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d214d603-4a48-4f23-a9a1-7ed101874919 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.529541 Sep 27 01:39:12.766991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1127/2163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:12 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:12.832066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:13.100596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:13.101217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:13.121755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.122391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.125062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.127931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.128818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.129263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.531677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:13.546891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:13.550957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:13.555357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-731c86eb-5350-4a56-a41a-dc407e902ba5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.457717 Sep 27 01:39:13.570247 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1128/2164] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:13 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:39:13.577187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:13.579083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:13.600788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.602250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.603794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.605169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.606705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.609910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.867430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:13.883872 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27ff4c9c-5c3b-478b-bbb3-7de487eb72c2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.316608 Sep 27 01:39:13.899847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:13.900531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:13.900753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:13.901193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:13.901637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:13.915498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1129/2165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:13 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:13.915702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.915702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.915702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.915702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.916071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.916071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.938418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:13.939923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:13.942363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:13.944437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:13.958460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:13.960660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.961266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.961760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:13.964536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:13.965369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:13.965828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:13.973204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.056795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26cbf635-a0c2-4628-81db-83104abc289b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324147 Sep 27 01:39:14.061383 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1037/2166] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:39:14.073231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:14.076815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:14.092436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.092939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.093397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.095623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.096097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.096537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.286771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.298935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d07f08b-af8a-454b-a77d-13deb32951bb tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.378829 Sep 27 01:39:14.301750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1130/2167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:13 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:14.350208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.360335 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a20b72d-1d88-4e27-9569-9cac85c02309 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.296707 Sep 27 01:39:14.362259 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1038/2168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:14 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:14.368708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c7c5fc5-b191-4e2d-b6f6-da256e1a3d76 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:14.369609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c7c5fc5-b191-4e2d-b6f6-da256e1a3d76 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:14.440345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c7c5fc5-b191-4e2d-b6f6-da256e1a3d76 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.448779 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c7c5fc5-b191-4e2d-b6f6-da256e1a3d76 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1215 microversion: 2.1 time: 0.084450 Sep 27 01:39:14.451064 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1039/2169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:14 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:14.591768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:14.592558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:14.606388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.606893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.607259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:14.610286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.611420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.613301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.613696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.667518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=24 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:14.861885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.868356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Action: 'create', calling method: .version_select at 0x7f24d5a3bca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:14.873302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.874859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:14.876167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dc0aa65-46ec-43f5-a53a-29aeb1426b6b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.289347 Sep 27 01:39:14.877100 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1040/2170] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:14 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:39:14.917929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Getting quotas for project db619d74d9ef41a39a2d1268c0af16ec. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:14.927469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:14.930216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:14.935484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Getting quotas for user a9487b3bd91f4187997b279831fb74c1 and project db619d74d9ef41a39a2d1268c0af16ec. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:14.942336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.945862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.946400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:14.948138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:14.948619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:14.949059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.018703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:15.037971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Getting quotas for project db619d74d9ef41a39a2d1268c0af16ec. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:15.046342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Getting quotas for user a9487b3bd91f4187997b279831fb74c1 and project db619d74d9ef41a39a2d1268c0af16ec. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:15.065934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44af76cc-6112-468e-bfb5-3faad8e03ae0 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.762790 Sep 27 01:39:15.067505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1131/2171] 10.222.0.52 () {62 vars in 1214 bytes} [Tue Sep 27 01:39:14 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:15.079567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7250fa55-8b3d-49ae-89e6-13c820f40a01 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.128786 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7250fa55-8b3d-49ae-89e6-13c820f40a01 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.054304 Sep 27 01:39:15.132815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1132/2172] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:39:15.143633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3011b84a-0b64-4f2d-a40b-cfc86917963b tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.153246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3011b84a-0b64-4f2d-a40b-cfc86917963b tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb" status: 200 len: 235 microversion: 2.64 time: 0.013019 Sep 27 01:39:15.157685 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1133/2173] 10.222.0.52 () {60 vars in 1304 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb => generated 235 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:39:15.167504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a2a0d9f-4e76-4c42-a83f-701de31361dd tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.199076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a2a0d9f-4e76-4c42-a83f-701de31361dd tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb" status: 204 len: 0 microversion: 2.64 time: 0.037811 Sep 27 01:39:15.201060 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1134/2174] 10.222.0.52 () {60 vars in 1307 bytes} [Tue Sep 27 01:39:15 2022] DELETE /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:39:15.218370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5619d3a8-8148-48e6-ac83-474eb454a882 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.235461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5619d3a8-8148-48e6-ac83-474eb454a882 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] HTTP exception thrown: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5619d3a8-8148-48e6-ac83-474eb454a882 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Request method failure captured: Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb HTTP/1.1 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRBd0OfkoaPLHxKPI_ul4O1i-3E6JYoba8Rkfk9hqIWlD7r4QWekoF8309Fiue4pRAHx5v8Ugx2IB7HLM3omWMsJwZD4IDVf1jnNRlzV6I1HngFwknmEMjQkAYMEbZpT8hWA-aqrny87Z8GW2viAOtBEAogiRek8IRteTMEHqq24Qc Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.64 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: db619d74d9ef41a39a2d1268c0af16ec Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerGroup264TestJSON-1659164446 Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:39:15.240535 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db619d74d9ef41a39a2d1268c0af16ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/db619d74d9ef41a39a2d1268c0af16ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/db619d74d9ef41a39a2d1268c0af16ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_db619d74d9ef41a39a2d1268c0af16ec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerGroup264TestJSON-1659164446 Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: db619d74d9ef41a39a2d1268c0af16ec Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1659164446 Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerGroup264TestJSON-1659164446-project Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: a9487b3bd91f4187997b279831fb74c1 Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerGroup264TestJSON-1659164446-project Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. Sep 27 01:39:15.242360 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b3ecad55-beef-4e1f-b9a4-04653a7089fb'} Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:15.243426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. Sep 27 01:39:15.244947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:15.248040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5619d3a8-8148-48e6-ac83-474eb454a882 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] Returning 404 to user: Instance group b3ecad55-beef-4e1f-b9a4-04653a7089fb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:39:15.249080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5619d3a8-8148-48e6-ac83-474eb454a882 tempest-ServerGroup264TestJSON-1659164446 tempest-ServerGroup264TestJSON-1659164446-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb" status: 404 len: 117 microversion: 2.64 time: 0.041416 Sep 27 01:39:15.250180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1135/2175] 10.222.0.52 () {60 vars in 1307 bytes} [Tue Sep 27 01:39:15 2022] DELETE /compute/v2.1/os-server-groups/b3ecad55-beef-4e1f-b9a4-04653a7089fb => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:39:15.292788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:15.310168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4b9a5b0-007d-4d1b-95d8-ebb4f2da95eb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.391062 Sep 27 01:39:15.310769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1041/2176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:14 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:15.326523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.327158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:15.335208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.335719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.336143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.337456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.342094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.342903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.389441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.390332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:15.397392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.398386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.399024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.399990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.400820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.401960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.681025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:15.696139 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e4d3326-88ee-4a86-8ad3-13a0203e2a90 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.313200 Sep 27 01:39:15.697473 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1042/2177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:15.703645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.704901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:15.713260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.714048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.714668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.715594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.716225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.716819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.797741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:15.809402 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-494c2f87-c918-4b53-bf50-1596c5556e59 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.488721 Sep 27 01:39:15.810911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1136/2178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:15.822999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:15.833685 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f952f31-a3cb-47d3-9253-8f9ea55001b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1267 microversion: 2.1 time: 0.134623 Sep 27 01:39:15.835029 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1043/2179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:15.902353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:15.904183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:15.913054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.914154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.914788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:15.916172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:15.916803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:15.917461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.334737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:16.338819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:16.344002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:16.348168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:16.350063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:16.352750 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4ecbe6b-6258-4fff-b439-1602c3e91c6e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.455633 Sep 27 01:39:16.354196 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1137/2180] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:15 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:16.369029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.373824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.374474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.376588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.377292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.377969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.585811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:16.597871 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-daac3100-e776-4d82-a219-dd8516788a11 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.265819 Sep 27 01:39:16.599279 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1044/2181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:16 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:16.720179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:16.720797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:16.741207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.741730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.742167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.742893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.743352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.743783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.834472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:16.835008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:16.847037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.847899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.848971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:16.850034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:16.850960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:16.851607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.149193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:17.163872 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46e69486-30ea-46df-b9e7-006d3ac412dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.333252 Sep 27 01:39:17.166103 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1045/2182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:16 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:17.166939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:17.178426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:17.179180 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3cc1d830-1e08-4f6c-b810-77669a3315a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.463374 Sep 27 01:39:17.179473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:17.180085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1138/2183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:16 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:17.207251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.208051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.208662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.214756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.215292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.215737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.385767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:17.386389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:17.386858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:17.397034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.397551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.397781 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7fadef5-1ac8-454d-8feb-a7c6c486e8c5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1273 microversion: 2.1 time: 0.229255 Sep 27 01:39:17.397981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.399113 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1046/2184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:17 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:17.409064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.409957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.410512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.623346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:17.624066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:17.635755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.638479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.640657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:17.642169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:17.645248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:17.645942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.125681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.139851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-984e24d3-7a17-4244-9e3e-8bc499b2e6a7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.520370 Sep 27 01:39:18.140529 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1047/2185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:17 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:18.209083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:18.209758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:18.219432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.219950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.220397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.221295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.222082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.222806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.327452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.330156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:18.343351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.350035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.351733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0abfcaf-c6a9-4cf2-b1b2-d93ecdcf0d6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.970398 Sep 27 01:39:18.365210 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1139/2186] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:17 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:18.376971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:18.377912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:18.392869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.394402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.396648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.398273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.400407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.401059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.619425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.631997 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad67a321-b1cf-4165-be62-8f3a6253423e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.427640 Sep 27 01:39:18.648240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1048/2187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:18 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:18.653416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:18.660449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:18.680549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.681783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.682402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.683311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:18.685295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:18.685961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:18.907300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:18.942481 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e71614d-71f5-4a91-b2b5-0e975debf66c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1273 microversion: 2.1 time: 0.272705 Sep 27 01:39:18.943164 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1049/2188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:18 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:19.082034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:19.093713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c17ea1fa-54e7-4aef-aeb9-0c1b3040c668 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.729862 Sep 27 01:39:19.104986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1140/2189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:18 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:19.166004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:19.166671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:19.181232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:19.181813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:19.182256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:19.185238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:19.186048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:19.186664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:19.380770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:19.381459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:19.398550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:19.402135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:19.403259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:19.404008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:19.404485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:19.404960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:19.994397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.005169 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd7429ae-1a2d-42f9-ba02-202df8d5a527 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.845103 Sep 27 01:39:20.006389 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1050/2190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:19 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:20.012850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:20.013746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:20.022891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.023669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.024314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.025267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.026020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.026871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.061956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.079469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.081552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.095059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-211dceed-8f3f-4481-8f78-7b541fea5e5f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.706829 Sep 27 01:39:20.106285 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1141/2191] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:19 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:20.122251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:20.122967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:20.139116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.139633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.140082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.140818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.144745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.148840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.487266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.499857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f0bd51d-401a-4897-beca-67d0471bc35a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.491975 Sep 27 01:39:20.501836 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1051/2192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:20 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:20.515386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:20.518748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:20.538005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.544414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.545066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.545866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:20.546328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:20.546989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:20.624842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:20.634623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b3f7308-f190-45a9-ab9f-3b80d15238d4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.526901 Sep 27 01:39:20.639473 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1142/2193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:20 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:21.034846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:21.035491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:21.044905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.045423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.046069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:21.046974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.047589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.048176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:21.636680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:21.647216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-119dc704-782e-48a1-8c53-47e337206b55 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.618232 Sep 27 01:39:21.673742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1143/2194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:21 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:21.681461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:21.682411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:21.693577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.695121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.698519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:21.699612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.700291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.700949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:21.800121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:21.809329 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4883642-b654-468e-849f-05e1182c5b6d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 1.305089 Sep 27 01:39:21.818735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1052/2195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:20 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:21.829701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:21.829701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:21.868805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.880242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.880945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:21.883684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:21.884255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:21.885760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.113301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:22.133562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:22.142171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:22.145152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91c2a556-181b-4dd4-ac50-a50b63769c2e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.467704 Sep 27 01:39:22.151137 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1144/2196] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:21 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:22.168097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:22.168731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:22.180317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.181607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.181607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.194765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.195276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.195720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.508411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:22.523673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3fd19c8-b0a6-489a-abcc-9577902ed042 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 0.703789 Sep 27 01:39:22.524863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1053/2197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:21 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:22.641192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:22.656769 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95715fc6-7ce2-4d6f-bd55-863445e4b787 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.502373 Sep 27 01:39:22.658270 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1145/2198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:22 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:22.675098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:22.676723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:22.688661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.688805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.689181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.689924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.690373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.690797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.846209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:22.847121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:22.859478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.862746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.869277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:22.870066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:22.870560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:22.871760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.112052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:23.125886 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62281262-b1ad-44f2-8b81-3331d1f5bf79 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.457740 Sep 27 01:39:23.127653 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1054/2199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:22 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:23.137873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1", "tag": "b1c02f8c-353b-4405-abca-8ddd97005834"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:23.162606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:23.163240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:23.163815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.175061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:23.198860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] Creating event network-changed:b1c02f8c-353b-4405-abca-8ddd97005834 for instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 on n-h1-859358-1 Sep 27 01:39:23.205583 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-efa63b0d-bb54-4f6f-b42a-a365a79f8067 req-406168eb-dbb6-4633-9d25-40607c919a20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071908 Sep 27 01:39:23.206773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1055/2200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:23.440239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:23.456211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22c29046-5fe1-4cf1-a15d-fc03b9dea441 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.613099 Sep 27 01:39:23.464308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:23.465853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:23.473551 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1146/2201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:22 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:23.476846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:23.485308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:23.490962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.493019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:23.495296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:23.504318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.549055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:23.549770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:23.604923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:23.607411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:23.608102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.608923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:23.609718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:23.610386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:23.926058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:23.970701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:23.984958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:23.988779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:23.993554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-191398b2-e567-4d8e-b103-b2f23e374133 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.785230 Sep 27 01:39:23.995408 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1056/2202] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:23 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:24.007197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:24.009131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:24.024715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.025244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.027774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.033920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.034672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.035298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.448697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=22 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:24.535276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:24.548135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89019a96-0100-4553-aade-1f13108c18b1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1476 microversion: 2.1 time: 1.003199 Sep 27 01:39:24.549408 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1147/2203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:23 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1476 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:24.556101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:24.556824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:24.585146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.586064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.586777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.587754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.588584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.589252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.767534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:24.785005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9921cd4a-3ab5-484c-a89f-af5af45e1be3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.783486 Sep 27 01:39:24.786424 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1057/2204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:23 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:24.796403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:24.797813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:24.807900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.808755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.809545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.811558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:24.813779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:24.814189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:24.873597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:24.882268 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1f527bf-e04d-484a-ac69-4d16e4b5e7f4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.330906 Sep 27 01:39:24.924924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1148/2205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:24 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:25.032469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:25.033098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:25.043451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.043735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.044176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:25.044900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.045468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.046457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:25.065642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:25.378147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:25.392552 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fd6d215-3f9c-4e9c-bfa8-4514b20cd279 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.604620 Sep 27 01:39:25.396735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1058/2206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:24 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:25.577973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:25.579401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:25.580037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:25.589269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.589833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.592571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:25.594136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:25.594504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.594990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.596691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:25.600839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:25.605743 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b04aac7e-b5cf-4b1c-8aac-54a8f532b369 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.583253 Sep 27 01:39:25.609686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1149/2207] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:25 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:25.816938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:25.816938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:25.823594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.824133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.824584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:25.830483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:25.831238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:25.831893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.290674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.300720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6f31520-d2f1-4a45-a186-3c50ec39b82a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.491200 Sep 27 01:39:26.317179 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1150/2208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:25 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:26.325185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:26.326115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:26.334486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.335243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.335912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.336867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.337592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.338251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.496542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.507586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.509530 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34352647-de1a-437e-b2e9-28240d2eaf65 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1475 microversion: 2.1 time: 0.939828 Sep 27 01:39:26.510305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1059/2209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:25 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1475 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:26.515300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:26.516580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:26.522995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.532384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.533807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.534959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.536870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.537535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.547641 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52e23c93-05cc-4898-ba18-34a4030d594c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.228457 Sep 27 01:39:26.548715 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1151/2210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:26 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:26.635204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:26.637264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:26.644120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.644947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.645679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.646631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:26.647316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:26.648069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:26.882717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.896595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.898081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:26.899446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88836144-1643-4e0d-9e6e-5b4558faf10a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.268151 Sep 27 01:39:26.901045 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1152/2211] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:26 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:39:27.262835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:27.298998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3928aac8-434b-4207-a752-d6600e259e33 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.787092 Sep 27 01:39:27.301955 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1060/2212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:26 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:27.325882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:27.326670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:27.341080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:27.342012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:27.342707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:27.344808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:27.345787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:27.346725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:27.810046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:27.819629 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cffc0710-143d-409e-8a04-181c30c0539e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.498065 Sep 27 01:39:27.829605 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1153/2213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:27 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:27.834459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:27.839269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:27.852869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:27.853404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:27.853851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:27.854738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:27.855077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:27.856638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.056409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9ff6861-accc-47bf-af4f-4952f0e0cfa7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24da6ccaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1975829800", "description": "tempest-description-729643147"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:28.428723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:28.440045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f591b9e6-7179-4b19-8f28-40c3e1224ed8 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1475 microversion: 2.1 time: 0.609238 Sep 27 01:39:28.440941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1154/2214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:27 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1475 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:28.447471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:28.448486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:28.476746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.478239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.479784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.481315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.482026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.482680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.572138 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9ff6861-accc-47bf-af4f-4952f0e0cfa7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.047184 Sep 27 01:39:28.573907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1061/2215] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:39:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:39:28.582468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:28.614872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.615863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.616852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.659001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Creating event network-vif-unplugged:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h2-859358-1 Sep 27 01:39:28.678971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:39:28.707393 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aef2d935-5fcb-4a99-974d-ba3d9d34883c req-e0f85eed-41f9-45b2-b1b4-f216567eded9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131374 Sep 27 01:39:28.708107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1062/2216] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:28.724498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:28.726227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:28.741210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.741915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.742413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.743155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.743629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.744159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.804150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:28.818400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee135cfa-90c0-4c25-bb60-9bb6e4d33364 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.375947 Sep 27 01:39:28.822976 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1155/2217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:28 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:28.829562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:28.832726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:28.841421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.842679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.843554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.844986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:28.846088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:28.847040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:28.873160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:29.354919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:29.355568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:29.369466 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f6b616df-80fd-420f-bde2-e2521bb7b0b8 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1514 microversion: 2.1 time: 0.544932 Sep 27 01:39:29.370326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:29.371118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1156/2218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:28 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:29.374333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:29.377028 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61ee0ba3-a1ff-4e82-a6d7-f9d4a1d63d33 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1815 microversion: 2.25 time: 0.667722 Sep 27 01:39:29.378087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1063/2219] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:28 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1815 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:29.384692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:29.387869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ab89b07-2cb1-4385-8698-cf25f135198e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24da531d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-764827830", "description": "tempest-description-1456485196"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:29.406298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:29.421096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:29.421961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:29.422668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:29.424278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:29.425644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:29.426293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:29.862884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ab89b07-2cb1-4385-8698-cf25f135198e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.490401 Sep 27 01:39:29.863984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1157/2220] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:39:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:29.868979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:29.869726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:29.880927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:29.881460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:29.888441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:29.891560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:29.891560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:29.891560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:29.934453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:29.954611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53e7ae0b-148a-44b6-95a9-f8d66f7ed9f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.564291 Sep 27 01:39:29.955479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1064/2221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:29 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:29.960862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:29.961552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:29.997152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:29.998011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.002387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:30.003375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:30.005826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.006453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:30.224833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:30.241940 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb9cc771-919c-4f9c-a965-60e009ffc8cd tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1475 microversion: 2.1 time: 0.374810 Sep 27 01:39:30.254915 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1158/2222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:29 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:30.267339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-702887145", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "18e42b6a-7765-41a6-b80b-00e1ec1192b4"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:30.351549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] validate_networks() for [('18e42b6a-7765-41a6-b80b-00e1ec1192b4', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:30.441057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:30.469593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c653a547-4e91-4fa8-812d-ea0d6636f786 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.511295 Sep 27 01:39:30.472813 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1065/2223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:29 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:30.502134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:30.503190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:30.521297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:30.521820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.522261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:30.522980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:30.523433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.523855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:30.931226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:30.949364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03c3cee5-d91a-47e7-8266-ab98860dea89 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.465700 Sep 27 01:39:30.950067 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1066/2224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:30 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:30.976672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:30.977758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:30.985313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:30.989102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.989645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:30.990449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:30.991798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:30.992459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.017861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:31.018326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:31.018536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:31.019150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:31.019751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:31.034832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.036893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.037762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.040854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.041635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.042556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.087699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Getting quotas for project d1706ba087bc4e2baadb344bfbbf3772. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:31.102339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Getting quotas for user c1b39472acb645cdb988150af70b4883 and project d1706ba087bc4e2baadb344bfbbf3772. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:31.135651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:31.143920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:31.288446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd46e994-301f-4b50-a1a5-df7b8f70c9ae tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031994 Sep 27 01:39:31.298295 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1159/2225] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:31.303953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:31.317125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.318044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.319386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.348035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Creating event network-changed:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h2-859358-1 Sep 27 01:39:31.364978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:39:31.388871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cc07b433-7e58-494d-9406-a2621ecb5957 req-26f30599-500e-445a-9180-56608d5a41e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088989 Sep 27 01:39:31.404108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.404788 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1160/2226] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:31.411660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:31.412365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:31.415337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.421213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.425847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7bed4a4-2421-4dfe-8e1e-2e10ed7b3f73 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1805 microversion: 2.25 time: 0.467594 Sep 27 01:39:31.427598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.428092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.428897 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1067/2227] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:30 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1805 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:31.432350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.433895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.437429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.438059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.445959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:31.446809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:31.459022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.459893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.460589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.461589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.463028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.469253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.721959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.733062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f90638d-150a-4c5b-afb9-5f1b7301cd77 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.326384 Sep 27 01:39:31.733726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1161/2228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:31.751454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f16bdfb-c728-4a1e-a674-71f1ddd26567 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:31.752413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f16bdfb-c728-4a1e-a674-71f1ddd26567 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:31.849379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f16bdfb-c728-4a1e-a674-71f1ddd26567 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.868716 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f16bdfb-c728-4a1e-a674-71f1ddd26567 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1215 microversion: 2.1 time: 0.131870 Sep 27 01:39:31.870678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1162/2229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:31.878591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50b6f770-d781-4b47-b5d4-bfa5065cf84f tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '.version_select at 0x7f24da5248b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:31.881348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:31.883987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b6f770-d781-4b47-b5d4-bfa5065cf84f tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.885319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b6f770-d781-4b47-b5d4-bfa5065cf84f tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.886507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b6f770-d781-4b47-b5d4-bfa5065cf84f tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.904334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25da2e65-87a1-4bfa-91ef-870142e553c1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1475 microversion: 2.1 time: 0.474079 Sep 27 01:39:31.906866 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1068/2230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:31.911703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:31.912327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:31.928107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50b6f770-d781-4b47-b5d4-bfa5065cf84f tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 4475 microversion: 2.25 time: 0.055982 Sep 27 01:39:31.930045 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1163/2231] 10.222.0.52 () {60 vars in 1184 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/os-migrations => generated 4475 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:31.937402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772662d5-7c79-47c4-9d53-e8abb1d4e32f", "name": "network-vif-unplugged", "status": "completed", "tag": "ad096b90-1e1b-4720-b23b-e1a59d2c0613"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:31.949987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.950937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.952183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.959816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.960413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.960742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.961497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:31.961971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:31.962398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:31.975040 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] Creating event network-vif-unplugged:ad096b90-1e1b-4720-b23b-e1a59d2c0613 for instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f on n-h2-859358-1 Sep 27 01:39:31.983638 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-eecb5f2c-4127-45c2-bda9-889330936ff9 req-6be05cef-4f19-4d39-9be2-3cbd575db46b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051632 Sep 27 01:39:31.994926 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1164/2232] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:32.003894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:32.004486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:32.021556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.023360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.024132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.025312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.026225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.027871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.218986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:32.242452 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06663fc0-da84-4bf0-babd-ac7b03ff6caa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 2424 microversion: 2.25 time: 0.245289 Sep 27 01:39:32.243181 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1165/2233] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 2424 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:32.259786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:32.261940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:32.270649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.271953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.272850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.274428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.274992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.275527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.357979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:32.367935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2bcae76-a374-44ad-b445-d76a08e5817e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.459973 Sep 27 01:39:32.391822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1069/2234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:31 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:32.410035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:32.411242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:32.422033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.422866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.423502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.424546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:32.425170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:32.425796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:32.478743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:32.488580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e027647a-0dac-4e21-a7c2-57c058ecf4b3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.244008 Sep 27 01:39:32.499474 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1166/2235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:32 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:32.507218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-562628887", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e586b006-974b-41f8-931d-30e9fc73d562"}], "block_device_mapping_v2": [{"uuid": "b874307c-ddff-439e-be62-cbe9b2e9395e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:32.549290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:32.650912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] validate_networks() for [('e586b006-974b-41f8-931d-30e9fc73d562', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:33.193329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:33.194031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:33.194259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:33.195257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:33.195682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:33.214535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:33.224667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.225423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.226725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.228546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.229039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.230569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.239900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab3c72fa-20b7-49ef-9030-10aee7d593bc tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 2424 microversion: 2.25 time: 0.845254 Sep 27 01:39:33.254688 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1070/2236] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:39:32 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 2424 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:39:33.269591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:33.284906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:33.301176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.301836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.302382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.303495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.303915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:33.304169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.315947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.321734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Getting quotas for user 56e5b4943e3c4d31aec5dd4dc2ecac66 and project 115fecd0e9f34141a8630f6a0b76864e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:33.431924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:33.439087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b874307c-ddff-439e-be62-cbe9b2e9395e',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:33.700594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60dd912c-ec90-4259-b593-dda4fd013d8e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198871 Sep 27 01:39:33.701182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1167/2237] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:33.706451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:33.707601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:33.715089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.715905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.716628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.717532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.718099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.718619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.806480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:33.821035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e00963ac-872e-4b78-9015-53ededecdcba tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1211 microversion: 2.1 time: 0.118276 Sep 27 01:39:33.822492 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1168/2238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:33 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:33.853808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:33.863686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7db23b7-f177-4021-8675-ff09eed8d0a5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.607386 Sep 27 01:39:33.866713 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1071/2239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:33 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:33.875311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:33.880705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:33.898003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.900174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.901475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:33.903338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:33.906779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:33.907492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.213822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.215596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.235708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.236203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.236633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.237394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.237827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.238252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.240154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lazy-loading 'services' on Instance uuid 75350180-8fa9-4333-9b41-e725f696e376 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:34.447553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:34.464024 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8949914d-1052-492a-b397-cff510511df2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments/9040416c-e51a-4144-aee3-fe2589ed0b27" status: 202 len: 0 microversion: 2.25 time: 0.592901 Sep 27 01:39:34.465772 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1072/2240] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Sep 27 01:39:33 2022] DELETE /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments/9040416c-e51a-4144-aee3-fe2589ed0b27 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:39:34.497122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:34.497733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.498526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.507555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.508306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.508897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.509829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.510445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.511672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.522741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82748d8b-f8f7-4d7c-b366-ea30d887ed01 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1473 microversion: 2.1 time: 0.698164 Sep 27 01:39:34.524273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1169/2241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:33 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1473 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:34.543608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.544518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.556026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.558097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.560028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.561018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.561734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.562351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.719590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:34.727348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca7aa8cc-6e99-4068-9acd-42b96be996a2 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.200701 Sep 27 01:39:34.727911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1170/2242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:34.733138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.733861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.739551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.740253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.740686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.741395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.741922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.742820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.787045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:34.795716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef953240-9156-40ba-b44a-a2ba754f9c0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.328256 Sep 27 01:39:34.802942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1073/2243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:34.802942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1", "name": "network-vif-plugged", "status": "completed", "tag": "b1c02f8c-353b-4405-abca-8ddd97005834"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:34.808651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:34.816822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dde79951-8f3e-4c62-a363-0236dc607c41 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1102 microversion: 2.1 time: 0.087779 Sep 27 01:39:34.817307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1171/2244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1102 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:34.817562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.818260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.818696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.828765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.831231 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] Creating event network-vif-plugged:b1c02f8c-353b-4405-abca-8ddd97005834 for instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 on n-h1-859358-1 Sep 27 01:39:34.832780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.836819 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e9116ecb-494d-40dd-89d8-80bed0a0561e req-8c7660d1-057e-43da-bba5-75673f481b42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039018 Sep 27 01:39:34.837394 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1074/2245] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:34.842188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.842353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.842790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.843494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.844116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.844543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.847434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.848142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.854251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.855343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.855965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.856659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.857111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.857560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.877671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c65857c-3cf4-44de-ba89-1890d54816e9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055300 Sep 27 01:39:34.879029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1172/2246] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:34.898411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:34.899164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:34.906253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.906746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.907176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.908308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:34.908798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:34.909223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:34.940745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:34.950911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14712f58-fd86-4821-ba61-e950030b19bd tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1267 microversion: 2.1 time: 0.107577 Sep 27 01:39:34.952136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1075/2247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:35.117328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:35.125854 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63956c2e-a6d8-42d4-a576-5f7e7e53c778 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.232841 Sep 27 01:39:35.142161 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1173/2248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:34 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:35.553867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:35.555283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:35.562619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.563369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.563993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.564906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.565578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.566184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.752274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:35.753778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:35.760867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.761737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.762448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.763537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.764229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.764884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.790231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:35.798722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce796c41-2265-4f9e-8ae0-7f194b30acc1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1473 microversion: 2.1 time: 0.248686 Sep 27 01:39:35.805610 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1076/2249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:35 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:35.820993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:35.821649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:35.830034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.830524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.830959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.831668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:35.832112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:35.832738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:35.987778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:35.996926 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97f32efa-3155-43dd-8bd3-01768c0935e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.249077 Sep 27 01:39:35.997612 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1174/2250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:35 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:36.009695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:36.015464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:36.028072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.028574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.029018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.029784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.030510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.040259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.129325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:36.138843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7eb1bd7c-588c-4ba6-a16b-31a51bc2b683 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1102 microversion: 2.1 time: 0.136268 Sep 27 01:39:36.140041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1175/2251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:36 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1102 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:36.145430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:36.148519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:36.161403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.162223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.162990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.164586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.165647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.165758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.203909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:36.217820 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7115209-1111-4290-8e36-c60b0b9ec7cf tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.400802 Sep 27 01:39:36.224395 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1077/2252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:35 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:36.233534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4eb64b79-a315-4557-ae1f-f325973b7c98 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092206 Sep 27 01:39:36.234856 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1176/2253] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:36 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:36.242758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:36.243809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:36.253562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.254523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.255158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.255892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:36.256624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:36.256985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.257686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.258768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.278842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.278842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.279516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.280601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.281161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.281712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.419067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:36.436164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2b4d846-e8d2-42f6-b5fb-d14e6dea063a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1267 microversion: 2.1 time: 0.201067 Sep 27 01:39:36.436908 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1078/2254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:36 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:36.558127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:36.568528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:36.572623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e616f7f-3f64-4274-9d4f-ee1e21b97318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1315 microversion: 2.1 time: 0.335987 Sep 27 01:39:36.586062 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1177/2255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:36 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:36.829280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:36.830733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:36.851356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.855760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.858296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.861161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.861823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.863318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.867014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772662d5-7c79-47c4-9d53-e8abb1d4e32f", "name": "network-vif-plugged", "status": "completed", "tag": "ad096b90-1e1b-4720-b23b-e1a59d2c0613"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:36.896624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:36.897261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:36.897754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:36.934202 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] Creating event network-vif-plugged:ad096b90-1e1b-4720-b23b-e1a59d2c0613 for instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f on n-h2-859358-1 Sep 27 01:39:36.941016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c0edf709-1c38-4b45-ae4e-82cef6e9989e req-38c5b487-a8c8-4945-a699-2e1647a37f31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078572 Sep 27 01:39:36.942406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1178/2256] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:37.026505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.027617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.035535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.036183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.036725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.037583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.038337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.039258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.181514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:37.194546 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-842d4494-79bf-47bd-90c7-67175074121d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1473 microversion: 2.1 time: 0.373807 Sep 27 01:39:37.196469 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1079/2257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:36 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1473 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:37.218644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.219546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.226078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:37.228558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.230173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.232049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.233085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.233810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.234468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.272589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:37.291789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a81c119-5394-446c-9c5c-55d2915f7552 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.271852 Sep 27 01:39:37.293363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1179/2258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:37.301651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.305965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.327007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.327828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.328495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.329564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.330332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.330979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.351266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:37.364946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16fb2a3e-0121-4c46-afe5-630af6cc1cad tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1102 microversion: 2.1 time: 0.153690 Sep 27 01:39:37.379754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1080/2259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1102 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:37.389370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.390069 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-205c8ab1-217e-4c32-8ae5-462c0810a8e4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092715 Sep 27 01:39:37.390626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.390763 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1180/2260] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:37.397283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.398682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.399713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.401254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.402534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.403213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.464399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.465439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.477872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.481645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.482102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.482843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.483305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.483739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.561121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:37.592607 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de26ddf7-4026-4630-bb2f-bbd06c858b74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1267 microversion: 2.1 time: 0.132061 Sep 27 01:39:37.593141 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1181/2261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:37.608371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:37.608991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.616116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.616613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.617054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.617797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.618278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.618704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.866553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:37.878795 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-491d8e63-99ba-4cd9-8a35-1f357ed0957b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1501 microversion: 2.1 time: 0.274789 Sep 27 01:39:37.880560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1182/2262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:37.910276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:37.910834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:37.917920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.918419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.918860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:37.919745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:37.920357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:37.920942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.011663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eacd53c2-bf2d-4c3c-9923-4f9b90087382 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1/action" status: 202 len: 0 microversion: 2.1 time: 0.108343 Sep 27 01:39:38.018178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1183/2263] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:39:37 2022] POST /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:38.028606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.029931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.040420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.041010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.041547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.047931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.047931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.047931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.283149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:38.293093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d07e13c3-a358-44e8-8ffc-c7828c08da03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.911934 Sep 27 01:39:38.297227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1081/2264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:37 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:38.318441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.319616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.338644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.339675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.340367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.341783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.345490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.347984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.528409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:38.539675 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd613811-b89a-462e-8d5e-521e08e7f9e0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1506 microversion: 2.1 time: 0.519021 Sep 27 01:39:38.558718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1184/2265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:38.571698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.572335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.588888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.593699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.595622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.596751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.597480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.598715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.813028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:38.825946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6a30b27-8c94-45e5-a435-5a5eb4aeacfb tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.266435 Sep 27 01:39:38.826967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1185/2266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:38.833709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.834322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.847467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.847974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.848411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.849124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.850632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.851173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.856702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:38.866574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f587633-9553-4d02-9fd7-e700c549e561 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1473 microversion: 2.1 time: 0.566719 Sep 27 01:39:38.879320 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1082/2267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1473 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:38.879320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.879320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.885955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.886656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.887566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.888446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.889054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.889695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.930007 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dab0a24f-7bed-4b3d-87c5-7ecc970e3fe2 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058286 Sep 27 01:39:38.930592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1083/2268] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:38.943166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:38.943791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:38.957197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.957732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.958173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.958888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:38.959356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:38.959779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:38.964233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:38.983959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-537dd199-e1a5-45fa-b656-820daa1c095a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1094 microversion: 2.1 time: 0.155921 Sep 27 01:39:39.002126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1186/2269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1094 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:39.072937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:39.086500 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d21a0afa-d1f1-45bf-9d5a-f2823acf5ddc tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1267 microversion: 2.1 time: 0.154519 Sep 27 01:39:39.087536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1084/2270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:38 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:39.132829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-614134711", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "706c0a11-e3a2-418e-9d47-4afe08929fe0"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:39.192793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] validate_networks() for [('706c0a11-e3a2-418e-9d47-4afe08929fe0', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:39.348579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:39.349613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:39.357831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.358325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.358765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.359478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.359935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.360363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.570794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:39.584540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-385d68ff-855d-4c5f-a0aa-7a8a15bda679 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.237101 Sep 27 01:39:39.594659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1085/2271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:39 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:39.602608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:39.603489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:39.613787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.615013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.615644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.616531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.620497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.621291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.748607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:39.749548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:39.750828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:39.751620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:39.752878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:39.765658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.766153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.766591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.767323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.767776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.768365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.805054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:39.811152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Getting quotas for project 1ecb15af922544368b41955fbde43f76. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:39.819562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Getting quotas for user 98647c3bc0964ff0a532e05f1bf62ab6 and project 1ecb15af922544368b41955fbde43f76. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:39.832939 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d88860c-b5ea-41b3-add4-3c88171742ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1486 microversion: 2.1 time: 0.235321 Sep 27 01:39:39.834127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1086/2272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:39 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:39.846307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:39.848770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:39.856648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:39.857803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:39.882826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.883626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.886598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.887375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.887858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.888288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.956100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6846813b-de11-4176-be31-864f4c674e15 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952643 Sep 27 01:39:39.957922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1187/2273] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:39.971791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:39.973212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:39.988423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.989204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.989837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:39.990868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:39.996242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:39.996957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.052109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:39:40.246184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a28d2da-686f-45f2-8d58-72cdf5933d42 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 204 len: 0 microversion: 2.1 time: 0.285885 Sep 27 01:39:40.247004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1188/2274] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:39:39 2022] DELETE /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:39:40.257562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.258516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.271412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.273566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.274070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.274824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.275291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.275719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.567749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:40.579686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e431cdb-f1e0-4be9-8d55-ea01794a335b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1520 microversion: 2.1 time: 0.731923 Sep 27 01:39:40.581930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1087/2275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:39 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1520 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:40.583631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:40.590018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.591934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ad8ea6e-450b-4eb7-96f7-3e25ea1eb229 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1470 microversion: 2.1 time: 0.340179 Sep 27 01:39:40.592710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1189/2276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:40.594186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.605490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51528b5b-78de-4e22-bce6-6c192e568d76 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.606120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51528b5b-78de-4e22-bce6-6c192e568d76 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.622486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.624028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.625241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.626259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.628332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.630084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.718989 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a908d0f3-05f4-46aa-8246-951b911a30b1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135173 Sep 27 01:39:40.719950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-51528b5b-78de-4e22-bce6-6c192e568d76 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:40.720754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1088/2277] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:39:40.731044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.731942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.735147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51528b5b-78de-4e22-bce6-6c192e568d76 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1215 microversion: 2.1 time: 0.131122 Sep 27 01:39:40.735570 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1190/2278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:40.739544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.740276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.740894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.741914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.742577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.743783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.744253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.744392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.764956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.765476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.766545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.773809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.774967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.778959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.850981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:40.862997 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-178497aa-4542-4d92-adef-2c4b2138f85a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1150 microversion: 2.1 time: 0.140597 Sep 27 01:39:40.867356 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1089/2279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:40.884152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.884942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.907052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:40.916804 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3649bbf-a4c3-4d57-8786-84837b72b5e3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1273 microversion: 2.1 time: 0.180176 Sep 27 01:39:40.917441 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1191/2280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:40.927846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.928339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.928773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.929520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.929959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.933682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:40.937695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:40.938199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.956796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:40.966265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.966770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.967244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:40.970392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:40.970752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:40.971290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.265274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:41.278452 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9d232fa-59ad-47b5-9a11-71894517e4ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1497 microversion: 2.1 time: 0.355907 Sep 27 01:39:41.289296 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1192/2281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1497 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:41.302450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:41.303743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:41.313965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.314779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.315316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.316909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.317609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.318157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.391732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:41.404538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15c041b1-ebf8-467b-9eee-32c809e3b9b9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1492 microversion: 2.1 time: 0.535634 Sep 27 01:39:41.429025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:41.432374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1090/2282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:40 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1492 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:41.548507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab7491c3-9795-474d-9281-d48412c50642 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "POST /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e/action" status: 202 len: 0 microversion: 2.1 time: 0.256090 Sep 27 01:39:41.550332 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1193/2283] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:39:41 2022] POST /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:39:41.559631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:41.560251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:41.567015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.567779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.568864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.569787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.570438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.571082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.609901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:41.610911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:41.625604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.628597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.629263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.631170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:41.632978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:41.634530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:41.970044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:41.985198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cff28a4-c5a3-4c3e-b686-cf91c46dff31 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.430304 Sep 27 01:39:41.987784 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1091/2284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:41 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:42.003167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:42.011406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:42.024874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.025673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.027364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.028430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.029154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.029886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.100014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24526511-bc7a-4e65-9504-d2f5c404fce8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.109713 Sep 27 01:39:42.101694 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1092/2285] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:39:41 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:42.111573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:42.112202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:42.141073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.141627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.142065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.142782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.143239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.143670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.356597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:42.380663 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3089bbee-1eb2-433d-823c-2278250e0bc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1267 microversion: 2.1 time: 0.277792 Sep 27 01:39:42.382660 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1093/2286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:42 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:42.394592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:42.395435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:42.403651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.410622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.411381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.412331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.412985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.413633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.683765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:42.699102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-219aeae5-ba37-4acd-b7b2-7b3b1db424d9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1168 microversion: 2.1 time: 0.314597 Sep 27 01:39:42.699693 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1094/2287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:42 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1168 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:42.718078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:42.719559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:42.741528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.743554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.744021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:42.749902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:42.750425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:42.750868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:43.110960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:43.142245 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2be1900d-ad10-451c-9f02-46e28a73c928 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1505 microversion: 2.1 time: 1.536835 Sep 27 01:39:43.150850 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1194/2288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:41 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1505 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:43.163761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:43.168561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:43.185588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:43.186352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:43.189153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:43.191349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:43.194781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:43.196921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:43.439991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:43.473761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9709b9ca-7dc2-400e-b333-c0459387e104 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.767449 Sep 27 01:39:43.499909 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1095/2289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:42 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:43.521070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:43.529986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:43.554316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:43.554857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:43.559031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:43.559800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:43.560269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:43.565222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:43.957152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:43.967797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9549470-9885-4a6c-90be-c1d41b8645ca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1492 microversion: 2.1 time: 0.461720 Sep 27 01:39:43.971002 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1096/2290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:43 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1492 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:43.983816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:43.986217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:44.006184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:44.008865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:44.009317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:44.012855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:44.015614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:44.016089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:44.658061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:44.672880 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-159e3e30-1944-49f6-993c-6da3f022c516 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.697934 Sep 27 01:39:44.676493 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1097/2291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:43 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:44.698247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-plugged", "status": "completed", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:44.733204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:44.734549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:44.736881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:44.768765 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Creating event network-vif-plugged:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h2-859358-1 Sep 27 01:39:44.783376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:39:44.818347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1f9f1121-0693-47e7-aa8b-ffffab31d4aa req-7b1fc9c5-ad94-40c5-b918-8dddef19633b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138988 Sep 27 01:39:44.819530 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1098/2292] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:44.840615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:44.844182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:44.865499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:44.868543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:44.872467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:44.873492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:44.874138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:44.874998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.061877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:45.076038 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e61c0c7c-e953-43ab-aca2-b35e63e3c7d0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 200 len: 1474 microversion: 2.1 time: 1.921824 Sep 27 01:39:45.082578 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1195/2293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:43 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 1474 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:45.103029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:45.103865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:45.125176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.125737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.126371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.127253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.127874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.128943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.310186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:45.322520 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8eb3b99b-eafb-4f01-aed2-f410c9fec6fd tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1273 microversion: 2.1 time: 0.236504 Sep 27 01:39:45.326013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1196/2294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:45 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:45.334174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:45.335915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:45.356089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:45.362406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.368282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.369193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.372346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.373793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.375009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.572809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:45.597887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2ebf225-3f7a-4968-bbe7-b7f68dc84bb5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 200 len: 1505 microversion: 2.1 time: 0.772883 Sep 27 01:39:45.599034 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1099/2295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:44 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:45.604896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:45.605808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:45.612953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.613562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.614073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:45.614962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:45.615492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:45.616083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.079706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:46.092070 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5db1bcd1-30d7-448a-adbe-067a178f4df3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1210 microversion: 2.1 time: 0.764531 Sep 27 01:39:46.101548 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1197/2296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:45 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1210 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:46.104294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:46.105399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:46.127847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.128363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.130999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.132106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.146598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.151073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.268195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.269053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.269902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.270526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'fault' on Instance uuid 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:46.401659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:46.414399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e43d8b98-cebb-439f-a236-5ad950d209b2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1305 microversion: 2.1 time: 0.319940 Sep 27 01:39:46.421324 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1198/2297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:46 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:46.438668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-398107954"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:46.445907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:46.463348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.467076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.469025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.471490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.473358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.475404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.969721 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c806991-8b1a-4d32-8d8d-b8e55ef68893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113/action" status: 202 len: 0 microversion: 2.1 time: 0.544056 Sep 27 01:39:46.970410 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1199/2298] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:39:46 2022] POST /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:39:46.982499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:46.983102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:46.992994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.993549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.994012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:46.995453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:46.998813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:46.999350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.006285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:47.018300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81bcc49a-62c1-4db6-ae78-254bb9196892 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 1.417841 Sep 27 01:39:47.021819 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1100/2299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:45 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:47.033124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:47.037906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:47.067319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.068004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.069037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.069816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.070274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.071034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.102871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:39:47.240610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f267fb1-bca9-44d4-8dd4-1ace3469a916 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 204 len: 0 microversion: 2.1 time: 0.260590 Sep 27 01:39:47.243210 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1200/2300] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:39:46 2022] DELETE /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:39:47.261933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1", "name": "network-vif-deleted", "tag": "b1c02f8c-353b-4405-abca-8ddd97005834"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:47.271488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:47.282725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.283384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.283819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.285366 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a79e7607-567d-4ceb-9f3d-da3111fe4a50 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.262365 Sep 27 01:39:47.288964 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1101/2301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:47 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:47.301200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf99c02d-d224-48c0-bca7-f91e06057847", "tag": "19a71e1e-31a9-4f1b-a22d-94a02d5ec36a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:47.328339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.332176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.332767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] Creating event network-vif-deleted:b1c02f8c-353b-4405-abca-8ddd97005834 for instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 on n-h1-859358-1 Sep 27 01:39:47.333162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.338520 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c95854b4-8175-4360-918c-c3462cbda72e req-f7a22ace-96eb-4cf5-bd2c-2d9d68b62f10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089428 Sep 27 01:39:47.339695 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1201/2302] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:47.349964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:47.359461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:47.364377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] Creating event network-changed:19a71e1e-31a9-4f1b-a22d-94a02d5ec36a for instance cf99c02d-d224-48c0-bca7-f91e06057847 on n-h2-859358-1 Sep 27 01:39:47.366053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.366556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.366995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.376444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d617a77f-eec9-4cfe-bf00-2c4fd61a04ef req-104c6b7a-4e27-41e8-84d9-8c179a7e0c4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085616 Sep 27 01:39:47.378291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.379000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.379659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.380892 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1102/2303] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:47.404244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbf8aa10-9366-46f5-8042-5207a092c968 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6291310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:47.492535 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbf8aa10-9366-46f5-8042-5207a092c968 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.104824 Sep 27 01:39:47.493666 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1103/2304] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:47 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:47.505083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:47.510565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:47.535232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.535738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.541903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.542909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.544207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.544864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.622796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:47.632016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fe3146a7-655d-4c1e-9c72-86bee7785f9e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.291086 Sep 27 01:39:47.641541 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1202/2305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:47 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:47.666002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:47.668483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:47.684562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.687376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.688128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.689883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.691729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.693267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.717915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:47.730283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca71437b-f307-4b58-bff0-c3fb6577d549 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1210 microversion: 2.1 time: 0.234306 Sep 27 01:39:47.731180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1104/2306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:47 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:47.736159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1982449827", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "41d3fd12-2d49-47ef-8d36-7babc9c9070d"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:47.751542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:47.752240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:47.752774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:47.753826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'fault' on Instance uuid 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:39:47.810837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:47.820495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aa2a1ffe-d994-4b7e-9d47-77ecd1aebb35 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 200 len: 1305 microversion: 2.1 time: 0.185662 Sep 27 01:39:47.835570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] validate_networks() for [('41d3fd12-2d49-47ef-8d36-7babc9c9070d', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:47.836505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1203/2307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:47 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 1305 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:48.052248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:48.053031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:48.062119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.063056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.063614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.064973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.066187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.066729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.244889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:48.254768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2252ed8f-cc8e-4daa-9291-582377650c5a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.213205 Sep 27 01:39:48.263017 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1204/2308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:48 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:48.313022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:48.313777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:48.322092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.322820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.323524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.324748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.325330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.325976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.504224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:48.514201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:48.519303 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-520464a1-515c-42be-8ead-1d16cde9f85e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.209156 Sep 27 01:39:48.523707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1205/2309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:48 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:48.562350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9cbee74-cf6b-4ac8-8bec-afb6a9166dd1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d5be2040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:48.619230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9cbee74-cf6b-4ac8-8bec-afb6a9166dd1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.075883 Sep 27 01:39:48.620392 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1206/2310] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:48 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:48.639519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:48.640753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:48.641442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:48.642038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:48.642612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:48.659066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:48.661005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:48.661413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.662133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.663801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.666164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.670090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.671152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.674961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.675515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.675956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.676683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.677147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.678141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.709661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:48.716742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for user 7c7cf1bdbba44c2e939151843c9ac187 and project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:48.734075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:48.737626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:48.861572 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46b29a80-2ba5-475d-ae51-fd82b669fb6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125712 Sep 27 01:39:48.868749 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1105/2311] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:48.877091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:48.877748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:48.932381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.935057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.935548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:48.939053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:48.940102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:48.940564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.087068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:49.117917 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6bb9d40-ea3d-45be-8ef7-ca43f0930ff5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.465056 Sep 27 01:39:49.132498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1207/2312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:48 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:49.145654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:49.146288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:49.200037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:49.200540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:49.207116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.208019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:49.215155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:49.215640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.274292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 HTTP/1.1 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:39:49.285226 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:39:49.287157 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1'} Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:39:49.288211 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:39:49.290116 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:39:49.291608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:39:49.291608 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a18f75e-1574-4d18-95d6-f609784faf34 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 404 len: 111 microversion: 2.1 time: 0.146724 Sep 27 01:39:49.302637 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1208/2313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:49 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:39:49.308150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c868fb5a-b67b-42ea-a2dc-b319cfc1a38b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:49.308787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c868fb5a-b67b-42ea-a2dc-b319cfc1a38b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:49.503472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c868fb5a-b67b-42ea-a2dc-b319cfc1a38b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:49.520974 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c868fb5a-b67b-42ea-a2dc-b319cfc1a38b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1218 microversion: 2.1 time: 0.213698 Sep 27 01:39:49.536188 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1209/2314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:49 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:49.552064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:49.552960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:49.586336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:49.586699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:49.586870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:49.587355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.588143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:49.588599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:49.589188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.602736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d61dd85f-cb69-480d-a042-be4882b91809 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1210 microversion: 2.1 time: 0.730341 Sep 27 01:39:49.619746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1106/2315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:48 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1210 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:49.632515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a30166-865c-427a-94ff-8b85ea13b756", "tag": "3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:49.647206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:49.650051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:49.653067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:49.680043 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] Creating event network-changed:3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e for instance 48a30166-865c-427a-94ff-8b85ea13b756 on n-h2-859358-1 Sep 27 01:39:49.685914 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-81aa2ff2-0bf8-4211-baa9-33eb3250f276 req-8efb0f2f-1db6-4d21-afcc-28955e8c1918 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064232 Sep 27 01:39:49.686960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1107/2316] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:49.692661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-959924599", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:49.785593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:39:49.785960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:50.376412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:50.384509 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f504a644-9a38-4723-be7c-c08be690fba7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.846625 Sep 27 01:39:50.387462 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1210/2317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:49 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:50.397165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:50.402368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:50.412907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:50.413510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:50.414235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:50.415506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:50.423739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:50.424504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:50.842089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:50.852610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27dde6c2-dc8d-4e7f-89ad-1d256d386fad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.463187 Sep 27 01:39:50.853196 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1211/2318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:50 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:50.871920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4af52678-839f-4cb1-997c-c8a4a5670b44 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6ea3a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:50.953825 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4af52678-839f-4cb1-997c-c8a4a5670b44 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.087825 Sep 27 01:39:50.954417 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1212/2319] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:50 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:50.962762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810fd928-bea5-4675-984e-ff8c97349c46", "tag": "60341d10-7901-42df-96a1-219b3ec5a840"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:50.992201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:50.992692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:50.993130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.007208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] Creating event network-changed:60341d10-7901-42df-96a1-219b3ec5a840 for instance 810fd928-bea5-4675-984e-ff8c97349c46 on n-h2-859358-1 Sep 27 01:39:51.012555 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7151f8ff-59fb-46c9-a790-2bb75c37d543 req-5a606259-24df-490a-8df1-630fec73f441 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056754 Sep 27 01:39:51.013585 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1213/2320] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:51.018831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.019724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.029012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.029916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.030872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.032542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.033324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.034008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.250930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:39:51.251442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:39:51.251923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:39:51.252367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:39:51.252868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:39:51.270696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.271880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.272539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.276047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.277582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.278257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.329466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:39:51.350047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:39:51.372431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:39:51.373094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:51.380836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:39:51.384710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a2292b7c-ea85-4b1d-8662-c7c8d08de37f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.369277 Sep 27 01:39:51.397988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1214/2321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:51.402142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.414627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.427235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.428277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.428907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.429925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.431817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.432358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.487213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10ea5a4b-4fa4-4782-a4af-44478a6c7ac7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798685 Sep 27 01:39:51.488123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1108/2322] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:39:51.508595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.510467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.533471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.534974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.535525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.537706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.538864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.539633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.675923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:51.685804 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9823c967-d719-4671-88ec-ffdca29f1199 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1278 microversion: 2.1 time: 0.294291 Sep 27 01:39:51.690891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1215/2323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1278 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:51.713317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.714801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.722910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.723502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.724185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.725326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.726243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.726983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.800442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:51.812386 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a8ac77e-3eff-444f-906c-0def1b2264db tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1210 microversion: 2.1 time: 0.317826 Sep 27 01:39:51.813962 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1109/2324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1210 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:51.820319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-406999fc-d3fd-44ae-bc1b-ed26f27d9417 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.821439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-406999fc-d3fd-44ae-bc1b-ed26f27d9417 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.927430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-406999fc-d3fd-44ae-bc1b-ed26f27d9417 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:51.937254 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-406999fc-d3fd-44ae-bc1b-ed26f27d9417 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1214 microversion: 2.1 time: 0.121667 Sep 27 01:39:51.937662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1110/2325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:51.942515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "772662d5-7c79-47c4-9d53-e8abb1d4e32f", "name": "network-vif-deleted", "tag": "ad096b90-1e1b-4720-b23b-e1a59d2c0613"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:51.953981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.954464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.954901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.966258 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] Creating event network-vif-deleted:ad096b90-1e1b-4720-b23b-e1a59d2c0613 for instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f on n-h2-859358-1 Sep 27 01:39:51.971520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-628efa47-9c96-44f1-9558-333693c58e06 req-0502f87a-2502-404c-9cd3-c8074b468f55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032631 Sep 27 01:39:51.972283 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1111/2326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:51.978003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:51.978948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:51.985811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.986296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.986782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:51.987431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:51.987886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:51.988309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.005719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:52.118447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:52.137020 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bac877f3-ae8c-4a6e-91ec-77c7672acd19 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.431869 Sep 27 01:39:52.138262 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1216/2327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:52.153367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9902f08-ac06-4186-8af8-c8f23a5fe44a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da70ca60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:52.168257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:52.177930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c8360e5-ffd4-4085-8c02-75415a8b4d03 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.204555 Sep 27 01:39:52.178521 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1112/2328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:51 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:52.226919 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9902f08-ac06-4186-8af8-c8f23a5fe44a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.086846 Sep 27 01:39:52.228096 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1217/2329] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:52 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:52.414269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:52.415558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:52.424879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.476817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.476817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.476817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.476817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.486881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.679637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:52.690985 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e624d72d-c206-4743-b2bf-851d2b3efc46 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.280942 Sep 27 01:39:52.691591 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1113/2330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:52 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:52.723406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:52.725002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:52.732799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.733290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.733883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.735025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.735621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.736421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.835077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:52.835693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:52.846560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.846968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.852907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:52.853704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:52.854177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:52.855437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.024411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:53.034438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e51ca82a-e002-473d-96c4-fa94a2cfc7c4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1210 microversion: 2.1 time: 0.203031 Sep 27 01:39:53.035117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1114/2331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:52 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:53.043029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:53.045185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:53.055403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.055899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.056335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.057042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.057585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.058163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.131866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:53.159441 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cbacc46-e773-4e1b-ab61-51d4c01ca0c1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1266 microversion: 2.1 time: 0.121613 Sep 27 01:39:53.161841 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1115/2332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:53 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:53.172655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:53.174084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:53.180703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:53.182860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.183907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.184506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.185277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.186109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.186666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.308880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:53.322649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2866dcb6-8792-4231-aa88-97e02cc5fc20 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.607597 Sep 27 01:39:53.323389 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1218/2333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:52 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:53.348403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:53.355207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:53.388797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.392906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.394159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.399343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.406510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.410187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.601752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:53.610904 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8447dfc5-3b82-4a60-847e-4ae4e36ca8ac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.448063 Sep 27 01:39:53.630588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1116/2334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:53 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:53.650648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b59de7e-c97b-456c-b8da-d4af1a425d88 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d65025e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:53.755909 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b59de7e-c97b-456c-b8da-d4af1a425d88 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.123794 Sep 27 01:39:53.766567 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1117/2335] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:53 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:53.775005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:53.777207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:53.788637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.789922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.790852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:53.793251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:53.793850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:53.794785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.110863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:54.119276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2774f9b4-6f4f-492b-978e-6774cf8d85bb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.351143 Sep 27 01:39:54.125522 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1118/2336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:53 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:54.125522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:54.126682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:54.130833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:54.137772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.138272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.138727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.140355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.140835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.142147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.146152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eddcd420-4970-4849-aa8e-fe35d9d1e822 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.820722 Sep 27 01:39:54.150192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1219/2337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:53 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:54.187896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:54.188779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:54.195629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.196370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.196975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.197843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.198473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.199045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.285084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:54.297131 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f5cb5bc-e61e-40d5-a8b3-1b4b33bae520 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1272 microversion: 2.1 time: 0.112983 Sep 27 01:39:54.298319 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1220/2338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:54 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:54.348891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:54.350058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:54.361270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.362123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.362769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.363556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.364350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.364919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.611571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:54.622461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-377c0cdb-c8ff-4e25-bd4c-074e78b2c59d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.278950 Sep 27 01:39:54.637772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1221/2339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:54 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:54.657678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db91074-a09e-4553-b4e0-0248f7559a3b", "tag": "ece7687e-b7b8-4413-b1e7-db4ec7e847ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:54.667617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.668098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.668527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.691735 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] Creating event network-changed:ece7687e-b7b8-4413-b1e7-db4ec7e847ef for instance 8db91074-a09e-4553-b4e0-0248f7559a3b on n-h1-859358-1 Sep 27 01:39:54.699784 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-dafb88ef-67a9-4642-874e-d61d0d3becee req-e638d5fd-bae8-4bc6-a4bd-a0824e294793 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060723 Sep 27 01:39:54.701118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1222/2340] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:54.712659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:54.715468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:54.724157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.725675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.726704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:54.727633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:54.728409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:54.732793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.039691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:55.053651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6877823c-b85d-423d-8830-61080da78715 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.344369 Sep 27 01:39:55.054317 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1223/2341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:54 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:55.062252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f148e0f1-ce44-4b25-b8ec-4b5ee403bd56 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c4b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:55.137275 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f148e0f1-ce44-4b25-b8ec-4b5ee403bd56 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.076564 Sep 27 01:39:55.138955 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1224/2342] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:55 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:55.145021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:55.158420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.159377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.160228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.180350 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Creating event network-vif-unplugged:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:39:55.191340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:39:55.206514 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b9715743-405d-41f6-bf0c-e8507bc1f3ee req-1fe343d6-eced-4caf-a110-39112b08593b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065909 Sep 27 01:39:55.207712 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1225/2343] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:55.217527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:55.218755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:55.226514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.227543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.228406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.230001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.231283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.231753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.441075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:55.451360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f4f05db-1f50-4cea-acbf-b8cdfd80c4e8 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 1.329494 Sep 27 01:39:55.452450 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1119/2344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:54 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:55.457644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:55.458435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:55.465102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.465609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.466232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.467102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.467758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.478066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.480381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:55.492183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9a242cf-90e9-4de5-adea-49e846d4c73f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.282994 Sep 27 01:39:55.492860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1226/2345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:55 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:55.525310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:55.526741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:55.535082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.535594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.536032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.537113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.537668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.538102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.809833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:55.818408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ebae5b29-e63c-4157-83f9-197f16765e00 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.310447 Sep 27 01:39:55.826945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1227/2346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:55 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:55.826945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:55.826945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:55.831166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.831166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.831666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.832376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:55.832885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:55.833316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:55.862080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:55.872737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c74ff246-9c99-45e2-b49e-5a94f00ce0ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.419083 Sep 27 01:39:55.873657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1120/2347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:55 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.000055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:56.010296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d58c15a1-1df1-4868-a0ef-154a4815cced tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.190210 Sep 27 01:39:56.011494 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1228/2348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:55 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.083459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.084071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:56.094503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.095076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.095610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.096398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.096949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.097487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.156329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32e55277-a278-4e57-8400-d08350ec3514 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c4820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.212680 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32e55277-a278-4e57-8400-d08350ec3514 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.060830 Sep 27 01:39:56.228157 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1229/2349] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.364672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:56.379369 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dac8c5e5-edc2-43b9-9bd1-971ea2f2d654 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.298343 Sep 27 01:39:56.380984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1121/2350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.406279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:56.419302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.419822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.420260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.435107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Creating event network-changed:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:39:56.442501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 01:39:56.458016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6e2b0f0c-53f2-403b-9b17-d72903d4f2c2 req-711a9d4b-304f-4bc4-8b1a-eeefa621c20e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056789 Sep 27 01:39:56.459086 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1230/2351] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:56.479290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.480625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:56.488984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.490337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.490928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.492334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.492934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.493719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.519743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.522101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:56.537899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.540222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.540871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.543203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.543877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.546196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.594734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:56.806275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:56.818771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91d9947f-1c23-4e15-b435-5a0306dfcfc5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.303132 Sep 27 01:39:56.837681 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1231/2352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.849822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.850762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:56.858865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.859793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.860857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.862534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.863209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.863858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.877325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:56.885439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7293920a-df80-4d3d-be6d-f21ef898f602 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.413121 Sep 27 01:39:56.893593 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1122/2353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:56.895769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:56.901370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:56.911699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.912223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.912674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:56.913420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:56.913882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:56.914389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.208333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:57.219640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70a9a776-14f3-4f7d-bff5-34282f18d637 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.380463 Sep 27 01:39:57.226337 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1232/2354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:57.237956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:57.238710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:57.246182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.246873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.247312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.248213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.248672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.249102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.304271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:57.314199 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c71ea069-4931-4f74-a70a-40d23fdbde78 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.422049 Sep 27 01:39:57.314885 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1123/2355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:56 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:57.320628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab2782-bd65-42dc-adf5-20c04bac9113", "name": "network-vif-plugged", "status": "completed", "tag": "0119ebdb-334a-4237-ac56-e48b77e13bd5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:57.331702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.332634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.332961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.346251 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] Creating event network-vif-plugged:0119ebdb-334a-4237-ac56-e48b77e13bd5 for instance 75ab2782-bd65-42dc-adf5-20c04bac9113 on n-h2-859358-1 Sep 27 01:39:57.354405 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4e3bd188-5618-4c7e-89ff-46471887e397 req-e0e68c77-fd8b-49c5-86c4-de55c0686dab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037861 Sep 27 01:39:57.362188 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1124/2356] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:57.369046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c62eabbb-fe7d-4325-ae8d-cf90cf016e19 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6252670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:57.423972 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c62eabbb-fe7d-4325-ae8d-cf90cf016e19 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.060172 Sep 27 01:39:57.424688 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1125/2357] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:57 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:57.429949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:57.430799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:57.437986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.438620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.439154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.440392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.441048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.441735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.450142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:57.473136 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae710fb2-38ec-4df6-8591-f9e3c822253a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.244391 Sep 27 01:39:57.474484 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1233/2358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:57 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:57.691492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:57.700986 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9115b5a-0452-4640-8c3e-323316c4f385 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.275143 Sep 27 01:39:57.720047 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1126/2359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:57 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:57.840694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:57.841311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:57.851097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.851955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.852738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.853849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.854822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.855455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.917541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:57.918559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:57.925683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.926493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.927154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:57.928120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:57.928945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:57.929594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.031726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:58.040818 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a925aaed-02e0-412f-8d9d-cf18f3c6e774 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.204075 Sep 27 01:39:58.041753 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1234/2360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:57 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:58.089082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:58.097691 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8aa2cea-2fb8-4229-811b-8ab3bf1caf0c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.184908 Sep 27 01:39:58.098260 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1127/2361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:57 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:58.242938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:58.243488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:58.250608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.251094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.251534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.252249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.252705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.253134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.340496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:58.341188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:58.348254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.349040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.349508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.350407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.351030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.351882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.390047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:58.400960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-075295bd-f8d3-49b5-96bd-ebd69ecf160e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.160073 Sep 27 01:39:58.400960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1235/2362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:58 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:58.440752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-686ad8f1-12d4-4b4a-bd82-ba473c4e93cb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d611c940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:58.541007 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-686ad8f1-12d4-4b4a-bd82-ba473c4e93cb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.104364 Sep 27 01:39:58.542421 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1236/2363] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:58 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:58.554536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:58.555173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:58.565184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.565910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.566536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.567550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.568181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.568932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.696208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:58.705569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1aef31b7-1675-4748-8bad-ca3ad681694f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1469 microversion: 2.1 time: 0.368918 Sep 27 01:39:58.706159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1128/2364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:58 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:58.719335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb4aa0e-b1c8-4d18-915c-d650b18b1822", "tag": "58e9130c-1693-4c7d-9bfb-44ba7976f816"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:58.754001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.756166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.756611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.784002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] Creating event network-changed:58e9130c-1693-4c7d-9bfb-44ba7976f816 for instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 on n-h1-859358-1 Sep 27 01:39:58.795459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b6d1fb8c-259e-4e50-8e30-9b19d720d5f3 req-db3f06ac-10ce-4965-9da8-ef62ff9de9cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088098 Sep 27 01:39:58.800388 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1129/2365] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:58.807561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:58.812120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:58.825061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.826568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.829191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:58.831699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:58.833098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:58.834440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.025350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:59.034353 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af4cb2ae-de3e-40c7-8f28-dfd66c64a9fd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.490991 Sep 27 01:39:59.035182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1237/2366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:58 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:59.066902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:59.067928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:59.076550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.077197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.077757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.078605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.079178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.079693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.460637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:59.475111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c99ab532-4836-4db5-ad0c-d664f25738f8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.412513 Sep 27 01:39:59.477851 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1238/2367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:59 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:39:59.493240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:59.494316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:59.504550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.505057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.506718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.509232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.509772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.510218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.511869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=24 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:39:59.692810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:59.727792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa2a8f75-4bc9-4a02-8b34-1b668883c4cf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.915598 Sep 27 01:39:59.731626 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1130/2368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:58 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:59.760298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf99c02d-d224-48c0-bca7-f91e06057847", "name": "network-vif-plugged", "status": "completed", "tag": "19a71e1e-31a9-4f1b-a22d-94a02d5ec36a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:39:59.808854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.815428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.818313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.821829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:39:59.831261 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-78b545b6-6c92-4977-bfdd-dc57f3fa9229 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.351614 Sep 27 01:39:59.831862 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1239/2369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:59 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:39:59.837466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:39:59.838095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:39:59.848690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.849185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.849657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.850368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:39:59.850825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:39:59.851252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:39:59.865163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] Creating event network-vif-plugged:19a71e1e-31a9-4f1b-a22d-94a02d5ec36a for instance cf99c02d-d224-48c0-bca7-f91e06057847 on n-h2-859358-1 Sep 27 01:39:59.871900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fce05841-2a40-4545-9b6a-7bf523357d11 req-ae4e0ae6-cd33-4e7e-a07a-2dac674b58ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137543 Sep 27 01:39:59.877895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1131/2370] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:39:59.888967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-938f5dde-0ddf-45ed-8f61-24edf8e7067b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6d5fa60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.008207 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-938f5dde-0ddf-45ed-8f61-24edf8e7067b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.128482 Sep 27 01:40:00.008784 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1132/2371] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:39:59 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:00.032715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.033798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:00.041324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.042512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.043168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.044083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.044686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.045365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.078656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:00.089188 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08acb783-8809-4bbd-83d3-4bd4d1c9a4ff tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.255701 Sep 27 01:40:00.092011 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1240/2372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:39:59 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:00.101466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.103910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:00.124796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.126587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.128322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.129229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.130062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.133161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.326575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:00.335026 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0028270-ea4f-448a-bfc8-d2da462de3be tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.241665 Sep 27 01:40:00.335768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1241/2373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:00.500223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.500855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:00.509450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.510209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.511134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.511843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.512296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.512725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.661112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:00.671288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4623bac9-ac55-45c4-b188-ff15a813bab9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.174866 Sep 27 01:40:00.672413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1242/2374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:00.757028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.757669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:00.764601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.765091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.765550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.766480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.766939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.767604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.917664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:00.926890 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db8d385c-50d7-4a96-8f45-2af4b90cb98d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1462 microversion: 2.1 time: 0.916713 Sep 27 01:40:00.949520 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1133/2375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1462 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:00.949520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:00.949520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:00.949520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.949520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.950061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.950061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:00.950061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:00.950061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:00.962276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:00.964053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:00.972879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70b48ee7-74e3-4a3d-89ac-09d190e310a4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1315 microversion: 2.1 time: 0.219619 Sep 27 01:40:00.986145 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1243/2376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:01.150169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.150807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:01.157575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.158480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.159640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.160958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.162309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.163064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.296793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:01.324264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:01.359503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-131867c9-4f47-46e3-9f48-6f0f69ddd475 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.425056 Sep 27 01:40:01.362025 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1134/2377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:01.368131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01d9b3b7-64fe-44c0-835e-f860fb93b8a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6262550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.428541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01d9b3b7-64fe-44c0-835e-f860fb93b8a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.064634 Sep 27 01:40:01.429994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1135/2378] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:01 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:01.434985 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00b58905-1fc2-463d-9682-21532ef846b5 tempest-MigrationsAdminTest-1940789038 tempest-MigrationsAdminTest-1940789038-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1613 microversion: 2.1 time: 0.447324 Sep 27 01:40:01.436485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1244/2379] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:00 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1613 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:01.441308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.442066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:01.448704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.449551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.450106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.451668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.452717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.453412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.476740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.477453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:01.492056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.492575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.494238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.495626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.496099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.496528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.747876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:01.759792 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1c258d6-c02f-46b4-956f-25357112cb4a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.321383 Sep 27 01:40:01.771678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1245/2380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:01 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:01.783187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:01.787347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.787939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:01.793540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc09593b-096c-4652-a044-129a1c23aae2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.362157 Sep 27 01:40:01.797258 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1136/2381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:01 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:01.802696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:01.804545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.805187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.805789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.806659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.808119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.808621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:01.811017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.820068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.820572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.821037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.821763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:01.822222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:01.822840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:01.875820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:01.931609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:02.053148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:02.069765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:02.086502 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ed64a1e-39e4-4ba8-b63b-ce5bbc8985c8 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.287956 Sep 27 01:40:02.087636 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0e66da2-1982-46ba-8b0e-deed796fd3e0 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 204 len: 0 microversion: 2.1 time: 0.313429 Sep 27 01:40:02.088598 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1137/2382] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:01 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:02.093526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.094407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.101238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.101929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.102519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.103088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1246/2383] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:01 2022] DELETE /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:02.103701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.104913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.105600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.125603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91074-a09e-4553-b4e0-0248f7559a3b", "name": "network-vif-plugged", "status": "completed", "tag": "ece7687e-b7b8-4413-b1e7-db4ec7e847ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:02.153531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.154548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.155218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.171183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:02.173863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] Creating event network-vif-plugged:ece7687e-b7b8-4413-b1e7-db4ec7e847ef for instance 8db91074-a09e-4553-b4e0-0248f7559a3b on n-h1-859358-1 Sep 27 01:40:02.180487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-56f7ac81-7bc3-432f-ae21-ea59d568f9e6 req-dd052804-e0da-4e73-a360-4b88d953bfef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073182 Sep 27 01:40:02.183078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1247/2384] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:02.188718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.189741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.197694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.199554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.200144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.201114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.201781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.203609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.428356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:02.438420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfb3a05c-7023-4270-a460-0a58fcbba824 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1503 microversion: 2.1 time: 0.348547 Sep 27 01:40:02.444304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:02.453531 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ac3c24b-e267-4af0-9ddd-287abf9db6d9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1468 microversion: 2.1 time: 0.269072 Sep 27 01:40:02.455127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1138/2385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:02.457237 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1248/2386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1468 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:02.473188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3877effe-bdf3-4bec-a6f2-5aa01c01833c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6ea550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.490872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.492079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.500406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.500907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.501367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.502260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.502728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.503235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.524823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3877effe-bdf3-4bec-a6f2-5aa01c01833c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.066127 Sep 27 01:40:02.525328 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1249/2387] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:02.532950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1975829800"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:02.534181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.543518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.544180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.544757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.545649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.546248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.546817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.726307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Adding security group 3b0b3e17-82fe-45bd-9a5c-52347bfd4477 to port 19a71e1e-31a9-4f1b-a22d-94a02d5ec36a Sep 27 01:40:02.754905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:02.766348 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1f41e07-5e14-4803-bcf0-627fdf3a0263 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.309928 Sep 27 01:40:02.767738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1139/2388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:02.785450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.786315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.795274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.795778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.796329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.797052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.797540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.797973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.968552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:02.977709 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-469e6c06-d74c-4f2c-b1e1-08b837f6a736 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.196639 Sep 27 01:40:02.978324 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1140/2389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:02.984134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:02.984969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:02.992577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.993291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.994035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:02.994745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:02.995246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:02.995672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.181834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:03.194733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d53450aa-7b97-452d-b633-e8c9cf2c2514 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.215341 Sep 27 01:40:03.209655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8889e887-2b45-444b-81a6-21f1f42f3279 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/action" status: 202 len: 0 microversion: 2.1 time: 0.675971 Sep 27 01:40:03.209655 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1250/2390] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:02 2022] POST /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:03.209655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:03.209655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:03.213168 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1141/2391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:02 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:03.219488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-764827830"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:03.220329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:03.221160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.223307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.224141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.227124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.227124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.227327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.230340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.231064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.231720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.232634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.233843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.234480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.462266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:03.472313 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eef272eb-61da-4859-8527-5b0f50b244d9 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.267399 Sep 27 01:40:03.472940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Adding security group eb00ad7e-43c8-43d9-bc81-08fd5f5593d5 to port 19a71e1e-31a9-4f1b-a22d-94a02d5ec36a Sep 27 01:40:03.473653 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1251/2392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:03 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:03.499559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf99c02d-d224-48c0-bca7-f91e06057847", "tag": "19a71e1e-31a9-4f1b-a22d-94a02d5ec36a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:03.519931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.520397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.520837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.553426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] Creating event network-changed:19a71e1e-31a9-4f1b-a22d-94a02d5ec36a for instance cf99c02d-d224-48c0-bca7-f91e06057847 on n-h2-859358-1 Sep 27 01:40:03.564318 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c338e17b-0aba-4242-b008-b5f03a56f89b req-7fa5af10-04cc-43a6-a750-77f504cce09b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089226 Sep 27 01:40:03.564988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1252/2393] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:03.581675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:03.582401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:03.591808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.592302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.593064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.593525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.593990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.594417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.867018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:03.883394 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c92731c-7c2a-46be-8ad4-8ebc6d0d3293 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1468 microversion: 2.1 time: 0.312374 Sep 27 01:40:03.893420 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1253/2394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:03 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:03.893420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d4daa32-ecaa-49b8-9af4-5e24fd460ed4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da70c310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:03.958104 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d4daa32-ecaa-49b8-9af4-5e24fd460ed4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.072590 Sep 27 01:40:03.969804 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1254/2395] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:03 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:03.975283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:03.975911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:03.985078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.985275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.985615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:03.986596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:03.986830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:03.987262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.042937 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04f1a41b-7c93-4d2c-9447-6463f940dce4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/action" status: 202 len: 0 microversion: 2.1 time: 0.827464 Sep 27 01:40:04.044579 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1142/2396] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:03 2022] POST /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:04.050231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:04.051196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:04.075908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.077120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.079478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.080578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.082151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.083688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.217804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:04.230915 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64bbd5d8-516c-497a-9e9b-3df140c43a21 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.257362 Sep 27 01:40:04.250833 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1255/2397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:03 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:04.274237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:04.274655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:04.301199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.301656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.303788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.306157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.306778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.307444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.559034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:04.570102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32b0dbc5-9043-4d52-b64e-7bad0285326a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1318 microversion: 2.1 time: 0.521430 Sep 27 01:40:04.572107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1143/2398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:04 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:04.579453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf99c02d-d224-48c0-bca7-f91e06057847", "tag": "19a71e1e-31a9-4f1b-a22d-94a02d5ec36a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:04.614695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90bbbfa4-bc23-4b38-a048-df417ce4b8df tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.362634 Sep 27 01:40:04.615515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1256/2399] 10.222.0.52 () {58 vars in 1293 bytes} [Tue Sep 27 01:40:04 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847/os-security-groups => generated 1157 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:04.632752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:04.633658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:04.641132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.644297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.644903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.645138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.645933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.646057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.647640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.648246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.648818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.690306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] Creating event network-changed:19a71e1e-31a9-4f1b-a22d-94a02d5ec36a for instance cf99c02d-d224-48c0-bca7-f91e06057847 on n-h2-859358-1 Sep 27 01:40:04.714374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-02aeb14c-e70d-4d32-98ca-a331c895ef04 req-c82dcf60-0e48-46d2-9480-b9e28337eb44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140554 Sep 27 01:40:04.716726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1144/2400] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:04.727737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:04.729955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:04.747414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.748318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.748987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.749948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:04.750624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:04.756351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:04.996449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:05.006652 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76c1166e-a4fb-47f3-bfc8-e6f6b24e26db tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.379951 Sep 27 01:40:05.026336 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1257/2401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:04 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:05.032216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-plugged", "status": "completed", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:05.043411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.043761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.044199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.094683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] Creating event network-vif-plugged:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:40:05.109413 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-85163855-cd79-48cc-8dc5-6cc510f4739e req-7fe22a89-ec63-4e0b-b739-000a00d898f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081635 Sep 27 01:40:05.110757 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1258/2402] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:05.125753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46c2e055-3b9f-4c0d-a0f6-265fa4511c05 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24da658790>, body: {"security_group": {"name": " tempest-securitygroup -1035140794 ", "description": "tempest-description-1823461712"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:05.220583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:05.232331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f7ec2a1-4c95-4574-8c26-ad3eb96008a1 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.513975 Sep 27 01:40:05.232930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1145/2403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:04 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:05.256462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:05.257503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:05.264362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.265188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.265939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.266936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.267655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.268333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.436931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46c2e055-3b9f-4c0d-a0f6-265fa4511c05 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.324926 Sep 27 01:40:05.437604 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1259/2404] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:05 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:05.445252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dcdeb8ef-d013-4c2d-b9d5-fbb90b4c89ab tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d611c670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:05.523438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dcdeb8ef-d013-4c2d-b9d5-fbb90b4c89ab tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.084212 Sep 27 01:40:05.524295 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1260/2405] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:05 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:05.548372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:05.549459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:05.558140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.558837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.559453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.560311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.560908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.561524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.671523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:05.690895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db8aa031-a0ff-4621-8e7a-d076817b33ac tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1468 microversion: 2.1 time: 0.440088 Sep 27 01:40:05.691985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1146/2406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:05 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:05.703114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-590ab8da-c1c7-4582-b0bf-c0d544f13812 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d68608b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:05.904402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:05.916860 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d691b68-2e75-4dfc-ba57-f399ef8bc8ca tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.385330 Sep 27 01:40:05.930416 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1261/2407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:05 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:05.945433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:05.951201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:05.966217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.967129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.967819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:05.968745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:05.969429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:05.970122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.042928 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-590ab8da-c1c7-4582-b0bf-c0d544f13812 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db" status: 200 len: 224 microversion: 2.1 time: 0.349493 Sep 27 01:40:06.044562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1147/2408] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:05 2022] GET /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db => generated 224 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:06.050329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:06.051172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:06.063857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.064716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.071004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.071969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.072579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.073809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.258483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:06.269060 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6acb2e8d-6a5d-4da1-94bf-65836eab5d62 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1508 microversion: 2.1 time: 0.337180 Sep 27 01:40:06.272646 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1262/2409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:05 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:06.302884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ab630c3-154e-423a-ad37-2bc78ffc8a39 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da736ca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:06.579656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:06.588317 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-651df177-49d7-473c-9885-a9fb0342a0bc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.542449 Sep 27 01:40:06.592773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1148/2410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:06 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:06.612666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:06.614839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:06.634195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.639496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.640516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.648071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.652505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.652997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.702570 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ab630c3-154e-423a-ad37-2bc78ffc8a39 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db" status: 202 len: 0 microversion: 2.1 time: 0.414491 Sep 27 01:40:06.704180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1263/2411] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:40:06 2022] DELETE /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:06.709129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:06.711318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:06.734967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.735740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.736197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:06.739444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:06.742140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:06.744817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.102220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:07.115670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f62ba0a-770b-41a8-92d4-af7cf5059e43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1508 microversion: 2.1 time: 0.408954 Sep 27 01:40:07.129954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1264/2412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:06 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.129954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f963997-5e14-46dd-9b42-e424f85ce774 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da70c700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:07.204138 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f963997-5e14-46dd-9b42-e424f85ce774 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.083975 Sep 27 01:40:07.205212 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1265/2413] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:07 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.220397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da736790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:07.223754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:07.238996 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77ed9a4b-f82f-4e28-adc1-170c17f2b1cf tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.643412 Sep 27 01:40:07.239587 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1149/2414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:06 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.254673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:07.261784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:07.263402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:40:07.264023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:40:07.264555 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.264555 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db HTTP/1.1 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:40:07.267241 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.268646 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db'} Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:07.269596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.270780 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:07.271715 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-78039d29-8518-4cd3-9436-c2cb8db9e3ec'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df7a08bc-90e2-4967-8713-48af335ce6b5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db" status: 404 len: 194 microversion: 2.1 time: 0.062168 Sep 27 01:40:07.272688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1266/2415] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:07 2022] GET /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:07.277831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.278310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.278743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.284263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.285860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ae8a6d-89f9-4238-bf05-425f95b3e00e", "name": "network-vif-deleted", "tag": "8a6c525f-5918-47d0-96a9-5ad5d6fec00f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:07.286803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.294218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.309902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.310389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.310823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.334908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] Creating event network-vif-deleted:8a6c525f-5918-47d0-96a9-5ad5d6fec00f for instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e on n-h1-859358-1 Sep 27 01:40:07.345973 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-db7e09a4-70ac-4b61-b84e-91cae864086d req-7f0a7f5e-fd49-4ff4-938b-c993315efb31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075496 Sep 27 01:40:07.346766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1267/2416] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:07.355654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:07.362389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:07.375285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.375780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.376219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.376943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.377426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.377943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.421318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.424107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.424567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.425035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lazy-loading 'fault' on Instance uuid 80ae8a6d-89f9-4238-bf05-425f95b3e00e {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:07.562001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:07.570616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ea0c2b4-1127-4a0c-8337-ff81e2f789c9 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 200 len: 1302 microversion: 2.1 time: 0.324005 Sep 27 01:40:07.571214 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1150/2417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:07 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 1302 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.578855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:07.594093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:07.620603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.625327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.628129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.631459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.633906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.635162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.661877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:07.677736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-690473c6-c35d-45fb-b1fa-69d6b6c2442b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.326643 Sep 27 01:40:07.701366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1268/2418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:07 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.710300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810fd928-bea5-4675-984e-ff8c97349c46", "name": "network-vif-plugged", "status": "completed", "tag": "60341d10-7901-42df-96a1-219b3ec5a840"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:07.742508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.744224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.747107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.763623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63bdaeaf-cf97-4e55-8899-f30f999961e3 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "PUT /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1080 microversion: 2.1 time: 0.187212 Sep 27 01:40:07.777769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1151/2419] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:40:07 2022] PUT /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1080 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:07.778133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] Creating event network-vif-plugged:60341d10-7901-42df-96a1-219b3ec5a840 for instance 810fd928-bea5-4675-984e-ff8c97349c46 on n-h2-859358-1 Sep 27 01:40:07.778746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dcc9e9f-e207-481f-91ad-6896a421f484 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24d65bb4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071302679", "description": "tempest-description-1790843182"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:07.779646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-30f7c02a-1c73-4256-b428-dafd807d0b78 req-9127490a-b2cb-4293-8648-35a512b7e06b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086283 Sep 27 01:40:07.780731 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1269/2420] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:07.787299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:07.798633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:07.817775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.820458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.820954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:07.821741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:07.824261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:07.825272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.144862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:08.163082 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f8a5090-1ccf-4ed0-a066-501e5fc2aa82 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.380791 Sep 27 01:40:08.181821 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1270/2421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:07 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:08.204808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.205868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:08.217480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.218014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.229121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.230459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.230934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.231370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.423166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:08.434379 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7fe40fd-f84a-4149-96e5-a02f2dada366 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1506 microversion: 2.1 time: 0.249354 Sep 27 01:40:08.435461 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1271/2422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:08.440954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dcdf7a73-a89f-4972-a9a5-63346b831a0a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d61ea280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.507087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dcdf7a73-a89f-4972-a9a5-63346b831a0a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.070253 Sep 27 01:40:08.508632 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1272/2423] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:08.516162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.517753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:08.529280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.530022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.530623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.532271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.533806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.534394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.764519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:08.782248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1af883c5-aad2-4c74-8d7a-81126c25aac5 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.270667 Sep 27 01:40:08.782871 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1273/2424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:08.793073 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dcc9e9f-e207-481f-91ad-6896a421f484 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.026641 Sep 27 01:40:08.802424 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1152/2425] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:08.807570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.808574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: 80ae8a6d-89f9-4238-bf05-425f95b3e00e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:08.810935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.812778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:08.829672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.830176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.830283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.830613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.830737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.831181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.831283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.831725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.831887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.832342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.832908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.834667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.849438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] HTTP exception thrown: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Request method failure captured: Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e HTTP/1.1 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMoBv7tVsHvjtQ5PSk-DvAzK7RRianGbRrA-xbiCHBge15eQbjjnU9fMuOcrKMwdM-vN1c6raThbl1Ntnb89oCyzQkNfXD0VXcIbtDwkcZkd3IshMNl0KCOGBeiEF4wk-YIlqpby1atPg_lw9lF58Z_Hux7-SLOIK_KRNn6OylYDxk Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:08.851346 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_058c7591ee264e86b5a9435827eb0095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82e4afc58d9c46faba5253e7e5542873 Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. Sep 27 01:40:08.852480 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '80ae8a6d-89f9-4238-bf05-425f95b3e00e'} Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:08.853131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. Sep 27 01:40:08.854114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:08.855731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Returning 404 to user: Instance 80ae8a6d-89f9-4238-bf05-425f95b3e00e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:08.856899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-206df6b8-2f84-4ce8-b8af-385301a51d6f tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e" status: 404 len: 111 microversion: 2.1 time: 0.053284 Sep 27 01:40:08.857987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1153/2426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/servers/80ae8a6d-89f9-4238-bf05-425f95b3e00e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:08.863217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:08.863988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:08.870621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.871325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.872043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.872901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:08.873548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:08.874106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:08.906355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:08.985295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:08.994028 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d7c31be-c197-4829-84c0-8348d65f22f1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1506 microversion: 2.1 time: 0.198138 Sep 27 01:40:08.994604 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1274/2427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:09.001037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a15eabc-4889-452f-8cfd-3cde5990b877 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24d7c47430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1774684883", "description": "tempest-description-1895216495"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:09.084487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:09.095347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9f7b99e-2904-4b6d-8316-8c8921fcb55e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.234167 Sep 27 01:40:09.096764 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1154/2428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:08 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:09.115669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:09.116556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:09.125644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.126488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.127176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.128786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.129464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.129941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.168546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:09.257256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a15eabc-4889-452f-8cfd-3cde5990b877 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.261496 Sep 27 01:40:09.258715 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1275/2429] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:09.265575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:09.271183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:09.291271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.291941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.292386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.293154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.293709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.294465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.298751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c837fa8-3d9c-40f7-8e31-abfdc5976770 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "DELETE /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 204 len: 0 microversion: 2.1 time: 0.199708 Sep 27 01:40:09.299738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1155/2430] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:09 2022] DELETE /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:09.309231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:09.311054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:09.320356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.321147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.321813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.322685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.323965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.324538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.411649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:09.435277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:40:09.435631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:40:09.436107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:40:09.438444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:40:09.438873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:40:09.562455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:09.585198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.585832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.589300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.593072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.593481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.593931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.654389 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ba5c85f-6a87-40b1-93fa-d5457c171699 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "POST /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b/action" status: 202 len: 1112 microversion: 2.1 time: 0.394104 Sep 27 01:40:09.669923 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1276/2431] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:09 2022] POST /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b/action => generated 1112 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 27 01:40:09.687715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af3f38d2-9266-429d-a4b0-b35459327ae4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24d622b670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1993110497", "description": "tempest-description-1324267632"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:09.805988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:09.824424 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f39981ac-b78b-455e-9947-d682669f8986 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.520756 Sep 27 01:40:09.826448 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1156/2432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:09 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:09.833254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:09.841054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:09.853480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.854296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.855182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:09.856182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:09.857088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:09.860353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.059216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af3f38d2-9266-429d-a4b0-b35459327ae4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.387964 Sep 27 01:40:10.060698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1277/2433] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:10.076324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c845bfc-aa0d-4f63-9c09-0ab8a02c6790 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6c5940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.185307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:10.197764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c845bfc-aa0d-4f63-9c09-0ab8a02c6790 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.127318 Sep 27 01:40:10.199173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8f907de-2168-47bd-928a-fb6a9e7245ec tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1534 microversion: 2.1 time: 0.369612 Sep 27 01:40:10.207647 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1278/2434] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:10.207856 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1157/2435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:09 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1534 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:10.218055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.218683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:10.224568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.225221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:10.235711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.236236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.236690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.237727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.238467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.238909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.251725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.253550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.254304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.254899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.255367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.255796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.487871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:10.504295 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31d7ba1b-1686-472e-8992-742f456d00fb tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1315 microversion: 2.1 time: 0.299340 Sep 27 01:40:10.505653 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1158/2436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:10.515399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb4aa0e-b1c8-4d18-915c-d650b18b1822", "name": "network-vif-plugged", "status": "completed", "tag": "58e9130c-1693-4c7d-9bfb-44ba7976f816"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:10.530795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.531922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.532604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.549751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] Creating event network-vif-plugged:58e9130c-1693-4c7d-9bfb-44ba7976f816 for instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 on n-h1-859358-1 Sep 27 01:40:10.560535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:10.565897 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a2ccc020-6120-45a5-9144-0cff611bbd7c req-42622c9d-1390-46c4-9792-f572f635ac8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057706 Sep 27 01:40:10.571114 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1159/2437] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:10.576788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7dcd7e87-efbb-4631-9911-a8075e622eff tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.365012 Sep 27 01:40:10.581138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e427560-10da-407a-ac0f-f67be48ea1e5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d62f6670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.581329 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1279/2438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:10.604411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.605146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:10.613039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.613781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.614415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.615479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:10.616189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:10.616873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:10.958718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:10.967944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8495576-7742-441c-bed3-950a78028c93 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.368957 Sep 27 01:40:10.982497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1280/2439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:10.990565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:10.991424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:11.005276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.005973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.006585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.007815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.007815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.008173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.027201 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e427560-10da-407a-ac0f-f67be48ea1e5 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.454384 Sep 27 01:40:11.039632 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1160/2440] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:11.046665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a860c1c0-9762-4d59-98af-adbc0aba9843 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d6a05ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.306742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:11.317828 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01ce89d8-2a07-488f-b79a-e89168919033 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1314 microversion: 2.1 time: 0.333431 Sep 27 01:40:11.319495 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1281/2441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:10 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:11.326358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-992f2c5f-df24-4faf-b024-3f719b534da0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d61d2550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.408153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-992f2c5f-df24-4faf-b024-3f719b534da0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.087367 Sep 27 01:40:11.413796 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1282/2442] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:11 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:11.418650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.426035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:11.440522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.441528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.444289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.445099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.449243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.449931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.496133 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a860c1c0-9762-4d59-98af-adbc0aba9843 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f" status: 202 len: 0 microversion: 2.1 time: 0.453917 Sep 27 01:40:11.497636 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1161/2443] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:40:11 2022] DELETE /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:11.506264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d6262310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.614124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:11.624647 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-37ff70ef-aac0-4d23-a74d-7e32f5e51fda tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1534 microversion: 2.1 time: 0.209668 Sep 27 01:40:11.626542 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1283/2444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:11 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1534 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:11.631835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.633842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:11.641144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.641733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.642231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.643072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.643865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.644397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.662735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:40:11.663362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group da89878e-2c47-431a-8dd0-f17839ebb76f not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:40:11.664362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.664362 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f HTTP/1.1 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:11.667553 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.668764 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'da89878e-2c47-431a-8dd0-f17839ebb76f'} Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:11.669541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.670425 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:11.671547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] Sep 27 01:40:11.672578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:11.675017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:40:11.675017 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-8ce683c2-c2a7-43be-906e-3ae0534b8903'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:11.676177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e571859-3215-4810-b300-37a7419e8e70 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f" status: 404 len: 194 microversion: 2.1 time: 0.174979 Sep 27 01:40:11.677376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1162/2445] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:11 2022] GET /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:11.686442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:11.687974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:11.696598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.698631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.699320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.700265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:11.700938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:11.705832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:11.808554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:11.818579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1bfbe100-0207-435a-ad4c-05bc85f0660f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1503 microversion: 2.1 time: 0.189911 Sep 27 01:40:11.823881 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1284/2446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:11 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:11.842762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b1542ba-f7be-44f7-a9d3-ae6721b4b887 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d61ea8b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.033423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:12.043922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02e969e3-2dc3-4513-bab8-0bac7fcd9673 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.365210 Sep 27 01:40:12.044540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1163/2447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:11 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:12.052633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.053154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:12.078635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.079019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.079469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.080179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.080618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.086166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.125960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b1542ba-f7be-44f7-a9d3-ae6721b4b887 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb" status: 202 len: 0 microversion: 2.1 time: 0.300173 Sep 27 01:40:12.129835 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1285/2448] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:40:11 2022] DELETE /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:12.138770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.140637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:12.157928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.158438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.171324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.174049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.176519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.177906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.329431 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62fc73eb-6347-4dec-b14e-159d11e33296 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "DELETE /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.283688 Sep 27 01:40:12.330662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1164/2449] 10.222.0.52 () {58 vars in 1296 bytes} [Tue Sep 27 01:40:12 2022] DELETE /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46/os-server-password => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:12.344233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d68001f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.409401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:40:12.410671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group cd3e45f8-ea11-4150-8a16-21b745dc12cb not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:40:12.411283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.411283 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb HTTP/1.1 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:12.414596 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.415908 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'cd3e45f8-ea11-4150-8a16-21b745dc12cb'} Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:12.416598 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.417717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:12.419240 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-14a2ef9b-6a28-44e7-825a-129d688a4b3f'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5542f47e-81e3-473f-a2e3-6f3c461729ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb" status: 404 len: 194 microversion: 2.1 time: 0.084833 Sep 27 01:40:12.422352 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1165/2450] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:12 2022] GET /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:12.446391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.448653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:12.457808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.458356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.459118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.484920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.485565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.486456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.491539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:12.519078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3235479-9fac-4636-a942-c42cf422563f tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095891 Sep 27 01:40:12.519615 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a16011d9-9437-478a-b05f-ff8c4132efd3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.389572 Sep 27 01:40:12.520293 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1286/2451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:12 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:12.529509 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1166/2452] 10.222.0.52 () {58 vars in 1293 bytes} [Tue Sep 27 01:40:12 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46/os-server-password => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:40:12.532907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.533562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:12.538286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2c8ab-7765-42ba-9f11-4583419c3559", "name": "network-vif-deleted", "tag": "21ed026a-16ac-4fb8-885c-4864ee318786"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:12.553228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.554379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.554965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.557031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.561965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.563821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.565179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:12.566672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:12.567218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:12.576506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] Creating event network-vif-deleted:21ed026a-16ac-4fb8-885c-4864ee318786 for instance baf2c8ab-7765-42ba-9f11-4583419c3559 on n-h2-859358-1 Sep 27 01:40:12.584951 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b975d06a-efe4-4583-9fb4-7f5c3d5cc9e7 req-66886b71-cfaf-4dad-8eb3-4456e81a780a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056918 Sep 27 01:40:12.586394 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1167/2453] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:12.594740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fba89077-a418-42f9-9ad2-fad0209d4376 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d614c940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.814287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:12.826045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7b1777e-f736-4fc5-a2dd-7e7007d48299 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1500 microversion: 2.1 time: 0.303957 Sep 27 01:40:12.828843 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1287/2454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:12 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1500 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:12.833906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00184485-8264-42da-b7d9-9cdb37c36d08 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d61ea160>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.905092 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00184485-8264-42da-b7d9-9cdb37c36d08 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.074462 Sep 27 01:40:12.912559 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1288/2455] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:12 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:12.925226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-212637780", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "239c95d9-c168-4521-87d2-b79ab3af1a31"}], "block_device_mapping_v2": [{"uuid": "a73c61d2-872a-4242-8537-df999fd239fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:12.960208 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fba89077-a418-42f9-9ad2-fad0209d4376 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e" status: 202 len: 0 microversion: 2.1 time: 0.372411 Sep 27 01:40:12.964565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1168/2456] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:40:12 2022] DELETE /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:12.989726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:12.990436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:13.020756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.021255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.022043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.023221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.023824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.024397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.040288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] validate_networks() for [('239c95d9-c168-4521-87d2-b79ab3af1a31', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:40:13.061092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:13.171098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f435f47-e987-49db-9978-6f66d8ad68a3 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "DELETE /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 204 len: 0 microversion: 2.1 time: 0.204820 Sep 27 01:40:13.172161 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1169/2457] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:12 2022] DELETE /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:13.177920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a30166-865c-427a-94ff-8b85ea13b756", "name": "network-vif-plugged", "status": "completed", "tag": "3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:13.187792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:13.192556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.193026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.193477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.206836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] Creating event network-vif-plugged:3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e for instance 48a30166-865c-427a-94ff-8b85ea13b756 on n-h2-859358-1 Sep 27 01:40:13.214448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-72063e63-3d7b-4273-94e5-a28f59bd49a0 req-144d619b-1403-4627-ac15-3de2d7bd7388 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040689 Sep 27 01:40:13.215405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1170/2458] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:13.220545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:13.221249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:13.228462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.228960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.229950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.230662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.231120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.231550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.276482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.276971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.277441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.277903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lazy-loading 'fault' on Instance uuid baf2c8ab-7765-42ba-9f11-4583419c3559 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:13.347319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:13.360851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb9361ca-fd5e-41f9-b52a-27f7bb2ae73d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1369 microversion: 2.1 time: 0.144072 Sep 27 01:40:13.378983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1171/2459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:13 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:13.392740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:13.393263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:13.400597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.401054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.401572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.402360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.402815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.422509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.458633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'flavor' on Instance uuid 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:13.538071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:13.546794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:40:13.547757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:40:13.548502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:40:13.549086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:40:13.549756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:40:13.562241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.562782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.563214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.563954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.564414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.564837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.592130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:40:13.597841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Getting quotas for user 5591a6d007e9465a9ec1a856483feb6d and project d07021c27c9b4371950fd1b930cdec82. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:40:13.664273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:40:13.666757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a73c61d2-872a-4242-8537-df999fd239fc',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:40:13.765669 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7dd6aaad-ddbd-4c72-a612-09020ea8f2f7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822/action" status: 202 len: 0 microversion: 2.1 time: 0.384938 Sep 27 01:40:13.769513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1172/2460] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:13 2022] POST /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:13.774453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d613f9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:13.837474 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4cd22d68-2f56-40da-a402-8de5b872e79f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.923530 Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group a1c16992-9b97-458d-9cc7-750fc0382c4e not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e HTTP/1.1 Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:13.845016 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:40:13.845906 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a1c16992-9b97-458d-9cc7-750fc0382c4e'} Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:40:13.846793 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:40:13.847733 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.848946 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-743535d3-5ab6-49ee-9643-86c71a3d3b12'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:13.850771 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba7df3ba-c83f-4b44-bb09-b8b75e4534ad tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e" status: 404 len: 194 microversion: 2.1 time: 0.076623 Sep 27 01:40:13.852114 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1173/2461] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:13 2022] GET /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:13.853812 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1289/2462] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:40:13.856285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:13.859425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:13.861275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:13.862940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:13.872683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.873186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.873684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.875055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.875529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.876003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.878412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.878993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.880283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:13.881425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:13.882032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:13.882612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.062424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.074999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.082772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f48c4d19-adab-425b-bab7-4b740380337a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.225565 Sep 27 01:40:14.089483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1174/2463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:13 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.089618 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f81ba5f-2120-4527-a2ca-eb6b40970c62 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1509 microversion: 2.1 time: 0.228082 Sep 27 01:40:14.094943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.095688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:14.099349 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1290/2464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:13 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.103874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.105066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.105707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.105946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.106564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:14.106888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.107478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.108170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.114047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.114047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.114047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.114406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.114858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.115279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.312335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.323212 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d18b68c-0673-4ff3-bc4d-227f9c1225f4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.222740 Sep 27 01:40:14.324140 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1291/2465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.329864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.330480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:14.352243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.363581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36c55628-1a27-4e08-9cfc-701dba774749 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.279031 Sep 27 01:40:14.364179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1175/2466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.381853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66d483f7-b857-417a-8fc7-1990f7693c7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d62b4dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.442015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.454454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.456135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.457278 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7783f734-7445-41c5-b568-e7928930c45a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1103 microversion: 2.25 time: 0.131717 Sep 27 01:40:14.484727 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1292/2467] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1103 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:14.492702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c35959e0-8cd7-4e36-a514-35fb7680c473 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da736dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.582326 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c35959e0-8cd7-4e36-a514-35fb7680c473 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.096151 Sep 27 01:40:14.584331 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1293/2468] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.589698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:14.590389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:14.596934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.597547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.598151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.598930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.599449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.599946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.641169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:14.641759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:14.642354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:14.642865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lazy-loading 'fault' on Instance uuid baf2c8ab-7765-42ba-9f11-4583419c3559 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:14.648142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66d483f7-b857-417a-8fc7-1990f7693c7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.282892 Sep 27 01:40:14.648740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1176/2469] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.672160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ce5869d-9d03-4421-a262-38c8281a9619 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24d6245d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1419587823", "description": "tempest-description-1090337124"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:14.727317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:14.739705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4ab004f-3fee-47bf-8641-ddeab9a016ad tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 200 len: 1369 microversion: 2.1 time: 0.154144 Sep 27 01:40:14.740563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1294/2470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:14 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:14.963855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ce5869d-9d03-4421-a262-38c8281a9619 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.299049 Sep 27 01:40:14.964737 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1177/2471] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:14.977668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c446f921-dd1b-422c-8905-376d24e086c4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24da658d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-578651216", "description": "tempest-description-2029402637"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:15.109788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:15.110530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:15.127936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.128436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.128883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:15.129631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.130097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.130534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:15.231843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c446f921-dd1b-422c-8905-376d24e086c4 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.258088 Sep 27 01:40:15.233192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1295/2472] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:40:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:15.238246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:15.238858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:15.261293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.261831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.262275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:15.263007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.263469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.265130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:15.365112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:15.379774 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43b3ff67-e080-491e-a117-8dd325f4677e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.276498 Sep 27 01:40:15.380366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1178/2473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:15 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:15.396096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1587461522", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "18e42b6a-7765-41a6-b80b-00e1ec1192b4"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:15.470618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] validate_networks() for [('18e42b6a-7765-41a6-b80b-00e1ec1192b4', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:40:15.825232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:15.836450 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f357262-63b1-4cb3-a245-2b4999bb3dd4 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1509 microversion: 2.1 time: 0.601862 Sep 27 01:40:15.837660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1296/2474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:15 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1509 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:15.845747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:15.846865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:15.853761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.854649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.855289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:15.856277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:15.857052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:15.857711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.043658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.053037 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-970384b0-c023-4a6f-a7ac-b373488b6ef8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.213844 Sep 27 01:40:16.054700 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1297/2475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:15 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:16.060157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.061032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.075748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.076646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.077287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.078373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.079018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.079781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.148591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:40:16.149109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:40:16.149622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:40:16.150047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:40:16.150466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:40:16.165275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.169485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.170160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.171288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.171774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.172214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.215137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Getting quotas for project d1706ba087bc4e2baadb344bfbbf3772. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:40:16.230985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Getting quotas for user c1b39472acb645cdb988150af70b4883 and project d1706ba087bc4e2baadb344bfbbf3772. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:40:16.240840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.252331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f5c70413-8edf-4f2f-8956-af99f4992868 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1198 microversion: 2.1 time: 0.196337 Sep 27 01:40:16.253533 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1298/2476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1198 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:16.258757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.259682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.261963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:40:16.265900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:16.268098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:40:16.269161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.269965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.270618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.271666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.272474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.273111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.386207 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-204d391a-9719-4c3f-b81b-d00ee56cf896 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002234 Sep 27 01:40:16.390792 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1179/2477] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:40:16.402078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3204a4ec-61e3-4905-ab87-c89a9100ea9f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d62b4040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.404871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.408587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:16.414698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.416150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.417818 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31e05215-15e1-40f0-b229-cd24d32efa17 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1250 microversion: 2.25 time: 0.163144 Sep 27 01:40:16.430401 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1299/2478] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1250 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:16.435886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.440889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: baf2c8ab-7765-42ba-9f11-4583419c3559] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.452249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.452754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.453194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.453954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.454414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.454845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.467391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3204a4ec-61e3-4905-ab87-c89a9100ea9f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.075149 Sep 27 01:40:16.478194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] HTTP exception thrown: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. Sep 27 01:40:16.479695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1180/2479] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Request method failure captured: Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 HTTP/1.1 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlMoBv7tVsHvjtQ5PSk-DvAzK7RRianGbRrA-xbiCHBge15eQbjjnU9fMuOcrKMwdM-vN1c6raThbl1Ntnb89oCyzQkNfXD0VXcIbtDwkcZkd3IshMNl0KCOGBeiEF4wk-YIlqpby1atPg_lw9lF58Z_Hux7-SLOIK_KRNn6OylYDxk Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:40:16.480978 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_058c7591ee264e86b5a9435827eb0095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82e4afc58d9c46faba5253e7e5542873 Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. Sep 27 01:40:16.482399 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'baf2c8ab-7765-42ba-9f11-4583419c3559'} Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:16.483136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. Sep 27 01:40:16.484345 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:40:16.486939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Returning 404 to user: Instance baf2c8ab-7765-42ba-9f11-4583419c3559 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:16.488000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-832f7ae7-1351-4caa-9a77-31cf6ca443a7 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559" status: 404 len: 111 microversion: 2.1 time: 0.056504 Sep 27 01:40:16.488951 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1300/2480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/baf2c8ab-7765-42ba-9f11-4583419c3559 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:16.494794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.496811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.500790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-094a9434-3b5e-427a-ae58-637cebf928f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.503450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.504136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.504712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.505611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.506875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.506988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-094a9434-3b5e-427a-ae58-637cebf928f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.507558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.648876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-094a9434-3b5e-427a-ae58-637cebf928f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.658369 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-094a9434-3b5e-427a-ae58-637cebf928f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1216 microversion: 2.1 time: 0.167264 Sep 27 01:40:16.677291 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1181/2481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:16.682858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dec563cf-ad9b-4b52-b473-21c0a3406178 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '.version_select at 0x7f24d633f9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.704490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dec563cf-ad9b-4b52-b473-21c0a3406178 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017587959" status: 202 len: 0 microversion: 2.1 time: 0.025665 Sep 27 01:40:16.705465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1182/2482] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:40:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017587959 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:16.741533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:16.750429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-691e9f30-9af4-4974-8aee-876989e390ee tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.260212 Sep 27 01:40:16.766055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1301/2483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:16.864564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:16.866082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:16.878702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.882713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.883426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:16.884316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:16.884933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:16.886074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.083726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:17.086352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:17.117928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.118424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.118879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.119602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.120116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.120553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.381731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:17.391673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3253ae56-9b0b-4a1c-9ab9-af6f4fb3119e tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1509 microversion: 2.1 time: 0.531709 Sep 27 01:40:17.396022 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1183/2484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:16 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:17.414659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:17.416209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:17.427211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.428069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.428641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.433317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.433875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.434308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.451307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:17.482356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa20fb48-8294-4ece-b0e6-56b349a52001 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.401180 Sep 27 01:40:17.484569 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1302/2485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:17 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:17.519559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:17.520445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:17.544730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.548749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.549840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.553482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.554199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.555805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.744642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:17.754481 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f938bd55-7fcf-4ac0-910d-f652de0832e9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1382 microversion: 2.1 time: 0.355674 Sep 27 01:40:17.755061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1184/2486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:17 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1382 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:17.794067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fa5248b-9dbd-4802-9c18-b2d5e5a30f02 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d62f6280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:17.864782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fa5248b-9dbd-4802-9c18-b2d5e5a30f02 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.086030 Sep 27 01:40:17.866036 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1185/2487] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:17 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:17.874872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:17.877825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:17.891275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.894464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.895183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:17.896665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:17.898130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:17.902164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.015935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.030581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-291296e2-9b3f-4483-bd4e-5c3eb3571d6b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1268 microversion: 2.1 time: 0.163338 Sep 27 01:40:18.031595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1186/2488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:17 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:18.042834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.043447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.072186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.072728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.073398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.074271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.074881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.075450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.095675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.113017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.116890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.118824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80e7eb8f-23bc-4a9d-93cb-7f9a12ff963b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1250 microversion: 2.25 time: 0.629563 Sep 27 01:40:18.138760 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1303/2489] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:17 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1250 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:18.149732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.150602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.167262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.169968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.172597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.173738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.174448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.175562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.475062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8be9f560-82ba-4549-85f3-a06d05d75133 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1533 microversion: 2.1 time: 0.334107 Sep 27 01:40:18.476022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1304/2490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:18 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1533 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:18.487709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.493968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.504221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.505680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.506443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.507706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.508456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.509095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.606330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.616982 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-abd636c9-8cbe-43c0-a61d-4a5c717adb60 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1467 microversion: 2.1 time: 0.139574 Sep 27 01:40:18.618926 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1305/2491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:18 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1467 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:18.624246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.625158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.632856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.633602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.634304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.635998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.637095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.638014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.697075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:18.786247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:18.795738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3cffe75-a5fe-4e64-b5fc-f2bffa319c4b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.763247 Sep 27 01:40:18.803627 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1187/2492] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:18 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:18.827636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.828274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.832471 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6362609b-5ffb-49ef-97c4-4e35899dee26 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "DELETE /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 204 len: 0 microversion: 2.1 time: 0.211908 Sep 27 01:40:18.842461 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1306/2493] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:18 2022] DELETE /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:18.842785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.843308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.843765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.844499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.844956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.845411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.849091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810fd928-bea5-4675-984e-ff8c97349c46", "name": "network-vif-deleted", "tag": "60341d10-7901-42df-96a1-219b3ec5a840"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:18.861495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.861987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.862763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.885251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] Creating event network-vif-deleted:60341d10-7901-42df-96a1-219b3ec5a840 for instance 810fd928-bea5-4675-984e-ff8c97349c46 on n-h2-859358-1 Sep 27 01:40:18.897059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3721b49b-bafc-4b55-b646-3dc05a66506e req-9375cf88-1b91-4821-8eaf-b6ca02079951 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052280 Sep 27 01:40:18.900760 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1307/2494] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:18.910804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:18.911526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:18.931695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.932730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.933170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:18.935297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:18.944302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:18.944964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.144224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:19.164096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a52e4fbb-5f13-4c19-81f4-e14362f6ed0e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.255816 Sep 27 01:40:19.166171 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1308/2495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:18 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.172349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.172957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:19.198835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.199324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.199754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.200468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.200917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.201354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.542661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:19.554067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27f5b4cd-fed1-41f5-af5a-7412280b3315 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1468 microversion: 2.1 time: 0.386153 Sep 27 01:40:19.570826 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1309/2496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.578339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9da9b1b2-6cd2-4ade-8de1-c53dc6cf55f6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6c47d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.649888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9da9b1b2-6cd2-4ade-8de1-c53dc6cf55f6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.077605 Sep 27 01:40:19.651979 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1310/2497] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.657693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.658311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:19.674088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.674685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.675447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.676515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.677055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.677601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.680583 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-845e4b8c-8dc1-4066-a541-c3a9762a641d tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1533 microversion: 2.1 time: 0.875417 Sep 27 01:40:19.686191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1188/2498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:18 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1533 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.701810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.706622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:19.719023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.719524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.719965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.720704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.721165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.721703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.753602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:19.764390 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-485dc08d-71a3-4311-b580-b5bbd5d85625 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1274 microversion: 2.1 time: 0.110740 Sep 27 01:40:19.766610 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1311/2499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.771576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.772423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:19.780124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.780840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.782246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.783130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.783741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.784315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.824729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.825770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.826394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.827150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lazy-loading 'fault' on Instance uuid 810fd928-bea5-4675-984e-ff8c97349c46 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:19.873553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98647c3bc0964ff0a532e05f1bf62ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecb15af922544368b41955fbde43f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:19.881859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70db3161-3e63-4d9b-b9bd-a4c4f29f3dc6 tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 200 len: 1305 microversion: 2.1 time: 0.113817 Sep 27 01:40:19.893360 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1312/2500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:19.906861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:19.927986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.928489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.933403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.934313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:19.934793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:19.935234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:19.983109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-880c02af-4f34-4e31-8c7d-b3e7f494c4cc tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091059 Sep 27 01:40:20.003246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1313/2501] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:20.013918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:20.029909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:20.037559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.038053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.038509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.039270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.039726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.040149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.280188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:20.304521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:20.307360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:20.313824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:20.314933 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5838619-3107-4cb5-b805-d55e2bb8c79a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1292 microversion: 2.25 time: 0.621968 Sep 27 01:40:20.325053 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c803d7dc-8c95-42ba-9ff9-54e0a2b07d50 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.318964 Sep 27 01:40:20.325053 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1314/2502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:20 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:20.336033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-859358-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:20.336033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:20.338174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1189/2503] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:19 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1292 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:20.339506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.340545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.340545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.341437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.341993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.342544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.356163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:20.359334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:20.379995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.383748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.384612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.387072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:20.388199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:20.390347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:20.394440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lazy-loading 'flavor' on Instance uuid 48a30166-865c-427a-94ff-8b85ea13b756 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:20.428937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Going to try to live migrate instance to n-h1-859358-1 {{(pid=128778) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:40:20.525495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:21.258043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:21.269994 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ba67601-7b7c-462d-826f-8f945c9344e1 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.926296 Sep 27 01:40:21.270843 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1190/2504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:20 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:21.285589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:21.285589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:21.286466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:21.287026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:21.287470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:21.288673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:21.289361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:21.289991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:22.207784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:22.220471 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fd33dd7-0322-4143-98b3-d46a76503195 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1468 microversion: 2.1 time: 0.948004 Sep 27 01:40:22.243739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1191/2505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:21 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1468 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:22.251474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-942ee54f-6129-46b6-96f0-3a81bbac6893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d621c310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:22.316138 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-942ee54f-6129-46b6-96f0-3a81bbac6893 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1411 microversion: 2.1 time: 0.071035 Sep 27 01:40:22.317904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1192/2506] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:22 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1411 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:22.329823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:22.331057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:22.337780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:22.338303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:22.338770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:22.339797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:22.340263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:22.340858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.119255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:23.131779 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-997cff67-6eee-4dcd-9550-9fc8d8890b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.812011 Sep 27 01:40:23.132594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1193/2507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:22 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:23.148459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:23.149311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] [instance: 810fd928-bea5-4675-984e-ff8c97349c46] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:23.161011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.161890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.162533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.163436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.164071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.164696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.182730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] HTTP exception thrown: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Request method failure captured: Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 HTTP/1.1 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRavsxgkDi31RcP01jg1beEvntoBRLmIjm1k_FuHB3_jE7AEmKFf0Xy1icAQBRUrzmvNMPDWNFiULiO83ULTBtIxj2VfSSFmpElnvCkxU-eHTyb4D9vxbgEFsoEJ1HxbsHxgI__fgL7H2ZmZl6ismtAU1rdUNuXC1z_HiB5d3bbtgY Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1ecb15af922544368b41955fbde43f76 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerPasswordTestJSON-1370116829 Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:23.185095 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ecb15af922544368b41955fbde43f76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1ecb15af922544368b41955fbde43f76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1ecb15af922544368b41955fbde43f76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1ecb15af922544368b41955fbde43f76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerPasswordTestJSON-1370116829 Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1ecb15af922544368b41955fbde43f76 Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1370116829 Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerPasswordTestJSON-1370116829-project Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 98647c3bc0964ff0a532e05f1bf62ab6 Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerPasswordTestJSON-1370116829-project Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. Sep 27 01:40:23.186588 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '810fd928-bea5-4675-984e-ff8c97349c46'} Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:23.187380 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. Sep 27 01:40:23.188349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:23.190677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] Returning 404 to user: Instance 810fd928-bea5-4675-984e-ff8c97349c46 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:23.192535 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eaa0455b-eeaf-4da0-809a-cc6dc6777e9c tempest-ServerPasswordTestJSON-1370116829 tempest-ServerPasswordTestJSON-1370116829-project] 10.222.0.52 "GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46" status: 404 len: 111 microversion: 2.1 time: 0.057380 Sep 27 01:40:23.193816 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1194/2508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:23 2022] GET /compute/v2.1/servers/810fd928-bea5-4675-984e-ff8c97349c46 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:23.218091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:23.219957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:23.245147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.251964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.256212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.257783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.258366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.260059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.650796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:23.660359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:23.678918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:23.680239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a11a8fef-2bff-4244-af5d-1a59bae0c9c7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1292 microversion: 2.25 time: 0.485132 Sep 27 01:40:23.680972 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1195/2509] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:23 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1292 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:23.688469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:23.718517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:23.734179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.735199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.748482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:23.751574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:23.753006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:23.757370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.054058 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad91bfb6-79e6-4fa5-8e99-6a35f5e762d7 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756/action" status: 202 len: 0 microversion: 2.1 time: 3.728665 Sep 27 01:40:24.054987 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1315/2510] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:20 2022] POST /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756/action => generated 0 bytes in 3730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:24.061268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48db1246-5da2-415d-bc56-b16f43b5e1d8", "tag": "f5cb92c3-bc19-45a6-b0e4-2e1f4df54667"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:24.076058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.076600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.077049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.093406 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] Creating event network-changed:f5cb92c3-bc19-45a6-b0e4-2e1f4df54667 for instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 on n-h1-859358-1 Sep 27 01:40:24.107373 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4f0ce181-ed20-4b53-be48-182adad7dddf req-48d6750f-f98f-4d85-a674-9d6c8dbe8cd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050916 Sep 27 01:40:24.110948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1316/2511] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:24.127894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.128964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:24.141453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.142525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.143630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.144532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.145148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.145769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.161539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:24.176137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91e247ed-79b2-403c-b135-b889f462a47f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.491934 Sep 27 01:40:24.197271 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1196/2512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:23 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.204761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.206018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:24.215797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.216594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.217440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.219936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.220695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.222606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.244502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:24.297363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.297851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.302229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.305211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lazy-loading 'fault' on Instance uuid da48f3bc-f212-407c-a5d5-a5c3e4f348e6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:24.452427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:24.474158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:24.496079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a4d2246-54f8-4e49-8abd-0a485429717e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 200 len: 1302 microversion: 2.1 time: 0.296991 Sep 27 01:40:24.496672 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1197/2513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 1302 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.504385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0ac2c51-31bf-49d3-ba19-04f21caae7ff tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da6413a0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.565727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0ac2c51-31bf-49d3-ba19-04f21caae7ff tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1420 microversion: 2.1 time: 0.060611 Sep 27 01:40:24.566937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1198/2514] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.573600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.574482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:24.582687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.583599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.584458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.585242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.585910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.586496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.614547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:24.626509 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b41f0e3-7117-4446-8c3d-8311b09c2096 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.510895 Sep 27 01:40:24.627215 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1317/2515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.632858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.633677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:24.641673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.642407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.643018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.644473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.645130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.646548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.863114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:24.866989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:24.875497 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-925dbd83-697d-4d36-a216-2d3c87314535 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.307250 Sep 27 01:40:24.876974 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1199/2516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.881728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8bc634c-bd2f-4fb1-bb54-f5bdedf7f03f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d6262700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.898574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc46f8e9-8c83-4f9a-b8f0-49c13afc5850 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.268267 Sep 27 01:40:24.903679 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1318/2517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.909076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:24.909744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:24.916833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.917780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.918983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.920266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:24.921228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:24.921982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:24.946525 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8bc634c-bd2f-4fb1-bb54-f5bdedf7f03f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 200 len: 1420 microversion: 2.1 time: 0.068273 Sep 27 01:40:24.947391 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1200/2518] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:24.961767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88b54154-a2ad-4082-9273-391a372d5d27 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d62b4b80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.183655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:25.206200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:25.210687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:25.213926 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-385d4778-65e3-4d46-a36b-4def8a51cdc5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.308194 Sep 27 01:40:25.230891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1319/2519] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:24 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:25.247437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.248199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.256376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.257034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.257663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.260313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.261942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.262530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.516022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88b54154-a2ad-4082-9273-391a372d5d27 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 204 len: 0 microversion: 2.1 time: 0.558001 Sep 27 01:40:25.517024 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1201/2520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:24 2022] DELETE /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:25.525798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.527525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: da48f3bc-f212-407c-a5d5-a5c3e4f348e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.537382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.538135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.538794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.539999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.540693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.541454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.558981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] HTTP exception thrown: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Request method failure captured: Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 HTTP/1.1 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMoBv7tVsHvjtQ5PSk-DvAzK7RRianGbRrA-xbiCHBge15eQbjjnU9fMuOcrKMwdM-vN1c6raThbl1Ntnb89oCyzQkNfXD0VXcIbtDwkcZkd3IshMNl0KCOGBeiEF4wk-YIlqpby1atPg_lw9lF58Z_Hux7-SLOIK_KRNn6OylYDxk Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:25.561647 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_058c7591ee264e86b5a9435827eb0095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82e4afc58d9c46faba5253e7e5542873 Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. Sep 27 01:40:25.562764 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'da48f3bc-f212-407c-a5d5-a5c3e4f348e6'} Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:25.563385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. Sep 27 01:40:25.564388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:25.566900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Returning 404 to user: Instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:25.568009 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8d21228-a0cc-4745-8492-3d047b3d9a76 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6" status: 404 len: 111 microversion: 2.1 time: 0.046088 Sep 27 01:40:25.569926 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1202/2521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:25 2022] GET /compute/v2.1/servers/da48f3bc-f212-407c-a5d5-a5c3e4f348e6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:25.575699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.576621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:25.576954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.583820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.584687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.585403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.586470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.587130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.587774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.588735 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c8666127-684d-46e2-9ba2-12581642ae37 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.356345 Sep 27 01:40:25.589351 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1320/2522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:25 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:25.601077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.601833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.612997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.613859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.614538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.615557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.616195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.616860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.632289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:25.657017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:25.741824 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34dfc4e3-9252-4a70-9604-5e24178e8940 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 204 len: 0 microversion: 2.1 time: 0.165860 Sep 27 01:40:25.747191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1203/2523] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:25 2022] DELETE /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:25.754498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.756140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.766233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.766955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.767608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.768125 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cda15b8-dff5-4e8b-8eea-2d4c61c8de2b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 204 len: 0 microversion: 2.1 time: 0.176091 Sep 27 01:40:25.768461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.768989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.769287 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1321/2524] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:25 2022] DELETE /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:25.772479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.787583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:25.789531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:25.801770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.805384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.806118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:25.807046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:25.809870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:25.810341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.064316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.072918 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-42ef9ff1-f4d9-4775-9aea-95210dde96dc tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1468 microversion: 2.1 time: 0.298261 Sep 27 01:40:26.073772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1322/2525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:25 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:26.078831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:26.079794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:26.086375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.087063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.087958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.089033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.089792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.090385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.190056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:26.198917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.208135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d888a7b-671d-4849-913d-533db203a0a2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.462872 Sep 27 01:40:26.223778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1204/2526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:25 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:26.223778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:26.223778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:26.236421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.239347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.239922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.242159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.242851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.243668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.335235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.344850 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0777aa3-fa2c-4ff6-b32d-7fc33f4700f3 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.269564 Sep 27 01:40:26.345360 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1323/2527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:26 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:26.350209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1217881577", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8c88e62c-74c5-4ff9-a7df-3a1b273be5ea"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:26.437899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] validate_networks() for [('8c88e62c-74c5-4ff9-a7df-3a1b273be5ea', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:40:26.456731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.470187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbe7ad76-c872-4e5c-845e-4527d12c2d55 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.255340 Sep 27 01:40:26.486726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1205/2528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:26 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:26.492571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da48f3bc-f212-407c-a5d5-a5c3e4f348e6", "name": "network-vif-deleted", "tag": "ad59b064-b492-4320-b5ca-1c700cff84b4"}, {"name": "network-changed", "server_uuid": "0cce6ff3-eaf0-4f8f-b671-5b4430d19339", "tag": "198c20d2-ddd3-40aa-baf9-0c4294597ecb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:26.504506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.505033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.505644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.523614 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Creating event network-vif-deleted:ad59b064-b492-4320-b5ca-1c700cff84b4 for instance da48f3bc-f212-407c-a5d5-a5c3e4f348e6 on n-h1-859358-1 Sep 27 01:40:26.524394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] Creating event network-changed:198c20d2-ddd3-40aa-baf9-0c4294597ecb for instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 on n-h2-859358-1 Sep 27 01:40:26.535464 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-54506c4f-a8ea-428c-8447-2f3451c5959d req-eef8a616-fea0-4915-ae12-0700e19c8c30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047064 Sep 27 01:40:26.537106 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1206/2529] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:26.544737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:26.547137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:26.554819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.555222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.556421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.557467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.558425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.559150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.654369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:26.727872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.736810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.738344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.739579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2cf46bd8-23e6-4a7b-9b9f-76787f2ace10 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.201073 Sep 27 01:40:26.740380 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1207/2530] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:26 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:26.752577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:26.753996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:26.761945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.762401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.762838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.763580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:26.764160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:26.764597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:26.905317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:26.914870 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75535d4e-ef5f-44cf-a823-c78d781bfed1 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.167331 Sep 27 01:40:26.921391 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1208/2531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:26 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:27.097572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.098362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.104794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.105292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.105764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.106679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.106929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.107358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.376698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:27.381562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:40:27.382020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:40:27.382468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:40:27.382881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:40:27.383298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:40:27.396536 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9b8b68c-a2ff-4622-a203-896b9dc22c0e tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1468 microversion: 2.1 time: 0.303347 Sep 27 01:40:27.409363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1209/2532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:27.409538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.409538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.409538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.409538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.409833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.409833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.415097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.415908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.422771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.423546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.424550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.425412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.426153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.427548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.436086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:40:27.445878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for user 72f64b5a7b76437c9f31cf277c601aa3 and project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:40:27.465990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:40:27.469242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:40:27.532874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b92df00-7766-47b7-b504-d3109d3c2421 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186231 Sep 27 01:40:27.533905 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1324/2533] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:40:27.538386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.539082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.545467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.546065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.546404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.547117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.547572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.547997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.758009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:27.769646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f94a45e-0aa1-4ac5-8ea6-b74f75e7ec78 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.234798 Sep 27 01:40:27.770460 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1325/2534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:27.776077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.784386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.786343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:27.796428 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fee5035-8801-41eb-8270-f195f3c4de04 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.397351 Sep 27 01:40:27.796589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.797060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.797530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.798226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.799022 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1210/2535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:27.808673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.809439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.818078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e124f8c-da1a-489e-9be5-b5b692706bee tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.818741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e124f8c-da1a-489e-9be5-b5b692706bee tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.943829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e124f8c-da1a-489e-9be5-b5b692706bee tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:27.957913 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e124f8c-da1a-489e-9be5-b5b692706bee tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1208 microversion: 2.1 time: 0.157341 Sep 27 01:40:27.958334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1211/2536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:27.972788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:27.973521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:27.990839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.991338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.991784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:27.992502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:27.992962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:27.994046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.011919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.020246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aec978a4-2331-45f5-9c5e-ba0a10ae7c4f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.247867 Sep 27 01:40:28.021744 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1326/2537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:28.034927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:28.037790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:28.048368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.048863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.049291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.050032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.050474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.051026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.275791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.285218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.286637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.295189 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06375755-35b4-4137-84d8-a3ab7d3d2fdf tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.328521 Sep 27 01:40:28.296112 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1212/2538] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:27 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:28.303371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.317571 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8f24961-8ff5-40bf-92a1-c92ebf9d3b29 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.294566 Sep 27 01:40:28.332093 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1327/2539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:28 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:28.426768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:28.427685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:28.434750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.435258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.435763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.437170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.437689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.438118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.483338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab2782-bd65-42dc-adf5-20c04bac9113", "name": "network-vif-unplugged", "status": "completed", "tag": "0119ebdb-334a-4237-ac56-e48b77e13bd5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:28.504958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.505785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.509294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.536009 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] Creating event network-vif-unplugged:0119ebdb-334a-4237-ac56-e48b77e13bd5 for instance 75ab2782-bd65-42dc-adf5-20c04bac9113 on n-h2-859358-1 Sep 27 01:40:28.544068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-565735a1-b89b-4803-b763-2b03300e4e9a req-6348f417-b15b-41cd-8c60-1a748c5bdc76 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066398 Sep 27 01:40:28.545263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1328/2540] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:28.796323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:28.797454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:28.804748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.805463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.806416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.807516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.808170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.808716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.853368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:28.870322 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0acc2c50-5dfb-4e43-987b-6d4ede141f7b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1468 microversion: 2.1 time: 0.450535 Sep 27 01:40:28.870948 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1213/2541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:28 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:28.885957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:28.886973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:28.892347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:28.896566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.899934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.901770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:28.905431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:28.907532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:28.907981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.074861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.081065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-029b0d0f-e21b-48af-90be-1808acc60048 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.291051 Sep 27 01:40:29.090123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1329/2542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:28 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:29.102616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:29.103371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:29.110719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.111499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.112127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.113115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.113915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.114590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.274953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.276524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.286077 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-653dd16b-edc4-41b2-93ec-92641e56998b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.413718 Sep 27 01:40:29.302055 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1214/2543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:28 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:29.302055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:29.302055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:29.310428 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c52674ea-1091-419f-b8db-1c748ef1cbdb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1260 microversion: 2.1 time: 0.217598 Sep 27 01:40:29.325945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.325945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.325945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.325945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.326363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.326500 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1330/2544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:29 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:29.331043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.333864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:29.338440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:29.352506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.353714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.354721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.356140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.356608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.357041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.784235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.795681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.807921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.809461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f98e585d-666a-4081-aa83-9c71f4c269b7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.488736 Sep 27 01:40:29.810242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1331/2545] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:29 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:29.814934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:29.826308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:29.832891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.833761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.834413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.835393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.836210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.837604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.883198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:29.918713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:29.931804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e66543a8-85df-42ab-b63b-9eba0679307d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.638615 Sep 27 01:40:29.934536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1215/2546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:29 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:29.944458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:29.946396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:29.960146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.960908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.963252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:29.964220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:29.965530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:29.967264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.073883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:30.082883 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84fb1ff7-1122-4d3e-a509-27a5a3782ca9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.271403 Sep 27 01:40:30.086242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1332/2547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:29 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:30.106625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:30.107595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:30.116276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.117117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.118012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.118943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.122949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.125918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.228448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:30.238892 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6a2e271-abc6-46e8-9b33-87ade607cdb1 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1426 microversion: 2.1 time: 0.302465 Sep 27 01:40:30.240514 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1216/2548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:29 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1426 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:30.317822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:30.321811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:30.329952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.330996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.331664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.332576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.333248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.335271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.368856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:30.516834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:30.531374 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c663868-5d04-47ef-9c2f-b98c41382f8b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.428849 Sep 27 01:40:30.536576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1333/2549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:30 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:30.543841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:30.544470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:30.547670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:30.551438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.551925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.552581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.553320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.553940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.554367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.663104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:30.675449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c05f7e5-d0ec-4d8d-aeca-a1916cc34cd6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1266 microversion: 2.1 time: 0.137739 Sep 27 01:40:30.687897 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1334/2550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:30 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:30.700851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ab2782-bd65-42dc-adf5-20c04bac9113", "name": "network-vif-deleted", "tag": "0119ebdb-334a-4237-ac56-e48b77e13bd5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:30.714013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.714717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.715254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.751952 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] Creating event network-vif-deleted:0119ebdb-334a-4237-ac56-e48b77e13bd5 for instance 75ab2782-bd65-42dc-adf5-20c04bac9113 on n-h2-859358-1 Sep 27 01:40:30.764242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:30.766393 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-dfe3dc25-07ab-4b0d-9fad-8b7042364026 req-82786e3a-60c5-4920-a18d-ede25f1a6b2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075362 Sep 27 01:40:30.767734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1335/2551] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:30.777567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbf00ab3-f548-41d1-a49b-c7d5477ebf65 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.464769 Sep 27 01:40:30.778503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1217/2552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:30 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:30.791520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab455d9-d484-4e83-9e97-e17788aaffa7", "name": "network-vif-deleted", "tag": "452ff2c7-c5c0-4573-b022-ab335f7e6864"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:30.809487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.810432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.812991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.825475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] Creating event network-vif-deleted:452ff2c7-c5c0-4573-b022-ab335f7e6864 for instance cab455d9-d484-4e83-9e97-e17788aaffa7 on n-h2-859358-1 Sep 27 01:40:30.831416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2abd6aef-bd2a-4521-a859-224674a3225b req-594731e5-1ac4-4649-a3df-f36f462e83be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059201 Sep 27 01:40:30.832340 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1336/2553] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:30.902766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:30.903424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:30.911262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.911934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.912564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.913757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.914421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.915185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.967974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:30.968693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:30.981001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.981880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.982411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:30.983439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:30.984082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:30.984568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.134392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.155409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.175880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.179875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c7cfa0a-cffe-418b-8dbd-98113e4e4028 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.279299 Sep 27 01:40:31.185624 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1218/2554] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:30 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:31.186028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.193125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:31.196888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15d785dc-09ce-41f8-a2a2-58b1ce4d2901 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.233682 Sep 27 01:40:31.198102 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1337/2555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:30 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:31.208998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:31.221372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.222169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.223059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.224179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.224909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.225700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.267199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:31.267819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:31.280725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.281234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.282448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.284931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.285472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.285996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.386767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.402873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a802b30-96fb-48d3-afef-285ce836b66a tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1426 microversion: 2.1 time: 0.139921 Sep 27 01:40:31.415352 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1338/2556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:31 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1426 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:31.533908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.542876 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d6e511f-1e4d-4a11-adc9-e46d79a82154 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.355738 Sep 27 01:40:31.543859 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1219/2557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:31 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:31.569936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:31.570591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:31.579938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.580830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.581743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.582878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.584398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.585284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.703978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:31.704601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:31.711273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.712007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.712590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.714430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.715093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.715813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.913444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:31.942005 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afc059ba-8ec2-4be3-b26a-f80a94c2ee3f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.374440 Sep 27 01:40:31.942656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1339/2558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:31 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:31.954867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:31.962298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:31.972804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.973603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.974181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:31.978485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:31.979252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:31.979876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.261741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.270853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4c9e738-5cde-41f3-90aa-c194e8df552e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.571172 Sep 27 01:40:32.282178 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1220/2559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:31 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:32.293797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:32.294799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:32.301809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.302927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.303576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.304495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.305168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.305827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.320013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.332642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2a4b6df-ecec-4eb7-9a2d-d87b8f7e93d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.387100 Sep 27 01:40:32.333247 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1340/2560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:31 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:32.350074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:32.351058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:32.358132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.358940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.359948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.361046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.361739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.362366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.589746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.605859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.607686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.611420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee5dd32a-7c29-4c84-af0b-c245acb34374 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.325300 Sep 27 01:40:32.612024 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1221/2561] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:32 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:32.625834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:32.628422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:32.649301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.650295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.650931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.653752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.654405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.655015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.810919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.822167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5551ee64-3f3b-4998-80ae-eae19510b01d tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1297 microversion: 2.1 time: 0.208239 Sep 27 01:40:32.838800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1222/2562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:32 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:32.851029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:32.853783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:32.863555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.864276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.865083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.866268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.867037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.867638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:32.929047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:32.943535 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6970bff1-3684-4ca7-a93c-2cb6d7215c51 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.606002 Sep 27 01:40:32.944477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1341/2563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:32 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:32.962763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1ee5ed-b16f-4dba-9cc2-91aae039af02", "tag": "58867592-4149-441f-9ff8-171a791b7d8a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:32.988014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:32.988765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:32.989364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.014449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] Creating event network-changed:58867592-4149-441f-9ff8-171a791b7d8a for instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 on n-h1-859358-1 Sep 27 01:40:33.025655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8866c964-c077-4d14-85e6-11f805b348ea req-088152df-e37b-4250-a31b-4d543a804c78 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077208 Sep 27 01:40:33.027615 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1342/2564] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:33.044501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.045982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:33.065290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.065811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.066579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.067710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.067710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.068404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.198968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.209833 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c27aa19a-9bd1-4b4f-85f7-0b809c827849 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.369810 Sep 27 01:40:33.210572 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1223/2565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:32 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:33.297739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.299362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:33.306663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.307728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.308383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.309316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.310000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.323705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.378667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.387874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fca7d6aa-c813-4bdd-ae48-b831948c1d60 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.355151 Sep 27 01:40:33.392612 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1343/2566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:33.416577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.417569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:33.430408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.431254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.431897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.432894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.433556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.434320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.757624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.782641 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1554972-3177-4ccf-8b20-2fdaed1dc177 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.489271 Sep 27 01:40:33.783697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1224/2567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:33.791212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.792124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:33.803426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.804051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.804583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.805424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.806005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.806538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.961967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.967639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.971357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.972884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:33.974081 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30514be8-1cd8-43dc-9de0-92a6196c04c4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.189226 Sep 27 01:40:33.974643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1225/2568] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:33.979467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.980038 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0699566-00bb-4182-b8ad-271d6467463b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.585845 Sep 27 01:40:33.980143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:33.980785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1344/2569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:33.986310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.986968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.987641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.988527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:33.989135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:33.989790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:33.990260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:33.990991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:34.000968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.001870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.002605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.003529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.004832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.005532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.028187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.028876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.030224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.030684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lazy-loading 'fault' on Instance uuid cab455d9-d484-4e83-9e97-e17788aaffa7 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:34.074957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e4afc58d9c46faba5253e7e5542873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058c7591ee264e86b5a9435827eb0095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:34.085890 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e45da775-87ca-4ecb-a020-c2798ba3360b tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 200 len: 1302 microversion: 2.1 time: 0.109171 Sep 27 01:40:34.088805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1226/2570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:34.237708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:34.239112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:34.249059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.249973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.250757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.252315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.253144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.253995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.303973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:34.316383 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85858cc4-bf1a-4a39-b3a7-30a308b4d1f6 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.333672 Sep 27 01:40:34.335019 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1345/2571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:33 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:34.420516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:34.421393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:34.432682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.433454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.438674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.441284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.441879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.442397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.444574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:34.454585 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05158379-3ad9-4525-9d62-f18693571405 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.223095 Sep 27 01:40:34.469378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1227/2572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:34 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:34.806515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:34.807073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:34.814251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.814742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.815182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.815889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:34.816343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:34.816769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:34.972907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:34.991227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-300c0c80-8973-417a-b9f9-8e13dc9aad5d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.188704 Sep 27 01:40:35.001614 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1228/2573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:34 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:35.009226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:35.009982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:35.017219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.017871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.018525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.019345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.019899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.020423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.039187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.048904 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c736ee4-cfeb-48be-9604-34dcec126256 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.632929 Sep 27 01:40:35.058560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1346/2574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:34 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:35.063507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:35.064294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:35.070626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.071301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.071879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.073446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.074057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.074494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.252679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.262372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.263805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.265057 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-996da8cc-e000-415e-a93c-1397ec95ffb5 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.262254 Sep 27 01:40:35.265662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1229/2575] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:35 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:35.272771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:35.273739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] [instance: cab455d9-d484-4e83-9e97-e17788aaffa7] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:35.280896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.281625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.282490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.283409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.283866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.284292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.298746 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] HTTP exception thrown: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Request method failure captured: Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 HTTP/1.1 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMoBv7tVsHvjtQ5PSk-DvAzK7RRianGbRrA-xbiCHBge15eQbjjnU9fMuOcrKMwdM-vN1c6raThbl1Ntnb89oCyzQkNfXD0VXcIbtDwkcZkd3IshMNl0KCOGBeiEF4wk-YIlqpby1atPg_lw9lF58Z_Hux7-SLOIK_KRNn6OylYDxk Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:35.300846 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/058c7591ee264e86b5a9435827eb0095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_058c7591ee264e86b5a9435827eb0095", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 058c7591ee264e86b5a9435827eb0095 Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MigrationsAdminTest-1524353099 Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82e4afc58d9c46faba5253e7e5542873 Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MigrationsAdminTest-1524353099-project Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. Sep 27 01:40:35.302022 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'cab455d9-d484-4e83-9e97-e17788aaffa7'} Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:35.302945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. Sep 27 01:40:35.304019 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:35.305103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] Returning 404 to user: Instance cab455d9-d484-4e83-9e97-e17788aaffa7 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:35.305103 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d040ecd-7c5b-4768-8925-9ccc9929ef51 tempest-MigrationsAdminTest-1524353099 tempest-MigrationsAdminTest-1524353099-project] 10.222.0.52 "GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7" status: 404 len: 111 microversion: 2.1 time: 0.035547 Sep 27 01:40:35.305103 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1230/2576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:35 2022] GET /compute/v2.1/servers/cab455d9-d484-4e83-9e97-e17788aaffa7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:40:35.311249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.322251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05109593-647a-4e73-835b-41dd88658bd8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.262036 Sep 27 01:40:35.323826 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1347/2577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:35 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:35.342876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:35.343535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:35.350238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.350723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.351158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.351863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.352473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.352902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.485912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:35.486530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:35.498972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.505225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.505910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.506817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.509269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.509736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.665857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.674465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2503e745-330a-4322-8072-6620e4afa768 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.335556 Sep 27 01:40:35.690448 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1231/2578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:35 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:35.753627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48db1246-5da2-415d-bc56-b16f43b5e1d8", "name": "network-vif-plugged", "status": "completed", "tag": "f5cb92c3-bc19-45a6-b0e4-2e1f4df54667"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:35.772404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:35.773064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:35.773974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:35.787291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] Creating event network-vif-plugged:f5cb92c3-bc19-45a6-b0e4-2e1f4df54667 for instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 on n-h1-859358-1 Sep 27 01:40:35.793543 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7f3ab46a-9444-4271-ad57-11895a09fe66 req-6dbc3d46-be42-43d5-8b85-57dc205fd870 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043282 Sep 27 01:40:35.794574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1232/2579] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:35.835934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:35.849033 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-368284fc-e964-490b-b367-73a6ba215d1c tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.371748 Sep 27 01:40:35.850282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1348/2580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:35 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:36.020685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.021479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.028702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.029325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.029797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.030602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.031266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.031948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.072236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.082220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.092073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.093968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.099449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.100603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.101319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.102021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.294252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.320039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a67aa781-add3-4104-b654-0bc7eac7fcaa tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.302539 Sep 27 01:40:36.323989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1233/2581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:36.346701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.347571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.359845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.361141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.362017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.363953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.364911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.365790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.431177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.441092 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85d6b6fb-6d2a-4727-bef4-4a32a1f67d8d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.372814 Sep 27 01:40:36.442178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1349/2582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:36.450694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.452632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.466017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.466496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.469775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.470119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.470594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.471125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.606466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.622817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.625905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.626942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46738cb8-f582-4551-80b0-8c76a4d0bb27 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.300954 Sep 27 01:40:36.636068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1234/2583] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:36.701678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.702326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.709452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.710327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.710841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.711622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.712178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.713051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.719462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:36.753573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.763181 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cce758ed-3e63-47a1-a43c-0b1821d76fe9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.319633 Sep 27 01:40:36.764434 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1350/2584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:36.872514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:36.873991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:36.880756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.881435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.882069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.883061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:36.883667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:36.884841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:36.893276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:36.970368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:36.984111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87678118-2673-4fcc-8f32-1e257aa105d7 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.287756 Sep 27 01:40:36.994293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1235/2585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:37.131237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.141978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f29e83a1-67ea-430f-b99f-fa4d904399dd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1517 microversion: 2.1 time: 0.273732 Sep 27 01:40:37.143709 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1351/2586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:36 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:37.347751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:37.349332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:37.357268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.358385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.359672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.360380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.361852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.362857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.472404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:37.473075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:37.476386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:37.477110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:37.485914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.486653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.487247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.488116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.488735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.489309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.597064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.614047 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18a68a87-3568-4f5e-bc49-bdd05a28dc90 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.265631 Sep 27 01:40:37.614722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1236/2587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:37 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:37.654428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:37.655587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:37.668403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.669867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.670945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.671644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.672106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.672676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.866130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.876816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.878626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.880487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c2d1e79-6c37-4a4e-8dd6-b747d586791d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.231238 Sep 27 01:40:37.881722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1237/2588] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:37 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:37.888892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:37.889857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:37.898041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.898909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.899584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.900528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:37.901780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:37.902483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:37.956547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:37.988427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:37.998728 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77c7d4a2-bc65-4992-ba6c-9f1d1bdaa576 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.530151 Sep 27 01:40:38.000171 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1352/2589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:37 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:38.005489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce6ff3-eaf0-4f8f-b671-5b4430d19339", "name": "network-vif-plugged", "status": "completed", "tag": "198c20d2-ddd3-40aa-baf9-0c4294597ecb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:38.041279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.041835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.042277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.057532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] Creating event network-vif-plugged:198c20d2-ddd3-40aa-baf9-0c4294597ecb for instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 on n-h2-859358-1 Sep 27 01:40:38.066263 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4bd56d7c-83ed-40c0-853c-b0884b8b39f5 req-10a9e728-32e2-46b0-8ae4-bf883f9e10e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064414 Sep 27 01:40:38.067224 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1353/2590] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:38.076809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:38.077569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:38.103643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.104851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.105438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:38.106283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.107872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.109028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.116360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.120520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0858b091-fa40-49c9-bb0d-ab3dce9ed11e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.236951 Sep 27 01:40:38.141536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1238/2591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:37 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:38.168531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:38.169130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:38.182813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.183345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.183767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.184530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.184985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.187022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.423396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:38.433470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3ad3f6c-0ea1-428f-bd82-e0528856d814 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.269045 Sep 27 01:40:38.434862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1239/2592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:38 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:38.578352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:38.589325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-679d7947-c97a-4dae-aa3d-4d7c1583c3ee tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.519978 Sep 27 01:40:38.590997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1354/2593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:38 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:38.637180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:38.637823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:38.646105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.647454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.648451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.650755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.651522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.652203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.885067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:38.896965 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fed23e10-804a-4d11-90df-1ed7534d603c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.263776 Sep 27 01:40:38.897843 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1240/2594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:38 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:38.905791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:38.906461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:38.913564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.914065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.914676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:38.915717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:38.916996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:38.917539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.028717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:39.029740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:39.037974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.038650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.039512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.040412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.041184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.042287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.093748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.102939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.105064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.106540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80518352-34b0-404c-ba00-2a851ce78fa9 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1280 microversion: 2.25 time: 0.204499 Sep 27 01:40:39.107149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1355/2595] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:38 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:39.198629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.219489 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ff4c5c8-3feb-44ed-847e-51feb5b84bbb tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.196275 Sep 27 01:40:39.220883 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1241/2596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:39 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:40:39.226383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:39.227205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:39.235270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.236048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.236633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.237586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.238317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.238871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.397833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-752213764", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:39.503403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] validate_networks() for [('a0fdbb8e-f51d-4904-9715-a1b8b06f7dab', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:40:39.521878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.532766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63a116d7-bc23-435c-9d89-31ba7c35c4d2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.310596 Sep 27 01:40:39.533387 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1242/2597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:39 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:39.542879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:39.543823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:39.554593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.555353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.556101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.557073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:39.557698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:39.558125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:39.725390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:39.733915 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92f14b84-a5f7-45bc-9337-5cd825afa043 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.197595 Sep 27 01:40:39.734500 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1243/2598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:39 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:39.928681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32248088-d455-4771-a6e8-793a30e2a5cd tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24da64be50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:39.976587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:40:39.977798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:40:39.978434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:40:39.979045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:40:39.979599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:40:40.000022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.000612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.003873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.004918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.008319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.009050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.015012 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32248088-d455-4771-a6e8-793a30e2a5cd tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1" status: 200 len: 371 microversion: 2.1 time: 0.278797 Sep 27 01:40:40.016128 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1244/2599] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:40:39 2022] GET /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1 => generated 371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:40.021199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:40.022064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:40.029765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.041962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Getting quotas for project 7505cfe6fc404799b610b135ab125c78. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:40:40.048352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Getting quotas for user ed3cd5251bca4e2dad6da15d11423667 and project 7505cfe6fc404799b610b135ab125c78. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:40:40.062771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:40:40.064472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.064977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.066636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:40:40.068517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.069122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.069627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.143963 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63e9db5e-3c67-47ef-8d45-39d28492cbe3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.035223 Sep 27 01:40:40.145465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1356/2600] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:40:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:40:40.151584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:40.152748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:40.160823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.161251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.161735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.162568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.163260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.164046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.314365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.325858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b444ec3f-c9da-4092-af2d-f597a740b259 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1316 microversion: 2.1 time: 0.308441 Sep 27 01:40:40.327215 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1245/2601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:40.356446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Action: 'update', calling method: .version_select at 0x7f24da6d15e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:40.490791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.494562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.495451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.496220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.497610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.499248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.501619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.520148 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f693826c-61ad-4fb7-a012-0806f1802cc9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.373324 Sep 27 01:40:40.520799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1357/2602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:40.553389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1ee5ed-b16f-4dba-9cc2-91aae039af02", "name": "network-vif-plugged", "status": "completed", "tag": "58867592-4149-441f-9ff8-171a791b7d8a"}, {"server_uuid": "8db91074-a09e-4553-b4e0-0248f7559a3b", "name": "network-vif-unplugged", "status": "completed", "tag": "ece7687e-b7b8-4413-b1e7-db4ec7e847ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:40.564822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78401172-f161-42b2-81ab-b230cdce4237 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1" status: 200 len: 328 microversion: 2.1 time: 0.214069 Sep 27 01:40:40.565669 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1246/2603] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:40:40 2022] PUT /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1 => generated 328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:40.577253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:40.577995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:40.585030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.585779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.586290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.587209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.587737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.588747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.591150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.591630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.592061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.624997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Creating event network-vif-plugged:58867592-4149-441f-9ff8-171a791b7d8a for instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 on n-h1-859358-1 Sep 27 01:40:40.625535 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] Creating event network-vif-unplugged:ece7687e-b7b8-4413-b1e7-db4ec7e847ef for instance 8db91074-a09e-4553-b4e0-0248f7559a3b on n-h1-859358-1 Sep 27 01:40:40.637932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-400ccbdd-48cd-42b0-b4ca-ac7a186524e7 req-ef02de3f-a890-4aee-996b-917bd2e9cba2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.110698 Sep 27 01:40:40.638993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1358/2604] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:40.644944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a25ad6d5-6f0f-4b0a-80db-29460a757386 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:40.646509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a25ad6d5-6f0f-4b0a-80db-29460a757386 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:40.733055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a25ad6d5-6f0f-4b0a-80db-29460a757386 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.765725 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a25ad6d5-6f0f-4b0a-80db-29460a757386 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1222 microversion: 2.1 time: 0.122512 Sep 27 01:40:40.769440 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1359/2605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:40.779769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:40.784026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:40.797440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.799564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.801246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.804228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:40.804832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:40.806308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:40.960995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.977177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.982001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:40.983327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4441b303-dd13-44de-ab17-09bbda0609c1 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1476 microversion: 2.25 time: 0.412608 Sep 27 01:40:40.986594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1247/2606] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:41.001789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.004989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:41.021304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.024100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.026969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.028996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.030367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.032479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.042171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:41.051098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a6904e7-f74c-44c9-977d-080f93e65bef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.280268 Sep 27 01:40:41.052239 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1360/2607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:41.057147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc9648e7-ac56-4d77-a163-9f8ebe3cd3f6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.074524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc9648e7-ac56-4d77-a163-9f8ebe3cd3f6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1" status: 202 len: 0 microversion: 2.1 time: 0.021131 Sep 27 01:40:41.075497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1361/2608] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:40:41 2022] DELETE /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:41.081217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.082401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:41.090200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.091054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.091800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.092930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.093714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.094358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.319620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:41.330336 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23872036-d768-42de-9bf3-5c7c478e393a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.253485 Sep 27 01:40:41.346294 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1362/2609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:41.374238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:41.384331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96fa07b4-7500-4c0a-b778-cb7742f0e273 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.395937 Sep 27 01:40:41.384866 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1248/2610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:40 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:41.406041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b55f9f4-fa6f-4500-8c58-57e9f84b4844 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24da593dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.534995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b55f9f4-fa6f-4500-8c58-57e9f84b4844 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1" status: 200 len: 371 microversion: 2.1 time: 0.146972 Sep 27 01:40:41.536110 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1249/2611] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/os-quota-sets/38a16d4ab6284c2db29c21f2c83276e1 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:41.556172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.558857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:41.561089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.561841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:41.570200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.571652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.572409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.573931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.574277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.578388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.579125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.579246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.579671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.580114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.580930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.582001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.790163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 48db1246-5da2-415d-bc56-b16f43b5e1d8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:41.810626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f840fd4a-06b2-475c-b25a-f36e0316e814 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1968 microversion: 2.25 time: 0.462714 Sep 27 01:40:41.811523 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1363/2612] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1968 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:41.818659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a30166-865c-427a-94ff-8b85ea13b756", "name": "network-vif-unplugged", "status": "completed", "tag": "3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:41.831471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.832205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.832803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.849985 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] Creating event network-vif-unplugged:3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e for instance 48a30166-865c-427a-94ff-8b85ea13b756 on n-h2-859358-1 Sep 27 01:40:41.859658 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ea20362e-3950-49f0-a506-d3becdc1cf8e req-6a1a7c57-a0f1-4795-8231-cb4fd8ee8524 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046726 Sep 27 01:40:41.861660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1364/2613] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:41.870510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:41.871480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:41.878272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.878764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.879541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.880026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:41.880655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:41.880899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:41.957635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:41.966555 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa3f87c0-a9aa-467a-98b8-9b2265b7bddf tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1504 microversion: 2.1 time: 0.429062 Sep 27 01:40:41.968987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1250/2614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:41.980248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d6b59ae5-566a-44b5-8c5e-b3994beca0e5 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24d5fad9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:42.090895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:42.113556 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-695d49c9-07f7-420e-b457-c85e7f7ec8b5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1308 microversion: 2.1 time: 0.245022 Sep 27 01:40:42.115647 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1365/2615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:42.125034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:42.127973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:42.134891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.135847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.136461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.137768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.138707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.139548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.231293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:42.247822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83201dfc-8dfe-46f2-8a6e-84a2e1b891b4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1274 microversion: 2.1 time: 0.129598 Sep 27 01:40:42.248698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1366/2616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:42 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:42.254536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:42.255473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:42.268969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.269878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.271198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.272344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.272959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.273634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.428430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d6b59ae5-566a-44b5-8c5e-b3994beca0e5 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.456740 Sep 27 01:40:42.429353 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1251/2617] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:41 2022] GET /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9/defaults => generated 371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:42.435152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1419587823"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:42.437705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:42.448580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.449563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.450233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.451704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.452376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.452999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.486473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 48db1246-5da2-415d-bc56-b16f43b5e1d8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:42.508398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-767ec016-3490-4245-8206-c510e14b53fa tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1968 microversion: 2.25 time: 0.258433 Sep 27 01:40:42.509572 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1367/2618] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:42 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1968 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:42.518910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:42.519823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:42.526910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.527536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.528096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.528913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.529514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.530209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.690646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Adding security group 92ec2306-411b-425a-be6f-98f07cd1f869 to port 198c20d2-ddd3-40aa-baf9-0c4294597ecb Sep 27 01:40:42.884399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:42.896144 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa7a685c-ba8f-4e7b-905c-59bf28a28b47 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.384465 Sep 27 01:40:42.896799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1368/2619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:42 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:42.914333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:42.915134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:42.922536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.924058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.924564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:42.925378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:42.925827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:42.926295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.084715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26336a6d-fa7f-401e-a3d3-d3b82312dc8a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action" status: 202 len: 0 microversion: 2.1 time: 0.653880 Sep 27 01:40:43.085507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1252/2620] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:42 2022] POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:43.090799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:43.091660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:43.098573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.099538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.100162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.101192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.101974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.102907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.106112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:43.120351 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74225152-5b91-4162-9f54-cf1646304a79 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.220269 Sep 27 01:40:43.121412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1369/2621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:42 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:43.128016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:43.133021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.133728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.134816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.136284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.137107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.137728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.176396 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afabbef2-e2f5-4577-bd8c-0b254fe44e5a tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.053672 Sep 27 01:40:43.180032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1370/2622] 10.222.0.52 () {60 vars in 1217 bytes} [Tue Sep 27 01:40:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:40:43.185798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Action: 'update', calling method: .version_select at 0x7f24d669be50>, body: {"quota_set": {"ram": "5120"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:43.339620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:43.350467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1df22507-5d4f-4924-980a-b126ff751320 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1506 microversion: 2.1 time: 0.262501 Sep 27 01:40:43.351175 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1253/2623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:43 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:43.356672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d6211ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:43.429490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.430111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.430699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.433038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.433804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.434545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.483006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:43.483531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use.", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:40:43.484508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.484508 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869 HTTP/1.1 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:40:43.486973 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: exception: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.488209 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '92ec2306-411b-425a-be6f-98f07cd1f869'} Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:43.488911 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.490012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:40:43.491088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:40:43.492156 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:40:43.492156 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:40:43.492156 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.492156 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] Sep 27 01:40:43.492156 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:40:43.494477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 400 to user: Security Group 92ec2306-411b-425a-be6f-98f07cd1f869 in use. Sep 27 01:40:43.494477 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-f339360d-af77-4df0-ada5-d891c7b95e14'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:40:43.496157 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ff23bfd-2eca-4f50-a70f-b38e7a698f7d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869" status: 400 len: 185 microversion: 2.1 time: 0.144032 Sep 27 01:40:43.496934 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1254/2624] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:40:43 2022] DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869 => generated 185 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:40:43.504708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:43.505709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:43.513544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.514578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.515198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.516423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.517072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.517748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.523697 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d75e0999-6fee-454c-b73b-86f4b5a4417b tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55" status: 200 len: 328 microversion: 2.1 time: 0.341073 Sep 27 01:40:43.523697 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1371/2625] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:40:43 2022] PUT /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55 => generated 328 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:43.529298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-859358-1", "block_migration": "auto"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:43.532437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:43.540692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.541995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.542541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.544591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.545155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.545724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.578996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'flavor' on Instance uuid 48db1246-5da2-415d-bc56-b16f43b5e1d8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:43.598035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Going to try to live migrate instance to n-h2-859358-1 {{(pid=128778) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 01:40:43.604652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:43.683334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:43.697399 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8de23e49-8836-428b-9ca3-70949d421bde tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1488 microversion: 2.1 time: 0.196962 Sep 27 01:40:43.698366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1255/2626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:43 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1488 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:43.711595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:43.712604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:43.737002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:43.739111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.740179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.740952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.741925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.742530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.743282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.851581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:43.855901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:43.871723 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2cb3d421-f19a-46fe-9d2e-9c685a85250a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1280 microversion: 2.1 time: 0.169388 Sep 27 01:40:43.872510 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1256/2627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:43 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:43.889746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:43.910115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:43.924082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.924883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.925535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:43.926457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:43.927091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:43.927692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.030485 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cac36233-9d75-4213-8dd3-0b2988a11a83 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action" status: 202 len: 0 microversion: 2.1 time: 0.153485 Sep 27 01:40:44.032671 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1257/2628] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:43 2022] POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:44.041760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24d5ec91f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:44.170167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.170808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.171084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.171826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.172278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.172880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.206422 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d13c99e-d5b9-4373-a7e5-7fa851eb5de6 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55/detail" status: 200 len: 916 microversion: 2.1 time: 0.172089 Sep 27 01:40:44.216933 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1258/2629] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:40:44 2022] GET /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55/detail => generated 916 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:44.236527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:44.239694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:44.258364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.259659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.261187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.262132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.265595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.266243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.329947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lazy-loading 'flavor' on Instance uuid cd1ee5ed-b16f-4dba-9cc2-91aae039af02 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:40:44.606647 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2bc7fc5-c9aa-4201-b6b4-a89fbf5e7538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02/action" status: 202 len: 0 microversion: 2.1 time: 0.385393 Sep 27 01:40:44.607393 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1259/2630] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:44 2022] POST /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:44.628483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a30166-865c-427a-94ff-8b85ea13b756", "tag": "3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e"}, {"name": "network-changed", "server_uuid": "0cce6ff3-eaf0-4f8f-b671-5b4430d19339", "tag": "198c20d2-ddd3-40aa-baf9-0c4294597ecb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:44.689799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.690463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.690960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.711807 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Creating event network-changed:3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e for instance 48a30166-865c-427a-94ff-8b85ea13b756 on n-h2-859358-1 Sep 27 01:40:44.712459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] Creating event network-changed:198c20d2-ddd3-40aa-baf9-0c4294597ecb for instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 on n-h2-859358-1 Sep 27 01:40:44.725627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9ccce61b-f40e-476a-9fea-20763f8382c5 req-5f43aaff-4d19-462e-a72e-c77bbb7d9c89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110932 Sep 27 01:40:44.727781 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1260/2631] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:44.735275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:44.736344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:44.748639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.749241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.749801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:44.754140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:44.754723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:44.755256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:45.518848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:45.533534 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31e790ab-a73f-4e8f-beb4-9569fc183c7d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.804337 Sep 27 01:40:45.534215 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1261/2632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:44 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:45.538998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:45.539679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:45.545875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:45.546599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:45.547204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:45.548073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:45.548693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:45.549300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:45.901548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:45.911966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6133184c-d83a-4622-ab60-1ca5b6999e8d tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1575 microversion: 2.1 time: 0.376321 Sep 27 01:40:45.913264 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1262/2633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:45 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1575 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:45.918293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:45.919086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:45.926705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:45.927315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:45.927794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:45.928714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:45.929312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:45.929831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.084204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:46.093943 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28d307b4-7a5d-4458-b577-59349a08ed27 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.179312 Sep 27 01:40:46.106130 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1263/2634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:45 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:46.116429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:46.117574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:46.124865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.125554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.126173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.127326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.128027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.128597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.432322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:46.444412 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be5c46e6-4e01-41e7-a052-c6cd1af80673 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1527 microversion: 2.1 time: 0.335303 Sep 27 01:40:46.445628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1264/2635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:46 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:46.457322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:46.458938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:46.481140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.481891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.482430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.483460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.484267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.484920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.496356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-79aeae28-b37f-4c94-87fa-95f4beef8e87 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8/action" status: 202 len: 0 microversion: 2.25 time: 2.971203 Sep 27 01:40:46.498516 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1372/2636] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:40:43 2022] POST /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8/action => generated 0 bytes in 2974 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:46.505979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Action: 'update', calling method: .version_select at 0x7f24d61d29d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:46.655869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.656608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.658622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.659417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.660930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.661411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.712373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.712866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.715540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.716571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.720878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.721853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.796160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:46.813248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50b0c2e7-70bf-420f-8545-b7f6ca94d6c4 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 200 len: 1479 microversion: 2.1 time: 0.361701 Sep 27 01:40:46.814274 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1265/2637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:46 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 1479 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:46.820912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:46.821448 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-19073a03-b41f-4da3-9b18-9197ccc4ce92 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55?user_id=1bac9e89c9fb4c4bb7683a19ff1c999f" status: 200 len: 328 microversion: 2.1 time: 0.321543 Sep 27 01:40:46.821667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:46.823137 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1373/2638] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:40:46 2022] PUT /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55?user_id=1bac9e89c9fb4c4bb7683a19ff1c999f => generated 328 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:46.840689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91074-a09e-4553-b4e0-0248f7559a3b", "name": "network-vif-plugged", "status": "completed", "tag": "ece7687e-b7b8-4413-b1e7-db4ec7e847ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:46.842578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.846921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.847750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.848901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.850611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.852386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.864915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.865418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.865862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.906317 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] Creating event network-vif-plugged:ece7687e-b7b8-4413-b1e7-db4ec7e847ef for instance 8db91074-a09e-4553-b4e0-0248f7559a3b on n-h1-859358-1 Sep 27 01:40:46.912043 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a45999dc-7bc5-401d-a666-1e2a9416e2c4 req-c248cc43-c2f6-4438-ab68-200d056596c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086960 Sep 27 01:40:46.913108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1374/2639] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:46.918965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:46.935691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.936434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.937228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.952698 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] Creating event network-changed:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:40:46.959206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-98c6d714-90c5-4f9d-9b5d-48aa0ccd728c req-feed48c1-1138-421a-8397-5765f418f274 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044460 Sep 27 01:40:46.960853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1375/2640] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:46.969380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:46.970337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:46.981489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.982119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.982732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:46.983897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:46.984604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:46.985107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.132418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.144379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.147039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.148861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-726ee710-8802-4add-b049-e6b86af1d325 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.186270 Sep 27 01:40:47.149965 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1376/2641] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:46 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:47.156574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.157794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:47.171599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.172111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.172914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.173032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.187102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d14d8cc-4ebe-4659-9614-0ab08a13b34d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 0.371195 Sep 27 01:40:47.188162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.188949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.189437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.196437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1266/2642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:46 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:47.209119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-712e8724-2bfb-4d60-95bb-07aa231c5369 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24d5ec91f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.306215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-712e8724-2bfb-4d60-95bb-07aa231c5369 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55?user_id=1bac9e89c9fb4c4bb7683a19ff1c999f" status: 200 len: 370 microversion: 2.1 time: 0.108093 Sep 27 01:40:47.307424 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1267/2643] 10.222.0.52 () {58 vars in 1323 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/os-quota-sets/32402fc43f5444ac94b4726054144f55?user_id=1bac9e89c9fb4c4bb7683a19ff1c999f => generated 370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:47.313185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-615985611"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:47.315998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:47.324406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.325208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.325823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.326999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.327588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.328161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.403659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.414051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f22dbc4-1baf-4394-a116-89cda7067408 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.262208 Sep 27 01:40:47.414690 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1377/2644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:47.436784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.439305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:47.446091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.446719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.447237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.448583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.449038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.449550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.629576 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b73f624e-080f-4f47-834f-efb7247b82d6 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02/action" status: 202 len: 0 microversion: 2.1 time: 0.316606 Sep 27 01:40:47.632131 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1268/2645] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:47 2022] POST /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:40:47.655541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.656427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:47.656863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.668500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f7c45ee-5f7c-44f6-ada5-8869dd11cc2c tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1580 microversion: 2.1 time: 0.242789 Sep 27 01:40:47.669462 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1378/2646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1580 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:47.673652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.674230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.675007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.675979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.676299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.676924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.677312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:47.677598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.688137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.688927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.689542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.690590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:47.691195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:47.692147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:47.844018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.855558 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b8ef3c4-b99c-4e19-a257-fc89481a26ba tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1523 microversion: 2.1 time: 0.214175 Sep 27 01:40:47.856685 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1269/2647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:47.859968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:47.861755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-760b645a-14c4-49ed-bd92-c194c974c88a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da5b3820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.870807 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dfeb211a-6acf-489a-b685-deb504a0902b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1522 microversion: 2.1 time: 0.198224 Sep 27 01:40:47.871406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1379/2648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:47.881964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-695af68b-e456-4fd8-b6dd-88d86583f396 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Calling method '.version_select at 0x7f24d611c790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:47.914990 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-760b645a-14c4-49ed-bd92-c194c974c88a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1437 microversion: 2.1 time: 0.056992 Sep 27 01:40:47.916070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1270/2649] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1437 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:48.118583 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-695af68b-e456-4fd8-b6dd-88d86583f396 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.240131 Sep 27 01:40:48.120909 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1380/2650] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:40:47 2022] GET /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9/defaults => generated 371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:48.135054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Action: 'update', calling method: .version_select at 0x7f24da5b3160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:48.180693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:48.181674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:48.192854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.194312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.195648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.198129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.199296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.202329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.247078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.248312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.251863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.254448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.255114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.255678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.424496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:48.439585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:48.441140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:48.442394 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f08cf0f3-d631-4ee0-a708-131b6394ae6c tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.269567 Sep 27 01:40:48.443041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1381/2651] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:48 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:48.462872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:48.464071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:48.478582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.479837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.480390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.481751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.482972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.483573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.581816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38b90216-26a4-42cb-8af4-da8872b772e0 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9" status: 200 len: 329 microversion: 2.1 time: 0.451231 Sep 27 01:40:48.582542 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1271/2652] 10.222.0.52 () {60 vars in 1263 bytes} [Tue Sep 27 01:40:48 2022] PUT /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9 => generated 329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:48.587406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:48.588022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:48.594880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.596139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.596566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.597836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.598420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.598891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.684593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:48.704638 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5cab7c41-3591-4de0-b7f0-28bc7a78c7e0 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 0.259797 Sep 27 01:40:48.719303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1382/2653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:48 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:48.719303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Action: 'update', calling method: .version_select at 0x7f24d64fa5e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:48.788072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:48.801381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f4136c6-c25b-4ff3-a279-860edf4f2c6d tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.217671 Sep 27 01:40:48.813436 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1272/2654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:48 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:48.821458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:48.824811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:48.841993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.842606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.853036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.854932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.856648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.857217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.857748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.858262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.860586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.861440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:48.862857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:48.863333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:48.896522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:49.096115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:49.108567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd91da66-6783-41d4-b9d4-920adc67c5b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1580 microversion: 2.1 time: 0.302514 Sep 27 01:40:49.109361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1273/2655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:48 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1580 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:49.117362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:49.118098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:49.125507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.126138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.126751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.128368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.129573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.130123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.208351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=77,nova_api:UPDATE=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:49.327939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3899b3ff-bb33-4f05-8ee5-658503872f72 tempest-QuotasAdminTestJSON-835435426 tempest-QuotasAdminTestJSON-835435426-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9" status: 200 len: 329 microversion: 2.1 time: 0.620651 Sep 27 01:40:49.341276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1383/2656] 10.222.0.52 () {60 vars in 1263 bytes} [Tue Sep 27 01:40:48 2022] PUT /compute/v2.1/os-quota-sets/5a10ccb8aec54419a79af23247d46cd9 => generated 329 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:49.346649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:49.347311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:49.355119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.355651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.356085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.357019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.357679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.358186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.476032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:49.506516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a749081-7284-4a61-8ea0-b5fb0f496712 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1508 microversion: 2.1 time: 0.395428 Sep 27 01:40:49.522956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1274/2657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:49 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:49.523191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb4aa0e-b1c8-4d18-915c-d650b18b1822", "name": "network-vif-plugged", "status": "completed", "tag": "58e9130c-1693-4c7d-9bfb-44ba7976f816"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:49.562183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.567501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.571661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.623560 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] Creating event network-vif-plugged:58e9130c-1693-4c7d-9bfb-44ba7976f816 for instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 on n-h1-859358-1 Sep 27 01:40:49.633714 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e80a2e97-616d-449c-815a-858e282f3b72 req-ce882715-94fb-4cd7-953c-636110138b86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118751 Sep 27 01:40:49.643107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1275/2658] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:40:49.649202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c469b642-a2ec-48c0-b79c-f370c6e78885 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da5b3ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:49.743274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c469b642-a2ec-48c0-b79c-f370c6e78885 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1437 microversion: 2.1 time: 0.098623 Sep 27 01:40:49.744972 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1276/2659] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:49 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:49.757040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:49.764353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:49.791772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.794340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.795948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.799491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.802477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.803731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.833367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:49.842262 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-279cc916-7aa5-4806-a7e9-299d95e4a03b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1522 microversion: 2.1 time: 0.499736 Sep 27 01:40:49.846349 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1384/2660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:49 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:49.864288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:49.865177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:49.875144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.875692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.877647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:49.878765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:49.879208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:49.879640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.115041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:50.126769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:50.128530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:50.133300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58e5904d-4bda-4a2c-9beb-2c133385dde6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.387008 Sep 27 01:40:50.134520 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1277/2661] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:49 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:50.143157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:50.150905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:50.160904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.162119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.165937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.167453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.168076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.168663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.376266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:50.390691 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23740d6d-1767-4383-a703-d2d4bc13d865 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 200 len: 1508 microversion: 2.1 time: 0.542966 Sep 27 01:40:50.391313 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1385/2662] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:49 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:50.406641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:50.407536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:50.423802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.424299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.427730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.429170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.429664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.430258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.670298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:50.694997 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-913e9866-dde3-473d-80f0-3feea813c14c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 0.559122 Sep 27 01:40:50.695611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1278/2663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:50 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:50.721009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:50.729890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:50.737312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.738076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.738761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:50.742238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:50.742898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:50.743486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:51.264962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:51.282705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3bb7b2ef-e297-49d2-9e68-8907a3dea13c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1392 microversion: 2.1 time: 0.887876 Sep 27 01:40:51.315697 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1386/2664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:50 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1392 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:51.343009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:51.347478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:51.366796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:51.368067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:51.372701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:51.376722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:51.378188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:51.382118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:51.459062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:51.476190 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1bba871-c65f-4b52-b6f8-6d3612985cac tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1573 microversion: 2.1 time: 0.762129 Sep 27 01:40:51.491959 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1279/2665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:50 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1573 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:51.536241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2ae0eaf-1381-4782-8fc6-56ee49139fe2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da5f8700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:51.548633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:40:51.781710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c38a3ff0-3e86-447e-aaf1-c9635b984abd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 204 len: 0 microversion: 2.1 time: 0.464294 Sep 27 01:40:51.788342 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1387/2666] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:40:51 2022] DELETE /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:40:51.798630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:51.798630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:51.817663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:51.818042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:51.818503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:51.819206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:51.819671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:51.820077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:52.202208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:52.215080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76dffc4e-2320-4645-ba14-89198a1c3d94 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1522 microversion: 2.1 time: 0.429579 Sep 27 01:40:52.216996 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1388/2667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:51 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:52.224926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:52.226105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:52.237739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:52.238426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:52.239028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:52.240010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:52.240747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:52.241533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:52.279050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:52.513233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:52.544445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:52.550533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:52.553970 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aee86420-01ac-4030-b09d-8dabd3a37fda tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.333886 Sep 27 01:40:52.557443 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1389/2668] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:40:52 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:40:52.570814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-578651216"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:52.573522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:52.594951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:52.607747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:52.614742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:52.621059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:52.627068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:52.627618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:52.940579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Adding security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 to port 198c20d2-ddd3-40aa-baf9-0c4294597ecb Sep 27 01:40:54.069636 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-188ab657-ec6e-4ae3-b3be-8cb6516eb1b3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action" status: 202 len: 0 microversion: 2.1 time: 1.510464 Sep 27 01:40:54.071080 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1390/2669] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:40:52 2022] POST /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339/action => generated 0 bytes in 1513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:40:54.077115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:40:54.079369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:40:54.104125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:54.104641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:54.105090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:54.109251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:40:54.112674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:40:54.113374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:40:54.702193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:40:54.716644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70a4e928-5d53-42e5-b8cf-a79ca6a3c406 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 0.643443 Sep 27 01:40:54.722373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1391/2670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:40:54 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:40:54.740913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1295664764", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "41d3fd12-2d49-47ef-8d36-7babc9c9070d"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:40:58.269234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:58.575834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=52 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:58.889540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:40:59.318717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=62 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:00.736068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:01.464484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=29 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:04.710632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:04.789614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:09.272924 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2ae0eaf-1381-4782-8fc6-56ee49139fe2 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1437 microversion: 2.1 time: 17.776103 Sep 27 01:41:09.275438 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1280/2671] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:40:51 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1437 bytes in 17781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:09.279402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] validate_networks() for [('41d3fd12-2d49-47ef-8d36-7babc9c9070d', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:41:09.279897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:09.280202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:09.306361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.307658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.308778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.310187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.310825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.311944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.540960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:09.550274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a5aaea3-899b-4a14-b2fa-d81a694c2fdc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1382 microversion: 2.1 time: 0.275486 Sep 27 01:41:09.550863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1281/2672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:09 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1382 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:09.563826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1ee5ed-b16f-4dba-9cc2-91aae039af02", "name": "network-vif-plugged", "status": "completed", "tag": "58867592-4149-441f-9ff8-171a791b7d8a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:09.587579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.588620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.589052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.601185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] Creating event network-vif-plugged:58867592-4149-441f-9ff8-171a791b7d8a for instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 on n-h1-859358-1 Sep 27 01:41:09.606622 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ea6e1c85-524d-4690-b44d-be0aeb166017 req-a5d35e11-ec33-4cf6-9c8c-b58b5ae0a272 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048654 Sep 27 01:41:09.607763 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1282/2673] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:09.613512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:09.614404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:09.621981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.622691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.623363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.624686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.625301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.626047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.849094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:09.867037 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff678114-60fe-41e7-944c-886de418680b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1522 microversion: 2.1 time: 0.254878 Sep 27 01:41:09.868430 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1283/2674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:09 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:09.875180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:09.876400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:09.898806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.900546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.904279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:09.910246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:09.911106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:09.921451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.251026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:10.267442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:10.272216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:10.275871 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad1b870b-0605-4e95-b8bd-585ae63dfcc8 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.404939 Sep 27 01:41:10.280074 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1284/2675] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:09 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:10.288678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da5ad280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:10.501664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:41:10.502189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:41:10.506532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:41:10.507048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:41:10.507517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:41:10.540627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.541806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.543474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.545071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.545888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.547736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.580320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:41:10.588654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Getting quotas for user 7c7cf1bdbba44c2e939151843c9ac187 and project 769d12d962a14080b756c1a57d723bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:41:10.634535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:41:10.644137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:41:10.804234 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea12f3b1-a80f-42e9-b3fc-75d19bb9928a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.079343 Sep 27 01:41:10.804920 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1392/2676] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:40:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 16082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:41:10.818869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cce6ff3-eaf0-4f8f-b671-5b4430d19339", "tag": "198c20d2-ddd3-40aa-baf9-0c4294597ecb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:10.831001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use.", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:10.831773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.831773 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122 HTTP/1.1 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:10.834353 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: exception: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.835845 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6cf0b83c-aa86-4df6-810b-d4a8e619b122'} Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:10.836753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.838632 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:10.839914 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 400 to user: Security Group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 in use. Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-d6745cd5-dfbc-41be-9ed5-5cb4a1fbd8ce'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d19c8fe5-451c-414d-a360-eee7fb06f964 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122" status: 400 len: 185 microversion: 2.1 time: 0.554517 Sep 27 01:41:10.841503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1285/2677] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:10 2022] DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122 => generated 185 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:41:10.850884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db91074-a09e-4553-b4e0-0248f7559a3b", "name": "network-vif-deleted", "tag": "ece7687e-b7b8-4413-b1e7-db4ec7e847ef"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:10.872197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.872728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.873275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.904634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.905288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.906702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.916859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] Creating event network-changed:198c20d2-ddd3-40aa-baf9-0c4294597ecb for instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 on n-h2-859358-1 Sep 27 01:41:10.929627 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9e997a91-c43e-4b3b-9ec3-a38965eade69 req-569d7edb-2f2c-4353-9f34-75f2d0fb5109 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120888 Sep 27 01:41:10.930937 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1393/2678] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:10.931220 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] Creating event network-vif-deleted:ece7687e-b7b8-4413-b1e7-db4ec7e847ef for instance 8db91074-a09e-4553-b4e0-0248f7559a3b on n-h1-859358-1 Sep 27 01:41:10.939020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-48707543-14d1-4e78-b637-d259527a4808 req-c6580bc3-2368-4a6e-a55c-e2955d3bd2ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096012 Sep 27 01:41:10.940705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1286/2679] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:10.951707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2da07f50-f388-4bcc-8966-a716bd4e7e04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '.version_select at 0x7f24da5b3160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:10.952058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:10.952822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:10.968859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da07f50-f388-4bcc-8966-a716bd4e7e04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.969458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da07f50-f388-4bcc-8966-a716bd4e7e04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.969728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.970228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.972059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da07f50-f388-4bcc-8966-a716bd4e7e04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.972649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:10.974328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:10.987205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:10.988217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:11.044138 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2da07f50-f388-4bcc-8966-a716bd4e7e04 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3090 microversion: 2.1 time: 0.094522 Sep 27 01:41:11.048275 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1287/2680] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 01:41:10 2022] GET /compute/v2.1/os-migrations => generated 3090 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:11.067693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3f779b9-d462-4e5e-9ff2-1d811027302e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da58d310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:11.235924 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3f779b9-d462-4e5e-9ff2-1d811027302e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1437 microversion: 2.1 time: 0.186312 Sep 27 01:41:11.237891 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1288/2681] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:11 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1437 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:11.250363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94db6bb6-cd1b-4289-bf98-e47d24d8594b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:11.251021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94db6bb6-cd1b-4289-bf98-e47d24d8594b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:11.639346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94db6bb6-cd1b-4289-bf98-e47d24d8594b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:11.653366 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94db6bb6-cd1b-4289-bf98-e47d24d8594b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1218 microversion: 2.1 time: 0.414368 Sep 27 01:41:11.663581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1289/2682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:11 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1218 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:11.663581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:11.663581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:11.673413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:11.677804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:11.678458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:11.679377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:11.680243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:11.682466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:11.743353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:11.968142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45aa582b-57f3-4c4b-b2b8-44dba7520a1a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 204 len: 0 microversion: 2.1 time: 0.312094 Sep 27 01:41:11.968992 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1290/2683] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:11 2022] DELETE /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:11.975400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:11.976350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:11.991080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:11.993076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:11.997947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:11.999389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.000019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.000620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.194987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:12.204774 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-edadf1d8-0b8d-4097-9722-aad048ae670f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 1.270127 Sep 27 01:41:12.207579 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1394/2684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:10 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:12.223219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:12.238286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:12.267239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.271163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.271817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.275174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.276421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.277062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.550996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:12.564427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd7d2076-f5a3-41e6-b658-73660d3f1022 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1504 microversion: 2.1 time: 0.592376 Sep 27 01:41:12.565043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1291/2685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:11 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:12.600393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:12.602361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:12.629082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.630727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.631198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.636267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.644149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.647273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.953008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:12.962944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:12.964485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:12.966215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0b2373b-7daa-400b-98f1-f99a4d1b2548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.397766 Sep 27 01:41:12.966797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1292/2686] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:12 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:12.971921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "name": "network-vif-plugged", "status": "completed", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:12.982536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:12.982536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:12.982960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:12.996269 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36197f6f-90a4-4b0a-8794-78e1352aef41 tempest-LiveMigrationTest-765864523 tempest-LiveMigrationTest-765864523-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1533 microversion: 2.1 time: 0.782280 Sep 27 01:41:12.997794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1395/2687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:12 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1533 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:13.015603 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] Creating event network-vif-plugged:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:41:13.015603 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4fda211a-9561-4b2e-b96a-891bda6d3fa2 req-3ca77cae-6ac7-464a-b498-0084506bbbc3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Sep 27 01:41:13.015603 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1293/2688] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:13.015603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.015603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:13.035537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e8f481e-95f4-4f72-80e5-bcd6458e954c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d67dfca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.040647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.041263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.041799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.042628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.045816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.046251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.099315 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e8f481e-95f4-4f72-80e5-bcd6458e954c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1446 microversion: 2.1 time: 0.080464 Sep 27 01:41:13.100144 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1396/2689] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:13 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1446 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:13.116164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.117058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:13.126540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.127222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.127868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.129054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.129813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.130575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.246591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:13.263021 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-10d1bd61-02bf-48c2-ab1b-d117ca7f4b6a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1270 microversion: 2.1 time: 0.161617 Sep 27 01:41:13.265786 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1397/2690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:13 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:13.290038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48db1246-5da2-415d-bc56-b16f43b5e1d8", "name": "network-vif-unplugged", "status": "completed", "tag": "f5cb92c3-bc19-45a6-b0e4-2e1f4df54667"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:13.323501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.330563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.332262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.378468 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] Creating event network-vif-unplugged:f5cb92c3-bc19-45a6-b0e4-2e1f4df54667 for instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 on n-h1-859358-1 Sep 27 01:41:13.393164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1fc42c1c-87ab-471d-86f4-73888d546f51 req-0f1b5496-c10d-40c0-8cbe-983ce1bf4542 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126061 Sep 27 01:41:13.393836 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1398/2691] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:13.417470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.418073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:13.433691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.437634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.439210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.439210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.440715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.441872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.445534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:13.459689 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4589207a-ce02-42d4-a082-7f5821cf6466 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1647 microversion: 2.1 time: 0.450287 Sep 27 01:41:13.479800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1294/2692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:13 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1647 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:13.491505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a68874d-8f01-4a4c-b2be-c70d8604a546 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da580160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.534013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:13.569245 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a68874d-8f01-4a4c-b2be-c70d8604a546 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 200 len: 1446 microversion: 2.1 time: 0.088223 Sep 27 01:41:13.570257 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1295/2693] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:13 2022] GET /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:13.580162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:13.580796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:13.601196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.604281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.607660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.608923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:13.611130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:13.613618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:13.713946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12014ef4-15d6-4ba4-b1e3-ff6802934a2a tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 204 len: 0 microversion: 2.1 time: 0.318128 Sep 27 01:41:13.714544 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1399/2694] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:13 2022] DELETE /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:13.721859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c36293b-ec84-42fd-906e-35a910156ea1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d624d040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:14.169124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:14.177622 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7859e0f0-f4c7-4d02-9f83-aa6350c86a54 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1322 microversion: 2.1 time: 0.603969 Sep 27 01:41:14.193747 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1296/2695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:13 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:14.215210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:14.215844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:14.222691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:14.223184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:14.223617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:14.224323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:14.224774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:14.225195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:14.929899 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c36293b-ec84-42fd-906e-35a910156ea1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 204 len: 0 microversion: 2.1 time: 1.213856 Sep 27 01:41:14.930740 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1400/2696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:13 2022] DELETE /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:14.940092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:14.940846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:14.966519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:14.970227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:14.971319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:14.972086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:14.977398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:14.980996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.041750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.052999 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7579cd1f-4f79-4aa0-8f15-f9682a8fbe9e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1504 microversion: 2.1 time: 0.858058 Sep 27 01:41:15.065390 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1297/2697] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:14 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1504 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:15.065390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:15.065390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:15.086795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.087321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.087853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.100457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.102366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.103886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.409285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.424030 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f763374-0fa2-4c19-80d5-bb47ad792542 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1388 microversion: 2.1 time: 0.488068 Sep 27 01:41:15.438188 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1401/2698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:14 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1388 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:15.445622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:15.446463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:15.471184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.471707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.472157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.472884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.473399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.473839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.563539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.571504 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28905f1f-020c-4106-b3b5-e77404e82d6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1278 microversion: 2.1 time: 0.132134 Sep 27 01:41:15.575521 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1402/2699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:15 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:15.582335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:15.582960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:15.598759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.599258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.602798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.604137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.606848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.607785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.614416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.629438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.631543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:15.633632 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21699081-8b12-4872-88c5-daab713c2c77 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.574530 Sep 27 01:41:15.635940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1298/2700] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:15 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:15.646052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:15.648069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:15.665365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.666377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.669059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.671416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:15.671916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:15.675754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:15.759067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:15.974128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b47bad6d-ab9d-4970-a95f-2e9de5584538 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 204 len: 0 microversion: 2.1 time: 0.335563 Sep 27 01:41:15.974812 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1299/2701] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:15 2022] DELETE /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:15.985238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb4aa0e-b1c8-4d18-915c-d650b18b1822", "name": "network-vif-unplugged", "status": "completed", "tag": "58e9130c-1693-4c7d-9bfb-44ba7976f816"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:16.026623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:16.028960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.029479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.039512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.055051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76dcead2-6e98-402f-8755-95f8ac1a5046 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 200 len: 1647 microversion: 2.1 time: 0.478103 Sep 27 01:41:16.057148 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1403/2702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:15 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 1647 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:16.058812 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] Creating event network-vif-unplugged:58e9130c-1693-4c7d-9bfb-44ba7976f816 for instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 on n-h1-859358-1 Sep 27 01:41:16.074787 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-509351bd-9f37-45ff-99ee-ec92dcf935d7 req-e98c9bc0-4c86-4500-aab2-61d8a3191082 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098328 Sep 27 01:41:16.076006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:16.077313 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1300/2703] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:16.078499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:16.088470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48db1246-5da2-415d-bc56-b16f43b5e1d8", "tag": "f5cb92c3-bc19-45a6-b0e4-2e1f4df54667"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:16.098027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.101935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.102584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.104239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.107260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.108501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.113729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.114417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.119021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.158654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] Creating event network-changed:f5cb92c3-bc19-45a6-b0e4-2e1f4df54667 for instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 on n-h1-859358-1 Sep 27 01:41:16.165323 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2613304f-3899-4d91-8794-1c97fbd03621 req-125787bc-9aa4-48f6-ac9a-4911df6b093e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084211 Sep 27 01:41:16.167428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1301/2704] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:16.174367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:16.175289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:16.185057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.185904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.187220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.188096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.188737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.189447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.196610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:16.523343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:16.534336 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcf005f4-5ec4-418c-8824-5f8e2472a40a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1507 microversion: 2.1 time: 0.365496 Sep 27 01:41:16.534960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1302/2705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:16 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:16.562656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-281525519", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8c88e62c-74c5-4ff9-a7df-3a1b273be5ea"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:16.604856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:16.618478 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1780652e-5668-429b-85db-5eeab4aff58b tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1516 microversion: 2.1 time: 0.556005 Sep 27 01:41:16.629512 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1404/2706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:16 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1516 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:16.633836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] validate_networks() for [('8c88e62c-74c5-4ff9-a7df-3a1b273be5ea', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:41:16.647142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:16.647758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:16.655686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.656188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.656637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.657384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.660799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.661270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.783344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:16.810061 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-73a74aa1-def8-4967-b6be-519634d42e77 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1346 microversion: 2.1 time: 0.167853 Sep 27 01:41:16.831042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1405/2707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:16 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:16.838024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:16.838477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:16.855201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.855879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.856481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.857452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:16.858140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:16.858784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:16.910878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:16.922266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Working on deleting snapshot 2e88cb78-186b-4c30-9b90-28d720281b94 from shelved instance... Sep 27 01:41:17.363143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:41:17.363903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:41:17.364521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:41:17.365642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:41:17.366328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:41:17.384330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.384961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.385530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.386278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.386839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.387271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.415578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:41:17.433250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Getting quotas for user 72f64b5a7b76437c9f31cf277c601aa3 and project f3961cd41a154feba0e624e2fdc0a15e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:41:17.473562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:41:17.476313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:41:17.572671 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b68d379-2f87-41a2-8c2e-ca343a1dace9 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019221 Sep 27 01:41:17.581655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1303/2708] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:41:17.591927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:17.593884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:17.606156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.606950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.607459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.608789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.609367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.610336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.810209 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b711274d-3fc4-4572-9924-a242cc37532f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 204 len: 0 microversion: 2.1 time: 0.977674 Sep 27 01:41:17.811775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1406/2709] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:16 2022] DELETE /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 0 bytes in 980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:17.823336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:17.826191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:17.844916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.845444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.845885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.846687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.847143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.851794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.898987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lazy-loading 'flavor' on Instance uuid bbcc6f19-8243-4ab7-95ce-edcfecac07fa {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:17.909640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:17.928609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3420e0d-3b38-431b-8167-a36ace12fa60 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1276 microversion: 2.1 time: 0.340316 Sep 27 01:41:17.930878 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1304/2710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:17 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1276 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:17.952234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:17.952864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:17.966853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.969919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.972550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.975333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:17.976957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:17.982943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:17.995208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:18.074032 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c113436-bbe2-4c50-8395-b2c65e8b05a4 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action" status: 200 len: 32 microversion: 2.1 time: 0.256525 Sep 27 01:41:18.075338 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1407/2711] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:41:17 2022] POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:41:18.095118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:18.099035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:18.111433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:18.112387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:18.113095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:18.114222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:18.114888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:18.115552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:18.163406 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 HTTP/1.1 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:18.165587 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:18.166880 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '0cce6ff3-eaf0-4f8f-b671-5b4430d19339'} Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:18.167555 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:18.168621 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:18.173158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:18.176840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fb96ee1-ca9d-4e63-8f64-2afcff2e9866 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 404 len: 111 microversion: 2.1 time: 0.100037 Sep 27 01:41:18.181272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1408/2712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:18 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:18.200896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29670cb8-d4d4-4603-a0b7-b32e1977d4a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:18.209136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29670cb8-d4d4-4603-a0b7-b32e1977d4a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:18.392901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29670cb8-d4d4-4603-a0b7-b32e1977d4a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:18.400796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29670cb8-d4d4-4603-a0b7-b32e1977d4a1 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1207 microversion: 2.1 time: 0.206249 Sep 27 01:41:18.404679 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1409/2713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:18 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1207 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:18.417833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:18.418821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:18.443583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:18.448996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:18.449845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:18.455395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:18.458795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:18.459535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:19.367874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:19.391287 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c5841ca-342f-478f-a070-ba9fb2b3f53c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 200 len: 1453 microversion: 2.1 time: 0.984103 Sep 27 01:41:19.393953 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1410/2714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:18 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 1453 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:19.404925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:19.408892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:19.445721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:19.448880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:19.451005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:19.453519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:19.454498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:19.456470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:19.937663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:19.947867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:19.960735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:19.964029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-296f8c90-e9d2-4cbc-a983-f4ce4aa4bbf7 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 2.029947 Sep 27 01:41:19.977508 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1305/2715] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:17 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:20.008722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:20.009929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:20.041642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:20.042574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:20.050161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:20.051368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:20.052069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:20.058446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:20.116120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:20.145013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a95ff779-75f0-4cb3-9c75-f6fef278735b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1183 microversion: 2.1 time: 0.743036 Sep 27 01:41:20.166501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1411/2716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:19 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1183 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:20.186850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a4d2911-db0f-4287-94ce-9d34eed30778 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d624dd30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:20.562902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:21.211842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:21.224777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a21e74c-79d3-4484-8024-1f5c12c414b3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 1.243605 Sep 27 01:41:21.233697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1306/2717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:19 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:21.243645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce6ff3-eaf0-4f8f-b671-5b4430d19339", "name": "network-vif-deleted", "tag": "198c20d2-ddd3-40aa-baf9-0c4294597ecb"}, {"server_uuid": "48a30166-865c-427a-94ff-8b85ea13b756", "name": "network-vif-deleted", "tag": "3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:21.280958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:21.286151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:21.289913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:21.337160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Creating event network-vif-deleted:198c20d2-ddd3-40aa-baf9-0c4294597ecb for instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 on n-h2-859358-1 Sep 27 01:41:21.338926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] Creating event network-vif-deleted:3ff62499-ebdc-4d59-bbfc-7d5b12f94e2e for instance 48a30166-865c-427a-94ff-8b85ea13b756 on n-h1-859358-1 Sep 27 01:41:21.363949 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3351ac83-76c2-4c70-bef7-121023f40921 req-12891b4c-a4bb-452c-976c-fa43b524a5a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128426 Sep 27 01:41:21.365224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1307/2718] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:21.381506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:21.386257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:21.412273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:21.415554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:21.425949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:21.427269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:21.434704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:21.435537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:21.698036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:21.711374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6702c84e-224e-4c88-9bef-9967f02f7de7 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1276 microversion: 2.1 time: 0.341099 Sep 27 01:41:21.720956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1308/2719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:21 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:21.737629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:21.739116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:21.764334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:21.765541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:21.766702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:21.770107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:21.771514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:21.777020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.203109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a4d2911-db0f-4287-94ce-9d34eed30778 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869" status: 202 len: 0 microversion: 2.1 time: 2.033729 Sep 27 01:41:22.204427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1412/2720] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:20 2022] DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869 => generated 0 bytes in 2037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:22.209781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1ee5ed-b16f-4dba-9cc2-91aae039af02", "name": "network-vif-deleted", "tag": "58867592-4149-441f-9ff8-171a791b7d8a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:22.224898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:22.243088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd854d17-61f5-4957-8f12-b71fa243f30f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1265 microversion: 2.1 time: 0.518590 Sep 27 01:41:22.247054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1309/2721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:21 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1265 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:22.260160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:22.264589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:22.269155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.270219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.270219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.304397 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] Creating event network-vif-deleted:58867592-4149-441f-9ff8-171a791b7d8a for instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 on n-h1-859358-1 Sep 27 01:41:22.306368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.308872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.311184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.314028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.315055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.318194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.321331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-49bc1bba-7d53-431a-b5f1-9e8393419fd5 req-f733026d-75e7-48dd-a80a-2de31b8326b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115392 Sep 27 01:41:22.323527 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1413/2722] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:22.330659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:22.337424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:22.361208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.361788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.362242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.363179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.363645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.364072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.366333 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 HTTP/1.1 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:22.384042 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:41:22.386312 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2bb4aa0e-b1c8-4d18-915c-d650b18b1822'} Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:22.387195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:41:22.390309 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:22.394654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:22.398609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f004e4a-228b-4e92-b73a-d094d50e81de tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 404 len: 111 microversion: 2.1 time: 0.147012 Sep 27 01:41:22.404255 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1310/2723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:22 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:22.420872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:22.422243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:22.486937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.488669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.492745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.495356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:22.505106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:22.505994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:22.779321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:22.796326 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc9d893d-3d24-4313-9c98-b0451c2e45a1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1183 microversion: 2.1 time: 0.388493 Sep 27 01:41:22.797177 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1311/2724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:22 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:22.816387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-244126a8-73c3-4e01-97c4-31c8a3a4cceb tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da5b3550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:22.941440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:22.958638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:22.969181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:22.978876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e94f91f1-b06a-48a0-8277-496806e99d30 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.653950 Sep 27 01:41:22.980422 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1414/2725] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:22 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:22.991178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:23.002083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:23.018902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.019052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.021948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.022700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.023160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.026893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.255451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:23.272233 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5e1cec3-ae1f-4679-8d43-b6da41a29d9a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.282173 Sep 27 01:41:23.277667 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1415/2726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:22 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:23.295257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:23.296890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:23.313255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.313836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.315928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.315928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.315928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.316341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.839482 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-244126a8-73c3-4e01-97c4-31c8a3a4cceb tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122" status: 202 len: 0 microversion: 2.1 time: 1.038874 Sep 27 01:41:23.840319 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1312/2727] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:22 2022] DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:23.847865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1141576018", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:23.868646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:23.878189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98fbc11d-1e36-4113-b369-bf8c6ac72392 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.599170 Sep 27 01:41:23.886653 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1416/2728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:23 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:23.927151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:23.927795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:23.952811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.959740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.963332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.968340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:23.972023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:23.972534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:23.998717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:41:24.328821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:24.343968 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3dfb4f9-053c-4883-a673-fb7c5d13e5e7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.455861 Sep 27 01:41:24.361394 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1417/2729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:23 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:24.375171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:24.376216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:24.394682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:24.396123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:24.401377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:24.402297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:24.404494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:24.405918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:24.818303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:24.827624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15d85641-b792-4f74-9867-e5e48844e2c5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1183 microversion: 2.1 time: 0.464811 Sep 27 01:41:24.842000 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1418/2730] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:24 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1183 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:24.857144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20811899-7944-4024-891e-779f46f1ca54 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'create', calling method: .version_select at 0x7f24d62cc820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-70804054", "description": "tempest-description-428140388"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:25.141191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:41:25.142281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:41:25.142982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:41:25.143771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:41:25.144425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:41:25.171573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.172065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.172504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.173313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.173881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.174311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.174570 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20811899-7944-4024-891e-779f46f1ca54 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.330262 Sep 27 01:41:25.175872 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1419/2731] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:41:24 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:25.183185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:25.184088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:25.213124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.214249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.217173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.218199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.220809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.222136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.235967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:41:25.246665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:41:25.262187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:41:25.264904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:41:25.395118 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35575613-21a6-4688-ad03-5fa9fce48545 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553525 Sep 27 01:41:25.400025 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1313/2732] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:41:25.411698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:25.414271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:25.424108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:25.425754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.427092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.427962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.429150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.429898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.430489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.848078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:25.877807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:25.885695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:25.887759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-743ff2bc-4499-4e90-9955-0e1373d37e41 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.710694 Sep 27 01:41:25.905475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1420/2733] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:25 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:25.913227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb4aa0e-b1c8-4d18-915c-d650b18b1822", "name": "network-vif-deleted", "tag": "58e9130c-1693-4c7d-9bfb-44ba7976f816"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:25.921248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:25.933017 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f897b529-9d61-4313-913c-1728dc66f564 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.528069 Sep 27 01:41:25.937935 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1314/2734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:25 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:25.948150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:25.948960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:25.960858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.961346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.966366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.971899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.974676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.975840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.979873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:25.980531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:25.984062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:25.996654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.server_external_events [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] Unable to find a host for instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822. Dropping event network-vif-deleted {{(pid=128778) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 27 01:41:26.000977 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9bc597ea-f39d-4577-a67f-63ec0e56e8ca req-16a17a6f-7d5d-499a-8851-2e003e5e8082 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.092593 Sep 27 01:41:26.001985 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1421/2735] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 96 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 27 01:41:26.008978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36c2cf7e-9420-474e-ad79-5b0659945980 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Action: 'update', calling method: .version_select at 0x7f24d64e0d30>, body: {"security_group": {"name": "tempest-sg-hth-1947592762", "description": "tempest-description-hth-1584256748"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:26.521824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:26.544204 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-014a013b-b6c8-453c-9b76-f770d3e369b5 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.597354 Sep 27 01:41:26.568068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1315/2736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:25 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:26.583264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:26.584188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:26.597692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.600500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.601150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.602307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.609857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.610770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.793698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:26.802784 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d084350d-061e-4136-80b7-78ddbb22e140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.232303 Sep 27 01:41:26.816016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1316/2737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:26 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:26.827977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:26.828898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:26.837744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.838563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.839141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.840145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.840733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.841637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.874488 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36c2cf7e-9420-474e-ad79-5b0659945980 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb" status: 200 len: 218 microversion: 2.1 time: 0.871018 Sep 27 01:41:26.883700 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1422/2738] 10.222.0.52 () {60 vars in 1290 bytes} [Tue Sep 27 01:41:26 2022] PUT /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb => generated 218 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:26.891059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b21386-b6d1-44ed-bc13-65ce0811b688", "tag": "c8873b33-5447-4412-a3e6-eb959b162b64"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:26.914750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.917214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.917899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.947275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:26.962384 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91d69210-0c95-4928-8375-bb79c4d7c318 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1267 microversion: 2.1 time: 0.145038 Sep 27 01:41:26.963390 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1317/2739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:26 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:26.972065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:26.974048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:26.986696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.990939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.993731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:26.994911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] Creating event network-changed:c8873b33-5447-4412-a3e6-eb959b162b64 for instance 31b21386-b6d1-44ed-bc13-65ce0811b688 on n-h1-859358-1 Sep 27 01:41:26.995381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:26.996008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:26.998552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.004287 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7b46a0b6-206f-4f5c-835f-6de2e490a789 req-1e7d26e7-5dca-4181-a722-c0f94904d771 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118954 Sep 27 01:41:27.013806 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1423/2740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:27.023158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-727b5a13-5287-4399-b290-e314c69db7eb tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d624d670>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:27.090750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:27.099754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5cc53d3-4aef-490e-9412-f52b63238eef tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 200 len: 1183 microversion: 2.1 time: 0.135055 Sep 27 01:41:27.106567 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1318/2741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:26 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 1183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:27.118672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:27.119334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:27.129963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.130455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.130895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.131734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.132481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.132678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.347135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:27.372298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:27.374098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:27.375467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fbffe7b-30b6-4a4f-ba05-98c5c54ea2b0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.267840 Sep 27 01:41:27.376547 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1319/2742] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:27 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:27.381372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:27.382154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:27.389297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.390236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.390503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.391357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.391972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.393330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.674267 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-727b5a13-5287-4399-b290-e314c69db7eb tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb" status: 200 len: 218 microversion: 2.1 time: 0.653197 Sep 27 01:41:27.678364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1424/2743] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:41:27 2022] GET /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb => generated 218 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:27.684368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:27.685803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:27.707388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.714482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.715664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:27.717500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:27.718189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:27.718912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.058363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:28.069751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71b1fcb7-c7e1-498b-bfb0-471c1a8a2c57 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.691972 Sep 27 01:41:28.074035 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1320/2744] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:27 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:28.084584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:28.090884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99e48cb4-e3c3-4fc6-92af-7138c2d9542f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da5ad160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.093028 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-11179440-dbef-4683-b6c1-b383459d3883 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.413350 Sep 27 01:41:28.093993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1425/2745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:27 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:28.111223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.111223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.111223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.111223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.111656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.112082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.112538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.112960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.306701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:28.327288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e77c782-951e-415b-8fce-439b6cb2081d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.231949 Sep 27 01:41:28.328835 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1426/2746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:28 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:28.340340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.346051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.367364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.368320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.371144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.374972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.376982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.377695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.426614 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99e48cb4-e3c3-4fc6-92af-7138c2d9542f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb" status: 202 len: 0 microversion: 2.1 time: 0.351014 Sep 27 01:41:28.427841 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1321/2747] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:28 2022] DELETE /compute/v2.1/os-security-groups/1002556b-cd8d-4a5e-8b6a-58462f75b7bb => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:28.434879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edff8600-ad03-4bf0-8b26-282bbe83f047", "tag": "c3a413fb-738b-4a34-83c0-1ee3fdddabf6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:28.463576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:28.467854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.474256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.476545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.550193 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] Creating event network-changed:c3a413fb-738b-4a34-83c0-1ee3fdddabf6 for instance edff8600-ad03-4bf0-8b26-282bbe83f047 on n-h2-859358-1 Sep 27 01:41:28.574159 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a3d7c506-096f-4fbc-9de7-56703063bc87 req-bfe1eaba-447c-4411-8f79-f116e97fd0e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144769 Sep 27 01:41:28.580978 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1322/2748] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:28.608430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.608430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 48a30166-865c-427a-94ff-8b85ea13b756] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.626796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:28.632475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.646315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.647119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.649074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.649743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.655592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.656394 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-58d0bec0-6278-4a30-81ac-7283974d2a9c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1267 microversion: 2.1 time: 0.321963 Sep 27 01:41:28.663307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1427/2749] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:28 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:28.670852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.677117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.700019 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] HTTP exception thrown: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Request method failure captured: Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 HTTP/1.1 Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLGn0PpBu99ZvdFqW-rq-iVRQlEadZVfrB3vXKaPVfoDTNL4QIEOTn45lwpG20nilKoU1Gm6uJc6FEex-oxrmwMX_zjjyBEFbmQJ6BeoRNr_g1x1n3raHxEmhdXjs_JXuw0UT1XUYL_JE0fQoWfwVpL77ePzlvWHr5IlLV9KUlEDGI Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:28.702930 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_115fecd0e9f34141a8630f6a0b76864e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationTest-725739650 Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 56e5b4943e3c4d31aec5dd4dc2ecac66 Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. Sep 27 01:41:28.704275 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48a30166-865c-427a-94ff-8b85ea13b756'} Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:28.704943 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. Sep 27 01:41:28.706264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.709581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Returning 404 to user: Instance 48a30166-865c-427a-94ff-8b85ea13b756 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:28.710733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a1cbb46-b78a-4e0a-b589-db5a63866339 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756" status: 404 len: 111 microversion: 2.1 time: 0.128398 Sep 27 01:41:28.711450 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1323/2750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:28 2022] GET /compute/v2.1/servers/48a30166-865c-427a-94ff-8b85ea13b756 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:28.723582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.724400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.732451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.733201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.733788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.734447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.734952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.735384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.753160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.755267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.756720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.758815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.760591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.762386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.834883 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 HTTP/1.1 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:28.836878 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:28.838697 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0cce6ff3-eaf0-4f8f-b671-5b4430d19339'} Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:28.839480 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:28.840706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:28.844264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:28.853874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e69eb68a-464a-4f60-a19f-49818eda1c24 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 404 len: 111 microversion: 2.1 time: 0.138030 Sep 27 01:41:28.855981 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1324/2751] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:28 2022] DELETE /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:28.878662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:28.879512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: 0cce6ff3-eaf0-4f8f-b671-5b4430d19339] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:28.919591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.923450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.930985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:28.934081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:28.935376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:28.939085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.014257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 HTTP/1.1 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:29.018566 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:29.019989 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0cce6ff3-eaf0-4f8f-b671-5b4430d19339'} Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.020734 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. Sep 27 01:41:29.021838 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.027325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Instance 0cce6ff3-eaf0-4f8f-b671-5b4430d19339 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.032511 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d774abf7-729a-47d0-b338-ffdd4aa304ec tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339" status: 404 len: 111 microversion: 2.1 time: 0.171775 Sep 27 01:41:29.035206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1325/2752] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:28 2022] GET /compute/v2.1/servers/0cce6ff3-eaf0-4f8f-b671-5b4430d19339 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.048864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da56cc10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.152257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.162406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.163911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.165177 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-992916aa-a614-4d40-b918-2a45affd6e48 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.499713 Sep 27 01:41:29.166686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1428/2753] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:28 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:29.171445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.172065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:29.178710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.179211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.179641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.180587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.181190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.182438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.361576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.388738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9bb656d4-c442-4d0b-b9a2-3018786de67a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.220962 Sep 27 01:41:29.398202 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1429/2754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:29 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:29.412320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.413505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:29.421308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.422130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.422754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.423739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.424512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.425116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.595058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.595797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.596699 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.596699 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.598850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122 HTTP/1.1 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:29.599847 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.601060 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6cf0b83c-aa86-4df6-810b-d4a8e619b122'} Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.602843 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.604497 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.605550 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] Sep 27 01:41:29.606702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.608783 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7bd31b99-ece7-4c79-905d-1f799db2036f tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.209105 Sep 27 01:41:29.611335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group 6cf0b83c-aa86-4df6-810b-d4a8e619b122 does not exist Sep 27 01:41:29.611335 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-21e09ca2-23d8-4502-a417-18eac9d59a60'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.612700 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9016c3e3-fa34-48ac-a730-e0e96746c53e tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122" status: 404 len: 194 microversion: 2.1 time: 0.575006 Sep 27 01:41:29.617006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1326/2755] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/6cf0b83c-aa86-4df6-810b-d4a8e619b122 => generated 194 bytes in 580 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.623094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1430/2756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:29 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:29.628163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d7c474c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.636345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.636345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:29.660445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.660445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.660445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.660445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.660974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.664069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.675461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:29.680779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.681921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group 92ec2306-411b-425a-be6f-98f07cd1f869 not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.682663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.682663 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869 HTTP/1.1 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:29.684731 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.686441 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '92ec2306-411b-425a-be6f-98f07cd1f869'} Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.687412 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.688591 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.689939 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] Sep 27 01:41:29.691045 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.692577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group 92ec2306-411b-425a-be6f-98f07cd1f869 does not exist Sep 27 01:41:29.692577 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-2f95416a-9e51-402c-a003-579bedc6cdfb'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.693481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9b1a8d8-affb-4368-b5ef-51ce5081c0b0 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869" status: 404 len: 194 microversion: 2.1 time: 0.069106 Sep 27 01:41:29.694197 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1431/2757] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/92ec2306-411b-425a-be6f-98f07cd1f869 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.700507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.701400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:29.709393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.710256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.711019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.712102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.713653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.714306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.736461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:29.794472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:29.806198 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae8eaa53-dbd2-4fbd-9459-a34e92733da9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1273 microversion: 2.1 time: 0.110704 Sep 27 01:41:29.808809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1432/2758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:29 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:29.813851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d67dfc10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group a1c16992-9b97-458d-9cc7-750fc0382c4e not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e HTTP/1.1 Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.849650 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.850522 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a1c16992-9b97-458d-9cc7-750fc0382c4e'} Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.851515 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.852560 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.855803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group a1c16992-9b97-458d-9cc7-750fc0382c4e does not exist Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ff57b2ff-f08e-45fd-8d97-4dfbc566b113'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.856929 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee47993f-a8f8-4e3f-9aca-8528936bd41b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e" status: 404 len: 194 microversion: 2.1 time: 0.035347 Sep 27 01:41:29.857741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1433/2759] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/a1c16992-9b97-458d-9cc7-750fc0382c4e => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.857741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d65194c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.882289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.882885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group cd3e45f8-ea11-4150-8a16-21b745dc12cb not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.883399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.883399 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb HTTP/1.1 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:29.887159 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.888630 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'cd3e45f8-ea11-4150-8a16-21b745dc12cb'} Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.889528 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.890838 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.892115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group cd3e45f8-ea11-4150-8a16-21b745dc12cb does not exist Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-aa540393-b0e1-4495-b6ac-158fd799c020'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b71746df-ac68-477d-a174-45661d96afea tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb" status: 404 len: 194 microversion: 2.1 time: 0.038313 Sep 27 01:41:29.893464 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1434/2760] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/cd3e45f8-ea11-4150-8a16-21b745dc12cb => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.897476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d6732ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.922968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.923584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group da89878e-2c47-431a-8dd0-f17839ebb76f not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.924072 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.924072 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f HTTP/1.1 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:29.926508 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.928001 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'da89878e-2c47-431a-8dd0-f17839ebb76f'} Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.928883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.930120 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.931431 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group da89878e-2c47-431a-8dd0-f17839ebb76f does not exist Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-65fea5a0-5adb-4719-8c2f-dacd57ec4483'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b36ad8cb-e380-416f-89d7-a88b949fee74 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f" status: 404 len: 194 microversion: 2.1 time: 0.034502 Sep 27 01:41:29.932886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1435/2761] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/da89878e-2c47-431a-8dd0-f17839ebb76f => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.938604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d67fb700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.966757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:41:29.967416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Neutron security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:41:29.968955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.968955 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db HTTP/1.1 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:29.971022 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.972498 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db'} Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.973396 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.974705 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:29.976092 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Security group bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db does not exist Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-ebfaee7a-349a-4a5d-b113-16403a2958a4'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-989b9999-179a-4a3e-b533-fd18f6121b8b tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db" status: 404 len: 194 microversion: 2.1 time: 0.039429 Sep 27 01:41:29.977711 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1436/2762] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/os-security-groups/bc8fa217-feb3-4c6a-bcd2-80a4cbbda9db => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:29.983446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:29.983940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:29.991678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.992293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.992734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:29.993499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:29.994096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:29.995203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.027196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:30.136071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:30.145775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-695e4ac3-253a-4199-8180-09ea6a9896ed tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 204 len: 0 microversion: 2.1 time: 0.166214 Sep 27 01:41:30.146998 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1437/2763] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:29 2022] DELETE /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:30.163365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.170888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:30.172736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:30.178657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a8489ba-ae69-433f-8f15-ebed5c3ca323 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.560179 Sep 27 01:41:30.179721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1327/2764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:29 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:30.185721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.186480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.187084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.188894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.189649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.190275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.201321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:30.202150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:30.217597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.220753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.221332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.222219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.225432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.228980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.472611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.487549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.491433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.495587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed411c96-ad9f-4026-b7ce-1ff4858f960b tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.298992 Sep 27 01:41:30.500475 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1328/2765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:30 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:41:30.509195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:30.510260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:30.511682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.518454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.519283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.519982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.520958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.521687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.522349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.527348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc364a16-55ba-480d-9eda-e3c17711814a tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1646 microversion: 2.1 time: 0.363845 Sep 27 01:41:30.539850 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1438/2766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:30 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1646 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:30.646032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:30.646956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:30.661187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.662402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.667408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.670315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:30.671064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:30.673190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:30.964633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:30.989580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da4cfe5a-6389-47e3-8a7b-7519e0f44816 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.348773 Sep 27 01:41:31.002223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1439/2767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:30 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:41:31.021705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:31.022348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:31.033587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.034130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.041903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.047487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.048200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.048952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.073713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.082678 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97d501ef-1aa1-49ef-97de-bfc3e0e52b94 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.580741 Sep 27 01:41:31.091922 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1329/2768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:30 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:31.210289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:31.210902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:31.223941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.224544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.225176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.226852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.227473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.229691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.251094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.263301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f6f4c27-725c-490d-8bd1-a312a338fd24 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1273 microversion: 2.1 time: 0.259800 Sep 27 01:41:31.267994 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1440/2769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:31 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:31.534833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:31.535448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:31.549053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.549587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.550028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.550742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.551198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.551623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.793897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.814860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.820133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.824010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08d8c575-163b-4911-a4fa-28a12c46b72e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.293570 Sep 27 01:41:31.827155 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1441/2770] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:31 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:41:31.837010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:31.840209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:31.854209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.855465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.856566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.858499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:31.860632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:31.861807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:31.987552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:31.999941 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-379f49bd-c7ca-4147-9c48-840ed08a0c03 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.793486 Sep 27 01:41:32.003281 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1330/2771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:31 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:41:32.024059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:32.025654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:32.032954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.033882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.034467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.035409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.036041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.036616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.231693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:32.242568 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a1c1f5c-131d-4049-b00d-19b51b7f13a3 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1646 microversion: 2.1 time: 0.412027 Sep 27 01:41:32.254333 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1442/2772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:31 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1646 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:32.260161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:32.270552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:32.278963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.279645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.280395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.281278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.282160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.282802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.503110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:32.513929 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97f4717f-ba73-4662-9a70-4846b4fbd31e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.257756 Sep 27 01:41:32.534914 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1443/2773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:32 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:32.547860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:32.554816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:32.594413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.596631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.599408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.601849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.603090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.607337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.734862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:32.745084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8f1bf8f-22cc-4e6d-8599-fa43d65d7c7e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.725448 Sep 27 01:41:32.774731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1331/2774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:32 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:32.795548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b21386-b6d1-44ed-bc13-65ce0811b688", "name": "network-vif-plugged", "status": "completed", "tag": "c8873b33-5447-4412-a3e6-eb959b162b64"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:32.841232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.841751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.842189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.897304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] Creating event network-vif-plugged:c8873b33-5447-4412-a3e6-eb959b162b64 for instance 31b21386-b6d1-44ed-bc13-65ce0811b688 on n-h1-859358-1 Sep 27 01:41:32.912567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ab07ad9f-9a8c-4ca1-888b-05271e054f8a req-e610e326-f771-4831-ad14-6c3b45c28298 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134393 Sep 27 01:41:32.928956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1332/2775] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:32.951295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:32.955310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:32.965039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.965887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.966512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:32.967403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:32.968032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:32.968640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.276747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:33.290162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9281615-570a-4bcb-a39d-84107bda67af tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.751544 Sep 27 01:41:33.290162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1444/2776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:32 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:33.301456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:33.302083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:33.324044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.324845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.325526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.326431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.327072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.327679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.617895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:33.627527 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2752109a-3fd9-4f7e-8200-7f22993b910b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.336870 Sep 27 01:41:33.628304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:33.651039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:33.651039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:33.651717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0249a595-c335-4f71-afae-91bb4a55609e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.721331 Sep 27 01:41:33.651870 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1445/2777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:33 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:33.654789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1333/2778] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:32 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:33.670910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:33.674442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:33.675152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:33.675555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:33.692329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.692932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.693480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.694271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.694800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.695300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.698467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.698984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.699412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:33.700122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:33.700583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:33.701016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.250146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:34.268462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b8f8f66-f769-441b-9d99-92a5caed7f72 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1646 microversion: 2.1 time: 0.614146 Sep 27 01:41:34.271464 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1446/2779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:33 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1646 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:34.310905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:34.312825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:34.328927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.332324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.332932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.334131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.340066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.341572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.440305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:34.456004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28c19c99-9804-4f1e-b2fc-6fa7c7b70d56 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.799998 Sep 27 01:41:34.481430 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1334/2780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:33 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:34.488131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833a2d0e-8a39-4f1c-966e-958c9c1bc1f2", "tag": "493dd02a-6b23-40e9-813f-73cd1dcbad57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:34.569065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.585762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.589149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.621303 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] Creating event network-changed:493dd02a-6b23-40e9-813f-73cd1dcbad57 for instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 on n-h1-859358-1 Sep 27 01:41:34.652381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ad034a56-8a36-4fdd-bf7c-9239baa2c72e req-ae73ff11-5606-42f6-a393-84623a7aafe0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168972 Sep 27 01:41:34.660173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1335/2781] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:34.667870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:34.668794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:34.701884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.702407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.706847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.707642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.708125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.709426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.842802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:34.852438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b83dadec-f7b3-4f8e-9e92-44774d2911db tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1318 microversion: 2.1 time: 0.557813 Sep 27 01:41:34.868426 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1447/2782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:34 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:34.887824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:34.888448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:34.909493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.910015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.922506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:34.923448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:34.924119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:34.924602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.206799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:35.255645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:35.311342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.322810 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-865d166b-1fee-42ad-8f1e-0ae60afaff05 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.442884 Sep 27 01:41:35.324959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1448/2783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:34 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:35.336906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:35.337214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:35.354835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.355415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.357119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.358773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.361055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.361554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.548729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.562474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.566257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b49c1dcc-0a47-41bc-9f41-a80caeb4c2d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.895889 Sep 27 01:41:35.571693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.573198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.585360 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1336/2784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:34 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:35.585542 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-595bd16d-90f5-4104-84e9-408baee50392 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1486 microversion: 2.25 time: 0.252196 Sep 27 01:41:35.585635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:35.585635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:35.585816 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1449/2785] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:35 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1486 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:35.592613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:35.593179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:35.596198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.596688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.597129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.597878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.598337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.600541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.609311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.609838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.610283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.610999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.611462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.611896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.687914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.688424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.688898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.699886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lazy-loading 'fault' on Instance uuid cf99c02d-d224-48c0-bca7-f91e06057847 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:35.813174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1b39472acb645cdb988150af70b4883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1706ba087bc4e2baadb344bfbbf3772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.832286 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-588289dc-4981-4c8c-b00b-3f50f3524517 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 200 len: 1305 microversion: 2.1 time: 0.256926 Sep 27 01:41:35.832873 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1337/2786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:35 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 1305 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:35.893197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:35.894047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:35.907744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.909545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.910548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.914328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:35.915078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:35.916572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:35.934579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:35.943581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb90bdf0-40a4-44cd-89ec-60d22b222ae1 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.358917 Sep 27 01:41:35.948242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1450/2787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:35 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:36.132607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:36.154056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f92f7cb-c57d-4849-a270-70f8c4a6180a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1509 microversion: 2.1 time: 0.255807 Sep 27 01:41:36.154643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1338/2788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:35 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:41:36.180810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:36.182470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:36.190277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.190948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.191480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.193673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.194220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.201037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.255238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:36.350990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:36.351621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:36.365751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.366274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.369942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.374566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.375074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.375525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.445027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:36.484041 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41624193-cc3f-4514-bf56-6ce740725c43 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1509 microversion: 2.1 time: 0.307176 Sep 27 01:41:36.501922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1451/2789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:36 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:36.501922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff8600-ad03-4bf0-8b26-282bbe83f047", "name": "network-vif-plugged", "status": "completed", "tag": "c3a413fb-738b-4a34-83c0-1ee3fdddabf6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:36.532074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.532851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.533657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.549730 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] Creating event network-vif-plugged:c3a413fb-738b-4a34-83c0-1ee3fdddabf6 for instance edff8600-ad03-4bf0-8b26-282bbe83f047 on n-h2-859358-1 Sep 27 01:41:36.556923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f120e28f-0a9b-4536-acce-95ddd4dcf824 req-6d938567-84fd-45d1-9bb0-98962734b188 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060601 Sep 27 01:41:36.558066 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1452/2790] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:36.571183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:36.592008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:36.609845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.610338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.610775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.611494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.611949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.612368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.749935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:36.764538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f6b411e-b9d7-4993-8d79-1a34e617f140 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1307 microversion: 2.1 time: 0.418385 Sep 27 01:41:36.766290 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1339/2791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:36 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:36.767294 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f4ec5f7-08bf-48c9-8de3-3032b133c528 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "PUT /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1081 microversion: 2.1 time: 0.201309 Sep 27 01:41:36.773581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:36.778045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:36.798203 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1453/2792] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:41:36 2022] PUT /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1081 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:36.807062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.812108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:36.812962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:36.813073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.813678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.814425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.814886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.815313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.822309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.823112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.823757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:36.827272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:36.827610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:36.828051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.090180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.104959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.106942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.110568 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a63efae-96f1-475b-a218-dc2d7159a352 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1476 microversion: 2.25 time: 0.311249 Sep 27 01:41:37.125363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1454/2793] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:36 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:37.125363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf99c02d-d224-48c0-bca7-f91e06057847", "name": "network-vif-deleted", "tag": "19a71e1e-31a9-4f1b-a22d-94a02d5ec36a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:37.136133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.136133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.136133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.148936 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] Creating event network-vif-deleted:19a71e1e-31a9-4f1b-a22d-94a02d5ec36a for instance cf99c02d-d224-48c0-bca7-f91e06057847 on n-h2-859358-1 Sep 27 01:41:37.160919 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0c2c1f54-a608-4781-ace4-3202d97b990d req-a4712d93-1d2a-481e-944b-c9113ec2675a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045307 Sep 27 01:41:37.162542 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1455/2794] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:37.169938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.170642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.188334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.191169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.191642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.195180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.195555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.196008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.276051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.289600 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f911acfb-b18e-4526-b5b0-c22f78c35fc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.521143 Sep 27 01:41:37.290385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1340/2795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:36 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:37.326136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.326639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.350326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.352360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.352815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.358430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.358921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.359452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.456193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:37.608497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.618624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecbf765a-9357-4399-a8fe-a1936792267d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1507 microversion: 2.1 time: 0.453333 Sep 27 01:41:37.619472 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1456/2796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:37.641544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.650708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] [instance: cf99c02d-d224-48c0-bca7-f91e06057847] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.663998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00432efe-2741-438a-b41e-a2b70f7056b9 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 204 len: 0 microversion: 2.1 time: 0.352990 Sep 27 01:41:37.665212 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1341/2797] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:37 2022] DELETE /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:37.673242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.674092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.674312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.674775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.675293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.676031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.676491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.676930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.683034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.683795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.684232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.685091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.685613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.686105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.698124 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] HTTP exception thrown: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Request method failure captured: Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 HTTP/1.1 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlRPXP83nFMkX8hMWbSR3pg3TMGakwq3v5Of4IGkbFtZwkoZ48jV4YzBr7GEPwP9cVGPDzRYxHYRATlg7b40tWDMJvLEBbQoKToWLLKYqa5ZFivCSIEQ4vgYnRlGyo1ZXy01A09oM7P1fenIYZUDbBv0FcI3KhMw43yLufg5twe6QZ4 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:37.700919 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d1706ba087bc4e2baadb344bfbbf3772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d1706ba087bc4e2baadb344bfbbf3772", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: d1706ba087bc4e2baadb344bfbbf3772 Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-246903486 Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c1b39472acb645cdb988150af70b4883 Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsTestJSON-246903486-project Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. Sep 27 01:41:37.702164 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'cf99c02d-d224-48c0-bca7-f91e06057847'} Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:37.702884 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. Sep 27 01:41:37.703943 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:37.706611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Returning 404 to user: Instance cf99c02d-d224-48c0-bca7-f91e06057847 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:37.707736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-402e55eb-e207-465d-bc54-6ea96c74259f tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847" status: 404 len: 111 microversion: 2.1 time: 0.078598 Sep 27 01:41:37.708540 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1457/2798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/servers/cf99c02d-d224-48c0-bca7-f91e06057847 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:37.714606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-084b2d9d-a8b9-484d-a925-b5dc8a8046f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '.version_select at 0x7f24d629c430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.718707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084b2d9d-a8b9-484d-a925-b5dc8a8046f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.719880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084b2d9d-a8b9-484d-a925-b5dc8a8046f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.720550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084b2d9d-a8b9-484d-a925-b5dc8a8046f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.744243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-084b2d9d-a8b9-484d-a925-b5dc8a8046f2 tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3203 microversion: 2.25 time: 0.033695 Sep 27 01:41:37.745097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1458/2799] 10.222.0.52 () {60 vars in 1184 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/os-migrations => generated 3203 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:37.749691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.750297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.756412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.756894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.757325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.758173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.758626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.759093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.932764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:37.943717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eda0d82d-4d9f-40f1-a41d-b07e65707e97 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1507 microversion: 2.1 time: 0.197494 Sep 27 01:41:37.944812 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1459/2800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:37.950208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:37.951001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:37.957457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.958100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.958543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:37.959318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:37.959780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:37.960209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.007220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:38.019741 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4957182-2f36-42d6-b56f-114aca9f0884 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.351996 Sep 27 01:41:38.037877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1342/2801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:38.044577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ce7c66b-270e-4ed5-834a-309f49fd3b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24da5cbf70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:38.217643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:38.240133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b9ffc8fc-6082-472d-bf57-8d42afe0580e tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1670 microversion: 2.1 time: 0.294147 Sep 27 01:41:38.243491 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1460/2802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:37 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1670 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:38.248587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:38.249200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:38.269883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.270389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.270914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.273027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.273764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.274713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.501274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ce7c66b-270e-4ed5-834a-309f49fd3b11 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/eb00ad7e-43c8-43d9-bc81-08fd5f5593d5" status: 202 len: 0 microversion: 2.1 time: 0.461817 Sep 27 01:41:38.502893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1343/2803] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:38 2022] DELETE /compute/v2.1/os-security-groups/eb00ad7e-43c8-43d9-bc81-08fd5f5593d5 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:38.515772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:38.516628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:38.545936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] Lazy-loading 'services' on Instance uuid 48db1246-5da2-415d-bc56-b16f43b5e1d8 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:38.567542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.569681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.570308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.572580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.575146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9975779-8eb4-4b79-b27e-cf853f782cab tempest-LiveAutoBlockMigrationV225Test-2107491105 tempest-LiveAutoBlockMigrationV225Test-2107491105-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1968 microversion: 2.25 time: 0.329979 Sep 27 01:41:38.578999 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1461/2804] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:38 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1968 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:38.586358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.588322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.590806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:38.598064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:38.615638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.617371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.621166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.622369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.622929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.623439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.655694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:38.795256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f1813ec-9a27-47ac-a33d-73c63a5f2e6b tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "PUT /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1083 microversion: 2.1 time: 0.214267 Sep 27 01:41:38.799867 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1462/2805] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:41:38 2022] PUT /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1083 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:38.809410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:38.820850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:38.838775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.839595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.840722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:38.841637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:38.842241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:38.845421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.057668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:39.067271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-972a7f50-5c11-447b-bffc-6630f425c84b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.265861 Sep 27 01:41:39.081363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1463/2806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:38 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:39.081363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de0056db-5753-4b67-9031-10a0f1476d87 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] Calling method '.version_select at 0x7f24d629cf70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:39.324083 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de0056db-5753-4b67-9031-10a0f1476d87 tempest-SecurityGroupsTestJSON-246903486 tempest-SecurityGroupsTestJSON-246903486-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/3b0b3e17-82fe-45bd-9a5c-52347bfd4477" status: 202 len: 0 microversion: 2.1 time: 0.253500 Sep 27 01:41:39.328722 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1464/2807] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:41:39 2022] DELETE /compute/v2.1/os-security-groups/3b0b3e17-82fe-45bd-9a5c-52347bfd4477 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:39.334517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:39.335120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:39.350938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.353561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.353561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.353561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.353561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.358290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.407295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:39.420580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:39.423489 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2da358fa-bef8-49e5-bded-b15f9d7b0ceb tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1486 microversion: 2.1 time: 0.919423 Sep 27 01:41:39.424651 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1344/2808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:38 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1486 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:39.438623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:39.439576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:39.459092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.459926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.466373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.472618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.473519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.475762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.566518 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7292b74-1f30-4792-9ce2-35435ce7e5b4 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 204 len: 0 microversion: 2.25 time: 0.235461 Sep 27 01:41:39.567292 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1465/2809] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:41:39 2022] DELETE /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:41:39.580708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:39.585254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:39.596131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.596548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.596987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.597737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:39.598197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:39.600897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:39.998153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:40.018955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b81ae4e-fd0f-41d3-8bd2-4e927586aa2a tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.446534 Sep 27 01:41:40.019540 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1466/2810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:39 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:40.026512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:40.047927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:40.048546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:40.055874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.056403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.056850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.057598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.058050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.058478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.067111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13a0aad8-91ae-4df9-894c-a91fb46823bf tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1509 microversion: 2.1 time: 0.638217 Sep 27 01:41:40.082156 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1345/2811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:39 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:40.100228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1815269848"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:40.110497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:40.122086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.123157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.127837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.129763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.133430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.134210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.388222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:40.407546 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-235390fa-8130-4900-b8a4-f2802c666690 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 200 len: 1602 microversion: 2.1 time: 0.363647 Sep 27 01:41:40.411611 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1467/2812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:40 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 1602 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:40.435287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:40.436477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:40.472899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.473900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.474358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.475455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.475975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.477454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.544368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:40.767548 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47f38fec-4db6-47fc-9011-0fb144c1b7c0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "POST /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047/action" status: 202 len: 0 microversion: 2.1 time: 0.683551 Sep 27 01:41:40.771639 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1346/2813] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:41:40 2022] POST /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 01:41:40.786659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:40.787762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:40.802679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.808145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.809389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:40.812185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:40.816614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:40.817814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.158870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.189853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a41ca99b-72a2-44c2-afce-38896eece8f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.416631 Sep 27 01:41:41.193038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1347/2814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:40 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:41.204543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.205371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:41.212822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.213622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.214225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.215089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.215729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.216496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.440078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.452800 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04fa04a8-750e-47c6-80d7-b6f1f9e8c4f9 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1509 microversion: 2.1 time: 0.257165 Sep 27 01:41:41.453714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1348/2815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:41 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:41.458340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b400664e-737e-4b04-9697-ca1eb3fb4250", "name": "network-vif-deleted", "tag": "a3540e21-41ce-4e4b-bdaf-22cb289ee799"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:41.473479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.473955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.475102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.489509 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] Creating event network-vif-deleted:a3540e21-41ce-4e4b-bdaf-22cb289ee799 for instance b400664e-737e-4b04-9697-ca1eb3fb4250 on n-h1-859358-1 Sep 27 01:41:41.496408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b704dd74-ffca-4575-a332-bbf40536aac0 req-9c97fbe6-3250-4a0c-af91-4609480880c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041432 Sep 27 01:41:41.497021 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1349/2816] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:41.507088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc22872f-0302-4ad6-b721-42a4eeab6890 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da57ce50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.576730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc22872f-0302-4ad6-b721-42a4eeab6890 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93" status: 200 len: 1412 microversion: 2.1 time: 0.074351 Sep 27 01:41:41.590045 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1350/2817] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:41 2022] GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:41.596246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.597126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:41.608983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.611267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.611907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.612742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.613322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.613893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.683088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.694019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.696320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.698309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd9608d8-a11f-438d-ab42-969a4893ac86 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1482 microversion: 2.25 time: 1.285615 Sep 27 01:41:41.714199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1468/2818] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:40 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1482 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:41.722544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.723408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: b400664e-737e-4b04-9697-ca1eb3fb4250] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:41.730390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.731193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.731794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.732724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.734124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.734797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.770978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] HTTP exception thrown: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Request method failure captured: Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 HTTP/1.1 Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlLGn0PpBu99ZvdFqW-rq-iVRQlEadZVfrB3vXKaPVfoDTNL4QIEOTn45lwpG20nilKoU1Gm6uJc6FEex-oxrmwMX_zjjyBEFbmQJ6BeoRNr_g1x1n3raHxEmhdXjs_JXuw0UT1XUYL_JE0fQoWfwVpL77ePzlvWHr5IlLV9KUlEDGI Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:41.777295 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_115fecd0e9f34141a8630f6a0b76864e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-LiveMigrationTest-725739650 Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 56e5b4943e3c4d31aec5dd4dc2ecac66 Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. Sep 27 01:41:41.778878 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b400664e-737e-4b04-9697-ca1eb3fb4250'} Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:41.779728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. Sep 27 01:41:41.780866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:41.783801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Returning 404 to user: Instance b400664e-737e-4b04-9697-ca1eb3fb4250 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:41.787034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbc3559a-2d29-4a13-8890-08d0e24ff9b5 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250" status: 404 len: 111 microversion: 2.1 time: 0.071487 Sep 27 01:41:41.791877 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1469/2819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:41 2022] GET /compute/v2.1/servers/b400664e-737e-4b04-9697-ca1eb3fb4250 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:41.806534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.808025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:41.818173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:41.822953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.823702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.824345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.829474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:41.830019 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d385ce5-ac39-460b-9e0d-87dc95cdaa72 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.238223 Sep 27 01:41:41.830484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:41.845216 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1351/2820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:41 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:41.845216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df9300fa-5cc2-4a8d-ace0-a637fe3077fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da57dd30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.846298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:41.903147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df9300fa-5cc2-4a8d-ace0-a637fe3077fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93" status: 200 len: 1412 microversion: 2.1 time: 0.070753 Sep 27 01:41:41.906815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:41.914553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1352/2821] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:41 2022] GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:41.920145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f05e2ae9-221d-4fda-a8dd-5f80b152d1b1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '.version_select at 0x7f24da5f8700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:41.971254 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f05e2ae9-221d-4fda-a8dd-5f80b152d1b1 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799841155" status: 202 len: 0 microversion: 2.1 time: 0.055546 Sep 27 01:41:41.972465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1353/2822] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:41:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799841155 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:41.978435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-471b142b-92fe-4a96-befb-7ae8d502f9af tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da56c700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.059769 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e17c9516-1110-4820-a816-37f06fb93f2a tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 204 len: 0 microversion: 2.1 time: 0.266164 Sep 27 01:41:42.078166 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1470/2823] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:41 2022] DELETE /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:42.089001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.092743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:42.108958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.110469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.112707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.113747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.115113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.117459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.187132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:42.268202 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-471b142b-92fe-4a96-befb-7ae8d502f9af tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93" status: 204 len: 0 microversion: 2.1 time: 0.294300 Sep 27 01:41:42.272618 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1354/2824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:41 2022] DELETE /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:42.279284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.280087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:42.299603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.303932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.304560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.307813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.310093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.310093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.341187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Instance is already in deleting state, ignoring this request Sep 27 01:41:42.342148 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4769cf3d-b79d-4ad6-b285-f756c58f10aa tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 204 len: 0 microversion: 2.1 time: 0.262421 Sep 27 01:41:42.351085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1471/2825] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:42 2022] DELETE /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:42.360438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e88a528a-3503-411d-9007-2392f6464fb0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d64e0820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.416357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e88a528a-3503-411d-9007-2392f6464fb0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Image not found. Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e88a528a-3503-411d-9007-2392f6464fb0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 HTTP/1.1 Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:42.418487 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8b891b98-7580-403c-a92b-e5a8daa41a93'} Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:42.419708 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b891b98-7580-403c-a92b-e5a8daa41a93 Sep 27 01:41:42.420666 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:42.421703 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b891b98-7580-403c-a92b-e5a8daa41a93 could not be found. Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:42.423941 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e88a528a-3503-411d-9007-2392f6464fb0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:42.425834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e88a528a-3503-411d-9007-2392f6464fb0 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93" status: 404 len: 62 microversion: 2.1 time: 0.070633 Sep 27 01:41:42.427533 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1472/2826] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:41:42 2022] GET /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:41:42.437180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.438049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:42.463504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.464004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.464442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.465179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.465631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.466055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.756013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:42.769387 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a01a910-9323-4d59-962a-9bdd471a627e tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1515 microversion: 2.1 time: 0.344634 Sep 27 01:41:42.770622 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1473/2827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:42 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1515 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:42.776211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:42.778812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:42.786427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.788316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.789262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:42.790539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:42.791688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:42.792275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.238741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:43.250533 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70e2db61-b142-47a4-8eea-e92c778a17ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.976656 Sep 27 01:41:43.251532 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1355/2828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:42 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:43.269294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48db1246-5da2-415d-bc56-b16f43b5e1d8", "name": "network-vif-deleted", "tag": "f5cb92c3-bc19-45a6-b0e4-2e1f4df54667"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:43.296097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.298868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.299757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.327079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] Creating event network-vif-deleted:f5cb92c3-bc19-45a6-b0e4-2e1f4df54667 for instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 on n-h2-859358-1 Sep 27 01:41:43.336179 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a7a19fbe-3450-4f42-9279-fb5a9d8e33a1 req-e5e50919-4634-47a8-9b11-d9cb5919c77c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083086 Sep 27 01:41:43.337002 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1356/2829] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:43.343234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:43.366709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:43.379669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.380156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.381158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.381293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.381757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.382177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.519722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:43.534526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:43.535972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:43.546272 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d30a188-772c-402e-bdad-1dff2b2f124f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.207390 Sep 27 01:41:43.547318 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1357/2830] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:43 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:43.552583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833a2d0e-8a39-4f1c-966e-958c9c1bc1f2", "name": "network-vif-plugged", "status": "completed", "tag": "493dd02a-6b23-40e9-813f-73cd1dcbad57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:43.572321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.572812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.573240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.606573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] Creating event network-vif-plugged:493dd02a-6b23-40e9-813f-73cd1dcbad57 for instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 on n-h1-859358-1 Sep 27 01:41:43.614395 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e4fb4c89-3c3d-452f-879f-210f4e3f70a2 req-69cacc8c-84a5-48a8-8222-5732cbee5418 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064684 Sep 27 01:41:43.623066 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1358/2831] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:43.630419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:43.631625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:43.639834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.641151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.641915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.642990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.643665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.644487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.930415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:43.941255 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91b391cf-ad7d-41c5-a136-347b66ac846a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1498 microversion: 2.1 time: 1.169582 Sep 27 01:41:43.965041 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1474/2832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:42 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1498 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:43.970006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:43.970628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:43.989254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.990940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.996566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:43.997773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:43.998390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:43.999519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.152756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:44.166118 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7883437-48a1-46b9-bdd9-35368cab8201 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.540749 Sep 27 01:41:44.183112 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1359/2833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:43 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:44.191158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:44.191853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:44.198665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.199128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.199637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.200962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.201553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.202476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.267876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:44.476282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:44.489937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28810257-2af2-4f7b-9c7a-e9b3fb52972d tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1515 microversion: 2.1 time: 0.523208 Sep 27 01:41:44.490573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34c42c38-0adf-453c-959d-b91401d28e9b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 204 len: 0 microversion: 2.1 time: 0.305918 Sep 27 01:41:44.492263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1475/2835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:43 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1515 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:44.509571 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1360/2835] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:44 2022] DELETE /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:44.510697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:44.512936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:44.515292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:44.516009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:44.523099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.523596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.524034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.525413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.526065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.526298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.531201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.536714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.537476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.538684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.539451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.540106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.845835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:44.861392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e3ba7e4-8afc-4528-8c46-5918e6f60cca tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1315 microversion: 2.1 time: 0.367264 Sep 27 01:41:44.862458 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1476/2836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:44 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:44.867521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:44.875483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:44.896448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.901991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.913879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.914808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:44.915388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:44.915978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:44.959882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:44.976344 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0caf385-a698-40b6-ac61-9a1b117dbedc tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1485 microversion: 2.1 time: 0.465273 Sep 27 01:41:44.998204 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1361/2837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:44 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1485 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:45.017836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:45.018490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:45.030431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:45.031995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.034216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.034216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.035470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.039096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.046816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.378510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:45.394769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:45.396216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:45.402610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c59e2e1d-ef53-49a8-baf6-14900516a94d tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.533844 Sep 27 01:41:45.403577 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1477/2838] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:44 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:45.419527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:45.422099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:45.435902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.439911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.440845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.441788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.442390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.443017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.637599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:45.648542 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1685865-0ce4-4f39-a1fe-a9571b63e42d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1504 microversion: 2.1 time: 0.647225 Sep 27 01:41:45.653487 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1362/2839] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:44 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:45.658731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b21386-b6d1-44ed-bc13-65ce0811b688", "name": "network-vif-deleted", "tag": "c8873b33-5447-4412-a3e6-eb959b162b64"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:45.683025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.687039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.687683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.716540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] Creating event network-vif-deleted:c8873b33-5447-4412-a3e6-eb959b162b64 for instance 31b21386-b6d1-44ed-bc13-65ce0811b688 on n-h1-859358-1 Sep 27 01:41:45.731820 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-96945d48-06ab-41e8-a229-59afef5bf42f req-4e3cc39c-b925-4fc8-b66a-a5fad55f996f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070955 Sep 27 01:41:45.732794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1363/2840] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:45.738134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:45.738839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:45.756336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.756824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.757255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.757980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.758429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.758848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.800995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:45.845159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.849729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.850541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:45.851155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lazy-loading 'fault' on Instance uuid 31b21386-b6d1-44ed-bc13-65ce0811b688 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:45.914779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7cf1bdbba44c2e939151843c9ac187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d12d962a14080b756c1a57d723bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:45.923849 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41c2f154-6aa1-4aea-81b5-7bd5cf2f0e47 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 200 len: 1308 microversion: 2.1 time: 0.189668 Sep 27 01:41:45.924937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1364/2841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:45 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:45.933288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:45.937653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:45.998436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:45.998938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:45.999380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.000092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.013638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.014495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.215536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.247723 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0472e8cc-d175-435f-ad24-78fba0bc832e tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.822233 Sep 27 01:41:46.265889 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1478/2842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:45 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:46.278402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:46.279633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:46.288707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.289687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.290458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.291499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.292169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.292843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.297773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.323292 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9f3dbc8-df8c-41c2-8db6-dbea21f064b7 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1502 microversion: 2.1 time: 0.386028 Sep 27 01:41:46.326658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1365/2843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:45 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:46.352469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:46.366123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.385299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.386080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.479833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:41:46.596531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cec4ac2-eff0-4e3e-99da-31b0fa135e48 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.248930 Sep 27 01:41:46.597091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1366/2844] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:41:46 2022] POST /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:41:46.599419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.611194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:46.613558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:46.629679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.632948 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b47d761f-0d9c-4311-939b-7b46949118d6 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 200 len: 1443 microversion: 2.1 time: 0.364530 Sep 27 01:41:46.633461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.634000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.635512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.636197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.637428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.644179 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1479/2845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:46 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 1443 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:46.674143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff8600-ad03-4bf0-8b26-282bbe83f047", "name": "network-vif-plugged", "status": "completed", "tag": "c3a413fb-738b-4a34-83c0-1ee3fdddabf6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:46.706642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.707689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.708338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.726395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] Creating event network-vif-plugged:c3a413fb-738b-4a34-83c0-1ee3fdddabf6 for instance edff8600-ad03-4bf0-8b26-282bbe83f047 on n-h2-859358-1 Sep 27 01:41:46.734591 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6761701a-91e6-48cc-bacd-5e44dc86a0a2 req-a3a87b50-eec5-41f8-9ce4-9b2778e82467 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088692 Sep 27 01:41:46.742475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1480/2846] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:46.780669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:46.797571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:46.816703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.824311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.828424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.828982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.832019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.832767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.835176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.837603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.840259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:46.841494 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6a236b7-f78f-4e16-b98b-079927511320 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.243000 Sep 27 01:41:46.855326 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1367/2847] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:46 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:46.855326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:46.855326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:46.878194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.878747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.880266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:46.880266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:46.880990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:46.881468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.138285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:47.149043 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e378880b-2a5b-42eb-900f-9f6a209d556b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1504 microversion: 2.1 time: 0.303736 Sep 27 01:41:47.172111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1368/2848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:46 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:47.179420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd37ed9d-c74d-40a7-9a37-12b6a8a490f1", "name": "network-vif-deleted", "tag": "772958ef-077e-4e59-b95a-c1309b8c6b76"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:47.224511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.224909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.225350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.246727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] Creating event network-vif-deleted:772958ef-077e-4e59-b95a-c1309b8c6b76 for instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 on n-h1-859358-1 Sep 27 01:41:47.251801 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3d24e380-3d04-4f25-afa8-cf9373074f08 req-664b189e-329a-4202-995b-1a92358b57ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078116 Sep 27 01:41:47.253325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1369/2849] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:47.258554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.259777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 31b21386-b6d1-44ed-bc13-65ce0811b688] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.268319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.268811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.269237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.270108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.270415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.270837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.287138 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] HTTP exception thrown: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Request method failure captured: Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 HTTP/1.1 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlQWZ1xzLhu_P5zTjwk3CNTdwM9WFw48ziI7KwgMWqKsk45gVk_G8UcsQOm9g5JtyAwS20EMbtWw0Pu28bVXblevz0UVIX8hILkb6fyIadodKTjGOe19VGcdFQbFrL1shU-M1X0JCaaX9DehZ4KwbQzXxTKjJyKGgLHeuoB4ej5C9gg Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:47.289115 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_769d12d962a14080b756c1a57d723bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 7c7cf1bdbba44c2e939151843c9ac187 Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. Sep 27 01:41:47.290714 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '31b21386-b6d1-44ed-bc13-65ce0811b688'} Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.291728 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. Sep 27 01:41:47.293201 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.294542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Returning 404 to user: Instance 31b21386-b6d1-44ed-bc13-65ce0811b688 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.294542 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bef114c-45db-41aa-b8b0-7d61e01a4716 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688" status: 404 len: 111 microversion: 2.1 time: 0.036033 Sep 27 01:41:47.294542 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1370/2850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/31b21386-b6d1-44ed-bc13-65ce0811b688 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:47.296922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.297598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.304585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.305070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.305539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.306863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.307312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.307729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.319969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:47.331939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3d5a3d7-7e9c-41a2-a711-e40130d640bd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.585196 Sep 27 01:41:47.333615 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1481/2851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:46 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:47.338935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.340014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.361121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.363201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.363642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.364434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.366401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.367374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.406527 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] HTTP exception thrown: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Request method failure captured: Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b HTTP/1.1 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlQWZ1xzLhu_P5zTjwk3CNTdwM9WFw48ziI7KwgMWqKsk45gVk_G8UcsQOm9g5JtyAwS20EMbtWw0Pu28bVXblevz0UVIX8hILkb6fyIadodKTjGOe19VGcdFQbFrL1shU-M1X0JCaaX9DehZ4KwbQzXxTKjJyKGgLHeuoB4ej5C9gg Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:47.412471 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_769d12d962a14080b756c1a57d723bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c7cf1bdbba44c2e939151843c9ac187 Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.413823 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8db91074-a09e-4553-b4e0-0248f7559a3b'} Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.414506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.417512 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.418643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Returning 404 to user: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.418643 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38b4584a-79c3-4606-a4f0-ad72265779f0 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 404 len: 111 microversion: 2.1 time: 0.080325 Sep 27 01:41:47.418643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1482/2852] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:47 2022] DELETE /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:47.433647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.437827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 8db91074-a09e-4553-b4e0-0248f7559a3b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.462903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=97 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:47.477827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.478699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.481357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.482444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.482924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.483744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.534266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] HTTP exception thrown: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Request method failure captured: Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b HTTP/1.1 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlQWZ1xzLhu_P5zTjwk3CNTdwM9WFw48ziI7KwgMWqKsk45gVk_G8UcsQOm9g5JtyAwS20EMbtWw0Pu28bVXblevz0UVIX8hILkb6fyIadodKTjGOe19VGcdFQbFrL1shU-M1X0JCaaX9DehZ4KwbQzXxTKjJyKGgLHeuoB4ej5C9gg Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:47.541205 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_769d12d962a14080b756c1a57d723bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c7cf1bdbba44c2e939151843c9ac187 Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.542709 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8db91074-a09e-4553-b4e0-0248f7559a3b'} Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.543505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. Sep 27 01:41:47.544886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.546119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Returning 404 to user: Instance 8db91074-a09e-4553-b4e0-0248f7559a3b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.553363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8be81f35-eab3-479e-9273-7b864e3d6bdd tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b" status: 404 len: 111 microversion: 2.1 time: 0.132499 Sep 27 01:41:47.572712 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1483/2853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/8db91074-a09e-4553-b4e0-0248f7559a3b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:41:47.584619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.587391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.613277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.624966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.625447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.626220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.629955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.630411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.645363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:47.663705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bac41740-9ce3-4098-9d26-d1fe00e9d931 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.369937 Sep 27 01:41:47.684113 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1371/2854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:47.693263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.695613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: cd37ed9d-c74d-40a7-9a37-12b6a8a490f1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.702935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] HTTP exception thrown: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Request method failure captured: Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f HTTP/1.1 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlQWZ1xzLhu_P5zTjwk3CNTdwM9WFw48ziI7KwgMWqKsk45gVk_G8UcsQOm9g5JtyAwS20EMbtWw0Pu28bVXblevz0UVIX8hILkb6fyIadodKTjGOe19VGcdFQbFrL1shU-M1X0JCaaX9DehZ4KwbQzXxTKjJyKGgLHeuoB4ej5C9gg Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:47.706361 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_769d12d962a14080b756c1a57d723bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c7cf1bdbba44c2e939151843c9ac187 Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.707798 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '772662d5-7c79-47c4-9d53-e8abb1d4e32f'} Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.708582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.709969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.713856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.714800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Returning 404 to user: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.715810 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6bd58158-26c0-4b6f-b9d7-e787091a7e40 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "DELETE /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 404 len: 111 microversion: 2.1 time: 0.140657 Sep 27 01:41:47.717432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.717862 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1484/2855] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:47 2022] DELETE /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:41:47.718649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.719504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.720160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.720668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.731557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.741431 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] HTTP exception thrown: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. Sep 27 01:41:47.742224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] [instance: 772662d5-7c79-47c4-9d53-e8abb1d4e32f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Request method failure captured: Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 HTTP/1.1 Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLGn0PpBu99ZvdFqW-rq-iVRQlEadZVfrB3vXKaPVfoDTNL4QIEOTn45lwpG20nilKoU1Gm6uJc6FEex-oxrmwMX_zjjyBEFbmQJ6BeoRNr_g1x1n3raHxEmhdXjs_JXuw0UT1XUYL_JE0fQoWfwVpL77ePzlvWHr5IlLV9KUlEDGI Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:47.743605 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_115fecd0e9f34141a8630f6a0b76864e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationTest-725739650 Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 56e5b4943e3c4d31aec5dd4dc2ecac66 Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. Sep 27 01:41:47.745293 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'cd37ed9d-c74d-40a7-9a37-12b6a8a490f1'} Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.745987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. Sep 27 01:41:47.747058 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.749647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Returning 404 to user: Instance cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.750821 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abf5a7f1-ce35-49d3-8394-1d20b60e7cb4 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1" status: 404 len: 111 microversion: 2.1 time: 0.065594 Sep 27 01:41:47.751977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1372/2856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/cd37ed9d-c74d-40a7-9a37-12b6a8a490f1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:47.754292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.755916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.756460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.757252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.757756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.758183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.761707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.762460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.770225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.771015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.771666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.772891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.773331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] HTTP exception thrown: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Request method failure captured: Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f HTTP/1.1 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlQWZ1xzLhu_P5zTjwk3CNTdwM9WFw48ziI7KwgMWqKsk45gVk_G8UcsQOm9g5JtyAwS20EMbtWw0Pu28bVXblevz0UVIX8hILkb6fyIadodKTjGOe19VGcdFQbFrL1shU-M1X0JCaaX9DehZ4KwbQzXxTKjJyKGgLHeuoB4ej5C9gg Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:47.775124 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/769d12d962a14080b756c1a57d723bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_769d12d962a14080b756c1a57d723bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 769d12d962a14080b756c1a57d723bc4 Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1540201162 Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c7cf1bdbba44c2e939151843c9ac187 Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiskConfigTestJSON-1540201162-project Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.776375 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '772662d5-7c79-47c4-9d53-e8abb1d4e32f'} Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:47.777055 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. Sep 27 01:41:47.778413 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:47.780194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.780766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.781100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] Returning 404 to user: Instance 772662d5-7c79-47c4-9d53-e8abb1d4e32f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:47.788123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3dedb02-a60c-4bfb-abda-33b807571d54 tempest-ServerDiskConfigTestJSON-1540201162 tempest-ServerDiskConfigTestJSON-1540201162-project] 10.222.0.52 "GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f" status: 404 len: 111 microversion: 2.1 time: 0.066417 Sep 27 01:41:47.789298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1485/2857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/772662d5-7c79-47c4-9d53-e8abb1d4e32f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:41:47.813420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:47.872795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:47.873457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:47.884907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.885439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.885882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.886619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:47.887071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:47.887495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:47.999545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1f5c96f-1435-42a8-8aa2-eb2f27e424f7 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "DELETE /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 204 len: 0 microversion: 2.1 time: 0.242990 Sep 27 01:41:48.007713 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1373/2858] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:47 2022] DELETE /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:48.019668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:48.020856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:48.028859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.029638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.030227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.031139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.031751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.032333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.147152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:48.161416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:48.163922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:48.167986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0377852-c8b3-46c4-bfac-c367269ed4ab tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.297276 Sep 27 01:41:48.189983 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1486/2859] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:47 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:41:48.201725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:48.203864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:48.217625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.218622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.219905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.221138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.223853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.225055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.259925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:48.543118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:48.552690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a8ac5ea-3aa6-47f9-b603-e5dbfbfa679c tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1499 microversion: 2.1 time: 0.543210 Sep 27 01:41:48.558813 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1374/2860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:48 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1499 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:48.570026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:48.574525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:48.586757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.588588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.589144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.591370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.592592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.593129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.803637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:48.816606 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-632d3cda-54ca-4bb5-9ce8-c744e681bf6c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1499 microversion: 2.1 time: 0.625360 Sep 27 01:41:48.865246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1487/2861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:48 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1499 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:48.891464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:48.900041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:48.914859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.915743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.917542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:48.918523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:48.920501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:48.923859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.126118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:49.143410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56e72972-9583-4076-b43e-ae562ea1940e tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.583114 Sep 27 01:41:49.149912 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1375/2862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:48 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:49.198078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:49.199127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:49.226794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.227296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.227734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.228998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.234417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.235175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.416039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:49.432178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:49.437739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:49.439051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f047a9d-74bd-4ca5-ae52-a8b34718540f tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.245269 Sep 27 01:41:49.457445 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1376/2863] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:49 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:49.520879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:49.531036 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3f41f6f-db12-4999-b328-078f1d78fe51 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.662648 Sep 27 01:41:49.555912 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1488/2864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:48 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:49.588399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:49.589314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:49.604516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.605130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.606954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.608614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.609168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.611326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.872966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:49.873677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:49.885088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.885619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.887226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:49.887958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:49.888422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:49.890988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.206648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.216139 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a35a8fd9-da2b-4460-8ed7-f20536a0a84b tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1499 microversion: 2.1 time: 0.634645 Sep 27 01:41:50.219929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1377/2865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:49 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1499 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:50.225600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:50.228843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:50.247106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.249943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.250711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.253088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.253747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.257017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.281096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.290285 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b0c6f06c-70ff-44b3-88a1-eb5ee7d3e58f tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1486 microversion: 2.1 time: 0.422599 Sep 27 01:41:50.295586 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1489/2866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:49 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:50.328025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:50.328897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:50.341122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.342299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.344417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.347615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.348394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.349411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.390858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:50.551886 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c95d4f1-5733-4102-bbbd-898947a8e1ec tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 204 len: 0 microversion: 2.1 time: 0.231904 Sep 27 01:41:50.553554 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1490/2867] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:50 2022] DELETE /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:41:50.572664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:50.577521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:50.590645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.592906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.593589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.603946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.604674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.605282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.720540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.735979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.738589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.740088 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b42bbc5-6056-45c4-b5f3-858fea013958 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.184355 Sep 27 01:41:50.745123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1491/2868] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:50 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:50.750145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:50.756817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:50.773576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.775463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.776468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.780703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:50.781455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:50.782109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:50.865689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:50.886911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34e23a08-0813-496f-92e1-3b151957edc0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.660672 Sep 27 01:41:50.892915 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1378/2869] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:50 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:50.905320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49fd5dad-5a48-4d7f-b1fa-02a9f310568a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da56cd30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:50.979397 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-49fd5dad-5a48-4d7f-b1fa-02a9f310568a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Image not found. Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49fd5dad-5a48-4d7f-b1fa-02a9f310568a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 HTTP/1.1 Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:50.981356 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8b891b98-7580-403c-a92b-e5a8daa41a93'} Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:50.983686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b891b98-7580-403c-a92b-e5a8daa41a93 to delete Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.985303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b891b98-7580-403c-a92b-e5a8daa41a93 could not be found. Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:50.986653 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:50.987972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49fd5dad-5a48-4d7f-b1fa-02a9f310568a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:50.989283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49fd5dad-5a48-4d7f-b1fa-02a9f310568a tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93" status: 404 len: 62 microversion: 2.1 time: 0.094927 Sep 27 01:41:50.990016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1379/2870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:50 2022] DELETE /compute/v2.1/images/8b891b98-7580-403c-a92b-e5a8daa41a93 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:41:50.995068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647d420a-9dd2-4d47-acc4-ece1000d8365", "name": "network-vif-deleted", "tag": "140d4304-1de9-44e9-a328-06cf241e556c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:51.023341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.027921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.030996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.048921 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] Creating event network-vif-deleted:140d4304-1de9-44e9-a328-06cf241e556c for instance 647d420a-9dd2-4d47-acc4-ece1000d8365 on n-h1-859358-1 Sep 27 01:41:51.058232 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dce9b000-7843-4017-b1d4-300fc63f24e4 req-6ef94fae-a129-4918-bddc-38d28f0188f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066391 Sep 27 01:41:51.060157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1380/2871] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:51.098204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:51.099474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:51.119843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.120461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.121768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.124229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.126100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.128179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.219504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:41:51.223981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:51.248563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:51.270392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97397900-8dcf-4d26-9979-3a828ae6abae tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.512720 Sep 27 01:41:51.271402 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1492/2872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:50 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:51.277149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:51.277789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:51.312933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.313493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.313983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.314716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.331149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.331995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.348954 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.compute.api [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Instance is already in deleting state, ignoring this request Sep 27 01:41:51.350823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-249f6c4d-d0c7-4d43-a23e-356698f46646 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 204 len: 0 microversion: 2.1 time: 0.289633 Sep 27 01:41:51.351840 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1381/2873] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:51 2022] DELETE /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:41:51.363271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:51.364612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:51.385626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.386254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.387742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.388581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.389220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.389828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.483943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.484669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.488035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.488726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lazy-loading 'fault' on Instance uuid 647d420a-9dd2-4d47-acc4-ece1000d8365 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:51.598698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:51.620358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e5b4943e3c4d31aec5dd4dc2ecac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115fecd0e9f34141a8630f6a0b76864e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:51.627593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5137881d-351a-4d9e-b807-f7f0a2fe312c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1492 microversion: 2.1 time: 0.270070 Sep 27 01:41:51.636658 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2a093f8-f54d-4873-bc31-e951ce904c1f tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 200 len: 1300 microversion: 2.1 time: 0.363275 Sep 27 01:41:51.650006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1382/2874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:51 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1492 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:51.650240 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1493/2875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:51 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 1300 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:51.773834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:51.775431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:51.789424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.791947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.792601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.793999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.796544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.797613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.919306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:51.920865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:51.933160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.934422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.948360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:51.950538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:51.957544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:51.960199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:52.075370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:52.086436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:52.092802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:52.101060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-219cb100-6873-41ca-8d70-8cf0a1cfc9f0 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 200 len: 1265 microversion: 2.25 time: 0.327794 Sep 27 01:41:52.104483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1383/2876] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:51 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:41:52.298649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:52.300108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:52.314623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:52.315439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:52.316104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:52.317242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:52.318250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:52.318873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:52.686799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:52.704936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cdd3dcde-085b-4e77-8e05-2fd9e7e46327 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.409935 Sep 27 01:41:52.705994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1384/2877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:52 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:52.712105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff8600-ad03-4bf0-8b26-282bbe83f047", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a413fb-738b-4a34-83c0-1ee3fdddabf6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:52.725450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:52.726028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:52.727287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:52.741948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] Creating event network-vif-unplugged:c3a413fb-738b-4a34-83c0-1ee3fdddabf6 for instance edff8600-ad03-4bf0-8b26-282bbe83f047 on n-h2-859358-1 Sep 27 01:41:52.747905 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-30908bdc-fbcb-449f-9292-7b0fac493b9d req-7efc704a-07f9-4a59-87de-c4515149a3cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040541 Sep 27 01:41:52.748990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1385/2878] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:52.755347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:52.756463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:52.766394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:52.766894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:52.767429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:52.768144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:52.768599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:52.769028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.006300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:53.017052 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f68f410f-df23-4c0b-8c72-d9fdd5534e12 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1492 microversion: 2.1 time: 0.266780 Sep 27 01:41:53.018659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1386/2879] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:52 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1492 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:53.046165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:53.047646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] [instance: 647d420a-9dd2-4d47-acc4-ece1000d8365] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:53.069083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.073439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.073948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.078344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.079563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.080175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.117510 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] HTTP exception thrown: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Request method failure captured: Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 HTTP/1.1 Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlLGn0PpBu99ZvdFqW-rq-iVRQlEadZVfrB3vXKaPVfoDTNL4QIEOTn45lwpG20nilKoU1Gm6uJc6FEex-oxrmwMX_zjjyBEFbmQJ6BeoRNr_g1x1n3raHxEmhdXjs_JXuw0UT1XUYL_JE0fQoWfwVpL77ePzlvWHr5IlLV9KUlEDGI Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:53.120285 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/115fecd0e9f34141a8630f6a0b76864e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_115fecd0e9f34141a8630f6a0b76864e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveMigrationTest-725739650 Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 115fecd0e9f34141a8630f6a0b76864e Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveMigrationTest-725739650 Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 56e5b4943e3c4d31aec5dd4dc2ecac66 Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveMigrationTest-725739650-project Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. Sep 27 01:41:53.121696 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '647d420a-9dd2-4d47-acc4-ece1000d8365'} Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:53.122365 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. Sep 27 01:41:53.123699 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.128215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] Returning 404 to user: Instance 647d420a-9dd2-4d47-acc4-ece1000d8365 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:53.133887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-744ce3d6-59b8-4fde-b957-49c21aa9c966 tempest-LiveMigrationTest-725739650 tempest-LiveMigrationTest-725739650-project] 10.222.0.52 "GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365" status: 404 len: 111 microversion: 2.1 time: 0.113988 Sep 27 01:41:53.152576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1387/2880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:53 2022] GET /compute/v2.1/servers/647d420a-9dd2-4d47-acc4-ece1000d8365 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:53.167202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:53.170991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 48db1246-5da2-415d-bc56-b16f43b5e1d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:53.192147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.199834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.200814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.202998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.203632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.207802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.258643 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] HTTP exception thrown: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Request method failure captured: Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 HTTP/1.1 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMJckNHP9WoZTPU2ZtOh2TkydF_vOchp4ekYJ6DIfE8XqZScjVQ4j-PyrCZu0pu17yigoRRUclpYYHM-Y9voNofIh9-DSjQatPRB4N-teTY0m-5mQZ7hHRfzp8bjR3pH7c44PgiWIrjmmI5ud4aUUZcG1CaDvqQgqQxRWbXeMsz36k Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.25 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:53.264588 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d07021c27c9b4371950fd1b930cdec82", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5591a6d007e9465a9ec1a856483feb6d Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. Sep 27 01:41:53.266230 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48db1246-5da2-415d-bc56-b16f43b5e1d8'} Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:53.267056 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. Sep 27 01:41:53.268360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:53.269573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Returning 404 to user: Instance 48db1246-5da2-415d-bc56-b16f43b5e1d8 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:53.269573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f912962-ae80-4e5a-a8a4-346e56b20c0a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8" status: 404 len: 111 microversion: 2.25 time: 0.114234 Sep 27 01:41:53.269573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1388/2881] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:41:53 2022] GET /compute/v2.1/servers/48db1246-5da2-415d-bc56-b16f43b5e1d8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:41:53.627701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:53.641260 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89868744-a076-429d-8636-ce72a647fe81 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 1.724706 Sep 27 01:41:53.643108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1494/2882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:51 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:53.730721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:53.732013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:53.749727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.752578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.753252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:53.754168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:53.755900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:53.758496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:54.042167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:54.043415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:54.056638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:54.059168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:54.059964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:54.061755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:54.063986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:54.064632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:54.299720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:54.325505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05bc4252-43ea-4fff-afa7-c6910149b279 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1450 microversion: 2.1 time: 0.285324 Sep 27 01:41:54.346123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1495/2883] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:54 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1450 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:41:54.383153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edff8600-ad03-4bf0-8b26-282bbe83f047", "name": "network-vif-deleted", "tag": "c3a413fb-738b-4a34-83c0-1ee3fdddabf6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:54.412368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:54.413142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:54.421365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:54.500502 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] Creating event network-vif-deleted:c3a413fb-738b-4a34-83c0-1ee3fdddabf6 for instance edff8600-ad03-4bf0-8b26-282bbe83f047 on n-h2-859358-1 Sep 27 01:41:54.521308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9a11286c-d658-4f65-aaeb-793da082dfe8 req-3a623d05-31dc-4599-ac10-b27a05091a46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171946 Sep 27 01:41:54.526589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1496/2884] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:41:54.670984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:54.673396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:54.687001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:54.688511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:54.689945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:54.692047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:54.694338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:54.695006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:55.157213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:55.184979 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ea0bc65-3956-4955-90b2-918adce84f58 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.519226 Sep 27 01:41:55.185628 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1497/2885] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:54 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:55.279918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:55.289587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89dbbc02-125b-42a0-9645-6373765934a3 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 1.563262 Sep 27 01:41:55.294540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1389/2886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:53 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:55.354941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:55.355585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:55.372953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:55.380625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:55.381259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:55.383005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:55.383493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:55.384605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:55.516659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:55.517492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:55.517978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:55.518505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lazy-loading 'fault' on Instance uuid edff8600-ad03-4bf0-8b26-282bbe83f047 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:41:55.735683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72f64b5a7b76437c9f31cf277c601aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3961cd41a154feba0e624e2fdc0a15e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:55.753855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4bb7ece0-4d61-4f72-85c4-79aa3b51141d tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 200 len: 1297 microversion: 2.1 time: 0.400119 Sep 27 01:41:55.761487 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1498/2887] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:55 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 1297 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:56.208612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:56.209976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:56.238866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.242762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.243555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.246885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.250057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.253252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.316227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:56.316774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:56.328676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.332337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.333139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.334118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.337193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.338081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.660761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:56.678798 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bb09f13-7d85-4a18-8fa8-1425e2847306 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.473934 Sep 27 01:41:56.693942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1390/2888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:56 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:56.780150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:56.780978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: edff8600-ad03-4bf0-8b26-282bbe83f047] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:56.794254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.797163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.797659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.798411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.799414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.799414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.844509 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 HTTP/1.1 Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:56.847637 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'edff8600-ad03-4bf0-8b26-282bbe83f047'} Sep 27 01:41:56.848955 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:56.849702 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.850886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance edff8600-ad03-4bf0-8b26-282bbe83f047 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:56.851853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f243379d-9b79-47e8-a5f2-eb6e191de99c tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047" status: 404 len: 111 microversion: 2.1 time: 0.080899 Sep 27 01:41:56.856216 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1391/2889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:56 2022] GET /compute/v2.1/servers/edff8600-ad03-4bf0-8b26-282bbe83f047 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:56.883387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc91e1c7-14b7-4475-a6d3-135decbe6b0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da580280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:56.911267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:56.922494 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc1e8393-9a35-49b0-a496-a22ef5d28a14 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1522 microversion: 2.1 time: 0.610228 Sep 27 01:41:56.938263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1499/2890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:56 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:41:56.940146 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-bc91e1c7-14b7-4475-a6d3-135decbe6b0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Image not found. Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc91e1c7-14b7-4475-a6d3-135decbe6b0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 HTTP/1.1 Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:56.941923 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '24b2ba49-3d10-4b9a-a6d7-221a5ce996a6'} Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:56.943368 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 to delete Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.944312 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 could not be found. Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:56.945601 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc91e1c7-14b7-4475-a6d3-135decbe6b0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:56.947514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc91e1c7-14b7-4475-a6d3-135decbe6b0e tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6" status: 404 len: 62 microversion: 2.1 time: 0.085573 Sep 27 01:41:56.948478 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1392/2891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:56 2022] DELETE /compute/v2.1/images/24b2ba49-3d10-4b9a-a6d7-221a5ce996a6 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:41:56.967950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:56.969639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:56.988457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.990520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.991823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:56.992867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:56.994308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:56.995523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.056913 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 HTTP/1.1 Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:57.059064 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'cd1ee5ed-b16f-4dba-9cc2-91aae039af02'} Sep 27 01:41:57.060316 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.061031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.062144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.078115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.080084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f16cfdd5-cbf0-4ec5-9362-72879b5c44a8 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 404 len: 111 microversion: 2.1 time: 0.127821 Sep 27 01:41:57.081279 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1500/2892] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:56 2022] DELETE /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.091181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.091802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: cd1ee5ed-b16f-4dba-9cc2-91aae039af02] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.108890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.109408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.109855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.114919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.115639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.116230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.148814 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 HTTP/1.1 Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:57.150756 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'cd1ee5ed-b16f-4dba-9cc2-91aae039af02'} Sep 27 01:41:57.152157 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.152979 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. Sep 27 01:41:57.154239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.156032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance cd1ee5ed-b16f-4dba-9cc2-91aae039af02 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.157837 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79b5f345-2cb3-44d4-98de-6a6106de0e3b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02" status: 404 len: 111 microversion: 2.1 time: 0.070060 Sep 27 01:41:57.166867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5b0459c-55ad-4263-a3d3-9ad578f85584 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24d62823a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.177514 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1393/2893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] GET /compute/v2.1/servers/cd1ee5ed-b16f-4dba-9cc2-91aae039af02 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.198202 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c5b0459c-55ad-4263-a3d3-9ad578f85584 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Image not found. Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5b0459c-55ad-4263-a3d3-9ad578f85584 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d HTTP/1.1 Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:57.200779 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2e37aea3-fa2f-4ab5-910c-7b83d441499d'} Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.202251 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e37aea3-fa2f-4ab5-910c-7b83d441499d to delete Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.203031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e37aea3-fa2f-4ab5-910c-7b83d441499d could not be found. Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.204889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:41:57.207087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.209330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5b0459c-55ad-4263-a3d3-9ad578f85584 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.210453 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5b0459c-55ad-4263-a3d3-9ad578f85584 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d" status: 404 len: 62 microversion: 2.1 time: 0.047447 Sep 27 01:41:57.221369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.221887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.223511 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1501/2894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] DELETE /compute/v2.1/images/2e37aea3-fa2f-4ab5-910c-7b83d441499d => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:41:57.231982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.233895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.240335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.241101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.241607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.242036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.279139 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 HTTP/1.1 Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:57.280732 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '75ab2782-bd65-42dc-adf5-20c04bac9113'} Sep 27 01:41:57.282446 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.283215 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.284567 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.287711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.287711 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-060fc512-c7d3-42f3-9eda-065023b1c6c5 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 404 len: 111 microversion: 2.1 time: 0.066819 Sep 27 01:41:57.290951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.291557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: 75ab2782-bd65-42dc-adf5-20c04bac9113] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.301320 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1394/2895] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:57 2022] DELETE /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.307305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.308199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.309567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.310496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.317610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.318370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.371112 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 HTTP/1.1 Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:57.380046 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '75ab2782-bd65-42dc-adf5-20c04bac9113'} Sep 27 01:41:57.381616 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.382445 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.383531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance 75ab2782-bd65-42dc-adf5-20c04bac9113 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.385134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67c747a4-ff85-4f01-a5ca-e0c192ae3ee7 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113" status: 404 len: 111 microversion: 2.1 time: 0.094386 Sep 27 01:41:57.392032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-388e16ad-255f-4181-befd-e11b21bc17fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '.version_select at 0x7f24da580c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.393276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1502/2896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] GET /compute/v2.1/servers/75ab2782-bd65-42dc-adf5-20c04bac9113 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.425882 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-388e16ad-255f-4181-befd-e11b21bc17fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Image not found. Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-388e16ad-255f-4181-befd-e11b21bc17fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 HTTP/1.1 Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:57.430451 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3ecb2d88-8cb6-4920-9e23-9d0829fa1b07'} Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.432508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 to delete Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.433457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 could not be found. Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.434825 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:41:57.436130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.438938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-388e16ad-255f-4181-befd-e11b21bc17fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.442767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-388e16ad-255f-4181-befd-e11b21bc17fe tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07" status: 404 len: 62 microversion: 2.1 time: 0.054947 Sep 27 01:41:57.448301 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1395/2897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] DELETE /compute/v2.1/images/3ecb2d88-8cb6-4920-9e23-9d0829fa1b07 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:41:57.455033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.456008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.479057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.479983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.480518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.481318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.481883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.482390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.512494 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 HTTP/1.1 Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:41:57.521795 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a652fc4e-ca56-44d1-a87b-0d683253f9e4'} Sep 27 01:41:57.523092 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.523802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.524944 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.525995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.528859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf4ed809-1e42-4b7e-9e65-d6c1b4fcaa21 tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 404 len: 111 microversion: 2.1 time: 0.072692 Sep 27 01:41:57.533924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1503/2898] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:41:57 2022] DELETE /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.539385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.540018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] [instance: a652fc4e-ca56-44d1-a87b-0d683253f9e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.563615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.567267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.570947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.577497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.578354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.579000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.639686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] HTTP exception thrown: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Request method failure captured: Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 HTTP/1.1 Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPwycSuOENQSrAy7Zm7eah-a6gCDMOunqthhBWpW_1p7MyoD5wJBNWDH8Jd9IXYRy6QgWFrBSMijlRSHH9UguOKFiQkyMai6HfF9su9ofJ1fbMwwPjmqiaSoTH1_gr1exWH73j7tF1GGR03uubfUVEYAxCp5HcCtIhfoXrKeOIFOHA Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:41:57.641695 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f3961cd41a154feba0e624e2fdc0a15e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f3961cd41a154feba0e624e2fdc0a15e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f3961cd41a154feba0e624e2fdc0a15e Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesTestJSON-959799348 Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 72f64b5a7b76437c9f31cf277c601aa3 Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesTestJSON-959799348-project Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a652fc4e-ca56-44d1-a87b-0d683253f9e4'} Sep 27 01:41:57.643140 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:41:57.644018 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. Sep 27 01:41:57.645326 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:41:57.646945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] Returning 404 to user: Instance a652fc4e-ca56-44d1-a87b-0d683253f9e4 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:41:57.650621 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71696518-7d21-48e6-8e51-e7ce7be0d55b tempest-ImagesTestJSON-959799348 tempest-ImagesTestJSON-959799348-project] 10.222.0.52 "GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4" status: 404 len: 111 microversion: 2.1 time: 0.115027 Sep 27 01:41:57.655605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1396/2899] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] GET /compute/v2.1/servers/a652fc4e-ca56-44d1-a87b-0d683253f9e4 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:41:57.706407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.707293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.721687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.722196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.722643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.736934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.737723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.738202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.946878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:57.948158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:57.963359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.973301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.974284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:57.979948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:57.982398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:57.983298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:58.238949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:58.247684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a2c48ab-0d8e-491e-a741-76dfea195efa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.545250 Sep 27 01:41:58.255523 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1504/2900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:59.247466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab3b4c48-13fa-4aa9-8d25-460690418921 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Action: 'create', calling method: .version_select at 0x7f24d624de50>, body: {"keypair": {"name": "tempest-keypair-780397929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIBFC/NSBvxGPBJ8osjvLexNwiw96g/Vpz6+TaBSc42EeR1WwfgKuyY6KQM4j10IzRXk9YqKFF45RxRDf+n7v34xm2u36ryMFkVwWVd3OqxYjLZQ/mw/q9q04PhF8GnVw=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:59.284035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ab3b4c48-13fa-4aa9-8d25-460690418921 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Getting quotas for project 2b8ca22bbdb9442ca7053b104701ee60. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:41:59.306506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ab3b4c48-13fa-4aa9-8d25-460690418921 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Getting quotas for user 8afa2dd2d948458798ab42ae7873c0c8 and project 2b8ca22bbdb9442ca7053b104701ee60. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:41:59.373876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab3b4c48-13fa-4aa9-8d25-460690418921 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325156 Sep 27 01:41:59.374523 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1505/2901] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:41:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:41:59.394995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:41:59.403715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:41:59.427177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:59.427675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:59.428123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:59.432673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:41:59.435758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:41:59.436221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:41:59.445514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:41:59.472874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:41:59.485215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd7bad10-29a1-4e51-b050-ff3aa8923a70 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1502 microversion: 2.1 time: 1.542304 Sep 27 01:41:59.487731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1397/2902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:57 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1502 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:41:59.516809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84ca42d2-b17c-4ea4-b3e4-93d211a7b67d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'create', calling method: .version_select at 0x7f24da580310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1284727451", "description": "tempest-description-1749272678"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:41:59.999519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:00.015385 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac582726-f74f-4412-9230-be613dd5954a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.631661 Sep 27 01:42:00.015986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1506/2903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:41:59 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:00.135806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84ca42d2-b17c-4ea4-b3e4-93d211a7b67d tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.626617 Sep 27 01:42:00.136415 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1398/2904] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:41:59 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:42:00.151281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1284727451"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:00.151832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:00.163536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.164061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.164504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.166552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.167015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.167446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.286918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:00.287420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:00.299821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.300396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.300911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.301682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.309186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.309818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.354134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:00.533289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a3b546c-24d6-479b-8815-819905172bbc tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 204 len: 0 microversion: 2.25 time: 0.251230 Sep 27 01:42:00.534951 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1399/2905] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:42:00 2022] DELETE /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:42:00.544733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:00.550605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:00.563161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.563683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.565323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.568015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:00.568609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:00.569057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:00.876822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Adding security group 9b273a93-2ec5-4aff-b2e4-460332d298f9 to port 31cf9b9f-72f3-4f00-ad02-de72551ee8c5 Sep 27 01:42:01.685014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:01.693762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:01.695222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:01.696474 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-633c6571-b124-421a-bbd6-257d7a987b7a tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1733 microversion: 2.25 time: 1.157086 Sep 27 01:42:01.702314 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1400/2906] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:00 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1733 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:01.717279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:01.717932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:01.733231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:01.745310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:01.746000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:01.746774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:01.747253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:01.747751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:02.016829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:02.038648 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d9f6075-b867-4db2-9857-dd0c9865915b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.334948 Sep 27 01:42:02.043100 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1401/2907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:01 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:02.724872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:02.725900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:02.735767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:02.736782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:02.737481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:02.738459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:02.739101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:02.740080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.296828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:03.329913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:03.332095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:03.333634 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fbf50df-de1c-45f5-b7ca-ed4a787d02ec tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1733 microversion: 2.25 time: 0.614472 Sep 27 01:42:03.341046 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1402/2908] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:02 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1733 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:03.369228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:03.371338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:03.381516 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ed5df7e-4a97-4a24-86bb-4060d075ab87 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action" status: 202 len: 0 microversion: 2.1 time: 3.234406 Sep 27 01:42:03.387933 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1507/2909] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:42:00 2022] POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action => generated 0 bytes in 3242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:42:03.388933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:03.389463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:03.389902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.390610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:03.391067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:03.391497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.396425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1284727451"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:03.398965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:03.402356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:03.412580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:03.413448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:03.414072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.415839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:03.416473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:03.423384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.808838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:03.827479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd41c8b5-135d-42ae-a563-d7ca8f116a6b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.484816 Sep 27 01:42:03.871856 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1403/2910] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:03 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:03.893467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:03.926711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:03.929118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:03.932345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:03.961722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] Creating event network-changed:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:42:03.967134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-da317dcb-b2b6-4fff-926b-c48fd48b586b req-558f4d51-c2d3-4dbf-89cf-020d6e94a985 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092850 Sep 27 01:42:03.968349 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1404/2911] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:04.111705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Removing security group 9b273a93-2ec5-4aff-b2e4-460332d298f9 from port 31cf9b9f-72f3-4f00-ad02-de72551ee8c5 Sep 27 01:42:04.373417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:04.375189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:04.384918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:04.386980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:04.388122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:04.389439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:04.395978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:04.400815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:04.766579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:04.776185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:04.778052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:04.779747 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca651d01-0e8a-45b2-a46e-3a6f63395627 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1733 microversion: 2.25 time: 0.415220 Sep 27 01:42:04.793480 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1405/2912] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:04 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1733 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:04.855268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:04.855913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:04.865123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:04.865646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:04.866076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:04.867150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:04.868122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:04.869151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:06.281768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:06.293597 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b95c0d73-3baf-4a76-b84f-ff3871bfdcf2 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 1.442241 Sep 27 01:42:06.296740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1406/2913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:04 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:06.314966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:06.315920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:06.324170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:06.325129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:06.328024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:06.329327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:06.331857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:06.332298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:06.409951 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0732c71-588b-4ca0-997c-3cf4f678270c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action" status: 202 len: 0 microversion: 2.1 time: 3.016753 Sep 27 01:42:06.411280 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1508/2914] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:42:03 2022] POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action => generated 0 bytes in 3023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:42:06.421327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31742aad-938c-4e61-8cb1-5c67c38a9801 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'create', calling method: .version_select at 0x7f24d61fa8b0>, body: {"pool": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:06.518541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:06.526999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:06.528446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:06.529692 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d40d9345-8ec7-40cf-93a5-947a85a0ae81 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 200 len: 1665 microversion: 2.25 time: 0.231696 Sep 27 01:42:06.530263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1407/2915] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:06 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 1665 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:06.552294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:06.570581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:06.571263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:06.572373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:06.601609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] Creating event network-changed:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:42:06.611820 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e5983925-fd48-4b71-9d3e-9eb9e77576da req-bf2199f1-6d0f-4633-af79-e758e44a885e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060290 Sep 27 01:42:06.612980 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1408/2916] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:07.326684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:07.328724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:07.339359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:07.345391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:07.346190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:07.349249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:07.350449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:07.353688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:07.354392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:08.290514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:08.339043 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f32481ec-1552-4a9e-97dd-22458280845f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 1.025485 Sep 27 01:42:08.340578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1409/2917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:07 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:08.370073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:08.371011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 75350180-8fa9-4333-9b41-e725f696e376] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:08.378383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:08.379133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:08.379799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:08.380914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:08.381623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:08.382275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:08.416729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] HTTP exception thrown: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Request method failure captured: Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 HTTP/1.1 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMJckNHP9WoZTPU2ZtOh2TkydF_vOchp4ekYJ6DIfE8XqZScjVQ4j-PyrCZu0pu17yigoRRUclpYYHM-Y9voNofIh9-DSjQatPRB4N-teTY0m-5mQZ7hHRfzp8bjR3pH7c44PgiWIrjmmI5ud4aUUZcG1CaDvqQgqQxRWbXeMsz36k Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.25 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:08.419915 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d07021c27c9b4371950fd1b930cdec82", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5591a6d007e9465a9ec1a856483feb6d Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. Sep 27 01:42:08.421854 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '75350180-8fa9-4333-9b41-e725f696e376'} Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:08.422654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. Sep 27 01:42:08.423735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:08.428868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Returning 404 to user: Instance 75350180-8fa9-4333-9b41-e725f696e376 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:08.430334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccbaefb5-1552-4b47-95f0-88fc67c27572 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376" status: 404 len: 111 microversion: 2.25 time: 0.068279 Sep 27 01:42:08.432372 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1410/2918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:08 2022] GET /compute/v2.1/servers/75350180-8fa9-4333-9b41-e725f696e376 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:42:08.441514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e7b64c1-ba6d-49ef-a489-38cf39b0da66 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '.version_select at 0x7f24da4ec0d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:08.474708 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e7b64c1-ba6d-49ef-a489-38cf39b0da66 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838919657" status: 204 len: 0 microversion: 2.25 time: 0.036916 Sep 27 01:42:08.475497 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1411/2919] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838919657 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:42:08.512094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-645233898", "imageRef": "8d469cd8-77b1-4afc-9f0c-4a30d4661836", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "86b60e99-1275-43e1-8a16-b24ea838a85f"}], "security_groups": [{"name": "tempest-securitygroup--1174021583"}], "key_name": "tempest-keypair-780397929", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:09.011991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] validate_networks() for [('86b60e99-1275-43e1-8a16-b24ea838a85f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:09.328299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:10.855954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:10.857079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:10.857832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:10.858412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:10.859053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:10.873379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:10.874230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:10.879475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:10.880647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:10.882123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:10.882970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:10.967654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Getting quotas for project 2b8ca22bbdb9442ca7053b104701ee60. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:10.980327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Getting quotas for user 8afa2dd2d948458798ab42ae7873c0c8 and project 2b8ca22bbdb9442ca7053b104701ee60. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:10.994331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:10.997113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d469cd8-77b1-4afc-9f0c-4a30d4661836',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:11.093308 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fb13409-25c1-4e86-9168-3967950c19c8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.585660 Sep 27 01:42:11.100166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1412/2920] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:42:11.123465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75350180-8fa9-4333-9b41-e725f696e376", "name": "network-vif-deleted", "tag": "9a2db782-19b9-414a-90a7-bdf6b723f34b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:11.147088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:11.147815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:11.148415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:11.162423 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] Creating event network-vif-deleted:9a2db782-19b9-414a-90a7-bdf6b723f34b for instance 75350180-8fa9-4333-9b41-e725f696e376 on n-h1-859358-1 Sep 27 01:42:11.168894 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-890240da-1971-4cf0-bc1f-c9b6ac6f8dcd req-050aa16d-4992-4400-8fbb-a01831d9fac0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060789 Sep 27 01:42:11.170073 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1413/2921] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:11.176418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:11.177997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:11.185153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:11.186465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:11.187057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:11.187940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:11.188548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:11.189122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:11.528920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:11.545093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-106eb7f7-33c4-4c96-a53c-9291265e55b0 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1512 microversion: 2.1 time: 0.373423 Sep 27 01:42:11.545705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1414/2922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:11 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:11.564861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6aff413-dec9-4672-aaaa-f171ef4a5f34 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:11.565699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6aff413-dec9-4672-aaaa-f171ef4a5f34 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:11.736115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6aff413-dec9-4672-aaaa-f171ef4a5f34 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:11.746009 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6aff413-dec9-4672-aaaa-f171ef4a5f34 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1244 microversion: 2.1 time: 0.197011 Sep 27 01:42:11.753513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1415/2923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:11 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1244 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:11.981306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae2319be-6b41-4986-b09d-af63d2d2c9d5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Action: 'create', calling method: .version_select at 0x7f24da5401f0>, body: {"keypair": {"name": "tempest-keypair-584095551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwvmdsbCkGJ9SBas2A5E7zNdYLv4TpSA8Ilxh+z8O6dRrndLW/rMNI9+OmjDAWAPFaXKMvfY7ZNGAYB/IFOW8w606L2O2pZO/nXXJhuneOSpZVJbJr+axOaJicJVSSSA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:12.017375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ae2319be-6b41-4986-b09d-af63d2d2c9d5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for project 588dc81e4691443bb9588a29675d4178. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:12.023405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ae2319be-6b41-4986-b09d-af63d2d2c9d5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for user a744be7f217a466c9f1c85543c0a8a96 and project 588dc81e4691443bb9588a29675d4178. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:12.084574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae2319be-6b41-4986-b09d-af63d2d2c9d5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.329897 Sep 27 01:42:12.085235 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1416/2924] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:42:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:12.114022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:12.118872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:12.140850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.141372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.142075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.143073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.143703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.144793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.184261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:12.335711 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9db0319-d87c-49b8-afc1-5f0d0410612e tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 204 len: 0 microversion: 2.25 time: 0.243448 Sep 27 01:42:12.339570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1417/2925] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:42:12 2022] DELETE /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:42:12.354665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:12.358445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:12.367719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.368522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.375684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.382302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.383201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.384433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.591063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:12.608826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:12.610479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:12.612167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a014fbda-c0fd-44d9-b0b8-1f0218a53528 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1550 microversion: 2.25 time: 0.266679 Sep 27 01:42:12.613855 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1418/2926] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:12 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1550 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:42:12.622509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:12.623587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:12.632763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.633399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.634470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.635195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:12.636024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:12.636505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:12.953232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:12.965381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03eac559-71da-4602-94af-10bd38de88c8 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1489 microversion: 2.1 time: 0.349842 Sep 27 01:42:12.966238 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1419/2927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:12 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1489 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:12.992987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:12.995804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:13.018846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.022130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.027929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.029047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.029993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.030713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.112628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:13.121399 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa078a6b-04cc-4505-a4d9-1bff51360a6e tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1296 microversion: 2.1 time: 0.153866 Sep 27 01:42:13.122581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1420/2928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:12 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:13.128651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:13.129481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:13.136839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.137487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.138051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.138852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.139412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.139940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.193204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:13.312759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31742aad-938c-4e61-8cb1-5c67c38a9801 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.895769 Sep 27 01:42:13.313790 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1509/2929] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:42:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:42:13.327265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.17"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:13.331279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:13.350912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8242128-26e8-4b0f-aa2c-b933e422e097 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 204 len: 0 microversion: 2.1 time: 0.226598 Sep 27 01:42:13.353864 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1421/2930] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:13 2022] DELETE /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:42:13.363989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:13.365619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.367943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.369303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.370286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.370509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:13.373250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.374410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.388735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.389306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.389929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.390748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.391268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.395203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.415727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:42:13.416228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquired lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:42:13.664252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:13.668626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:13.678652 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d4e37e0-452e-4a0b-ad6f-df2763c93c1a tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1495 microversion: 2.1 time: 0.318813 Sep 27 01:42:13.679240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1422/2931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:13 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1495 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:13.686304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:13.690848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:13.716354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.716846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.725952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:13.729708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:13.731013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:13.732372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:14.010066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:14.021400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:14.022854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:14.024046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-428bfc19-8b86-4b2a-8a24-74f18d849e83 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1550 microversion: 2.25 time: 0.343870 Sep 27 01:42:14.029054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1423/2932] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:13 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1550 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:14.147897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:14.148791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:14.161893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:14.163414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:14.164375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:14.166346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:14.167124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:14.169652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:14.426066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:14.443202 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3420a5c-a19b-44e5-b55d-5a0ed38a73d3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1304 microversion: 2.1 time: 0.297122 Sep 27 01:42:14.445153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1424/2933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:14 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:14.822349 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c33808b-bbfc-455c-98bc-5bdf033ffb05 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.359901 Sep 27 01:42:14.823655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1425/2934] 10.222.0.52 () {58 vars in 1128 bytes} [Tue Sep 27 01:42:14 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 01:42:14.835501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:14.836457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:14.854786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:14.855462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:14.856206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:14.856980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:14.857684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:14.858271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:15.433281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:15.455068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-047c3515-87c1-4cc3-8b8e-7d95b1273bcd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1495 microversion: 2.1 time: 0.626873 Sep 27 01:42:15.480962 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1426/2935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:14 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1495 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:15.486062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bccfd83-cab3-46a3-83ff-9d422ffc0689 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Calling method '.version_select at 0x7f24da4ec700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:15.544515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2bccfd83-cab3-46a3-83ff-9d422ffc0689 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] HTTP exception thrown: Image not found. Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bccfd83-cab3-46a3-83ff-9d422ffc0689 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Request method failure captured: Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT2s504rNfuW-Xs-Whb355R5jYEb0ix002GKd-3N1TOmiGzsSJ_orGX5EqQvKDJblYrEF0HqE_KnzDZ9-flIgj8Tb4VrPf0B3MabqVIwicmZrRh9E59Xb35YE43146ogxvQoKZe7rJ_Rm6skAGhmnVewp6tkHfwxoYxH-G87NtLMVE Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:15.546597 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54cf7f97b99f495b9fd5f6ea14792791", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 80c29133bc084830bbc9a53d3a55c759 Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '-1'} Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:15.548124 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.549118 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:42:15.550671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:42:15.552139 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:15.553947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bccfd83-cab3-46a3-83ff-9d422ffc0689 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:15.554970 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bccfd83-cab3-46a3-83ff-9d422ffc0689 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.072827 Sep 27 01:42:15.555915 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1427/2936] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 27 01:42:15 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:42:15.562836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:15.567348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:15.591177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:15.593248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:15.595725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:15.596674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:15.599569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:15.600513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:16.104032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:16.153197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:16.158864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:16.160074 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7d688ea-14eb-4320-a4f7-89e238e25b58 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 200 len: 1508 microversion: 2.25 time: 0.603014 Sep 27 01:42:16.189524 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1428/2937] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:15 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:16.202933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:16.212476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:16.229175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:16.229996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:16.249996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:16.253178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:16.253963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:16.254645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:16.746770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:16.768737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8d6a5d1-2351-458d-b71f-d683fa0e7529 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1302 microversion: 2.1 time: 0.567120 Sep 27 01:42:16.770212 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1429/2938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:16 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1302 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:16.789574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-199b73bf-9086-460e-ab9f-1f1500d84974 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Calling method '.version_select at 0x7f24da4ec5e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:16.851495 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-199b73bf-9086-460e-ab9f-1f1500d84974 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] HTTP exception thrown: Image not found. Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-199b73bf-9086-460e-ab9f-1f1500d84974 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Request method failure captured: Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/40fc9442-f8b7-4e90-8024-e9d19e419adj HTTP/1.1 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT2s504rNfuW-Xs-Whb355R5jYEb0ix002GKd-3N1TOmiGzsSJ_orGX5EqQvKDJblYrEF0HqE_KnzDZ9-flIgj8Tb4VrPf0B3MabqVIwicmZrRh9E59Xb35YE43146ogxvQoKZe7rJ_Rm6skAGhmnVewp6tkHfwxoYxH-G87NtLMVE Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:16.853453 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54cf7f97b99f495b9fd5f6ea14792791", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 80c29133bc084830bbc9a53d3a55c759 Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '40fc9442-f8b7-4e90-8024-e9d19e419adj'} Sep 27 01:42:16.855105 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 40fc9442-f8b7-4e90-8024-e9d19e419adj to delete Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:16.856078 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40fc9442-f8b7-4e90-8024-e9d19e419adj could not be found. Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:16.857208 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-199b73bf-9086-460e-ab9f-1f1500d84974 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:16.859694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-199b73bf-9086-460e-ab9f-1f1500d84974 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/40fc9442-f8b7-4e90-8024-e9d19e419adj" status: 404 len: 62 microversion: 2.1 time: 0.085085 Sep 27 01:42:16.861651 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1430/2939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:16 2022] DELETE /compute/v2.1/images/40fc9442-f8b7-4e90-8024-e9d19e419adj => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:42:16.866412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe00e739-4be2-4555-9c66-8908657ba317", "name": "network-vif-deleted", "tag": "846b5a4d-457b-4be0-b262-66e080ae9d57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:16.908688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:16.919454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:16.920080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:16.945368 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] Creating event network-vif-deleted:846b5a4d-457b-4be0-b262-66e080ae9d57 for instance fe00e739-4be2-4555-9c66-8908657ba317 on n-h2-859358-1 Sep 27 01:42:16.975911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5f5c6bf6-8a11-424f-9cd2-cde83629ea82 req-b337a192-0cd9-4423-a94b-430e525df5c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109965 Sep 27 01:42:16.976859 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1431/2940] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:16.982705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:16.983414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:17.016978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:17.018254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:17.018891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:17.019771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:17.020383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:17.020963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:17.837888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:17.848862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a8848bd-8a26-4cf6-918e-16ec45e710dc tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 200 len: 1453 microversion: 2.1 time: 0.870063 Sep 27 01:42:17.857561 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1432/2941] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:16 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 1453 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:17.881710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-050f126b-0e82-43a9-b3b9-8106ed003367 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Calling method '.version_select at 0x7f24da5f8550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:17.926877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-050f126b-0e82-43a9-b3b9-8106ed003367 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] HTTP exception thrown: Image not found. Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-050f126b-0e82-43a9-b3b9-8106ed003367 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Request method failure captured: Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/033fd6b2-fafe-476d-9013-a7762323f3af1 HTTP/1.1 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT2s504rNfuW-Xs-Whb355R5jYEb0ix002GKd-3N1TOmiGzsSJ_orGX5EqQvKDJblYrEF0HqE_KnzDZ9-flIgj8Tb4VrPf0B3MabqVIwicmZrRh9E59Xb35YE43146ogxvQoKZe7rJ_Rm6skAGhmnVewp6tkHfwxoYxH-G87NtLMVE Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:17.931719 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54cf7f97b99f495b9fd5f6ea14792791", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 80c29133bc084830bbc9a53d3a55c759 Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '033fd6b2-fafe-476d-9013-a7762323f3af1'} Sep 27 01:42:17.933017 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 033fd6b2-fafe-476d-9013-a7762323f3af1 to delete Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:17.934210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 033fd6b2-fafe-476d-9013-a7762323f3af1 could not be found. Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:17.935233 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-050f126b-0e82-43a9-b3b9-8106ed003367 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:17.936383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-050f126b-0e82-43a9-b3b9-8106ed003367 tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/033fd6b2-fafe-476d-9013-a7762323f3af1" status: 404 len: 62 microversion: 2.1 time: 0.074075 Sep 27 01:42:17.945472 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1433/2942] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:17 2022] DELETE /compute/v2.1/images/033fd6b2-fafe-476d-9013-a7762323f3af1 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:42:17.962652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:17.964445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: fe00e739-4be2-4555-9c66-8908657ba317] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:17.989841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:17.990773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:17.994244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:17.995301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:17.998290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:17.998977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.058092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] HTTP exception thrown: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Request method failure captured: Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 HTTP/1.1 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMJckNHP9WoZTPU2ZtOh2TkydF_vOchp4ekYJ6DIfE8XqZScjVQ4j-PyrCZu0pu17yigoRRUclpYYHM-Y9voNofIh9-DSjQatPRB4N-teTY0m-5mQZ7hHRfzp8bjR3pH7c44PgiWIrjmmI5ud4aUUZcG1CaDvqQgqQxRWbXeMsz36k Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.25 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:18.060428 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d07021c27c9b4371950fd1b930cdec82", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5591a6d007e9465a9ec1a856483feb6d Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. Sep 27 01:42:18.061847 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'fe00e739-4be2-4555-9c66-8908657ba317'} Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:18.062571 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. Sep 27 01:42:18.063721 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.064733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Returning 404 to user: Instance fe00e739-4be2-4555-9c66-8908657ba317 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:18.067690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e584d4a7-bc9a-4496-91af-f7400e070af6 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317" status: 404 len: 111 microversion: 2.25 time: 0.120843 Sep 27 01:42:18.071442 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1434/2943] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:17 2022] GET /compute/v2.1/servers/fe00e739-4be2-4555-9c66-8908657ba317 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:42:18.084145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:18.084798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:18.107010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:18.107759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:18.110074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.111187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:18.114508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:18.114965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.411253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:18.420355 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-067972b0-cc59-4702-8c3f-5539350ac68a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1302 microversion: 2.1 time: 0.347682 Sep 27 01:42:18.426802 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1435/2944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:18 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1302 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:18.431755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833a2d0e-8a39-4f1c-966e-958c9c1bc1f2", "name": "network-vif-deleted", "tag": "493dd02a-6b23-40e9-813f-73cd1dcbad57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:18.455036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:18.458138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:18.458792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.484317 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] Creating event network-vif-deleted:493dd02a-6b23-40e9-813f-73cd1dcbad57 for instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 on n-h1-859358-1 Sep 27 01:42:18.517674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-af5c996c-f6ca-41ae-b110-e347ba00197d req-65c3cda4-c009-408a-8ac2-8d07d426096a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081688 Sep 27 01:42:18.518712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1436/2945] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:18.532391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328a51d6-2d60-42cc-b4a3-8c8e3c63468a tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Calling method '.version_select at 0x7f24d5faddc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:18.585068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-328a51d6-2d60-42cc-b4a3-8c8e3c63468a tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] HTTP exception thrown: Image not found. Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328a51d6-2d60-42cc-b4a3-8c8e3c63468a tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Request method failure captured: Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/tempest-invalid-1663196460 HTTP/1.1 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT2s504rNfuW-Xs-Whb355R5jYEb0ix002GKd-3N1TOmiGzsSJ_orGX5EqQvKDJblYrEF0HqE_KnzDZ9-flIgj8Tb4VrPf0B3MabqVIwicmZrRh9E59Xb35YE43146ogxvQoKZe7rJ_Rm6skAGhmnVewp6tkHfwxoYxH-G87NtLMVE Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:18.587900 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54cf7f97b99f495b9fd5f6ea14792791", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 80c29133bc084830bbc9a53d3a55c759 Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'tempest-invalid-1663196460'} Sep 27 01:42:18.589496 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1663196460 to delete Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:18.590443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1663196460 could not be found. Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:18.591834 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:42:18.593075 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:18.620373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328a51d6-2d60-42cc-b4a3-8c8e3c63468a tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:18.620373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-328a51d6-2d60-42cc-b4a3-8c8e3c63468a tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-1663196460" status: 404 len: 62 microversion: 2.1 time: 0.093309 Sep 27 01:42:18.620373 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1437/2946] 10.222.0.52 () {58 vars in 1206 bytes} [Tue Sep 27 01:42:18 2022] DELETE /compute/v2.1/images/tempest-invalid-1663196460 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:42:18.628511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:18.632046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:18.647969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:18.648740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:18.653324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.657215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:18.657822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:18.659835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:18.747499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:19.096334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-452eb610-6da6-4a11-94b4-a4c3615a4548 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 204 len: 0 microversion: 2.25 time: 0.475132 Sep 27 01:42:19.097111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1438/2947] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:42:18 2022] DELETE /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:42:19.134848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9f6658e-c449-492a-905f-7854ae9cdedb tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Calling method '.version_select at 0x7f24da4fd700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:19.211492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c9f6658e-c449-492a-905f-7854ae9cdedb tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] HTTP exception thrown: Image not found. Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9f6658e-c449-492a-905f-7854ae9cdedb tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Request method failure captured: Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/images/6fc23ba1-e81f-4b55-9b82-f5c4ce07453f HTTP/1.1 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT2s504rNfuW-Xs-Whb355R5jYEb0ix002GKd-3N1TOmiGzsSJ_orGX5EqQvKDJblYrEF0HqE_KnzDZ9-flIgj8Tb4VrPf0B3MabqVIwicmZrRh9E59Xb35YE43146ogxvQoKZe7rJ_Rm6skAGhmnVewp6tkHfwxoYxH-G87NtLMVE Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:19.213949 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/54cf7f97b99f495b9fd5f6ea14792791"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_54cf7f97b99f495b9fd5f6ea14792791", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 54cf7f97b99f495b9fd5f6ea14792791 Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796 Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 80c29133bc084830bbc9a53d3a55c759 Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1789323796-project Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6fc23ba1-e81f-4b55-9b82-f5c4ce07453f'} Sep 27 01:42:19.215279 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6fc23ba1-e81f-4b55-9b82-f5c4ce07453f to delete Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:19.216187 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fc23ba1-e81f-4b55-9b82-f5c4ce07453f could not be found. Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:19.217276 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:42:19.218508 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:19.227027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9f6658e-c449-492a-905f-7854ae9cdedb tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:19.228918 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9f6658e-c449-492a-905f-7854ae9cdedb tempest-ImagesDeleteNegativeTestJSON-1789323796 tempest-ImagesDeleteNegativeTestJSON-1789323796-project] 10.222.0.52 "DELETE /compute/v2.1/images/6fc23ba1-e81f-4b55-9b82-f5c4ce07453f" status: 404 len: 62 microversion: 2.1 time: 0.119940 Sep 27 01:42:19.230323 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1439/2948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:19 2022] DELETE /compute/v2.1/images/6fc23ba1-e81f-4b55-9b82-f5c4ce07453f => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:42:19.240959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1548667763", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "003721a2-8aa3-4584-b719-d07285940ac0"}], "security_groups": [{"name": "tempest-securitygroup--361145433"}], "key_name": "tempest-keypair-584095551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:19.634355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] validate_networks() for [('003721a2-8aa3-4584-b719-d07285940ac0', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:20.527936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:20.929089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:21.044797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for project 588dc81e4691443bb9588a29675d4178. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:21.061161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for user a744be7f217a466c9f1c85543c0a8a96 and project 588dc81e4691443bb9588a29675d4178. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:21.097954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:21.098683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:21.100846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:21.101568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:21.103382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:21.126932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.127877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.131168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:21.133014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.133834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.134428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:21.185158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for project 588dc81e4691443bb9588a29675d4178. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:21.203275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Getting quotas for user a744be7f217a466c9f1c85543c0a8a96 and project 588dc81e4691443bb9588a29675d4178. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:21.237991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:21.244915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:21.355677 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f843c93-977d-4ffa-9ebf-7543b2feb5c4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.123836 Sep 27 01:42:21.363576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1440/2949] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:42:21.368972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:21.377747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:21.392412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.394863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.395314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:21.396092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.396574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.396997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:21.470375 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 HTTP/1.1 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:21.472051 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:21.473276 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '833a2d0e-8a39-4f1c-966e-958c9c1bc1f2'} Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:21.474015 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:21.475114 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:21.476105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:21.478648 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63901722-56aa-448d-9d9d-ea2d00a58f87 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 404 len: 111 microversion: 2.1 time: 0.113981 Sep 27 01:42:21.508158 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1441/2950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:21 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:21.516861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:21.534925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:21.554843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.555354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.556362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:21.575755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:21.577328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:21.580407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:22.179060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:22.199347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:22.204450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:22.218412 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd19a610-e8ea-414e-957c-635a17c1afac tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1565 microversion: 2.25 time: 0.708961 Sep 27 01:42:22.238781 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1442/2951] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:21 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1565 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:22.257835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:22.262155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:22.288463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:22.289189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:22.308915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:22.314288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:22.315035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:22.315663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:22.456072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:42:22.825743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:22.841832 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bfdea5d-aeb0-4ddc-9fd7-dcded490f242 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.598444 Sep 27 01:42:22.844636 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1443/2952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:22 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:22.854582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:22.870009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:22.891004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:22.891506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:22.891944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:22.892665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:22.893119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:22.893613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:23.052827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:23.064039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cb46be5-2446-4b7d-8b8c-49a4899bfdde tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1265 microversion: 2.1 time: 0.218131 Sep 27 01:42:23.082973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1444/2953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:22 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:23.095410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1142188647", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bc045262-2171-4861-b54a-61319ecc0dfb"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:23.210871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] validate_networks() for [('bc045262-2171-4861-b54a-61319ecc0dfb', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:23.352897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:24.488687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:24.489236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:24.489610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:24.490207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:24.490804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:24.510174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:24.511230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:24.511838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:24.517152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:24.518083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:24.518760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:24.563446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:24.582112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Getting quotas for user 66a7e63481c140cfad6744cdd2d4d4df and project 1988e26dd26641b09d27d751f4ebfde2. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:24.600091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:24.603958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:24.694749 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d6c0c3d-76db-4ce7-a90f-b7c28add7d36 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606484 Sep 27 01:42:24.697693 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1445/2954] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:42:24.711793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:24.785154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:24.794308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:24.794927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:24.836049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] Creating event network-changed:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:42:24.854614 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f37d56cb-0e6a-46ab-997f-75148de68b48 req-af5899f6-add9-49d2-93a3-e777aeb8e185 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148393 Sep 27 01:42:24.860628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1446/2955] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:25.574348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Updating instance_info_cache with network_info: [{"id": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5", "address": "fa:16:3e:57:91:ab", "network": {"id": "a0fdbb8e-f51d-4904-9715-a1b8b06f7dab", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-128252310-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7505cfe6fc404799b610b135ab125c78", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31cf9b9f-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:42:25.588673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-271825992", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "04c7aa52-d5db-43ae-895c-bb72985ca189"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:25.589643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Releasing lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:42:25.593505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb752e5d-4644-44bd-814b-40942f3c9644 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action" status: 202 len: 0 microversion: 2.1 time: 12.268196 Sep 27 01:42:25.596960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1510/2956] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:42:13 2022] POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action => generated 0 bytes in 12275 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 27 01:42:25.607074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:25.607817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:25.638118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:25.638460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:25.638903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:25.639624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:25.640082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:25.647319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:25.784447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:25.784935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:25.785395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:25.785854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lazy-loading 'fault' on Instance uuid 4f0e22af-37a9-410b-8046-383f083d74b2 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:25.828539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] validate_networks() for [('04c7aa52-d5db-43ae-895c-bb72985ca189', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:26.183750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:26.215358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:26.224043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5591a6d007e9465a9ec1a856483feb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd07021c27c9b4371950fd1b930cdec82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:26.225301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-30142917-e09b-4681-ad00-0f0bf4440283 tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 200 len: 1352 microversion: 2.25 time: 0.626182 Sep 27 01:42:26.225942 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1511/2957] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:25 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 1352 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:26.246412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:26.255664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:26.279712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:26.283264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:26.286171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:26.293115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:26.295788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:26.297912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:27.198701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:27.210703 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf518ef9-914c-41f2-95df-68c92803d14a tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.973309 Sep 27 01:42:27.214472 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1512/2958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:26 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:27.221632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:27.229045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:27.239920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:27.244757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:27.245540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:27.246511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:27.247197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:27.247861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:27.945107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:27.946911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:27.947591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:27.948271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:27.948886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:27.966649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:27.967568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:27.968208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:27.969208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:27.969895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:27.970753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:27.986168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:28.006577 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2416e56-bb10-4372-9f14-0d87121456d6 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.790805 Sep 27 01:42:28.011840 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1513/2959] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:27 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:28.018749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:28.027285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:28.037473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.038457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.039109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.040509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.040969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.041077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Getting quotas for project 97f9c7fb745e44e9bdaf3638ca92d04a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:28.041419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.060137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Getting quotas for user d2be119b81e84dfb94397455528cbed3 and project 97f9c7fb745e44e9bdaf3638ca92d04a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:28.092119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Going to run 2 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:28.094645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 2f6b6c78-61bb-4d45-be72-9d33a978d6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:28.185946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=2f6b6c78-61bb-4d45-be72-9d33a978d6fd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:28.267197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:28.307697 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb112682-3f66-4ede-9f3c-e6e64fbe9342 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1273 microversion: 2.1 time: 0.293858 Sep 27 01:42:28.308681 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1514/2960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:28 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:28.336481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Action: 'action', calling method: .version_select at 0x7f24d8a43a60>, body: {"removeFloatingIp": {"address": "172.25.2.17"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:28.342411 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7bddeb0a-cf9d-4508-ad92-9340004fd399 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.477517 Sep 27 01:42:28.343233 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1447/2961] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:42:28.361988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0e22af-37a9-410b-8046-383f083d74b2", "name": "network-vif-deleted", "tag": "ca3bf94d-3340-4cbd-9452-55bc799058e4"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:28.386611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.387367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.388040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.442454 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] Creating event network-vif-deleted:ca3bf94d-3340-4cbd-9452-55bc799058e4 for instance 4f0e22af-37a9-410b-8046-383f083d74b2 on n-h2-859358-1 Sep 27 01:42:28.456867 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-09f35ada-07a3-4336-89a5-7123bc26b47e req-f5001348-447d-49d5-bd8d-3b96d8d5274a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101911 Sep 27 01:42:28.458932 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1448/2962] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:28.479426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:28.485532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] [instance: 4f0e22af-37a9-410b-8046-383f083d74b2] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:28.500166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.502837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.509946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.511055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.511659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.512198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.533380 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] HTTP exception thrown: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Request method failure captured: Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 HTTP/1.1 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlMJckNHP9WoZTPU2ZtOh2TkydF_vOchp4ekYJ6DIfE8XqZScjVQ4j-PyrCZu0pu17yigoRRUclpYYHM-Y9voNofIh9-DSjQatPRB4N-teTY0m-5mQZ7hHRfzp8bjR3pH7c44PgiWIrjmmI5ud4aUUZcG1CaDvqQgqQxRWbXeMsz36k Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.25 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:28.536779 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d07021c27c9b4371950fd1b930cdec82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d07021c27c9b4371950fd1b930cdec82", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: d07021c27c9b4371950fd1b930cdec82 Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123 Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5591a6d007e9465a9ec1a856483feb6d Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1176063123-project Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. Sep 27 01:42:28.538195 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '4f0e22af-37a9-410b-8046-383f083d74b2'} Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:28.538928 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. Sep 27 01:42:28.540182 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:28.545988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] Returning 404 to user: Instance 4f0e22af-37a9-410b-8046-383f083d74b2 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:28.547002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a58b784d-c207-462c-8d5c-400ab6d245bd tempest-LiveAutoBlockMigrationV225Test-1176063123 tempest-LiveAutoBlockMigrationV225Test-1176063123-project] 10.222.0.52 "GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2" status: 404 len: 111 microversion: 2.25 time: 0.082865 Sep 27 01:42:28.548032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1449/2963] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:28 2022] GET /compute/v2.1/servers/4f0e22af-37a9-410b-8046-383f083d74b2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:42:28.552752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:28.553536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:28.560849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.561668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.562337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.563260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:28.563924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:28.564561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:28.624055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:29.039313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:29.046449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.047288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.048330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:29.049378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.052449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.053550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:29.276482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:29.290806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ddbf32b-f59a-49dd-93f0-8bc310269d1f tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.736378 Sep 27 01:42:29.291581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1450/2964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:28 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:29.306452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:29.320213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:29.323121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Searching by: {'deleted': False, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:42:29.356285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.358623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.359931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:29.360901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.369243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.372904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:29.581033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:42:29.726339 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5700326-a795-4ac3-b3e2-c8bbf8c07847 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.433501 Sep 27 01:42:29.727234 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1451/2965] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:42:29 2022] GET /compute/v2.1/servers => generated 675 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:29.731877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:29.732490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:29.765322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.765860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.766299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:29.772245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:29.772737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:29.773191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:30.257311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:42:30.257830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquired lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:42:30.386935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:30.412674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3eebda81-de7c-419e-89ff-6823a2a0254b tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.680593 Sep 27 01:42:30.414350 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1452/2966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:29 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:30.990807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:30.991444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:31.014129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.016737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.018182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:31.021294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.021857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.022304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:31.320714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:31.340576 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c8a8e36-74c1-4eec-8321-c09f960633e5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1273 microversion: 2.1 time: 0.919028 Sep 27 01:42:31.344469 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1453/2967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:30 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1273 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:31.364675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:31.365903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:31.385667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.386209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.386683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:31.390104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.393431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.393915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:31.560196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:31.571591 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58b0b1ff-6906-4f63-bc51-46a317b147ed tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1277 microversion: 2.1 time: 0.225422 Sep 27 01:42:31.589522 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1454/2968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:31 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:31.591914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:31.591914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:31.601501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.601501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.601501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:31.601501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:31.602009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:31.602009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.097095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:32.116616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fb669c1-72ea-47f6-8996-64764116aeab tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.529799 Sep 27 01:42:32.119248 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1455/2969] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:31 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:32.128642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0ca464-e1cf-4795-80fa-a55db5e5ab2c", "tag": "d88c6c7d-cc79-4cfe-beec-49e368dbdfed"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:32.150509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.154458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.155202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.177729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] Creating event network-changed:d88c6c7d-cc79-4cfe-beec-49e368dbdfed for instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c on n-h1-859358-1 Sep 27 01:42:32.191670 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bf3983b1-b416-4241-bf24-a7d1d6a3c023 req-e99dd150-c752-4657-8e9e-a1a39f900598 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070703 Sep 27 01:42:32.193087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1456/2970] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:32.200818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28acc060-a8ce-469b-8a6f-7fb777abe130", "tag": "327aad57-ae84-4acd-afc6-72132cb90b5f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:32.215992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.216933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.217620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.237180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] Creating event network-changed:327aad57-ae84-4acd-afc6-72132cb90b5f for instance 28acc060-a8ce-469b-8a6f-7fb777abe130 on n-h2-859358-1 Sep 27 01:42:32.244326 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a6c7ca24-9b5b-4f07-b07f-a382f83fda9c req-c2f2bba8-3d21-4c4b-bb98-fc0be5f5e567 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047914 Sep 27 01:42:32.246386 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1457/2971] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:32.255472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:32.256363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:32.265941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.266554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.267363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.269575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.270810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.271949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.697489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:32.706654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a89681d-30b8-4691-b8ec-3908aae96114 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.458709 Sep 27 01:42:32.707785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1458/2972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:32 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:32.713938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:32.714852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:32.722698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.723316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.724007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:32.724837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:32.725424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:32.725946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:33.471960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:42:33.491248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=51,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:33.602852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:33.622227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47148ad0-3c06-4afb-9e0e-6d989b7ec9d3 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.912733 Sep 27 01:42:33.622722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1459/2973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:32 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:33.635510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:33.640425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:33.666079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:33.666928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:33.668878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:33.669815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:33.672952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:33.673519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:34.398493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:34.418888 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f4b29b8-59c5-4b39-a08d-417f706190ef tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.787554 Sep 27 01:42:34.423232 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1460/2974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:33 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:34.437689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:34.440656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:34.459669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:34.466152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:34.467548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:34.469588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:34.472712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:34.473489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:34.869152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:34.877532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-258f166f-46a7-482d-8f05-0fcfa776bab4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.452554 Sep 27 01:42:34.878135 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1461/2975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:34 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:34.906181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:34.906809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:34.915364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:34.915858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:34.916298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:34.917001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:34.925051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:34.925553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:35.264305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:35.294455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b5d0a92-f01f-436a-94e0-56ab991989cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.415128 Sep 27 01:42:35.296710 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1462/2976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:34 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:35.307210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:35.308606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:35.312264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:35.323724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:35.333791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:35.334938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:35.335941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:35.336766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:35.337485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.182056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:36.193174 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25002821-b860-4f81-96af-5526a713efbd tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.893304 Sep 27 01:42:36.193946 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1463/2977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:35 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:36.199856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:36.215662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.216960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.217555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.234190 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] Creating event network-changed:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:42:36.241045 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a290531a-498b-4411-82e2-ac2c818ba15e req-7c233db8-e03e-4025-991c-0ae45d138257 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045084 Sep 27 01:42:36.241711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1464/2978] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:36.247766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68048fa5-8e95-436b-98df-681629eaf8ea", "tag": "68bd7fd1-18bf-47c1-84ba-01f792ad1673"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:36.257581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.258059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.258529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.269667 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] Creating event network-changed:68bd7fd1-18bf-47c1-84ba-01f792ad1673 for instance 68048fa5-8e95-436b-98df-681629eaf8ea on n-h1-859358-1 Sep 27 01:42:36.275844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9f4bd2e8-4c53-460a-844e-18b64a8f081f req-a902af88-c3db-416c-b37c-3d09370cfa83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Sep 27 01:42:36.277380 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1465/2979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:36.283688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:36.284834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:36.292153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.292866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.293481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.294328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.294958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.295523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.628710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:36.640519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52e657f6-d4d2-4599-a63c-934c0b493682 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.361858 Sep 27 01:42:36.641120 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1466/2980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:36 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:36.652425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:36.656651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:36.663403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.664334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.665067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.665965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.666575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.667160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.907319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Updating instance_info_cache with network_info: [{"id": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5", "address": "fa:16:3e:57:91:ab", "network": {"id": "a0fdbb8e-f51d-4904-9715-a1b8b06f7dab", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-128252310-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7505cfe6fc404799b610b135ab125c78", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap31cf9b9f-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:42:36.923313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Releasing lock "refresh_cache-bbcc6f19-8243-4ab7-95ce-edcfecac07fa" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:42:36.924392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0e5a02d-504d-4020-a63a-ffa27848377f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action" status: 202 len: 0 microversion: 2.1 time: 8.601911 Sep 27 01:42:36.928799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1515/2981] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:42:28 2022] POST /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa/action => generated 0 bytes in 8608 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:42:36.955338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:36.967735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fbcdfc6-4513-47d8-a9af-5db85f294679 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.322385 Sep 27 01:42:36.981628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1467/2982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:36 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:36.987865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:36.988490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:36.995294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.995777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.996215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:36.997126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:36.997608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:36.998038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:37.083756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Action: 'update', calling method: .version_select at 0x7f24d5a13dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:37.172181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:37.173044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:37.173738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:37.174936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:37.175628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:37.176278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:37.239057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c7385c1-76a0-40fa-80ff-c9c56b50b19b tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a" status: 200 len: 148 microversion: 2.57 time: 0.308820 Sep 27 01:42:37.240053 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1516/2983] 10.222.0.52 () {62 vars in 1303 bytes} [Tue Sep 27 01:42:36 2022] PUT /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a => generated 148 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:42:37.255166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e85e802a-ba04-44e3-bbbc-e9ec9793e523 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '.version_select at 0x7f24d62f6280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:37.369960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:37.379698 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-555afea3-5c20-4099-b5b6-b6bf2aa60177 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.396912 Sep 27 01:42:37.395133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1468/2984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:36 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:37.415187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:37.416415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:37.423404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:37.424114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:37.424742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:37.425734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:37.426463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:37.427118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:37.453435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:38.074145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=34 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:38.212567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:38.222962 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3ee28da-7368-4884-8a6d-7b9b5429d790 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.826391 Sep 27 01:42:38.224427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1469/2985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:37 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:38.230058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Calling method '.version_select at 0x7f24da4ec790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:38.348032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.349947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.350396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:38.351141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.352800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.353514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:38.392493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6affae3-ccd4-4b87-9653-0acc7ec3c2b5 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a/detail" status: 200 len: 463 microversion: 2.57 time: 0.164617 Sep 27 01:42:38.395398 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1470/2986] 10.222.0.52 () {60 vars in 1304 bytes} [Tue Sep 27 01:42:38 2022] GET /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a/detail => generated 463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:42:38.409012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:38.413682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:38.427381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.430756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.436410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:38.437235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.437235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.440448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:38.948349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:38.963568 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07791efc-8ff6-405f-8491-c0279ef656c9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.565305 Sep 27 01:42:38.964989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1471/2987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:38 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:38.977908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:38.979559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:38.990635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.991396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.992002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:38.993462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:38.994072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:38.994878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.498763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:39.508786 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15bb9481-d6b1-4885-825b-17b5c87917a2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.541308 Sep 27 01:42:39.512091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1472/2988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:38 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:39.522905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771474ed-26ff-4877-aeab-7d31880d0176", "tag": "af7b446b-b161-40aa-8ee2-5857e4abe883"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:39.549187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.551716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.552534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.586074 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] Creating event network-changed:af7b446b-b161-40aa-8ee2-5857e4abe883 for instance 771474ed-26ff-4877-aeab-7d31880d0176 on n-h1-859358-1 Sep 27 01:42:39.597926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3e9f8405-046d-438f-8cdb-819dd090780b req-6ec4d033-9b73-47d0-8ca4-bac689a5a31e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084430 Sep 27 01:42:39.598896 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1473/2989] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:39.606125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:39.606946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:39.614840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.615935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.616609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.617653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.618860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.620094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.717415 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e85e802a-ba04-44e3-bbbc-e9ec9793e523 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/53b479dd-f57e-4c37-bc9c-5059c3b002d4" status: 202 len: 0 microversion: 2.1 time: 2.476003 Sep 27 01:42:39.718315 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1517/2990] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:42:37 2022] DELETE /compute/v2.1/os-floating-ips/53b479dd-f57e-4c37-bc9c-5059c3b002d4 => generated 0 bytes in 2477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:42:39.724455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Action: 'update', calling method: .version_select at 0x7f24d61d65e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:39.815332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.816072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.816668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.817576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.818212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.818794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.857047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.857964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.858578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.859490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:39.860084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:39.860696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:39.932241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5037fd0-dbe8-460d-b44e-f3dcc4b84ed3 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a?user_id=ad137e1464a046b2af14e3923f359e75" status: 200 len: 148 microversion: 2.57 time: 0.212819 Sep 27 01:42:39.933529 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1518/2991] 10.222.0.52 () {62 vars in 1384 bytes} [Tue Sep 27 01:42:39 2022] PUT /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a?user_id=ad137e1464a046b2af14e3923f359e75 => generated 148 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:42:40.023366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0ca464-e1cf-4795-80fa-a55db5e5ab2c", "name": "network-vif-plugged", "status": "completed", "tag": "d88c6c7d-cc79-4cfe-beec-49e368dbdfed"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:40.036884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.037592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.038277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.055744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] Creating event network-vif-plugged:d88c6c7d-cc79-4cfe-beec-49e368dbdfed for instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c on n-h1-859358-1 Sep 27 01:42:40.063959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-606c4840-304b-403b-a3ed-c56980f0b887 req-ecabbc53-6839-48bd-b611-d317163fc69c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129040 Sep 27 01:42:40.065004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1519/2992] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:40.079069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:40.080006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:40.101318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.103762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.104326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.105457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.105999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.106764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.262216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:40.278364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e74f223-5ce4-40bf-9c34-e1acf37b9132 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.677469 Sep 27 01:42:40.279771 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1474/2993] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:39 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:40.289625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6b6c78-61bb-4d45-be72-9d33a978d6fd", "tag": "71a7a136-8e7c-4900-9dfd-2d0cba90bb31"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:40.309983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.310848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.311778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.332126 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] Creating event network-changed:71a7a136-8e7c-4900-9dfd-2d0cba90bb31 for instance 2f6b6c78-61bb-4d45-be72-9d33a978d6fd on n-h2-859358-1 Sep 27 01:42:40.345948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a12ae81a-6caf-451d-8953-c4e8a68f2f1f req-cc6786fc-4f3b-43b8-b11f-450f7b39fb3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061193 Sep 27 01:42:40.348687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:40.349025 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1475/2994] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:40.357078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68094d2a-4da5-4a90-8978-b97b85c9d369 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '.version_select at 0x7f24d6245670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:40.364624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e734135b-846e-4e28-994e-990186f55fbe tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.293504 Sep 27 01:42:40.367652 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1520/2995] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:40 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:40.374899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08e70f29-0e54-4df2-a03c-b2e7cf60be83 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] Calling method '.version_select at 0x7f24d62da5e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:40.459108 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08e70f29-0e54-4df2-a03c-b2e7cf60be83 tempest-QuotasAdminTestV257-1661681251 tempest-QuotasAdminTestV257-1661681251-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a?user_id=ad137e1464a046b2af14e3923f359e75" status: 200 len: 190 microversion: 2.57 time: 0.090290 Sep 27 01:42:40.471470 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1521/2996] 10.222.0.52 () {60 vars in 1364 bytes} [Tue Sep 27 01:42:40 2022] GET /compute/v2.1/os-quota-sets/892486b717c44060a58c6e99d2047a8a?user_id=ad137e1464a046b2af14e3923f359e75 => generated 190 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:42:40.487306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:40.488430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:40.496016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.496748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.497372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.498243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.501004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.502138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.881280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:40.892539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0becaf1d-e2b0-4b75-a26b-c09e01c1ead8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.414190 Sep 27 01:42:40.905291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1522/2997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:40 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:40.913824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:40.915301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:40.922480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.923179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.923764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:40.924624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:40.925440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:40.926020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:41.665307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:41.682670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12be05c1-2143-4a05-86e6-455b4dc1022c tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1370 microversion: 2.1 time: 0.775859 Sep 27 01:42:41.683269 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1523/2998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:40 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1370 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:41.699759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:41.700606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:41.711152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:41.712657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:41.714177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:41.715149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:41.717015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:41.718547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.073674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:42.075564 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68094d2a-4da5-4a90-8978-b97b85c9d369 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9b273a93-2ec5-4aff-b2e4-460332d298f9" status: 202 len: 0 microversion: 2.1 time: 1.724930 Sep 27 01:42:42.076759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1476/2999] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:42:40 2022] DELETE /compute/v2.1/os-security-groups/9b273a93-2ec5-4aff-b2e4-460332d298f9 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:42:42.084417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:42.085744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e492a690-5c7c-41f9-9700-856543c159d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.398112 Sep 27 01:42:42.087060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:42.105778 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1524/3000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:41 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:42.107109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.107534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.108291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.109115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.109765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.110264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.126233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:42.126945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:42.134068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.134663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.135103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.138069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.138553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.138986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.450583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:42.477394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5261c8d0-84e4-418a-b961-6d64de84c9e6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.398213 Sep 27 01:42:42.479510 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1477/3001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:42 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:42.504035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:42.505487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:42.525893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.526662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.527312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.529420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.530087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.530692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.587439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:42.815757 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae31419d-be3f-4f57-99e7-86dfe01ba09c tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 204 len: 0 microversion: 2.1 time: 0.333485 Sep 27 01:42:42.819280 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1478/3002] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:42 2022] DELETE /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:42:42.826136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28acc060-a8ce-469b-8a6f-7fb777abe130", "name": "network-vif-plugged", "status": "completed", "tag": "327aad57-ae84-4acd-afc6-72132cb90b5f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:42.844032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.844768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.845400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.862631 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] Creating event network-vif-plugged:327aad57-ae84-4acd-afc6-72132cb90b5f for instance 28acc060-a8ce-469b-8a6f-7fb777abe130 on n-h2-859358-1 Sep 27 01:42:42.872009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:42.887823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dfe900a4-3c18-4664-95cb-e1c01df6a0db req-48e9cea2-95ac-4da6-a78d-724412f65b46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069267 Sep 27 01:42:42.888517 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48c937b2-001e-4ab9-a241-9b3429570c4e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.776756 Sep 27 01:42:42.889149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1525/3003] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:42 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:42.891109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1479/3004] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:42.900465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:42.901830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:42.902631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:42.905794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:42.919456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.920391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.923286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.924190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.924596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.924726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.925131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.925658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.926084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:42.926431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:42.926860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:42.927840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.242225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:43.247340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:43.252222 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26dc02fb-bef2-4525-b70a-d61f07cebe71 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1555 microversion: 2.1 time: 0.361686 Sep 27 01:42:43.252805 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1526/3005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:42 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1555 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:43.257323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:43.258185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:43.264645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.265077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.265724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.266433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.266913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.267310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.285057 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0a10cc4-295a-44bf-a56a-f6bf381ae78f tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1508 microversion: 2.1 time: 0.392290 Sep 27 01:42:43.286330 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1480/3006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:42 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1508 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:43.293748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:43.300705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:43.312239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.312925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.313579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.314467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.315071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.316362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.482503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:43.490368 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d7f4570b-38ac-409e-8eaf-c0a491c689a4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.236546 Sep 27 01:42:43.490952 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1527/3007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:43 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:43.511455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:43.512085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:43.522482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.522972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.523406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.524633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.525091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.525644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.616569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0564ff19-3672-4d82-90d6-ac355662ee0b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.329002 Sep 27 01:42:43.617388 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1481/3008] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:42:43 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:43.911409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:43.912035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:43.921048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:43.931080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.932326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.933257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.934792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:43.936769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:43.937412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:43.938088 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55457079-5d93-463d-89e1-ab6e0173f2ad tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.435863 Sep 27 01:42:43.939544 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1528/3009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:43 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:44.314748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:44.315378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:44.322736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:44.323312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:44.323821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:44.324783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:44.325313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:44.326012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:44.429581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:44.447003 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7f78b38-b798-4bcd-8b07-948105dadd92 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.538753 Sep 27 01:42:44.448481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1482/3010] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:43 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:44.515362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:44.516287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:44.527280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:44.528903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:44.529621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:44.532308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:44.534253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:44.539478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:44.619951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:44.629978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0130468a-6482-45ff-9adb-b69f8263cec6 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1508 microversion: 2.1 time: 0.319187 Sep 27 01:42:44.630562 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1529/3011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:44 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:44.824052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:44.831899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d80f6762-9a83-4dc8-af51-9c663516f848 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.320697 Sep 27 01:42:44.836206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1483/3012] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:44 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:44.936663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68048fa5-8e95-436b-98df-681629eaf8ea", "name": "network-vif-plugged", "status": "completed", "tag": "68bd7fd1-18bf-47c1-84ba-01f792ad1673"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:44.960651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:44.961160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:44.961689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:44.984941 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] Creating event network-vif-plugged:68bd7fd1-18bf-47c1-84ba-01f792ad1673 for instance 68048fa5-8e95-436b-98df-681629eaf8ea on n-h1-859358-1 Sep 27 01:42:44.999963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-840104737", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "1b88011d-8a39-4a53-a94e-f34c079e7aa5"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:45.000688 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5382c1c9-76c9-41c7-b7a2-c5c69264344c req-20e7b65c-7f1f-44f5-a73c-f3686a1db49e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066722 Sep 27 01:42:45.002346 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1484/3013] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:42:45.011170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:45.012968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:45.064990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:45.067813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:45.072272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:45.081162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:45.083110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:45.084827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:45.093869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] validate_networks() for [('1b88011d-8a39-4a53-a94e-f34c079e7aa5', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:45.880527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:45.907227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cedc443e-b11d-41bd-adf1-78b2432d4d92 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1315 microversion: 2.1 time: 0.902519 Sep 27 01:42:45.909742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1485/3014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:45 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:45.929275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:45.930824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:45.938667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:45.939669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:45.940461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:45.941588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:45.942327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:45.943615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.298514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:46.314098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c73ca201-c0ec-40a5-8476-7b0eb0f9bac9 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.400568 Sep 27 01:42:46.315353 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1486/3015] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:45 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:46.328997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:46.330006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:46.340962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.341852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.342632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.343568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.344245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.345039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.629606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:46.630153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:46.630718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:46.631366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:46.631881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:46.654440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.657937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.661179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.662336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.665265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.669305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.737384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Getting quotas for project bc10d370184b4feca9e780670b76b3ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:46.751766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Getting quotas for user 7c1c182e183348bf9124846f87e1de54 and project bc10d370184b4feca9e780670b76b3ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:46.778893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:46.781553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:46.841007 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d255eee-b626-4db2-99e9-4e70b641de51 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053601 Sep 27 01:42:46.842288 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1530/3016] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:42:46.848227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:46.849071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:46.872185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.884550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.887108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.888876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:46.891745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:46.892300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:46.979829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:46.994454 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-080daf7b-979b-4ae8-9e8d-d9d43eae80b9 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1508 microversion: 2.1 time: 0.676727 Sep 27 01:42:47.010833 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1487/3017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:46 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1508 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:47.028550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0ca464-e1cf-4795-80fa-a55db5e5ab2c", "tag": "d88c6c7d-cc79-4cfe-beec-49e368dbdfed"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:47.063441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.063924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.064356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.118371 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] Creating event network-changed:d88c6c7d-cc79-4cfe-beec-49e368dbdfed for instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c on n-h1-859358-1 Sep 27 01:42:47.131670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:47.142752 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-78cb0a35-dfdd-4184-adf2-9f104cb7c7c8 req-7ad8b71d-4a2a-4930-98a4-1608fec6c4b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127712 Sep 27 01:42:47.148448 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1488/3018] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:47.163889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbce5db2-2925-4bab-ac31-4f526c2d988f tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1394 microversion: 2.1 time: 0.318863 Sep 27 01:42:47.167184 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1531/3019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:46 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1394 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:47.177978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:47.179325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7689f720-3694-4895-9c78-79573d7ca52f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:47.180235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7689f720-3694-4895-9c78-79573d7ca52f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:47.181084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:47.214972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.217408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.220812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.224430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.225151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.226889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.326827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7689f720-3694-4895-9c78-79573d7ca52f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:47.335560 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7689f720-3694-4895-9c78-79573d7ca52f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1224 microversion: 2.1 time: 0.184552 Sep 27 01:42:47.351840 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1489/3020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:47 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:47.665310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:47.683988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce7d1598-c040-49dc-9987-dcbe2f6a95b5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1501 microversion: 2.1 time: 0.514881 Sep 27 01:42:47.686054 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1532/3021] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:47 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1501 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:47.691820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771474ed-26ff-4877-aeab-7d31880d0176", "name": "network-vif-plugged", "status": "completed", "tag": "af7b446b-b161-40aa-8ee2-5857e4abe883"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:47.716337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.718972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.722627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.787674 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] Creating event network-vif-plugged:af7b446b-b161-40aa-8ee2-5857e4abe883 for instance 771474ed-26ff-4877-aeab-7d31880d0176 on n-h1-859358-1 Sep 27 01:42:47.802108 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9a63d0db-4483-48d1-973c-855a6608bc4e req-4c753c79-2e67-45ba-aa68-9df031fd72be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114351 Sep 27 01:42:47.804269 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1533/3022] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:47.819349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:47.822593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:47.844226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.844934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.847419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.849016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.850574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.851177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.928230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcc6f19-8243-4ab7-95ce-edcfecac07fa", "name": "network-vif-deleted", "tag": "31cf9b9f-72f3-4f00-ad02-de72551ee8c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:47.945186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:47.945919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:47.946530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:47.972227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] Creating event network-vif-deleted:31cf9b9f-72f3-4f00-ad02-de72551ee8c5 for instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa on n-h2-859358-1 Sep 27 01:42:47.979004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b453c6a2-6c55-4c1b-a431-bdf5c84495d2 req-9b994787-72ac-4571-99d2-d31b745ff383 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.635305 Sep 27 01:42:47.979804 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1490/3023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:47.990894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:47.995593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.013199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.014062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.014759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.015675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.016394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.016953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.048157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:48.062377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lazy-loading 'flavor' on Instance uuid 68048fa5-8e95-436b-98df-681629eaf8ea {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:48.226613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:48.228719 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64982680-a0a0-49fb-b689-e3285a1e587d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "POST /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea/action" status: 202 len: 0 microversion: 2.1 time: 0.239266 Sep 27 01:42:48.234765 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1491/3024] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:42:47 2022] POST /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:42:48.240648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69c84c0f-13a9-48df-9ea0-a2aa7132e496 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.432035 Sep 27 01:42:48.241656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1534/3025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:47 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:48.252821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:48.255401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.267752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:48.269139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:48.269257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.274611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.275503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.277034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.277535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.277996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.278629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.278885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.279749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.280312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.280660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.281319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.282035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.334135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.334957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.335550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.336823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lazy-loading 'fault' on Instance uuid bbcc6f19-8243-4ab7-95ce-edcfecac07fa {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:48.365906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:48.421202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3cd5251bca4e2dad6da15d11423667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7505cfe6fc404799b610b135ab125c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:48.438106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-268d777a-fef8-430f-9e4a-0070d0490aec tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 200 len: 1312 microversion: 2.1 time: 0.198542 Sep 27 01:42:48.441465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1492/3026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:48 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:48.456747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:48.457398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.465541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.477427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.477427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.477427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.477427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.477748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.503942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:48.520390 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89c99c6e-a729-4aa0-ad78-5e2ffe3bfffe tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1576 microversion: 2.1 time: 0.276872 Sep 27 01:42:48.521291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1535/3027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:48 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:48.528097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:48.529521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.552856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.553961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.559698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.560877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.561688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.563870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.591121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:48.708575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:48.717887 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9cf23d4c-b639-4938-b667-05252a20bba9 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1220 microversion: 2.1 time: 0.195061 Sep 27 01:42:48.727284 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1536/3028] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:48 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:48.735102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:48.744303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:48.769261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.770650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.771406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.772445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:48.773073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:48.776330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:48.944809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3bb71d7-29dd-40dd-b930-9c4afedb9cd3 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215603 Sep 27 01:42:48.946756 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1537/3029] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:42:48 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:49.011893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:49.034452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40386189-f0e3-4ad7-8d82-8b704d8a3cc9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1509 microversion: 2.1 time: 0.585217 Sep 27 01:42:49.035543 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1493/3030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:48 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:49.267224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:49.268002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:49.278162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.278626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.279595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.280502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.287498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.288490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.464145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:49.465115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] [instance: bbcc6f19-8243-4ab7-95ce-edcfecac07fa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:49.481878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.487496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.488114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.494245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.497737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.503152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.564172 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] HTTP exception thrown: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Request method failure captured: Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa HTTP/1.1 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlSWt25kf_dJtYHqOz8ZjlvPYzgwXm7he-tS_eGArGtelWZeFVyozstVBHoUrnsTd-ITU2OUq2lam1xXSXc6nYHhZCp1fnZ9YNbBe2Lc52-XNdrSuv0PgzkjdtXpg4wtyRIwNlanPFR7qj4pqwem_NlBluUhaFzxiWBPjDGe8YQ_iUM Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7505cfe6fc404799b610b135ab125c78 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1179753851 Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:49.571425 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7505cfe6fc404799b610b135ab125c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7505cfe6fc404799b610b135ab125c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7505cfe6fc404799b610b135ab125c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7505cfe6fc404799b610b135ab125c78", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1179753851 Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7505cfe6fc404799b610b135ab125c78 Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1179753851 Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueTestJSONUnderV235-1179753851-project Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ed3cd5251bca4e2dad6da15d11423667 Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1179753851-project Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. Sep 27 01:42:49.572892 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'bbcc6f19-8243-4ab7-95ce-edcfecac07fa'} Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:49.574542 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. Sep 27 01:42:49.576302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:49.578313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] Returning 404 to user: Instance bbcc6f19-8243-4ab7-95ce-edcfecac07fa could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:49.582844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40aa7e02-26df-4323-9dca-b4732815ad85 tempest-ServerRescueTestJSONUnderV235-1179753851 tempest-ServerRescueTestJSONUnderV235-1179753851-project] 10.222.0.52 "GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa" status: 404 len: 111 microversion: 2.1 time: 0.119620 Sep 27 01:42:49.587139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1494/3031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:49 2022] GET /compute/v2.1/servers/bbcc6f19-8243-4ab7-95ce-edcfecac07fa => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:49.777248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:49.792164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-895bb44d-495f-4a60-923f-77c033d367f8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1319 microversion: 2.1 time: 0.528708 Sep 27 01:42:49.795238 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1538/3032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:49 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:49.800841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:49.801729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:49.819624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.822225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.826147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.827815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.828495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.829156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.877651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1611822224", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:49.967099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:49.967671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:49.968267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:49.969009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:49.970334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:49.984220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.984965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.987206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:49.988520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:49.989204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:49.989823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:50.035807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Getting quotas for project 7615b03b04864814bd5266cea580c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:50.065865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Getting quotas for user c171fd79cc57437fa1048733a17aba08 and project 7615b03b04864814bd5266cea580c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:50.082759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:50.085945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:50.131390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:50.150094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-722476e9-3b8b-4a85-994f-34974a5f1539 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1282 microversion: 2.1 time: 0.353412 Sep 27 01:42:50.150808 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1539/3033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:49 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:50.151418 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6adf4e83-268f-49c1-8772-6c26350a5959 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.555149 Sep 27 01:42:50.152995 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1495/3034] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 27 01:42:50.158177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6b6c78-61bb-4d45-be72-9d33a978d6fd", "name": "network-vif-plugged", "status": "completed", "tag": "71a7a136-8e7c-4900-9dfd-2d0cba90bb31"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:50.160984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:50.161924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:50.170300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:50.171074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:50.171513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:50.172389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:50.173476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:50.174072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:50.183952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:50.185137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:50.185711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:50.227221 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] Creating event network-vif-plugged:71a7a136-8e7c-4900-9dfd-2d0cba90bb31 for instance 2f6b6c78-61bb-4d45-be72-9d33a978d6fd on n-h2-859358-1 Sep 27 01:42:50.239365 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2fef1ff5-4ff9-46f2-b6b7-86df5220b52a req-1bb71c17-acca-42e3-a2c9-6df8db503eff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087042 Sep 27 01:42:50.239992 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1540/3035] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:50.256298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:50.257020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:50.360546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:50.387701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:50.391829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:50.410792 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03a6f859-798d-4a43-b73c-357e8ecf822a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1454 microversion: 2.91 time: 0.162698 Sep 27 01:42:50.425548 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1541/3036] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:50 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:50.819963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:50.822175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:50.834205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:50.834839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:50.835438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:50.836326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:50.837432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:50.839499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.133813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.145296 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5139f79-002f-488e-92f0-27abc0d3a0a6 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1492 microversion: 2.1 time: 0.990952 Sep 27 01:42:51.151312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1496/3037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:50 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1492 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:51.177914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:51.178553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:51.188945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.194890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.195614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.196587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.197188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.197723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.376179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.390566 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecaf8267-1988-4bfb-8486-7ce86e13914f tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1282 microversion: 2.1 time: 0.217000 Sep 27 01:42:51.415837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1497/3038] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:51 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:51.441463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:51.441597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:51.475095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.475772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.477977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.479538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.481688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.485287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.553938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:51.584695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.595053 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbbcf283-95a9-4418-a51a-16246bda2f3f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 200 len: 1507 microversion: 2.1 time: 0.781824 Sep 27 01:42:51.595793 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1542/3039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:50 2022] GET /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:51.603720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:51.605138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:51.613762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.614597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.615278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.616221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.616905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.617593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.683016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:51.696890 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7e935db-3ec1-4db5-b777-2118f0990782 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 204 len: 0 microversion: 2.1 time: 0.279614 Sep 27 01:42:51.700601 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1498/3040] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:51 2022] DELETE /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:42:51.704080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.706360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:51.707416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:51.715614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.717588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.718209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.720151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.721187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.721856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.722452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.723101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.730439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-facb3488-50ea-4538-ba1f-b32127a6eba1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1506 microversion: 2.91 time: 0.133337 Sep 27 01:42:51.731511 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1543/3041] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:51 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1506 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:51.737123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28acc060-a8ce-469b-8a6f-7fb777abe130", "tag": "327aad57-ae84-4acd-afc6-72132cb90b5f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:51.749203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.750058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.750723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.768062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] Creating event network-changed:327aad57-ae84-4acd-afc6-72132cb90b5f for instance 28acc060-a8ce-469b-8a6f-7fb777abe130 on n-h2-859358-1 Sep 27 01:42:51.774279 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a0716111-1fe7-4280-b1f0-a1f63968ab3a req-b8f4d5e1-fc8c-4d02-8985-3cf5da90bc98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040510 Sep 27 01:42:51.778284 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1544/3042] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:51.784444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:51.785209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 2f6b6c78-61bb-4d45-be72-9d33a978d6fd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:51.791879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.792365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.792965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.793708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:51.794216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:51.794651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:51.971869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:51.981356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2881da83-9f46-48a0-a84b-fe3b64e8b093 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd" status: 200 len: 1319 microversion: 2.1 time: 0.201693 Sep 27 01:42:51.993982 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1545/3043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:51 2022] GET /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:52.003051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:52.003817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:52.010531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.011193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.011787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.012637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.013245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.014024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.292871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.306659 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-162d1565-cd7d-4a2d-b891-a550f2fc75c0 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1576 microversion: 2.1 time: 0.607004 Sep 27 01:42:52.307519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1499/3044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:51 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1576 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:52.376250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.390156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31450941-c297-47d5-bb53-db35a5d49ae5 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1498 microversion: 2.1 time: 0.394362 Sep 27 01:42:52.391454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1546/3045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:51 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:52.418050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:52.418672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:52.426636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.427590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.428379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.429291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.432566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.433217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.550950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.559627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3670922a-b048-468b-a80e-f03405fc0c75 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1282 microversion: 2.1 time: 0.145993 Sep 27 01:42:52.560773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1500/3046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:52 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:52.765185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:52.765828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:52.780916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.781443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.781884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.787068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:52.787711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:52.790176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:52.932352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.942601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.944164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:52.951474 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-113c2ce4-bd4e-473c-9384-bd2334ffbb9f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1514 microversion: 2.91 time: 0.192648 Sep 27 01:42:52.969515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1547/3047] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:52 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:53.008568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:53.009227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 2f6b6c78-61bb-4d45-be72-9d33a978d6fd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:53.015721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.016218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.016868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.017612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.018117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.018511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.413571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:53.414265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:53.421096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.421803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.422232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.422931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.423378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.423976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.573929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:53.585358 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06ca8b29-19f4-40f4-9307-45e626420360 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd" status: 200 len: 1506 microversion: 2.1 time: 0.581591 Sep 27 01:42:53.586517 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1501/3048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:53 2022] GET /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:53.591644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:53.592362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:53.595214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:53.605586 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ac8f962-e944-4a51-8ac6-1f5ec3baa3f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1498 microversion: 2.1 time: 0.196086 Sep 27 01:42:53.607224 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1548/3049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:53 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:53.611751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:53.612244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 2f6b6c78-61bb-4d45-be72-9d33a978d6fd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:53.614665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.615326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.616108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.618508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.619173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.619739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.619926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.620226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.620723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.621428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.621882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.622306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.656747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 2f6b6c78-61bb-4d45-be72-9d33a978d6fd] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:53.738436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e74f409a-3a06-4c0e-a989-9d6166dbc78f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd" status: 204 len: 0 microversion: 2.1 time: 0.129869 Sep 27 01:42:53.739246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1549/3050] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:53 2022] DELETE /compute/v2.1/servers/2f6b6c78-61bb-4d45-be72-9d33a978d6fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:42:53.749238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:53.750051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:53.757599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.758091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.758530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.759226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:53.759674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:53.760123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:53.786142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 771474ed-26ff-4877-aeab-7d31880d0176] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:42:53.868094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee78237b-ecee-46b0-b3ff-6bcd58b727c1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "DELETE /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176" status: 204 len: 0 microversion: 2.1 time: 0.122334 Sep 27 01:42:53.868785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1550/3051] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:53 2022] DELETE /compute/v2.1/servers/771474ed-26ff-4877-aeab-7d31880d0176 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:42:53.985600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1195939539", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "04c7aa52-d5db-43ae-895c-bb72985ca189"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:54.044344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] validate_networks() for [('04c7aa52-d5db-43ae-895c-bb72985ca189', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:42:54.073616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.082204 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa0787cc-d379-41f8-89d7-85a9a4a38900 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.494595 Sep 27 01:42:54.082771 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1502/3052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:53 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:54.096353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:54.097233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:54.105466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.106095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.106668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.107519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.108078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.108755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.248580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.260235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.262574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.270565 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7bc6ec83-7681-45f1-89e2-dc8b0f50ee4f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1512 microversion: 2.91 time: 0.184014 Sep 27 01:42:54.273411 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1503/3053] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:54 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:54.556387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:42:54.557422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:42:54.557967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:42:54.558458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:42:54.558939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:42:54.568242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.569044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.569577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.570378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.571394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.571885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.591671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Getting quotas for project 97f9c7fb745e44e9bdaf3638ca92d04a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:42:54.598250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Getting quotas for user d2be119b81e84dfb94397455528cbed3 and project 97f9c7fb745e44e9bdaf3638ca92d04a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:42:54.613711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Going to run 2 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:42:54.616426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:54.635896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:54.637015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:54.646587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.647308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.647931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.649408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.650030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.650793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.673836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=a0bbffae-c3d4-4078-a248-f160bdf21877,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:42:54.762777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0eba1752-8742-40b2-9e36-9a1ed6fbe9b0 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.779679 Sep 27 01:42:54.764656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1551/3054] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:42:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 27 01:42:54.774592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:54.780955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.781786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Searching by: {'deleted': False, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:42:54.802436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.803295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.803946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.805710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:54.806389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:54.807789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:54.844924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:42:54.870530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:54.896934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c66c36f1-49f2-4ac5-ae50-23d8afd2dd7d tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.128518 Sep 27 01:42:54.897832 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1552/3055] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:42:54 2022] GET /compute/v2.1/servers => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:54.911566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00572074-993d-4049-8839-688402b691c8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:54.912369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00572074-993d-4049-8839-688402b691c8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:54.989615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00572074-993d-4049-8839-688402b691c8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:54.998386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00572074-993d-4049-8839-688402b691c8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1218 microversion: 2.1 time: 0.092242 Sep 27 01:42:54.999333 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1553/3056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:54 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:55.109797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:55.110772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:55.113573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:55.123713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:55.123922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10cf4680-5359-4719-8d74-3764b201dc2d tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1498 microversion: 2.1 time: 0.493207 Sep 27 01:42:55.124552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:55.125656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:55.126531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:55.127129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:55.127712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:55.133835 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1504/3057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:54 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1498 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:55.306151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:55.307000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:55.313179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:55.316773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:55.317267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:55.317733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:55.318427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:55.322739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:55.323194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:55.324286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7068450-0301-4768-89bf-b9cedb05d8f3 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.222808 Sep 27 01:42:55.334680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1554/3058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:55 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:55.446098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:55.455950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:55.461699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:55.472727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:55.480837 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a57ee63-f0ba-47b7-8024-77ab042d0269 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1512 microversion: 2.91 time: 0.179275 Sep 27 01:42:55.482364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1505/3059] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:55 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:42:56.028843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:56.029581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:56.053665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.054219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.054672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.058399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.058943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.060839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.102844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68048fa5-8e95-436b-98df-681629eaf8ea", "name": "network-vif-deleted", "tag": "68bd7fd1-18bf-47c1-84ba-01f792ad1673"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:56.155918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.156514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.160442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.200798 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] Creating event network-vif-deleted:68bd7fd1-18bf-47c1-84ba-01f792ad1673 for instance 68048fa5-8e95-436b-98df-681629eaf8ea on n-h1-859358-1 Sep 27 01:42:56.208878 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-637ab8ef-1980-40ce-82c2-c8a0efb79b12 req-57c81255-67b4-447e-b0a1-9b4d6267d579 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111279 Sep 27 01:42:56.209825 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1506/3060] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:42:56.218472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:56.222584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:56.237924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.238470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.239015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.239740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.240200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.240631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.312050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:56.323840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-682064e5-2a4f-4849-a971-74e460bbc6d5 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1222 microversion: 2.1 time: 0.299843 Sep 27 01:42:56.324430 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1555/3061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:56 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1222 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:56.350532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:56.351375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:56.362238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.365103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.366620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.368460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:56.369051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:56.369527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:56.944982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:56.970585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf81912c-2f2c-4ada-beab-43cf10bb8ebd tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.624189 Sep 27 01:42:56.971218 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1556/3062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:56 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:56.995962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:56.996616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:57.014090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:57.014592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:57.015029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:57.015748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:57.016209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:57.021620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:57.077704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a7e63481c140cfad6744cdd2d4d4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1988e26dd26641b09d27d751f4ebfde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:57.095463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-673d4176-3274-491b-930f-ab242a463528 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 200 len: 1456 microversion: 2.1 time: 0.882801 Sep 27 01:42:57.105302 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1507/3063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:56 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 1456 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:57.123700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6b6c78-61bb-4d45-be72-9d33a978d6fd", "name": "network-vif-deleted", "tag": "71a7a136-8e7c-4900-9dfd-2d0cba90bb31"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:57.138965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:57.139970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:57.140719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:57.169134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] Creating event network-vif-deleted:71a7a136-8e7c-4900-9dfd-2d0cba90bb31 for instance 2f6b6c78-61bb-4d45-be72-9d33a978d6fd on n-h2-859358-1 Sep 27 01:42:57.178110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d1bc85c0-c4d0-45ab-b8a4-824e35109463 req-6eabc640-da99-4205-b989-29a113d11a0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070107 Sep 27 01:42:57.179565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1508/3064] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:57.285538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:57.297907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:57.299573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:57.314480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4563f653-b4b0-4c0b-b578-eb5d9b66f65e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1533 microversion: 2.91 time: 0.333177 Sep 27 01:42:57.315827 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1557/3065] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:56 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1533 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:57.352309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:57.354139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:57.364312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:57.366980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:57.369786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:57.371530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:57.378299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:57.378299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:57.606932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:57.615437 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5703bdc9-c4d7-461d-bfdf-f826f8ec1dc4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1214 microversion: 2.1 time: 0.269331 Sep 27 01:42:57.622248 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1558/3066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:57 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1214 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:42:58.001532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.002169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.060842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.061506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.065114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.068236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.068608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.069055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.267004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.267724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.291039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.291675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.294308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.295080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.300577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.301156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.475767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lazy-loading 'services' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:58.514243 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e458866-e80d-4bb8-ba5b-c98663704642 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1938 microversion: 2.91 time: 1.172966 Sep 27 01:42:58.517713 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1509/3067] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:57 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1938 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:42:58.522443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:58.526320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.532509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.535041 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-222ecf91-c6ac-4cbf-b258-0ecefb2508d7 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.542074 Sep 27 01:42:58.535694 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1559/3068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:57 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:58.544870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.558334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b", "tag": "8d3c4334-aa06-4f7a-bf05-f8502647f827"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:58.558976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.560268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.562360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.564369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.565547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.596631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.597891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.598476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.605817 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea HTTP/1.1 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:58.613047 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.614698 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '68048fa5-8e95-436b-98df-681629eaf8ea'} Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:58.615641 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.618010 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.619291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:58.619291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6720a317-fba3-4bc1-9c80-c7431eef442f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 404 len: 111 microversion: 2.1 time: 0.098267 Sep 27 01:42:58.638468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1510/3069] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:58 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:58.639960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] Creating event network-changed:8d3c4334-aa06-4f7a-bf05-f8502647f827 for instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b on n-h2-859358-1 Sep 27 01:42:58.649060 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cab03880-f011-4d9a-b855-24b9a56188bb req-ec6ee47c-f9a7-422e-86b9-6fd3d938dce7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098797 Sep 27 01:42:58.650280 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1560/3070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:58.655335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.655962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.657041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.657828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.666228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.668572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.669474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.670553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.671462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.672232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.686138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.688312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea HTTP/1.1 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:58.690272 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.692187 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '68048fa5-8e95-436b-98df-681629eaf8ea'} Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:58.693016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.694456 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.695854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.695854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.695854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.696664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:58.697297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.697992 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7187768-b08c-4a6d-9679-de6488c4835c tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 404 len: 111 microversion: 2.1 time: 0.046317 Sep 27 01:42:58.698795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1561/3071] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:58 2022] DELETE /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:58.702825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.706461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.707280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.715872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.716535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.717043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.718088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.718495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.718956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.928779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:58.942063 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0b8fe48-00a3-4e08-8d0c-a8313c497390 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1278 microversion: 2.1 time: 0.241752 Sep 27 01:42:58.942729 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1562/3072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:58 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:42:58.948384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:58.960243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 68048fa5-8e95-436b-98df-681629eaf8ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:58.968835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.969460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.970146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.971177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:58.971635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:58.972218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:58.988182 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea HTTP/1.1 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:58.990023 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.991585 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '68048fa5-8e95-436b-98df-681629eaf8ea'} Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:58.992471 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. Sep 27 01:42:58.993980 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:58.996236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 68048fa5-8e95-436b-98df-681629eaf8ea could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:58.997207 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c703e36-bbe1-4990-84bb-491f163d35ab tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea" status: 404 len: 111 microversion: 2.1 time: 0.052986 Sep 27 01:42:59.000843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lazy-loading 'services' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:59.001621 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1563/3073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:58 2022] GET /compute/v2.1/servers/68048fa5-8e95-436b-98df-681629eaf8ea => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.007017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.007619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.015463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:42:59.017015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.017623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.018068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.018932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.019392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.020067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.040753 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.051716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e11e16dc-36a7-45b6-af7f-d34082bda769 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1938 microversion: 2.91 time: 0.411021 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 HTTP/1.1 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:59.058237 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.060910 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '833a2d0e-8a39-4f1c-966e-958c9c1bc1f2'} Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.073399 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.076177 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.081929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1511/3074] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:58 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1938 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:59.090435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.092197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.093030 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22c2bd37-6af5-4bb3-bb3a-19a469a59470 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 404 len: 111 microversion: 2.1 time: 0.090362 Sep 27 01:42:59.096564 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1564/3075] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:59 2022] DELETE /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.100512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.101009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.106850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.107686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.108110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.108267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.110338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.112919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.126344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.128657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.130740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.131699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.134304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.135328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.177327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbfb4136-dff0-4c71-8562-6aa0cf58a040 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.089612 Sep 27 01:42:59.188393 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1512/3076] 10.222.0.52 () {60 vars in 1217 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:42:59.193825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:59.194370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.195099 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 HTTP/1.1 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:59.197769 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.199142 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '833a2d0e-8a39-4f1c-966e-958c9c1bc1f2'} Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.199886 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. Sep 27 01:42:59.201090 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.202283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.202283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.202458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.203296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.203720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.204272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.204895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.212539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83b22cf6-7679-4e93-99b5-1bee4e23e9f9 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2" status: 404 len: 111 microversion: 2.1 time: 0.111038 Sep 27 01:42:59.213528 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1565/3077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/833a2d0e-8a39-4f1c-966e-958c9c1bc1f2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:42:59.230988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.233726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.240424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lazy-loading 'flavor' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:42:59.249381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.250374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.253525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.254411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.255463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.256471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.290631 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 HTTP/1.1 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:59.294415 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.295916 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2bb4aa0e-b1c8-4d18-915c-d650b18b1822'} Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.296672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.297853 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.299055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.299055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c4c7606-df57-4562-aac7-f5cc29c0aa9f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 404 len: 111 microversion: 2.1 time: 0.079840 Sep 27 01:42:59.301937 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1566/3078] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:59 2022] DELETE /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.312219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.313437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2bb4aa0e-b1c8-4d18-915c-d650b18b1822] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.329106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.331119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.331807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.332745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.334569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.336540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.377424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 HTTP/1.1 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:59.381032 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.382443 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2bb4aa0e-b1c8-4d18-915c-d650b18b1822'} Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.383728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. Sep 27 01:42:59.384953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.387585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2bb4aa0e-b1c8-4d18-915c-d650b18b1822 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.389853 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f2a32d5-3637-4503-8cf6-04f61ac80949 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822" status: 404 len: 111 microversion: 2.1 time: 0.083375 Sep 27 01:42:59.392114 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1567/3079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/2bb4aa0e-b1c8-4d18-915c-d650b18b1822 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.407474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771474ed-26ff-4877-aeab-7d31880d0176", "name": "network-vif-deleted", "tag": "af7b446b-b161-40aa-8ee2-5857e4abe883"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:42:59.433863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.434854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.437168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.459996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] Creating event network-vif-deleted:af7b446b-b161-40aa-8ee2-5857e4abe883 for instance 771474ed-26ff-4877-aeab-7d31880d0176 on n-h1-859358-1 Sep 27 01:42:59.475920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d0c93267-4f9d-45e1-a85e-a8e14880d1c9 req-6ec31ecd-3427-4112-97a5-1f14e50c5049 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081882 Sep 27 01:42:59.479343 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1568/3080] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:42:59.494943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.498247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.515795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.518083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.518643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.520017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.522560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.524732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.543767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c838d650-139c-47e7-a7ac-cd52ee0e2787 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action" status: 202 len: 0 microversion: 2.91 time: 0.353853 Sep 27 01:42:59.545754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1513/3081] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:42:59 2022] POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:42:59.556710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 HTTP/1.1 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:42:59.558886 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.560151 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1'} Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.560881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.562064 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.569077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.571074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8e40b85-ea8e-467d-9198-82ea5cfaf123 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 404 len: 111 microversion: 2.1 time: 0.089439 Sep 27 01:42:59.572177 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1569/3082] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:59 2022] DELETE /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.574880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.576770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.580834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.585542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.599203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.599483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.600095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.601721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.602362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.602961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.603323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.604193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.604801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.604960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.605582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.605703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.707475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:59.718544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:59.722811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:42:59.730212 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-051f7299-10f9-41db-8fa0-07332f5b6e39 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.169031 Sep 27 01:42:59.730938 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1514/3083] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:42:59.735632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.736787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.744066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.744852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.746353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.747534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.748466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.749527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.766540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 HTTP/1.1 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:59.769113 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.770692 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1'} Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.771392 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. Sep 27 01:42:59.772517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.775873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.777062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-acfb9b27-30f3-4819-9c4c-832e0722f93b tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1" status: 404 len: 111 microversion: 2.1 time: 0.044946 Sep 27 01:42:59.778728 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1515/3084] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/2ae9f941-1ffe-4fe2-bd7b-8ac552cdefd1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.787991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.789971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.798512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.799699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.800378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.801635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.802223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.802741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.824104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 HTTP/1.1 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:59.826464 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.827948 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765'} Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.828986 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.830420 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.833517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.836165 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9826f76f-2a8e-4200-8aef-f6ff77c76bbb tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 404 len: 111 microversion: 2.1 time: 0.051676 Sep 27 01:42:59.837489 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1516/3085] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:42:59 2022] DELETE /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.852594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.853290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.859492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.859980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.860412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.861135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.861612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.862033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.876418 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 HTTP/1.1 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:42:59.877982 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.879481 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765'} Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:42:59.880288 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. Sep 27 01:42:59.881654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:42:59.882948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:42:59.882948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-608fc108-155d-49d0-83da-75e81ae24de4 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765" status: 404 len: 111 microversion: 2.1 time: 0.037844 Sep 27 01:42:59.882948 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1517/3086] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/6b31ce21-c7ad-4e97-aadb-5f0e4eb6d765 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:42:59.970055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:42:59.970055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:42:59.979493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.980214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.981109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:42:59.983709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:42:59.984397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:42:59.985101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:00.077192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:00.085423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:00.103433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-036615e9-efb0-46d8-a0a3-6dc5d1967712 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1276 microversion: 2.1 time: 0.139737 Sep 27 01:43:00.105386 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1518/3087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:00.138525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:00.146864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e176782-e19c-44fc-b457-3dedd52d5919 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.573433 Sep 27 01:43:00.147782 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1570/3088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:42:59 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:00.760935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:00.761621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:00.769201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:00.770090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:00.770736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:00.771670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:00.772305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:00.772914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:00.872105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:00.891053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:00.893481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:00.909049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df3272c0-1a60-46cc-b2c2-4cf9bd28cb71 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.152552 Sep 27 01:43:00.909961 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1519/3089] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:00 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:01.127993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:01.128629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:01.147100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.147609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.148299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:01.149213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.149852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.150446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:01.173286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:01.173950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:01.198741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.199283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.199730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:01.200450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.205672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.206152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:01.394715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:01.410543 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1ed4ad8-9b99-4f26-961a-20fdc0e90721 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1276 microversion: 2.1 time: 0.286486 Sep 27 01:43:01.415004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1571/3090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:01 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:01.943947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:01.944656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:01.948868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:01.960437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.963854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.964372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:01.965091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c6e6011-9ab2-4009-85c4-330f16fd20fb tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.793955 Sep 27 01:43:01.965927 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1520/3091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:01 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:01.977379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:01.977379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:01.977379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:02.134494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:02.151903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:02.153694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:02.172878 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44b20da4-bf60-4322-97fc-d10da7e44ed9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.230065 Sep 27 01:43:02.191261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1572/3092] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:01 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:02.441414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:02.442260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:02.454685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:02.457541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:02.461571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:02.463070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:02.467956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:02.470768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:02.712323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:02.721357 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc41ef92-c9c8-4909-bb03-282c17694587 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.284786 Sep 27 01:43:02.722893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1521/3093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:02 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:02.993604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:02.994700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:03.003382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.004106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.004756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.005697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.006304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.006884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.224473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:03.226265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:03.246588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.248134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.248918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.250101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.250889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.252998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.402563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:03.414544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:03.416801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:03.423612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b22a85ec-ae1f-4de0-b66b-2e1c80034f9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.219414 Sep 27 01:43:03.424585 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1522/3094] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:03 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:03.430804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b", "name": "network-vif-plugged", "status": "completed", "tag": "8d3c4334-aa06-4f7a-bf05-f8502647f827"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:03.442108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.442721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.443162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.471479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] Creating event network-vif-plugged:8d3c4334-aa06-4f7a-bf05-f8502647f827 for instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b on n-h2-859358-1 Sep 27 01:43:03.480785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b9099052-df86-46ee-a423-c2cb5987d294 req-9a184884-5563-4c60-9197-bc184f15e0e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053860 Sep 27 01:43:03.484080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1523/3095] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:03.659514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:03.672080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3522efa7-9b0f-4bf3-a342-4937a67bd310 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.683677 Sep 27 01:43:03.685390 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1573/3096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:02 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:03.749824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:03.750647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:03.758608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.759087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.760092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.760792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:03.761638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:03.761748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:03.926309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:03.936469 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7555a97f-6042-4466-9841-051a32904bac tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.193539 Sep 27 01:43:03.937854 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1524/3097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:03 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:04.243543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0bbffae-c3d4-4078-a248-f160bdf21877", "tag": "f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:04.265782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.266366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.266892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.285612 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] Creating event network-changed:f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246 for instance a0bbffae-c3d4-4078-a248-f160bdf21877 on n-h2-859358-1 Sep 27 01:43:04.297014 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a056fc04-0f98-44bf-a542-14f08e511984 req-9a828c2b-2778-4eb4-9472-cb9570b82e59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058075 Sep 27 01:43:04.297682 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1574/3098] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:04.350868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.351432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.359170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.359589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.360021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.360793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.361505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.362081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.367292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:04.381978 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a HTTP/1.1 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:04.384891 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.386762 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'fe47e343-1940-4339-b89c-6eba11c9670a'} Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:04.387783 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.389237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.391682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:04.392753 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93dd0511-edb0-400f-b45d-338c44d91a49 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 404 len: 111 microversion: 2.1 time: 0.046057 Sep 27 01:43:04.396794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1525/3099] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:04 2022] DELETE /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:04.411176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.412061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: fe47e343-1940-4339-b89c-6eba11c9670a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.421629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.422286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.422986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.423831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.424959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.425547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.444224 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a HTTP/1.1 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:04.447419 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.448784 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'fe47e343-1940-4339-b89c-6eba11c9670a'} Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:04.449505 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. Sep 27 01:43:04.454227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.455465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance fe47e343-1940-4339-b89c-6eba11c9670a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:04.455465 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b46433d6-5dc3-452b-9956-64c12bf6322f tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a" status: 404 len: 111 microversion: 2.1 time: 0.051257 Sep 27 01:43:04.455465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1575/3100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:04 2022] GET /compute/v2.1/servers/fe47e343-1940-4339-b89c-6eba11c9670a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:04.464442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.464898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.465655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.466099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.486369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.486990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.489749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.490984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.493189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.493476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.493988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.494440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.494554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.495176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.495636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.496070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.550155 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 HTTP/1.1 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:04.552578 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.554145 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7d6c388a-8a85-478e-afe9-7d820f1f2c78'} Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:04.555548 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.557005 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.560002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:04.562356 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed30d9b4-e322-43fd-9902-fb4ad0cdc2fa tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 404 len: 111 microversion: 2.1 time: 0.107036 Sep 27 01:43:04.563466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1526/3101] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:04 2022] DELETE /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:04.575094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.576097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] [instance: 7d6c388a-8a85-478e-afe9-7d820f1f2c78] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.584542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.585871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.586503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.587394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.587988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.588564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.620841 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] HTTP exception thrown: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Request method failure captured: Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 HTTP/1.1 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlPZrjl9i6GW-qeWUFng-x0MDI0yaTSF3HQslbPnerYsrHmFgp2PIy9VX3VQBwUUrWxBbFcTCi5n34uFWzSanpiBjz61gqTiDWsdZ2OFXrRCMLkFGDHBQxD-IjrR-d3TS58G28jRcCSdJ2rw8q3dgYvPODeGZ49qsgmiIYkXulZ3YNM Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:04.626411 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1988e26dd26641b09d27d751f4ebfde2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1988e26dd26641b09d27d751f4ebfde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1988e26dd26641b09d27d751f4ebfde2 Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-2120814137 Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 66a7e63481c140cfad6744cdd2d4d4df Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-2120814137-project Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.628010 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7d6c388a-8a85-478e-afe9-7d820f1f2c78'} Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:04.628851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. Sep 27 01:43:04.630062 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:04.632559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] Returning 404 to user: Instance 7d6c388a-8a85-478e-afe9-7d820f1f2c78 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:04.633963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5498dfe8-aa5e-4c3e-8606-6d2d2b854050 tempest-DeleteServersTestJSON-2120814137 tempest-DeleteServersTestJSON-2120814137-project] 10.222.0.52 "GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78" status: 404 len: 111 microversion: 2.1 time: 0.064765 Sep 27 01:43:04.636657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1527/3102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:04 2022] GET /compute/v2.1/servers/7d6c388a-8a85-478e-afe9-7d820f1f2c78 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:04.649838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:04.666451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:04.668706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:04.678656 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b4505e3-c38f-495c-8284-dcc8cf60a62b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.219477 Sep 27 01:43:04.696642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1576/3103] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:04 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:04.707227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.709608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.731574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.732189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.732646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.738061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.739712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.740466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.960196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:04.960868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:04.963363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:04.982445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.983085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.983758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:04.984518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:04.984981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:04.985552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:05.014526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=40 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:05.676860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:05.697182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6364ce4c-7310-4065-b09d-7b26bde08e25 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1324 microversion: 2.1 time: 0.999767 Sep 27 01:43:05.716294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1528/3104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:04 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1324 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:05.724581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:05.725595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:05.734032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:05.735304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:05.735966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:05.738083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:05.739048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:05.739820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:05.907852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:05.910443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:05.921593 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b66b5a40-5420-4d78-80a9-5c2aed40f6c4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.964382 Sep 27 01:43:05.922877 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1577/3105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:04 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:05.987340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:05.996577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:05.998373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:06.004037 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78b1401d-38f7-41c7-97c7-9bf302cf811c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.285999 Sep 27 01:43:06.013983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1529/3106] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:05 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:06.327766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0140434c-903b-48aa-90d1-3a05ef089b82", "tag": "4fe98671-33e9-46a5-be4e-f2eb453f16ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:06.351146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:06.355251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:06.355875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:06.397889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] Creating event network-changed:4fe98671-33e9-46a5-be4e-f2eb453f16ef for instance 0140434c-903b-48aa-90d1-3a05ef089b82 on n-h1-859358-1 Sep 27 01:43:06.414357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5c2306fc-eb4d-40f1-ac15-99a3605789ef req-4c3a2294-5819-4f3a-b365-5b47d96fd995 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090216 Sep 27 01:43:06.415626 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1578/3107] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:06.720398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:06.722137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:06.732514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:06.733282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:06.736781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:06.737792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:06.738461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:06.739114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:06.948810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:06.949714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:06.957478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:06.958165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:06.958749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:06.959739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:06.960331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:06.961086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.026086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:07.042452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1a02b81-ebda-4c6b-bf83-257ab527f17c tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1520 microversion: 2.1 time: 0.325918 Sep 27 01:43:07.043301 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1530/3108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:06 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:07.048468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:07.049835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:07.071263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.072697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.073309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.074558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.075165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.075803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.255805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:07.269195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:07.270805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:07.283706 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b488689a-6d5c-434b-9b05-9ad9f286ac62 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.239036 Sep 27 01:43:07.311044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:07.314461 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1531/3109] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:07 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:07.325141 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82ded340-027d-4de2-bf99-4d4a02239881 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.382038 Sep 27 01:43:07.326733 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1579/3110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:06 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:07.327831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:07.328378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:07.336324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.344904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.345722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.348175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.349462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.351263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.393201 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] HTTP exception thrown: Action 999 not found Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Request method failure captured: Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b/os-instance-actions/999 HTTP/1.1 Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUUr1jh6TqeUvfkXPU4f1hKq1xHDcZxAMumPifhBem-yV5EBuFkgTQCqq6ZWFIuWiaeeAq7ACQ5u3xgg1toMHfk9iqJhgsSleGzzL0o6um9ge3oPwG9UPZuhommDWhFXdlQP25MPcDr5MfwsZxohQQ7Cl28egOZeeV0V1ezFit0WLo Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:07.404748 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc10d370184b4feca9e780670b76b3ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 7c1c182e183348bf9124846f87e1de54 Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: exception: Action 999 not found Sep 27 01:43:07.406601 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b', 'id': '999'} Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 27 01:43:07.407517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.410313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Returning 404 to user: Action 999 not found {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:07.411438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bb7b3fe-90e0-48d3-b26c-c79b719a4a8d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.095862 Sep 27 01:43:07.413066 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1532/3111] 10.222.0.52 () {58 vars in 1308 bytes} [Tue Sep 27 01:43:07 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b/os-instance-actions/999 => generated 66 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:43:07.423620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '.version_select at 0x7f24d624dca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:07.424934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: 40a1a26c-0771-463a-a0a3-d3b803ad1c69] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:07.457715 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] HTTP exception thrown: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Request method failure captured: Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/40a1a26c-0771-463a-a0a3-d3b803ad1c69/os-instance-actions HTTP/1.1 Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlUUr1jh6TqeUvfkXPU4f1hKq1xHDcZxAMumPifhBem-yV5EBuFkgTQCqq6ZWFIuWiaeeAq7ACQ5u3xgg1toMHfk9iqJhgsSleGzzL0o6um9ge3oPwG9UPZuhommDWhFXdlQP25MPcDr5MfwsZxohQQ7Cl28egOZeeV0V1ezFit0WLo Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:07.461607 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc10d370184b4feca9e780670b76b3ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c1c182e183348bf9124846f87e1de54 Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. Sep 27 01:43:07.463029 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '40a1a26c-0771-463a-a0a3-d3b803ad1c69'} Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:43:07.463863 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. Sep 27 01:43:07.465770 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:07.466902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Returning 404 to user: Instance 40a1a26c-0771-463a-a0a3-d3b803ad1c69 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:07.466902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77004cb0-16b0-408f-b814-5ce039a6cb99 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/40a1a26c-0771-463a-a0a3-d3b803ad1c69/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044419 Sep 27 01:43:07.473982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:07.474540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:07.476354 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1580/3112] 10.222.0.52 () {58 vars in 1296 bytes} [Tue Sep 27 01:43:07 2022] GET /compute/v2.1/servers/40a1a26c-0771-463a-a0a3-d3b803ad1c69/os-instance-actions => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:07.486574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.486809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.487525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.488262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.490324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.490324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.551157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:43:07.711785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ade0ab84-3c4f-4fa1-9c0f-7b62c974ff2d tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 204 len: 0 microversion: 2.1 time: 0.240833 Sep 27 01:43:07.712911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1533/3113] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:07 2022] DELETE /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:43:07.721039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:07.721899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:07.730810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.731550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.732174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:07.733232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:07.734958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:07.735878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:08.137610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:08.145285 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-322ab005-009a-40b8-8803-0cd04f952e0a tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1526 microversion: 2.1 time: 0.428632 Sep 27 01:43:08.156334 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1581/3114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:07 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1526 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:08.322085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:08.323658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:08.327574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:08.350341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:08.351002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:08.359072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:08.362703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:08.363371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:08.367730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:08.373129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:08.373501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:08.374445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:08.378329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:08.378567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:08.380608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:08.381760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:08.383908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:08.592582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:08.602958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:08.605295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:08.613915 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ae5b721-52f2-42c2-9139-86336cd19fcf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.298870 Sep 27 01:43:08.615987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1534/3115] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:08 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:09.173449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:09.180668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:09.181297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:09.184576 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca02019f-55df-48dc-a929-864bfb11239a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.837976 Sep 27 01:43:09.186270 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1582/3116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:08 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:09.188640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:09.192191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:09.192692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:09.197592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:09.198611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:09.199094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:09.199537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:09.540895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:09.554169 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cbee209-b5aa-45c6-b13e-a0dced320bdf tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1526 microversion: 2.1 time: 0.377947 Sep 27 01:43:09.554832 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1535/3117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:09 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1526 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:09.646720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:09.647561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:09.665046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:09.670357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:09.671051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:09.678363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:09.679567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:09.680248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:09.815636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:09.829674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:09.831615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:09.839847 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fecd0429-d7a6-4e03-8c39-8ccc9cc7bd54 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.196535 Sep 27 01:43:09.858119 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1583/3118] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:09 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:10.208598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:10.209513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:10.217547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:10.218321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:10.224259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:10.232859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:10.233628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:10.234237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:10.592143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:10.593008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:10.605854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:10.606349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:10.606778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:10.612644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:10.613111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:10.616296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:11.123544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:11.132049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8dde0fd-87c8-4694-9294-912a50b877ec tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1526 microversion: 2.1 time: 0.555572 Sep 27 01:43:11.146988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1584/3119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:10 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1526 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:11.164134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:11.164825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:11.178901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:11.179402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:11.179884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:11.184423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:11.184919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:11.185978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:11.231945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:11.244912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59db151f-379b-4c69-8447-7ae2fc68e59f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 1.040431 Sep 27 01:43:11.246141 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1536/3120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:10 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:11.349488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:11.363600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:11.368903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:11.381667 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d33b262b-4e81-4903-a5d4-99b1ba6962c8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.231266 Sep 27 01:43:11.383914 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1585/3121] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:11 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:12.168206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:12.169616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:12.181963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.185498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.186844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.190960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.192724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.193496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.271063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:12.272348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:12.295769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.296270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.296703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.297454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.297911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.298339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.512834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1c182e183348bf9124846f87e1de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc10d370184b4feca9e780670b76b3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:12.527102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4599918-b96a-4615-9f19-04101c226a3b tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 200 len: 1484 microversion: 2.1 time: 0.370551 Sep 27 01:43:12.528463 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1537/3122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:12 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 1484 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:12.544625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b", "name": "network-vif-deleted", "tag": "8d3c4334-aa06-4f7a-bf05-f8502647f827"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:12.560789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.561279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.561745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.600328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] Creating event network-vif-deleted:8d3c4334-aa06-4f7a-bf05-f8502647f827 for instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b on n-h2-859358-1 Sep 27 01:43:12.610472 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-54fbe2b2-e001-4e3a-b96e-051141b72418 req-b3ada1b1-f6c4-4e94-8bd9-8c457a7e49d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079122 Sep 27 01:43:12.613676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1538/3123] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:12.624564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:12.625280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:12.666975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.668657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.671077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.672191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:12.672980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:12.674091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:12.688916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:12.708484 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c4f72a7-8b87-44ed-97e1-186ff1d35311 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.444254 Sep 27 01:43:12.709451 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1586/3124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:12 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:12.853309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:12.871171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:12.873749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:12.884089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86023028-e8f6-41a4-9395-7afe13a343e1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.268905 Sep 27 01:43:12.885893 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1539/3125] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:12 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:13.552875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:13.554148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] [instance: a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:13.572494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.573544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.574991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:13.578026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.578697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.580872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:13.619156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] HTTP exception thrown: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Request method failure captured: Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b HTTP/1.1 Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlUUr1jh6TqeUvfkXPU4f1hKq1xHDcZxAMumPifhBem-yV5EBuFkgTQCqq6ZWFIuWiaeeAq7ACQ5u3xgg1toMHfk9iqJhgsSleGzzL0o6um9ge3oPwG9UPZuhommDWhFXdlQP25MPcDr5MfwsZxohQQ7Cl28egOZeeV0V1ezFit0WLo Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:13.624381 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc10d370184b4feca9e780670b76b3ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc10d370184b4feca9e780670b76b3ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: bc10d370184b4feca9e780670b76b3ff Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1473609924 Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7c1c182e183348bf9124846f87e1de54 Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1473609924-project Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. Sep 27 01:43:13.625770 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b'} Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:13.626480 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. Sep 27 01:43:13.627753 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:13.632680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] Returning 404 to user: Instance a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:13.634438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a69b3db1-f109-4af7-a2a1-fe8b3e1f0b98 tempest-InstanceActionsNegativeTestJSON-1473609924 tempest-InstanceActionsNegativeTestJSON-1473609924-project] 10.222.0.52 "GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b" status: 404 len: 111 microversion: 2.1 time: 0.086739 Sep 27 01:43:13.646515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1587/3126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:13 2022] GET /compute/v2.1/servers/a65abf8d-ae4b-41ce-9268-fa3c87f4ce9b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:13.733374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:13.734429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:13.743906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.744453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.745306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:13.746236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.746701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.747206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:13.912404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:13.913025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:13.920580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.921077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.926763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:13.927626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:13.928117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:13.928565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:14.057274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:14.071047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:14.072527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:14.089924 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a052abf-af83-4531-b7c0-147cd95f615c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.181646 Sep 27 01:43:14.105953 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1588/3127] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:13 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:14.206933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:14.235907 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46495259-2772-45be-8177-bb34eaa0345a tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.495947 Sep 27 01:43:14.236695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1540/3128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:13 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:15.120509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:15.122276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:15.139918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:15.142539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:15.145204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:15.152236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:15.152866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:15.153957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:15.426787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:15.441768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:15.443302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:15.472930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-358f7f42-e9e8-4bd9-bcb7-0da44166e376 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.358531 Sep 27 01:43:15.490061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1541/3129] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:15 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:15.500066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:15.500932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:15.508458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:15.509225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:15.509914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:15.510912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:15.511625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:15.512302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:15.651895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1486807060", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:15.760221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] validate_networks() for [('568e538e-5e79-4b38-9778-13586420219d', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:43:15.824436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:15.831087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:15.838412 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa446143-ddc7-49dc-a34a-fc9d8a0fd33e tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.346850 Sep 27 01:43:15.839611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1542/3130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:15 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:16.424350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bbffae-c3d4-4078-a248-f160bdf21877", "name": "network-vif-plugged", "status": "completed", "tag": "f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:16.445644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:16.460504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:16.461685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:16.483722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] Creating event network-vif-plugged:f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246 for instance a0bbffae-c3d4-4078-a248-f160bdf21877 on n-h2-859358-1 Sep 27 01:43:16.493514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9580e8ae-dbd1-40f9-b42f-1f5f040f43f4 req-a05cee95-b37b-4e2e-83a6-318e13067e5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079207 Sep 27 01:43:16.496688 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1543/3131] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:16.515913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:16.518673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:16.544208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:16.544852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:16.547071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:16.547961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:16.551806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:16.552803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:17.050988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:17.060446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:17.067186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:17.076267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ffcd24a-1ff5-48e1-b370-d30af9369390 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.573412 Sep 27 01:43:17.076862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1544/3132] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:16 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:17.093825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:17.094492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:17.108175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:17.108718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:17.109171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:17.109983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:17.110444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:17.110872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:17.264717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:43:17.265237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:43:17.266099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:43:17.266585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:43:17.267190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:43:17.317821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:17.320397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:17.321100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:17.322026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:17.322633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:17.323296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:17.367811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:43:17.390262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for user 82cdaa103d9f4862baa7a76a2def10fe and project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:43:17.408240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:43:17.413404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:43:17.532787 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2bfd8314-89ed-49e0-b859-51681e4d9d13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.469875 Sep 27 01:43:17.534223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1589/3133] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:43:17.550063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2610c0b1-511f-49bf-a6c8-3518ce25c165 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:17.553885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2610c0b1-511f-49bf-a6c8-3518ce25c165 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:17.619862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:17.636234 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f579d78-1030-41c7-b4cc-0c46f91366dd tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.547034 Sep 27 01:43:17.656563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2610c0b1-511f-49bf-a6c8-3518ce25c165 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:17.656795 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1545/3134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:17 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:17.670510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2610c0b1-511f-49bf-a6c8-3518ce25c165 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1222 microversion: 2.1 time: 0.126955 Sep 27 01:43:17.672669 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1590/3135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:17 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:17.977154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-743446614", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:18.106344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:18.107411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:18.120189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] validate_networks() for [('568e538e-5e79-4b38-9778-13586420219d', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:43:18.121550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:18.124167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:18.124890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:18.126252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:18.128569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:18.129276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:18.411566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:18.430765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:18.435401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:18.454020 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-386b7ee2-dc52-456f-8dde-1c51cb9e5b2e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.351513 Sep 27 01:43:18.454672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1591/3136] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:18 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:18.667741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:18.668373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:18.710026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:18.714469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:18.715047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:18.718658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:18.719263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:18.722758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:19.386660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:19.398969 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15cd9e13-dede-413b-a3a3-5aecb2bd2387 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.735076 Sep 27 01:43:19.399568 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1592/3137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:18 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:19.413277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0140434c-903b-48aa-90d1-3a05ef089b82", "name": "network-vif-plugged", "status": "completed", "tag": "4fe98671-33e9-46a5-be4e-f2eb453f16ef"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:19.435369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:19.435854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:19.436447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:19.511475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] Creating event network-vif-plugged:4fe98671-33e9-46a5-be4e-f2eb453f16ef for instance 0140434c-903b-48aa-90d1-3a05ef089b82 on n-h1-859358-1 Sep 27 01:43:19.530650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-126c3b7c-21f4-40b3-8926-401cb76e00fa req-33a96e43-c04f-442b-976d-bb3da7b54ed4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125481 Sep 27 01:43:19.537801 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1593/3138] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:19.554113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:19.561862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:19.593819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:19.603294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:19.603747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:19.607041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:19.608652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:19.609128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:20.216289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:20.235037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:20.242233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:20.266162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3796b2c5-f549-4378-bb64-025ffb1077c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.724471 Sep 27 01:43:20.270670 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1594/3139] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:19 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:20.428919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:20.432589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:20.443828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:20.446162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:20.447052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:20.448127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:20.449238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:20.449943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:20.907165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:43:20.907674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:43:20.908064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:43:20.908686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:43:20.909270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:43:20.926772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:20.927811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:20.928425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:20.932933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:20.933673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:20.934125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:20.987814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:43:21.002720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for user 82cdaa103d9f4862baa7a76a2def10fe and project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:43:21.031147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:43:21.033563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:43:21.129051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db079099-d357-4a1b-8ae6-53d489ab5275 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.162771 Sep 27 01:43:21.141759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1546/3140] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:43:21.147459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a9276e8-9440-418f-94e9-59fde513ad7e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:21.148127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a9276e8-9440-418f-94e9-59fde513ad7e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:21.201019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:21.222104 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d84f4f6-be7f-41d8-a9a7-6f0fae59ecc6 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1318 microversion: 2.1 time: 0.798800 Sep 27 01:43:21.227709 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1595/3141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:20 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:21.313292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:21.314457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:21.327229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:21.330088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:21.330657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:21.334404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:21.335280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:21.337325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:21.344487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a9276e8-9440-418f-94e9-59fde513ad7e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:21.354518 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a9276e8-9440-418f-94e9-59fde513ad7e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1221 microversion: 2.1 time: 0.210806 Sep 27 01:43:21.363162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1547/3142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:21 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:21.598484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:21.628591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:21.641514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:21.671711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63be8fd9-2677-4f65-af27-269702763312 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.368605 Sep 27 01:43:21.674854 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1596/3143] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:21 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:22.179004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f447cab-8463-4e23-aef6-bc02466c58c1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:22.183869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:22.212809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.213382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.214327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.215330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.217701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.219542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.254970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:22.255925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:22.275347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.278955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.279512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.291694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.292323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.292784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.857235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2909b93b-5894-4bb4-9fe2-c666dd41a292 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "POST /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682164 Sep 27 01:43:22.869710 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1548/3144] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:43:22 2022] POST /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:22.887759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:22.890556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:22.912457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:22.921634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.922243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.924512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.925581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.927801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48e6dc6c-6de4-477b-9d82-4f6df73b19d3 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 200 len: 1506 microversion: 2.1 time: 0.677760 Sep 27 01:43:22.931777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.932444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.938780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1597/3145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:22 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:22.952466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:22.954555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:22.963625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:22.980426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.984748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.987392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:22.990402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:22.990921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:22.994770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:23.263781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:23.275717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcdb5eba-19c2-4821-bf8e-ecb4b32bcaec tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1273 microversion: 2.1 time: 0.404630 Sep 27 01:43:23.293367 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1549/3146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:22 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1273 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:23.293367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:23.299894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:23.312099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:23.312800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:23.313377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:23.314398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:23.316092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:23.316742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:23.341843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:23.352143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:23.368986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:23.390905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ceac6f4-1fc3-4a13-898e-421a4f67693d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.448906 Sep 27 01:43:23.399320 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1598/3147] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:22 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:24.083950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:24.093274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-618792e2-72a0-4619-82d0-aebc32f93ff8 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1505 microversion: 2.1 time: 0.812786 Sep 27 01:43:24.096526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1550/3148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:23 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:24.125563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:24.126076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:24.140038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.140798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.141552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.142433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.144157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.145963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.153825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:24.259964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:43:24.309410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:24.311187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:24.340849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.341374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.341831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.350327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.353587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.354067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.509270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e60758a2-3ae8-4706-9aac-31e6c74dadaf tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 204 len: 0 microversion: 2.1 time: 0.386453 Sep 27 01:43:24.510466 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1599/3149] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:24 2022] DELETE /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:43:24.519072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:24.523314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:24.557330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.559205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.562867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.563940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.564780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.565522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.707399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:24.725351 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6da54c85-aa89-475e-adb5-9a34b99f8db3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1279 microversion: 2.1 time: 0.422099 Sep 27 01:43:24.728900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1551/3150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:24 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1279 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:24.762370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:24.762987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:24.779020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.783092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.783739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.786820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:24.787759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:24.789667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:24.892183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:43:25.104306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce1561c6-0f08-48f6-9094-2746f6098f25 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 204 len: 0 microversion: 2.1 time: 0.372533 Sep 27 01:43:25.105052 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1552/3151] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:24 2022] DELETE /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:43:25.120649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:25.121504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:25.131461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:25.136908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:25.137511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:25.138667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:25.139352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:25.140029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:25.551052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:25.561852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:25.563289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:25.584930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-554fd34b-9c3d-4603-8ae2-19ff8cc06795 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 1.073133 Sep 27 01:43:25.606052 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1600/3152] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:24 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:25.752002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:25.752994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:25.763036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:25.763878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:25.779008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:25.786585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:25.787364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:25.788083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:25.978949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:25.993547 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ddfc88cc-1f2f-4320-bd07-9ba083e9185d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1279 microversion: 2.1 time: 0.245795 Sep 27 01:43:25.994413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1601/3153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:25 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:26.031824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:26.041127 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e619cd9-6070-4991-b61e-cb2aa1d23c7c tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1511 microversion: 2.1 time: 0.925641 Sep 27 01:43:26.057119 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1553/3154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:25 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1511 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:26.627382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:26.628065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:26.642733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:26.644615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:26.647024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:26.653053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:26.653620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:26.654567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:26.800578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0da0c08-6152-4018-8292-eecd8bddfbbf", "tag": "354d4bd3-b837-4ed3-ad66-b02ae11c4fba"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:26.827239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:26.828054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:26.829888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:26.875936 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] Creating event network-changed:354d4bd3-b837-4ed3-ad66-b02ae11c4fba for instance b0da0c08-6152-4018-8292-eecd8bddfbbf on n-h2-859358-1 Sep 27 01:43:26.884598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-48b73543-2686-456e-b2ca-193a610b01e8 req-70030e35-24ba-407c-9bf8-24ea1ea950bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370875 Sep 27 01:43:26.886785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1602/3155] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:26.999647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:27.024781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:27.026502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:27.028686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:27.029574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:27.041277 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-038fbd5a-822f-4a5b-8e97-8a953e15a527 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1560 microversion: 2.91 time: 0.419160 Sep 27 01:43:27.043562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1554/3156] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:26 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1560 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:27.074092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:27.074764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:27.075559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:27.076308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:27.076801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:27.077309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:27.080689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:27.081599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:27.088149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:27.088874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:27.089544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:27.090417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:27.091084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:27.091668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:27.334054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:27.663354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:27.766152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:27.776801 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24491d5e-e678-4b16-8236-e6ca4a126c86 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1511 microversion: 2.1 time: 0.699956 Sep 27 01:43:27.793374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1555/3157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:27 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1511 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:28.040649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:28.054885 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c2211b3-6152-4a20-89b5-1ad60973d1ab tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.031191 Sep 27 01:43:28.056014 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1603/3158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:27 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:28.074438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:28.075289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:28.087419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:28.088504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:28.089109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:28.092297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:28.092949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:28.093596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:28.271637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:28.287314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:28.292318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:28.315439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6bdb477c-f290-4373-8bc4-8c1db3865155 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.245276 Sep 27 01:43:28.317152 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1604/3159] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:28 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:28.382814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0963b484-5781-49bb-945a-6cc1605bc165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Action: 'create', calling method: .version_select at 0x7f24d685d790>, body: {"keypair": {"name": "tempest-keypair-1380817621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg9HqS8y7OYRapS8S81NvuQ635CUgQdlgpGk2ofr6+d8uZ3FQnPhDTPInM3qyt9aTgYGMgt3kpRhmnKnfFb8oz/U2RIxnsPkj0NgKZJc//Lv2JJZqnmurG7gFcGi7kiHQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:28.419061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0963b484-5781-49bb-945a-6cc1605bc165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:43:28.433889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0963b484-5781-49bb-945a-6cc1605bc165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for user 34c031568af44507940568f7d2e14085 and project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:43:28.500433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0963b484-5781-49bb-945a-6cc1605bc165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.638288 Sep 27 01:43:28.501829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1556/3160] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:43:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:28.809650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:28.811267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:28.833152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:28.833983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:28.834428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:28.846032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:28.846534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:28.846990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.039872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0140434c-903b-48aa-90d1-3a05ef089b82", "name": "network-vif-deleted", "tag": "4fe98671-33e9-46a5-be4e-f2eb453f16ef"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:29.080555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:29.107677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94265928-2e1d-4591-9460-5b57671adb7f tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1469 microversion: 2.1 time: 0.295569 Sep 27 01:43:29.109196 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1605/3161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:28 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:29.143281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:29.144686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:29.145035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:29.149275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.150146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:29.188286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:29.189065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:29.189906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.196648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:29.198452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:29.199450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.212112 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] Creating event network-vif-deleted:4fe98671-33e9-46a5-be4e-f2eb453f16ef for instance 0140434c-903b-48aa-90d1-3a05ef089b82 on n-h1-859358-1 Sep 27 01:43:29.234738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e269ea83-98d1-44df-8dbd-0588dd746294 req-7391f0d3-1c8c-4a66-88b7-ba00a41d0f4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193171 Sep 27 01:43:29.238030 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1557/3162] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:29.346517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:29.347293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:29.369518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:29.370372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:29.376322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.377425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:29.384468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:29.385731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:29.731363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:29.748170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a0656f8-976b-43c2-9872-eea30332d479 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.631813 Sep 27 01:43:29.774904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1606/3163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:29 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:30.131943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:30.133826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:30.153857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:30.154647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:30.155261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:30.157925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:30.158608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:30.161940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:30.259246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:30.259908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:30.260449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:30.261430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lazy-loading 'fault' on Instance uuid a0bbffae-c3d4-4078-a248-f160bdf21877 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:43:30.296712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:30.316464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:30.319031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:30.329806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ed3a64a-17d3-4d3e-9fd6-601357720843 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.987479 Sep 27 01:43:30.341478 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1558/3164] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:29 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:30.379021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:30.394364 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1246487f-3e47-40ab-80e0-2b1e951c87a1 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1308 microversion: 2.1 time: 0.266531 Sep 27 01:43:30.396886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1607/3165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:30 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:30.776209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:30.777738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:30.797191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:30.799656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:30.801780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:30.802764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:30.811325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:30.812500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:30.955030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:31.347966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:31.360582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1baa48cc-d757-4132-b743-69a74e15aecd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.589932 Sep 27 01:43:31.370907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1559/3166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:30 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:31.382817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9747f8ac-ab0e-47c2-a44f-25cc227a66c1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1028606144", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:31.383349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0bbffae-c3d4-4078-a248-f160bdf21877", "name": "network-vif-deleted", "tag": "f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:31.388795 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9747f8ac-ab0e-47c2-a44f-25cc227a66c1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] HTTP exception thrown: min_count must be <= max_count Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9747f8ac-ab0e-47c2-a44f-25cc227a66c1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Request method failure captured: Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 184 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVC7uhbjdDq8GoN0PyrpK8cXJNdiLjly8SnwuqKhd8a1hRulJ2JQugwdR23oW077i5fb1HINi2xtaaoFT2QAzzLKQy3Jmig2i1HkfOeBhbNUEFaQFl6cTImNx3F2mFlDirXHDnfqsCnCJ7zoFDUkavyurGSL-1az0KoUdxofm5hqtA Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:31.390533 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8668da621e4043e39a70273d6ad8f741", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7d664b55b8d94e0cb92c5421787e38d6 Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:43:31.394376 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1028606144", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: exception: min_count must be <= max_count Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1028606144', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:43:31.395119 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9747f8ac-ab0e-47c2-a44f-25cc227a66c1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Returning 400 to user: min_count must be <= max_count {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:31.396260 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9747f8ac-ab0e-47c2-a44f-25cc227a66c1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.377610 Sep 27 01:43:31.405745 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1608/3167] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 392 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:43:31.424829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:31.428565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:31.442749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.443309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.443757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.455548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.457511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.460930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.463044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.469493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.474161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.526808 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] Creating event network-vif-deleted:f44c2e2a-3e09-40ce-9bf1-d8aeb2cfc246 for instance a0bbffae-c3d4-4078-a248-f160bdf21877 on n-h2-859358-1 Sep 27 01:43:31.544736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-82cb1379-9871-4307-89db-e30a56558cb9 req-4feab41c-4374-441f-a221-c7c9035955eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172171 Sep 27 01:43:31.545381 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1560/3168] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:31.557280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:31.568679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:31.584585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.585089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.585623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.592798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.593936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.594687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.602182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:31.647293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:31.649669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:31.650352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:31.651236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:31.651859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lazy-loading 'fault' on Instance uuid a0bbffae-c3d4-4078-a248-f160bdf21877 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:43:31.720851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:31.732524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:31.745235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:31.755823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1cc0f3d4-8bd7-4485-8425-45016b21ebb2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.348715 Sep 27 01:43:31.763862 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1609/3169] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:31 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:31.781381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb1c5c7-f173-49a4-a9fd-242e7a702bff tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-686291495", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "max_count": 0}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb1c5c7-f173-49a4-a9fd-242e7a702bff tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Request method failure captured: Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 167 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVC7uhbjdDq8GoN0PyrpK8cXJNdiLjly8SnwuqKhd8a1hRulJ2JQugwdR23oW077i5fb1HINi2xtaaoFT2QAzzLKQy3Jmig2i1HkfOeBhbNUEFaQFl6cTImNx3F2mFlDirXHDnfqsCnCJ7zoFDUkavyurGSL-1az0KoUdxofm5hqtA Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:31.796155 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8668da621e4043e39a70273d6ad8f741", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7d664b55b8d94e0cb92c5421787e38d6 Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-686291495", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "max_count": 0}} Sep 27 01:43:31.797665 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-686291495', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'max_count': 0}}} Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 0 Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.798379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.799901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb1c5c7-f173-49a4-a9fd-242e7a702bff tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-acb1c5c7-f173-49a4-a9fd-242e7a702bff tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.032707 Sep 27 01:43:31.801086 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1610/3170] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:43:31.850376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2be119b81e84dfb94397455528cbed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f9c7fb745e44e9bdaf3638ca92d04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:31.867862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36b979c1-fe01-43f6-a08c-8e39ab74f4d4 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 200 len: 1308 microversion: 2.1 time: 0.314641 Sep 27 01:43:31.880691 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1561/3171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:31 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:31.905642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12db2506-97d2-4357-925e-42e95a0309e1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1380849521", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "max_count": 2.5}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12db2506-97d2-4357-925e-42e95a0309e1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Request method failure captured: Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 170 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVC7uhbjdDq8GoN0PyrpK8cXJNdiLjly8SnwuqKhd8a1hRulJ2JQugwdR23oW077i5fb1HINi2xtaaoFT2QAzzLKQy3Jmig2i1HkfOeBhbNUEFaQFl6cTImNx3F2mFlDirXHDnfqsCnCJ7zoFDUkavyurGSL-1az0KoUdxofm5hqtA Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:31.915120 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8668da621e4043e39a70273d6ad8f741", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7d664b55b8d94e0cb92c5421787e38d6 Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1380849521", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "max_count": 2.5}} Sep 27 01:43:31.916697 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1380849521', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'max_count': 2.5}}} Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 2.5 Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.917617 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:31.919229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12db2506-97d2-4357-925e-42e95a0309e1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:31.920631 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12db2506-97d2-4357-925e-42e95a0309e1 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018172 Sep 27 01:43:31.923029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1611/3172] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:43:32.034323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7498a1a6-8645-4676-893d-caf2e1f76841 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-44815293", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 0}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7498a1a6-8645-4676-893d-caf2e1f76841 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Request method failure captured: Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 166 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVC7uhbjdDq8GoN0PyrpK8cXJNdiLjly8SnwuqKhd8a1hRulJ2JQugwdR23oW077i5fb1HINi2xtaaoFT2QAzzLKQy3Jmig2i1HkfOeBhbNUEFaQFl6cTImNx3F2mFlDirXHDnfqsCnCJ7zoFDUkavyurGSL-1az0KoUdxofm5hqtA Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:32.042967 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8668da621e4043e39a70273d6ad8f741", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 7d664b55b8d94e0cb92c5421787e38d6 Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-44815293", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 0}} Sep 27 01:43:32.044438 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-44815293', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'min_count': 0}}} Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 0 Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.045166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:32.046525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:32.047710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:43:32.047710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:43:32.047710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 27 01:43:32.047710 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.052932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7498a1a6-8645-4676-893d-caf2e1f76841 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:32.058501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7498a1a6-8645-4676-893d-caf2e1f76841 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.029915 Sep 27 01:43:32.062858 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1562/3173] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:43:32.188704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e1032cf-7528-4905-b852-1cf539ea4668 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1740303427", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 2.5}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e1032cf-7528-4905-b852-1cf539ea4668 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Request method failure captured: Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 170 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVC7uhbjdDq8GoN0PyrpK8cXJNdiLjly8SnwuqKhd8a1hRulJ2JQugwdR23oW077i5fb1HINi2xtaaoFT2QAzzLKQy3Jmig2i1HkfOeBhbNUEFaQFl6cTImNx3F2mFlDirXHDnfqsCnCJ7zoFDUkavyurGSL-1az0KoUdxofm5hqtA Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:32.196446 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8668da621e4043e39a70273d6ad8f741"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8668da621e4043e39a70273d6ad8f741", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8668da621e4043e39a70273d6ad8f741 Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1836201134 Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7d664b55b8d94e0cb92c5421787e38d6 Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1836201134-project Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1740303427", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 2.5}} Sep 27 01:43:32.197756 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1740303427', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'min_count': 2.5}}} Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 2.5 Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.198463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:32.199778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:32.201731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:43:32.201731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:43:32.201731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 27 01:43:32.201731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:32.207388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e1032cf-7528-4905-b852-1cf539ea4668 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:32.210945 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e1032cf-7528-4905-b852-1cf539ea4668 tempest-MultipleCreateNegativeTestJSON-1836201134 tempest-MultipleCreateNegativeTestJSON-1836201134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030743 Sep 27 01:43:32.214514 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1612/3174] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:43:32.404278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:32.406720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:32.427787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:32.428561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:32.431065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:32.432172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:32.434602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:32.436476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:32.800070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:32.801387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:32.827110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:32.827662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:32.828121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:32.828887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:32.839966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:32.844492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.555494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:33.566427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bc29688-b9b8-4f49-83cd-98e53c7e1979 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.172958 Sep 27 01:43:33.593328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:33.607710 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1563/3175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:32 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:33.610944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:33.623620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:33.636777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:33.637444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: a0bbffae-c3d4-4078-a248-f160bdf21877] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:33.667677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f726464-6e14-4c60-90b0-2ea053d5bb4e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.865392 Sep 27 01:43:33.669857 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1613/3176] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:32 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:33.676983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:33.677529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:33.683539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.686363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:33.688431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49f1896-6732-4612-b2f2-b3f2f0a2f885", "tag": "fc698b3d-a14a-4d8c-8c81-3a459deee631"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:33.691931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:33.694009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.725880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:33.745084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:33.745813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.751922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] HTTP exception thrown: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Request method failure captured: Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 HTTP/1.1 Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT-_mOOYx2bGawxrLbzUZHgGhz55YP67xauPGNNnU7MMwTVrQgFZ2TZPYsDRPnXrcOEiOnFW9zr_s6NOaNbqd2t7z_fWooDZLUG-g54lv64yHj9QBcHr17grHPuq8QyK9gJqZONvyrYBa0XnoUKf_4sM6a-qpb3qKh0wY9dRnrmJ2U Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 97f9c7fb745e44e9bdaf3638ca92d04a Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:33.774800 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97f9c7fb745e44e9bdaf3638ca92d04a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 97f9c7fb745e44e9bdaf3638ca92d04a Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MultipleCreateTestJSON-676514708-project Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: d2be119b81e84dfb94397455528cbed3 Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MultipleCreateTestJSON-676514708-project Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. Sep 27 01:43:33.776407 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a0bbffae-c3d4-4078-a248-f160bdf21877'} Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:33.777308 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. Sep 27 01:43:33.778768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.784189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Returning 404 to user: Instance a0bbffae-c3d4-4078-a248-f160bdf21877 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:33.786075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a308dac7-f4a5-47c9-afca-b6ef3b303896 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877" status: 404 len: 111 microversion: 2.1 time: 0.177170 Sep 27 01:43:33.791159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1564/3177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:33 2022] GET /compute/v2.1/servers/a0bbffae-c3d4-4078-a248-f160bdf21877 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:33.799942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:33.809710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] Creating event network-changed:fc698b3d-a14a-4d8c-8c81-3a459deee631 for instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 on n-h2-859358-1 Sep 27 01:43:33.811440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] [instance: 0140434c-903b-48aa-90d1-3a05ef089b82] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:33.827880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:33.828387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:33.828826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.833249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:33.833781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:33.834223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:33.837788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4c255b10-1167-48c1-8693-f6ebd04046af req-97a2be68-bf5e-4dfb-af7d-32e2758a0a51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166819 Sep 27 01:43:33.838423 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1614/3178] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:33.875181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] HTTP exception thrown: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Request method failure captured: Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 HTTP/1.1 Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlT-_mOOYx2bGawxrLbzUZHgGhz55YP67xauPGNNnU7MMwTVrQgFZ2TZPYsDRPnXrcOEiOnFW9zr_s6NOaNbqd2t7z_fWooDZLUG-g54lv64yHj9QBcHr17grHPuq8QyK9gJqZONvyrYBa0XnoUKf_4sM6a-qpb3qKh0wY9dRnrmJ2U Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 97f9c7fb745e44e9bdaf3638ca92d04a Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:43:33.880095 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97f9c7fb745e44e9bdaf3638ca92d04a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97f9c7fb745e44e9bdaf3638ca92d04a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 97f9c7fb745e44e9bdaf3638ca92d04a Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-MultipleCreateTestJSON-676514708 Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-MultipleCreateTestJSON-676514708-project Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: d2be119b81e84dfb94397455528cbed3 Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-MultipleCreateTestJSON-676514708-project Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. Sep 27 01:43:33.881763 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0140434c-903b-48aa-90d1-3a05ef089b82'} Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:33.883146 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. Sep 27 01:43:33.886195 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:43:33.888853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] Returning 404 to user: Instance 0140434c-903b-48aa-90d1-3a05ef089b82 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:33.888853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1a747bc-b42a-4090-affe-48adc7dbfb88 tempest-MultipleCreateTestJSON-676514708 tempest-MultipleCreateTestJSON-676514708-project] 10.222.0.52 "GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82" status: 404 len: 111 microversion: 2.1 time: 0.087935 Sep 27 01:43:33.890481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1565/3179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:33 2022] GET /compute/v2.1/servers/0140434c-903b-48aa-90d1-3a05ef089b82 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:34.604478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:34.607114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:34.634164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:34.634676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:34.640820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:34.641974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:34.644313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:34.649124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:34.719568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:34.724796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:34.752010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:34.758298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:34.759623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:34.764073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:34.765909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:34.771171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:35.191652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:35.206295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:35.212358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:35.224982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-396d145a-63da-42bd-8624-b3b5ff0a29e0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.528912 Sep 27 01:43:35.230187 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1566/3180] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:34 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:35.233737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:35.255184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f6ffd58-45ef-4aa3-9a67-fb340bf6289d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.654586 Sep 27 01:43:35.256029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1615/3181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:34 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:35.737233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2128665225", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "71a5ac60-f8c3-4705-8478-fc095e3e91e5"}], "security_groups": [{"name": "tempest-securitygroup--1916734072"}], "key_name": "tempest-keypair-1380817621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:36.035008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0da0c08-6152-4018-8292-eecd8bddfbbf", "name": "network-vif-plugged", "status": "completed", "tag": "354d4bd3-b837-4ed3-ad66-b02ae11c4fba"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:36.058488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:36.059824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:36.061943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:36.087243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] Creating event network-vif-plugged:354d4bd3-b837-4ed3-ad66-b02ae11c4fba for instance b0da0c08-6152-4018-8292-eecd8bddfbbf on n-h2-859358-1 Sep 27 01:43:36.095544 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a9843144-3ffb-4f7e-a15b-d818409ed5bd req-4950299c-04e7-466b-bb59-7a236d901680 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064813 Sep 27 01:43:36.097000 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1616/3182] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:36.135773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] validate_networks() for [('71a5ac60-f8c3-4705-8478-fc095e3e91e5', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:43:36.260148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:36.261891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:36.270937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:36.271425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:36.273266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:36.273266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:36.273266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:36.276604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:36.393812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:36.404889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:36.416913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:36.431830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3cda89eb-020f-4d1e-b8a6-b1b64030adcb tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.176501 Sep 27 01:43:36.435416 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1617/3183] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:36 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:36.447604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:36.448206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:36.459558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:36.460198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:36.460660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:36.461406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:36.464349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:36.469531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:36.797782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:36.810972 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93fd52e7-fa59-4af9-9fa8-4e6abf687143 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.372997 Sep 27 01:43:36.812475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1618/3184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:36 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:37.463850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:37.464489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:37.482293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:37.483133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:37.484318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:37.485271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:37.486736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:37.487966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:37.689935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:37.697832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:37.714175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:37.720916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:37.735975 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab8ab2dc-b5cc-41f6-ad32-8a3278b00717 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.275944 Sep 27 01:43:37.737563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1619/3185] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:37 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:37.840191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:37.840813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:37.858853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:37.859947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:37.860560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:37.861526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:37.862137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:37.862727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:38.127508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:43:38.128135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:43:38.129708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:43:38.131010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:43:38.131824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:43:38.161766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:38.162525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:38.163147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:38.164628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:38.165245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:38.165867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:38.187515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:43:38.193861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for user 34c031568af44507940568f7d2e14085 and project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:43:38.211493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:43:38.214296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:43:38.256917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:38.267534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08c332fc-b99c-4a47-9552-68490dd833c0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.435106 Sep 27 01:43:38.268126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1620/3186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:37 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:38.336175 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af029e00-a793-437c-9433-ac118640424b tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.602471 Sep 27 01:43:38.341266 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1567/3187] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:43:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:43:38.352682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fcd4144d-882b-470d-8f41-3871fb4853fc tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:38.353579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fcd4144d-882b-470d-8f41-3871fb4853fc tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:38.439885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcd4144d-882b-470d-8f41-3871fb4853fc tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:38.449916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fcd4144d-882b-470d-8f41-3871fb4853fc tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1242 microversion: 2.1 time: 0.101301 Sep 27 01:43:38.467312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1621/3188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:38 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:38.775336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:38.775710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:38.795359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:38.800426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:38.800970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:38.802245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:38.817797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:38.821842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:39.082310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:39.099137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:39.100954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:39.108583 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46e1a385-1dfd-4b0d-a2d0-2abad1c92108 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.340114 Sep 27 01:43:39.115736 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1568/3189] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:38 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:39.294446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:39.295071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:39.321204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:39.326146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:39.329063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:39.332578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:39.354294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:39.355286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:39.480781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:39.482039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:39.495409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:39.496151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:39.496844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:39.498304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:39.499014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:39.499677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:39.646682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:39.660556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15f1a9ca-909e-40c3-8117-91800e9de3c5 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1246 microversion: 2.1 time: 0.180694 Sep 27 01:43:39.663853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1569/3190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:39 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1246 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:40.146406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:40.147019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:40.156171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:40.156660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:40.157093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:40.157828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:40.171131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:40.171775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:40.303678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:40.319067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-160a01ac-97ad-4eb2-8b70-d3e483bf762d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.029576 Sep 27 01:43:40.334317 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1622/3191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:39 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:40.410156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:40.430766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:40.437367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:40.495827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd56f4a5-e16f-4a9a-99e5-cc81a3df5f5c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.353214 Sep 27 01:43:40.496484 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1570/3192] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:40 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:40.684007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:40.685363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:40.700819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:40.701784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:40.705837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:40.708414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:40.709073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:40.711562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:40.824616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:40.833286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60427b73-9409-4f7d-9d4f-a3df46d72830 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1294 microversion: 2.1 time: 0.153018 Sep 27 01:43:40.845520 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1623/3193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:40 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:41.347413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:41.348046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:41.363329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.371656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.374105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.374949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.375445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.375890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.468534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:41.480618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:41.505260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.506234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.506847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.507796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.508610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.509212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.600058 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f09d89d3-ddec-4c48-975a-43ff050475f4 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136923 Sep 27 01:43:41.604116 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1624/3194] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:43:41 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:41.618680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:41.625729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:41.640234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.640934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.641854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.643645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:41.644520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:41.646605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:41.860862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:41.911168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:41.913387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:41.915083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:41.952690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-321ffe70-f132-4cd8-8de6-116a2c303807 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 0.610430 Sep 27 01:43:41.960902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-379657f5-60d6-4b11-b3fd-c035e9ddead1 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.346194 Sep 27 01:43:41.968669 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1625/3195] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:41 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:41.979207 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1571/3196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:41 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:41.987571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:41.992377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:42.004797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:42.012200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:42.019175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:42.020315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:42.022492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:42.024438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:42.025089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:42.025732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:42.034720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:42.035218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:42.039682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:42.040533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:42.041012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:42.041475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:42.325247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lazy-loading 'services' on Instance uuid 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:43:42.492469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13ec5b24-b014-4cb9-a433-dcbbc4e07882 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments/2f447cab-8463-4e23-aef6-bc02466c58c1" status: 202 len: 0 microversion: 2.1 time: 0.521597 Sep 27 01:43:42.496521 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1626/3197] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:43:41 2022] DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments/2f447cab-8463-4e23-aef6-bc02466c58c1 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:43:42.980750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:42.984083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:42.998302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:42.998917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:42.999352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:43.000360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:43.002758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:43.010601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:44.005959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:44.015108 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39e56ada-bd01-4a69-99a1-5710c7c0827c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.039093 Sep 27 01:43:44.022761 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1627/3198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:42 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:44.033855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:44.034731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:44.055118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:44.055618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:44.056053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:44.056768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:44.062993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:44.063679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:44.879397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:44.902470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:44.903963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:44.930037 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d492203d-84eb-4d0d-8199-c7c9651d2346 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.905146 Sep 27 01:43:44.930841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1628/3199] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:44 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:44.944972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49f1896-6732-4612-b2f2-b3f2f0a2f885", "name": "network-vif-plugged", "status": "completed", "tag": "fc698b3d-a14a-4d8c-8c81-3a459deee631"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:44.974877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:44.977052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:44.977688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:45.014742 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] Creating event network-vif-plugged:fc698b3d-a14a-4d8c-8c81-3a459deee631 for instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 on n-h2-859358-1 Sep 27 01:43:45.027081 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f037321f-c329-4fbb-99fc-59a4b3f49710 req-2bf171b6-0a8e-4bcd-8e50-52434a4d4f35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094868 Sep 27 01:43:45.030097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1629/3200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:45.045522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:45.046553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:45.063620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:45.066707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:45.068847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:45.077161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:45.078812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:45.080826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:45.100726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:45.143660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1d96322-2d66-4d11-95f7-4f4d9b922833 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 3.163149 Sep 27 01:43:45.155975 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1572/3201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:41 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 3176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:45.961179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:45.962008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:45.979958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:45.981625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:45.982345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:45.983916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:45.985899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:45.987027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:46.561821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:46.577970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:46.584709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:46.599701 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb35f56a-aafc-4397-b510-679ffac02703 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.643053 Sep 27 01:43:46.622653 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1573/3202] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:45 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:46.627929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:46.628546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:46.635524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:46.636454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:46.637064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:46.637970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:46.638614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:46.639205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:46.739157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:46.750628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71df662a-26aa-4f0f-b9d8-ff336dfeb656 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.710175 Sep 27 01:43:46.755662 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1630/3203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:45 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:47.214700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:47.224141 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f93c1ce3-15a0-4b07-ac22-62b2ad63507d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 0.600096 Sep 27 01:43:47.226154 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1574/3204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:46 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:47.378331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dcb45f-119a-413c-bc1e-e0699e25285f", "tag": "a4c916da-24cf-44b8-8816-d209db0cb8f7"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:47.414801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:47.415482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:47.419234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:47.462793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] Creating event network-changed:a4c916da-24cf-44b8-8816-d209db0cb8f7 for instance 74dcb45f-119a-413c-bc1e-e0699e25285f on n-h1-859358-1 Sep 27 01:43:47.484392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a2be083d-841a-4325-998b-b81e1d0667c4 req-5fd8cde1-bacf-4718-b2a7-7dd1999bf2ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108055 Sep 27 01:43:47.493110 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1631/3205] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:43:47.633413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:47.634029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:47.654272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:47.654773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:47.655230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:47.655938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:47.664667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:47.667724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:47.776835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:47.778320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:47.796600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:47.802170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:47.810792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:47.813847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:47.815815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:47.816454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:47.950080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:47.975062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:47.981324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:47.998733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60b7d494-d885-4257-9600-b3eae65c9d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.369273 Sep 27 01:43:48.000730 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1575/3206] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:47 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:48.250075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:48.250984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:48.273362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:48.283634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=18 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:48.295393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:48.295936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:48.296376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:48.297099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:48.298226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:48.298226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:48.445560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:49.167458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:49.185177 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-829f34bb-baf3-4216-99fe-96a993105f63 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1321 microversion: 2.1 time: 1.412599 Sep 27 01:43:49.211868 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1632/3207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:47 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1321 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:49.218717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:49.230739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:49.252564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:49.252787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:49.253122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:49.258169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:49.258646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:49.259082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:49.593176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:49.607885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:49.609321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:49.620359 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24d7c24e-a702-4b04-9a1d-7e53c9c86273 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.405368 Sep 27 01:43:49.621223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1633/3208] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:49 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:49.903226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:49.913307 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-766b9f96-0bbc-495f-b936-e7b5c8b94a1c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 1.669167 Sep 27 01:43:49.933137 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1576/3209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:48 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:50.238948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:50.239781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:50.262175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.262767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.263232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.263958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.264419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.264847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.648938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:50.649940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:50.666608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.670062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.670820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.671807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.672498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.674647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.707478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:50.720426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f7430b8-ff69-4c04-9ad3-e5a406f96ea3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1515 microversion: 2.1 time: 0.485597 Sep 27 01:43:50.722904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1634/3210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:50 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:50.757949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:50.760857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:50.790032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.790627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.791359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.794496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:50.794980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:50.796260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:50.899249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'flavor' on Instance uuid f49f1896-6732-4612-b2f2-b3f2f0a2f885 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:43:51.054928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:51.064368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:51.073139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:51.101598 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c8ca695-977b-4b63-88ea-6468edc05a9c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.455249 Sep 27 01:43:51.110815 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1577/3211] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:50 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:51.124614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:51.125233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:51.158381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:51.158873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:51.159309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:51.160027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:51.173484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:51.174842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:51.230880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0a10899-383d-4f51-9d8c-f08509f42e30 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action" status: 200 len: 32 microversion: 2.1 time: 0.480120 Sep 27 01:43:51.231688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1635/3212] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:43:50 2022] POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:43:51.258426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:51.259261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:51.297209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:51.310246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:51.310701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:51.311455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:51.311929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:51.312458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:51.348332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:52.048256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:52.068813 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98e6f519-053c-491d-b4fd-ce778d2948be tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 0.949703 Sep 27 01:43:52.072619 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1578/3213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:51 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:52.141545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:52.142421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:52.153735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:52.154479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:52.156150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:52.162179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:52.164226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:52.164863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:52.572436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:52.600474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:52.608177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:52.643922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7996ebdc-1777-4074-a24f-33f6011c07fd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.505711 Sep 27 01:43:52.646911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1579/3214] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:52 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:52.702910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:52.718434 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99a2d0d5-6c9e-4c47-ac2d-d597e05a2203 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.475690 Sep 27 01:43:52.730237 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1636/3215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:51 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:52.986789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:52.989786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:53.010501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.017734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.018502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.023281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.023768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.028786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.081760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:53.097028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:53.097885 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5c771ab-5158-4ab2-a6e8-b7bd0f415c09 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120928 Sep 27 01:43:53.098897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:53.100262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1580/3216] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:43:52 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:43:53.108120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:53.124046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.127986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.130430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.132674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.135500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.138668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.222278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:53.224804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:53.260072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.264685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.265189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.269609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.270103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.270562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.378425 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f861af2-fc71-4a4b-913e-432917359fbf tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160204 Sep 27 01:43:53.379787 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1581/3217] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:43:53 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:43:53.495055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:53.495474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:53.505117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.508763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.509321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.510203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.511033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.516011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.601958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:43:53.823082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac7423fb-299e-49be-acc0-2cb05f965a02 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 204 len: 0 microversion: 2.1 time: 0.332127 Sep 27 01:43:53.823688 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1582/3218] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:43:53 2022] DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:43:53.832529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:53.842798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:53.854148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.854654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.855101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:53.855834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:53.856307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:53.856760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:54.025940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:54.045900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:54.050004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:54.083331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1b986d3-3db6-4ccc-abd6-424e548c834b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.254811 Sep 27 01:43:54.098504 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1583/3219] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:53 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:54.109494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:54.110657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:54.126632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:54.127600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:54.129593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:54.130526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:54.137931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:54.138613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:54.210247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:54.221689 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bedb94f9-0ca0-4dae-93f3-deba5c8203ae tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 1.126915 Sep 27 01:43:54.222587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1637/3220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:53 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:54.251233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:54.254864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:54.303319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:54.304700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:54.305800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:54.309703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:54.315151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:54.318319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:54.908791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:54.922339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e100439-9c49-4e3c-98e7-6c83137c5323 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1679 microversion: 2.1 time: 0.693267 Sep 27 01:43:54.931310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1638/3221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:54 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1679 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:55.115136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:55.116417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:55.136311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:55.138968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:55.139696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:55.145725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:55.146537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:55.148477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:55.392258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:55.400822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f0c6a32-041e-4473-994b-7d7fecb0f954 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.300940 Sep 27 01:43:55.415301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:55.431528 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1584/3222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:54 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:55.451165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:55.454338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:55.470917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:55.478725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:55.479524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:55.485420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:55.486324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:55.489621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:55.490721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:55.498102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:55.504782 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75cfebf1-0ab3-47cf-b587-a38b44b6f96f tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.394767 Sep 27 01:43:55.507511 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1639/3223] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:55 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:43:55.969529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:55.970199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:55.991660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:55.997867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:55.999011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:56.002576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:56.006751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:56.008608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:56.099909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:56.116553 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37fc48cb-d66a-4022-881e-9d950d6fd284 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 0.678349 Sep 27 01:43:56.120224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1585/3224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:55 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:56.436823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:56.437637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:56.454577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:56.456202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:56.463213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:56.469366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:56.469929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:56.470490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:56.989051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:57.012423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5415d295-1fe8-4fa3-85f7-1429c54ae05b tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1611 microversion: 2.1 time: 1.061820 Sep 27 01:43:57.013030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1640/3225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:55 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1611 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:43:57.023813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:57.024439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:57.032840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:57.033362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:57.033864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:57.034575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:57.035017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:57.036309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:57.041253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:57.086707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90234b33-dd7c-4b3c-9709-ffe7934c10ad tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.652557 Sep 27 01:43:57.106123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1586/3226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:56 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:57.447631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:57.476749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:57.481117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:57.502212 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44672165-ad92-4f9f-9f35-14988cb1d247 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.483655 Sep 27 01:43:57.507242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1641/3227] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:57 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:57.526274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:57.528604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:57.550043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:57.552657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:57.553359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:57.556858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:57.557785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:57.559382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:57.968952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6527dc7-c95f-40ca-ac95-c1e523f833c8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: .version_select at 0x7f24d6adf550>, body: {"keypair": {"name": "tempest-keypair-1944148951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1lgrAXls5/ZIlWvvEefpGUwn7pMfjE/0hQRCVnlWwYbxoCyxhw2GIeuQi/mJrwmpfNSAEgVsV3Y51z9KJVPkMh29sH6r3kVW8JHmfM4kBNjUF/Jcw1YN6SjxwjPSVttA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:58.051363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6527dc7-c95f-40ca-ac95-c1e523f833c8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:43:58.068968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6527dc7-c95f-40ca-ac95-c1e523f833c8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:43:58.173268 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6527dc7-c95f-40ca-ac95-c1e523f833c8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.064278 Sep 27 01:43:58.174095 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1587/3228] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:43:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:58.201100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:58.219437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:58.226996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Searching by: {'deleted': False, 'project_id': '588dc81e4691443bb9588a29675d4178'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:43:58.236437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:43:58.256008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.258244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.262868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:58.288639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.297123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f56665b1-41cd-4ba4-bc17-c8846b78b513 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 0.777139 Sep 27 01:43:58.299298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.301063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.301824 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1642/3229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:57 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:58.304408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.333869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:58.340112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:58.373569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.374956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.375929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.379834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.380672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.381571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.457872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:43:58.571745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afa2dd2d948458798ab42ae7873c0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8ca22bbdb9442ca7053b104701ee60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:58.587351 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74cace92-4cb2-4cf4-a430-d4a035ab5e68 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 200 len: 1325 microversion: 2.1 time: 0.280909 Sep 27 01:43:58.588987 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ecc2bcc-81d8-40f9-beb5-d97e7b9928ca tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.406552 Sep 27 01:43:58.591430 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1588/3230] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:43:58 2022] GET /compute/v2.1/servers => generated 334 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:58.599962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1643/3231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:58 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 1325 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:58.614218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:58.618229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:58.631664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0ca464-e1cf-4795-80fa-a55db5e5ab2c", "name": "network-vif-deleted", "tag": "d88c6c7d-cc79-4cfe-beec-49e368dbdfed"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:43:58.655652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.658918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.666731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.668197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.671271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.672026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.694730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.695309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.695766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.758334 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] Creating event network-vif-deleted:d88c6c7d-cc79-4cfe-beec-49e368dbdfed for instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c on n-h1-859358-1 Sep 27 01:43:58.797590 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ffa565f4-08b3-412e-8657-22ef3d5c67c1 req-57e7e73a-b9c4-40a1-9fd5-dd2f33904e53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187883 Sep 27 01:43:58.799117 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1644/3232] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:58.826344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:58.828071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:58.864619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.868781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.869269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:58.875591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:58.881477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:58.883840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.219553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.241813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.256947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.286849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8076759-b690-4ab6-8ed3-1635f62736f3 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.476673 Sep 27 01:43:59.290215 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1645/3233] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:43:58 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:43:59.299495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:59.314905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.315691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Searching by: {'deleted': False, 'project_id': '588dc81e4691443bb9588a29675d4178'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:43:59.344537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.345042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.345493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.346228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.346673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.347094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.446713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:43:59.531086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.547107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6354b852-7370-43bc-bc9c-9514fd398cca tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.953896 Sep 27 01:43:59.548385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1589/3234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:58 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:59.554821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:43:59.567407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.568110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.568546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.585635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:59.586616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:59.603482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.604618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.605922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.607058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.612441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.614139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.822814 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ec0ee46-e691-48fc-a7e4-6b43db098b15 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.530556 Sep 27 01:43:59.837437 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1646/3235] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:43:59 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:43:59.837437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:59.837437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:43:59.846944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.848425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.848975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.853809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:43:59.854430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:43:59.855129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:43:59.873192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] HTTP exception thrown: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Request method failure captured: Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c HTTP/1.1 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlSxH3ffLPKfpMrE757kYaWaeKZRWCwDqOK6gG1EzbL3h2EfS_fAoEtUM5azrvuy55wP5--BrW304G5loKo9DsC4z1R0LuGlNyLzXQ8dr1tb8QNxrKuk_rmdn74MOc4BLEhsvdwYveJiye4x8KJ0ftYnaPUUED9DeW608EgWKqGtq7Q Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:43:59.875470 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b8ca22bbdb9442ca7053b104701ee60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 8afa2dd2d948458798ab42ae7873c0c8 Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:43:59.876781 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5a0ca464-e1cf-4795-80fa-a55db5e5ab2c'} Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:43:59.877561 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:43:59.879212 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:43:59.880503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Returning 404 to user: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:43:59.880503 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac6a21fe-27a8-4dc7-a06d-098398d908e2 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 404 len: 111 microversion: 2.1 time: 0.051887 Sep 27 01:43:59.880503 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1647/3236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:59 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:43:59.886295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c013e439-160c-4d54-9118-d2ee30f627b9 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:59.899250 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c013e439-160c-4d54-9118-d2ee30f627b9 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017611 Sep 27 01:43:59.900007 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1648/3237] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:43:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:43:59.904740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3fbf4ac3-230b-4c7f-b22f-e7248cc5e7e3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '.version_select at 0x7f24d59f3940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:43:59.938809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3fbf4ac3-230b-4c7f-b22f-e7248cc5e7e3 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780397929" status: 202 len: 0 microversion: 2.1 time: 0.037626 Sep 27 01:43:59.941043 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1649/3238] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780397929 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:44:00.139344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:00.156805 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e09a4392-091a-4a93-ab56-42abf39fa88f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 0.600605 Sep 27 01:44:00.158803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1590/3239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:43:59 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:00.250588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:00.251093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:00.264994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.265530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.265971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.266686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.267143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.267571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.287648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dcb45f-119a-413c-bc1e-e0699e25285f", "name": "network-vif-plugged", "status": "completed", "tag": "a4c916da-24cf-44b8-8816-d209db0cb8f7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:00.309532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.311877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.313367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.342893 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] Creating event network-vif-plugged:a4c916da-24cf-44b8-8816-d209db0cb8f7 for instance 74dcb45f-119a-413c-bc1e-e0699e25285f on n-h1-859358-1 Sep 27 01:44:00.348117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:44:00.359914 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8eeaecbf-affc-48a0-900c-cd69345a5005 req-e942068b-5ecb-40ef-8d7c-204b2b787860 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079113 Sep 27 01:44:00.363924 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1591/3240] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:00.383847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:00.389035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:00.406863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.407508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.407953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.409625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.411507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.412126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.656074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-72d8a48a-f5d7-46a9-9c40-593857b4350a tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 204 len: 0 microversion: 2.1 time: 0.411092 Sep 27 01:44:00.656672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1650/3241] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:44:00 2022] DELETE /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:44:00.674056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:00.674631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:00.675133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:00.686315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.686827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.687258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.687977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.688435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.688866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.690308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:00.702863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:00.746049 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-410f3e63-b3f0-40c4-bf6d-519d9c463b0a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1537 microversion: 2.91 time: 0.376255 Sep 27 01:44:00.746420 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1592/3242] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:00 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1537 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:00.811365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:00.813219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:00.858762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.859365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.867497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:00.873514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:00.875690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:00.876143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:01.542054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:01.563544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a589e9f-7597-484b-a82c-695195f030c2 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1700 microversion: 2.1 time: 0.787242 Sep 27 01:44:01.567018 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1593/3243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:00 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1700 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:01.580270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:01.581776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:01.600609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:01.604275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:01.604851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:01.605713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:01.608646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:01.609193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:01.669788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:01.677953 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0b6f5b3-e087-4400-9cae-6e696f28e5d8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.020061 Sep 27 01:44:01.679080 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1651/3244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:00 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:01.777969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:01.778587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:01.791487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:01.791909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:01.792352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:01.793073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:01.793557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:01.793985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:01.986570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:02.012152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:02.023969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:02.050856 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e6d1b7c-14ac-4c00-9db2-958b468d9946 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1537 microversion: 2.91 time: 0.265446 Sep 27 01:44:02.052194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1652/3245] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:01 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:02.591264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:02.592013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:02.593291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:02.616594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:02.618125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a127378-a30b-4aad-b269-16cd8f023378 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1368 microversion: 2.1 time: 1.047676 Sep 27 01:44:02.618924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:02.619602 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1594/3246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:01 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1368 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:02.620721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:02.622778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:02.623929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:02.626454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:02.706794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:02.707860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:02.724222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:02.733874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:02.736027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:02.739457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:02.740718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:02.746895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:02.896565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:02.899454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:02.907822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-438dc2c3-cf22-4fd6-926e-cee7a77bc818 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1700 microversion: 2.1 time: 0.322418 Sep 27 01:44:02.908707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1653/3247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:02 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1700 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:03.092001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:03.093787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:03.108743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.109648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.112632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:03.113772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.114453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.115273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:03.313865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:03.327860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:03.329378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:03.346988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d4882e88-bdf5-4f8c-b622-29f35a21d1fa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1537 microversion: 2.91 time: 0.266573 Sep 27 01:44:03.348217 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1654/3248] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:03 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1537 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:03.645269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:03.646168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:03.655191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:03.658027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.658534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.658978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:03.659706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.662387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.669371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:03.669879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bd2b774-6df9-46dd-bf6a-c5d06fdbe1db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.969095 Sep 27 01:44:03.691358 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1595/3249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:02 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:03.935523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:03.936614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:03.972653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.974061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.978838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:03.982786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:03.983984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:03.988311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:04.042290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:04.054435 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5249f40e-3bc8-4a6f-91b8-51fc5cebaa9a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1558 microversion: 2.1 time: 0.414244 Sep 27 01:44:04.066987 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1655/3250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:03 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1558 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:04.085325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:04.091604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:04.113257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:04.115796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:04.116863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:04.119531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:04.120730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:04.121194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:04.278749 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af830a65-943a-4439-bee2-4f9e733b1949 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198016 Sep 27 01:44:04.279386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1656/3251] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:44:04 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:04.378982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:04.379614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:04.396361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:04.401892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:04.402919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:04.404611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:04.405127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:04.405595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:05.260497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:05.264341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:05.284137 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2a48c69-072a-4151-bce4-6b6330d3fc47 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1700 microversion: 2.1 time: 1.350599 Sep 27 01:44:05.288980 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1596/3252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:03 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1700 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:05.313973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:05.314855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:05.346193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:05.347197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:05.348515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:05.349604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:05.354011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:05.354535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:05.601241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:05.615026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:05.618365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:05.633476 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ffb7dbca-cc11-430b-b5bc-dfda2f7e1c36 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1480 microversion: 2.91 time: 1.257106 Sep 27 01:44:05.636051 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1657/3253] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:04 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1480 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:05.680625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-859358-1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:05.687742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:05.752082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:05.752890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:05.754444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:05.757680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:05.760157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:05.760804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:06.213998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-859358-1". {{(pid=128778) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 01:44:06.387916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1dcd62ab-58e5-4161-a575-bbc22481330f tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action" status: 202 len: 0 microversion: 2.91 time: 0.716204 Sep 27 01:44:06.388795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1658/3254] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:44:05 2022] POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:44:06.411918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:06.416933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:06.453762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:06.454530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:06.456650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:06.460457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:06.461318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:06.467524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:06.687271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:06.701574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e3eede9-9f1f-40c1-831d-dcf4f043bfc0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.406339 Sep 27 01:44:06.719781 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1597/3255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:05 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:06.727079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:06.727937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:06.735608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:06.736398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:06.737020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:06.738011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:06.738627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:06.739373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:06.958811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:06.989481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae1b32d8-40cc-40c9-93e5-cd0f44c4a0cd tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1633 microversion: 2.1 time: 0.596383 Sep 27 01:44:06.993113 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1659/3256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:06 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1633 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:07.085577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1766144236", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23594c01-9d6b-41da-b812-329d1c79b6da"}], "security_groups": [{"name": "tempest-securitygroup--828986121"}], "key_name": "tempest-keypair-1944148951", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:07.110600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:07.126176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:07.160608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:07.177516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecb9c926-b0d2-45f7-8c39-f7cc8a91eb4a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1488 microversion: 2.91 time: 0.456274 Sep 27 01:44:07.201993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1598/3257] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:06 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1488 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:07.504229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dcb45f-119a-413c-bc1e-e0699e25285f", "tag": "a4c916da-24cf-44b8-8816-d209db0cb8f7"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:07.522099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:07.522971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:07.523622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:07.548197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] Creating event network-changed:a4c916da-24cf-44b8-8816-d209db0cb8f7 for instance 74dcb45f-119a-413c-bc1e-e0699e25285f on n-h1-859358-1 Sep 27 01:44:07.560473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-99f75bb9-ee35-411f-b688-a68efa619f49 req-1eb39b64-3cdd-4e7f-b1d7-a52619f7146c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059942 Sep 27 01:44:07.561643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1599/3258] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:07.642526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] validate_networks() for [('23594c01-9d6b-41da-b812-329d1c79b6da', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:07.737684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:07.738377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:07.750305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:07.771064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:07.771531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:07.772339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:07.772798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:07.773217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:08.099661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:08.372587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:09.050374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:09.063365 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e8cba15-f289-406d-9383-d0dbe42a49a0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.341573 Sep 27 01:44:09.067264 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1600/3259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:07 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:09.084058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:09.085237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:09.098686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:09.099513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:09.100390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:09.101278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:09.101944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:09.102555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:09.379846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:09.554041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:09.571132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a744be7f217a466c9f1c85543c0a8a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588dc81e4691443bb9588a29675d4178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:09.587789 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-286768b5-b270-4cc5-b437-a26f9fb54ed5 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 200 len: 1633 microversion: 2.1 time: 0.519199 Sep 27 01:44:09.595492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1601/3260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:09 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 1633 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:09.612232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:09.613256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:09.628519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:09.630068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:09.633003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:09.633973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:09.634599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:09.638298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:09.843782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:09.860827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:09.862313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:09.873112 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff1687c7-e396-4422-86f2-752e2d3219ad tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.276006 Sep 27 01:44:09.886017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1602/3261] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:09 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:09.902734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28acc060-a8ce-469b-8a6f-7fb777abe130", "name": "network-vif-deleted", "tag": "327aad57-ae84-4acd-afc6-72132cb90b5f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:09.915662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:09.916038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:09.916639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:09.936852 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] Creating event network-vif-deleted:327aad57-ae84-4acd-afc6-72132cb90b5f for instance 28acc060-a8ce-469b-8a6f-7fb777abe130 on n-h2-859358-1 Sep 27 01:44:09.947794 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fc00b8de-f2f7-40a8-beb8-d0a2670e1955 req-d294ea75-9dee-47d9-997b-f4c577ce659d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060397 Sep 27 01:44:09.949805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1603/3262] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:10.103663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:10.104530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:10.124607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.133114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.138927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.139831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.141047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.142051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.175881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:44:10.176375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:44:10.177394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:44:10.177753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:44:10.178869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:44:10.209073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.213618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.214202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.215083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.218124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.223360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.289589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:10.302083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:10.357989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:44:10.374457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:10.526054 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c495e53-7fd8-426e-93d4-adcaed988809 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.451443 Sep 27 01:44:10.537217 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1660/3263] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:44:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 3464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:44:10.567208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be1a4ea4-25d0-4514-b4c8-97dec4845348 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:10.574909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-be1a4ea4-25d0-4514-b4c8-97dec4845348 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:10.586754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:10.610780 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-deea2a76-03c9-4347-9258-89d5cefb970e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.514232 Sep 27 01:44:10.611336 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1604/3264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:10 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:10.645665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:10.646316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:10.683178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.686965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.689148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.695007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.695569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.696007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.806428 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] HTTP exception thrown: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Request method failure captured: Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c HTTP/1.1 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlSxH3ffLPKfpMrE757kYaWaeKZRWCwDqOK6gG1EzbL3h2EfS_fAoEtUM5azrvuy55wP5--BrW304G5loKo9DsC4z1R0LuGlNyLzXQ8dr1tb8QNxrKuk_rmdn74MOc4BLEhsvdwYveJiye4x8KJ0ftYnaPUUED9DeW608EgWKqGtq7Q Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:44:10.808152 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b8ca22bbdb9442ca7053b104701ee60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 8afa2dd2d948458798ab42ae7873c0c8 Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:10.809748 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '5a0ca464-e1cf-4795-80fa-a55db5e5ab2c'} Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:10.810637 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:10.812135 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:10.813645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Returning 404 to user: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:10.831269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-835925a8-b0de-45c2-b27d-e67ab744faa8 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 404 len: 111 microversion: 2.1 time: 0.169278 Sep 27 01:44:10.835880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-be1a4ea4-25d0-4514-b4c8-97dec4845348 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:10.845943 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1605/3265] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:44:10 2022] DELETE /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:44:10.853004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:10.853650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] [instance: 28acc060-a8ce-469b-8a6f-7fb777abe130] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:10.865873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-be1a4ea4-25d0-4514-b4c8-97dec4845348 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1239 microversion: 2.1 time: 0.305453 Sep 27 01:44:10.866560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1661/3266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:10 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1239 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:10.905688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.911954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.914038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:10.915019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.920790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.921105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] [instance: 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:10.929534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.931905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.963329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.963635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.968014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:10.970834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:10.972976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:10.974335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:11.004281 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] HTTP exception thrown: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. Sep 27 01:44:11.015849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] HTTP exception thrown: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Request method failure captured: Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c HTTP/1.1 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlSxH3ffLPKfpMrE757kYaWaeKZRWCwDqOK6gG1EzbL3h2EfS_fAoEtUM5azrvuy55wP5--BrW304G5loKo9DsC4z1R0LuGlNyLzXQ8dr1tb8QNxrKuk_rmdn74MOc4BLEhsvdwYveJiye4x8KJ0ftYnaPUUED9DeW608EgWKqGtq7Q Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:44:11.019868 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b8ca22bbdb9442ca7053b104701ee60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b8ca22bbdb9442ca7053b104701ee60", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 2b8ca22bbdb9442ca7053b104701ee60 Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2067510122 Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 8afa2dd2d948458798ab42ae7873c0c8 Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2067510122-project Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:11.021494 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5a0ca464-e1cf-4795-80fa-a55db5e5ab2c'} Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:11.022953 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. Sep 27 01:44:11.024513 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Request method failure captured: Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 HTTP/1.1 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlTzvMUiPCqBSkCaLkG8P6Z_nWzq-dTQsq6zrxPL7IewlRLZFHytYIMtwSI3PfdaP-Pa5dG3K9ZiO-cM7NHwbgsgYWagvLmGzOHPKBMemhk9kqOheu-3dSRK0jknC92QeKwYNZXv_PkDGKUyOEc7BjVCv5TLPGjfFhyv_FeB0r5HjgY Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 588dc81e4691443bb9588a29675d4178 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-569280456 Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:44:11.025824 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/588dc81e4691443bb9588a29675d4178"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/588dc81e4691443bb9588a29675d4178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/588dc81e4691443bb9588a29675d4178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_588dc81e4691443bb9588a29675d4178", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-569280456 Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 588dc81e4691443bb9588a29675d4178 Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-569280456 Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-569280456-project Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a744be7f217a466c9f1c85543c0a8a96 Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-569280456-project Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '28acc060-a8ce-469b-8a6f-7fb777abe130'} Sep 27 01:44:11.027339 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:11.028390 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:11.033095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Returning 404 to user: Instance 28acc060-a8ce-469b-8a6f-7fb777abe130 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:11.034592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1697588-9ec1-4fd3-a860-f4da4649c164 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130" status: 404 len: 111 microversion: 2.1 time: 0.177823 Sep 27 01:44:11.034592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1606/3267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:10 2022] GET /compute/v2.1/servers/28acc060-a8ce-469b-8a6f-7fb777abe130 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:44:11.034768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] Returning 404 to user: Instance 5a0ca464-e1cf-4795-80fa-a55db5e5ab2c could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:11.034768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f43d4439-997f-4135-ae00-0b32d34f9622 tempest-AttachSCSIVolumeTestJSON-2067510122 tempest-AttachSCSIVolumeTestJSON-2067510122-project] 10.222.0.52 "GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c" status: 404 len: 111 microversion: 2.1 time: 0.164037 Sep 27 01:44:11.047444 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1662/3268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:10 2022] GET /compute/v2.1/servers/5a0ca464-e1cf-4795-80fa-a55db5e5ab2c => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:44:11.057497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:11.058311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:11.067091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc620042-7860-4a5e-8801-521c05bc38d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] Calling method '.version_select at 0x7f24d599f790>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:11.086470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:11.086709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:11.088950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:11.089781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:11.093557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:11.094213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:11.130102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:11.156905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc620042-7860-4a5e-8801-521c05bc38d4 tempest-ServersTestJSON-569280456 tempest-ServersTestJSON-569280456-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-584095551" status: 202 len: 0 microversion: 2.1 time: 0.108024 Sep 27 01:44:11.162952 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1663/3269] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-584095551 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:44:11.616430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:11.626659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:11.634308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:11.635015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:11.636535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:11.660040 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1985fcf2-331d-4a87-891f-e92ba0edeeea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.629125 Sep 27 01:44:11.665947 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1607/3270] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:11 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:11.669102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:11.670013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:11.672908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:11.676321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:11.678239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:11.681978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:11.894817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-405ab3a8-a4b6-4fb9-93be-7ce50eba8291 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:11.895855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-405ab3a8-a4b6-4fb9-93be-7ce50eba8291 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:12.305728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-405ab3a8-a4b6-4fb9-93be-7ce50eba8291 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:12.316124 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-405ab3a8-a4b6-4fb9-93be-7ce50eba8291 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1239 microversion: 2.1 time: 0.425386 Sep 27 01:44:12.318283 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1608/3271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1239 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:12.702886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:12.704632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:12.757237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:12.758656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:12.763972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:12.765931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:12.766588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:12.769842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:13.097370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:13.106612 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8891022-2822-49e0-b34a-c4f4c6b94b8e tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.476407 Sep 27 01:44:13.108240 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1664/3272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:11 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:13.229214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:13.251608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:13.255239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:13.270492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb64eac9-cab0-4112-872a-74b216ecb302 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.577630 Sep 27 01:44:13.271520 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1609/3273] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:12 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:13.343345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:13.343965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:13.363575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:13.364079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:13.364517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:13.365240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:13.365763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:13.366194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:13.602724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:13.611526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27fb5b73-7029-4d0a-be51-7895645a7d34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1291 microversion: 2.1 time: 0.271971 Sep 27 01:44:13.621068 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1665/3274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:13 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1291 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:14.135054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:14.137129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:14.160586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.163542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.169676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.171204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.172119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.174215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.302513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:14.304513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:14.328419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.336191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.337170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.339111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.340994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.342383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.578512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:14.593172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:14.596773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:14.618189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0ccd017-5df2-4e5a-b365-66466f5f6250 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.320101 Sep 27 01:44:14.634148 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1666/3275] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:14 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:14.653728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:14.656604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:14.687652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.688617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.690210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.695640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:14.698315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:14.699347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:14.962959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:14.976802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c37510d8-b682-4eae-8d21-0ef75169f437 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1297 microversion: 2.1 time: 0.329432 Sep 27 01:44:14.978371 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1667/3276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:14 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1297 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:15.270224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:15.282942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d7546fd-19f6-41d7-bcb8-6bf85770297c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 1.152900 Sep 27 01:44:15.287985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1610/3277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:14 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:15.653966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:15.654663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:15.675990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:15.676927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:15.677579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:15.679046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:15.683085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:15.683770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:15.939400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:15.952700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:15.965084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:15.978416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4609e12-6f4b-4f56-b65c-77f99cccb975 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.328243 Sep 27 01:44:16.011677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:16.013458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:16.018846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1668/3278] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:15 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:16.021171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:16.022570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:16.023250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:16.024202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:16.024875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:16.029421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:16.148315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:16.164767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6344c483-1057-48ab-95a6-6da0950acdc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1297 microversion: 2.1 time: 0.159212 Sep 27 01:44:16.168263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1611/3279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:16 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1297 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:16.269963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1151712860", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:16.433578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:16.437035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:16.455167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:16.457985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:16.460993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:16.463835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:16.465676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:16.469194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:17.108845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:17.119688 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8881323b-3060-44ff-90ce-c83dcbfa98f3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.692298 Sep 27 01:44:17.130294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1612/3280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:16 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:17.148532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:17.154709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:17.184484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:17.189891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:17.192490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:17.194901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:17.198050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:17.199990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:17.443160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:17.458096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:17.462368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:17.478853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-49d909af-a221-4a7f-a4ec-ea67e0217fc8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.345770 Sep 27 01:44:17.479824 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1613/3281] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:17 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:17.489442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:17.490613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:17.500927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:17.501792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:17.502470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:17.513658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:17.517007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:17.518426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:18.047992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:18.056096 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6ea1fd2-313e-46ce-bab7-bc723d1253a5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.571072 Sep 27 01:44:18.056682 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1614/3282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:17 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:18.155569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:18.156194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:18.173825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:18.174323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:18.175021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:18.176322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:18.176976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:18.177617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:19.045778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:19.068211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0f74fc8-70d8-4510-8ec5-22a88a563a98 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.916899 Sep 27 01:44:19.074222 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1615/3283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:18 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:19.091313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:19.103332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:19.119536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:19.130120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:19.132570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:19.135332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:19.135944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:19.137755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:19.995609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:20.010345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:20.025251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:20.035839 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-882acfa2-91bb-405d-8f77-12f47158b221 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.959954 Sep 27 01:44:20.061723 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1616/3284] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:19 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:20.078384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:20.086751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] validate_networks() for [('62292327-c629-4d4e-864a-c80a2131f473', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:20.094272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:20.101477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:20.102235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:20.102850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:20.104453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:20.105191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:20.106789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:20.116151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:20.248056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:20.845101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:20.869287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:20.891580 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-063d960b-9da5-43ca-8373-ce019f1e74ff tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.823236 Sep 27 01:44:20.892341 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1617/3285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:20 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:20.941835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:20.943067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:20.966901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:20.973905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:20.974513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:20.975336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:20.975812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:20.976245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.331996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:44:21.332535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:44:21.332875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:44:21.336957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:44:21.338238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:44:21.360867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.363064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.364589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.366237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.366881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.367480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.390570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Getting quotas for project 8879eb61c6f94947921dd34a1e0931ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:21.402994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Getting quotas for user 2b585ddc3a2741d79a920bc96f5c21c4 and project 8879eb61c6f94947921dd34a1e0931ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:21.414617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:21.429460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:44:21.439080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:21.443697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e77a95d3-30a2-483c-8845-ece42cdf1b3b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.529775 Sep 27 01:44:21.446842 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1618/3286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:20 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:21.470507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:21.472441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:21.495044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.495596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.495979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.496696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.497155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.514239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3bb6d559-30b8-4281-8766-df7413254ce8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.375022 Sep 27 01:44:21.516171 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1669/3287] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:44:21.529541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.549686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-580bc075-7ba9-4eb3-bc60-58b7be1ba8ff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:21.551015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-580bc075-7ba9-4eb3-bc60-58b7be1ba8ff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:21.765297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-580bc075-7ba9-4eb3-bc60-58b7be1ba8ff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:21.777707 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-580bc075-7ba9-4eb3-bc60-58b7be1ba8ff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1217 microversion: 2.1 time: 0.239899 Sep 27 01:44:21.789894 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1670/3288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:21 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:21.810984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:21.840056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:21.849664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:21.867723 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f90038c4-149a-4712-b775-8a2e1aad37c6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.418847 Sep 27 01:44:21.884091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1619/3289] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:21 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:21.918778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:21.919971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:21.921224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:21.948381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.952364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.954436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.955437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.958808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.959719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:21.971362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:21.980278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:21.984310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:22.036222 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] Creating event network-changed:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:44:22.052281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d077049c-93b2-49c4-b7d3-8ca6bda33c94 req-945a7fde-ef74-4117-8028-74f2d0b439e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143115 Sep 27 01:44:22.057052 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1671/3290] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:22.315439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:22.471970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:22.472713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:22.487916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:22.488417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:22.488857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:22.498643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:22.500055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:22.501095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:22.781421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:22.789864 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-430a09c1-c4ea-4c45-ad3c-13f6e1fe42f3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.875276 Sep 27 01:44:22.790447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1620/3291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:21 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:22.810606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:22.817290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:22.829749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:22.833995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:22.840799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:22.842832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:22.843536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:22.846637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:23.046986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:23.055788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-070e2d9f-65f2-4e56-8201-36d55b67d630 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1521 microversion: 2.1 time: 0.588250 Sep 27 01:44:23.061668 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1672/3292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:22 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:23.072665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:23.080404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:23.099956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:23.100724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:23.102436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:23.104834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:23.109964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:23.110428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:23.245041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:23.265542 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a74720b-ad7d-4e90-95fb-b0d9228d3bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1221 microversion: 2.1 time: 0.458738 Sep 27 01:44:23.266454 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1621/3293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:22 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1221 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:23.330440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:23.342656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:23.355955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:23.392362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f3d48fd-8d0e-4031-8edd-96aafabb1c93 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.329325 Sep 27 01:44:23.393272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1673/3294] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:23 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:23.817939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:23.819341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:23.830727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:23.831474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:23.833254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:23.835411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:23.836830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:23.838054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.084537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:24.086219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:24.098489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.112086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.113907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.118086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.120368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.121061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.317772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:24.330851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-308ba436-cf2b-4a9a-8471-dc200c748f0c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.518356 Sep 27 01:44:24.336642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1622/3295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:24.344944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:24.345915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:24.360479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.361455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.362149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.363108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.363781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.364550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.582717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:24.598042 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0200eb9c-595d-4e33-95a8-3474073af394 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1277 microversion: 2.1 time: 0.258266 Sep 27 01:44:24.598258 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1623/3296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:24 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:24.628527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:24.631150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:24.651449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.653654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.655270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.664634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:24.664634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:24.664634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:24.821823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:24.844012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:24.845476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:24.875884 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a76ee937-cceb-40f7-960a-556d2ae580d9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.256525 Sep 27 01:44:24.889451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1624/3297] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:24 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:25.246912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:25.257881 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9b97893-f0f8-4552-8572-9c7b2674d980 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1501 microversion: 2.1 time: 1.177107 Sep 27 01:44:25.269826 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1674/3298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:24 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1501 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:25.281672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:25.282571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:25.290769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:25.291615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:25.292288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:25.293230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:25.293934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:25.295804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:25.358912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:25.360332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:25.369115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:25.374235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:25.375007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:25.379767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:25.383400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:25.384066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:25.393685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:26.038181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.050668 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f452fca-9204-4b0c-b892-b20f31861c78 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1517 microversion: 2.1 time: 0.772883 Sep 27 01:44:26.081464 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1625/3299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:25 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1517 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:26.090111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:26.090740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:26.123450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.124066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.124361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.125955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.126574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.135757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.216296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.230181 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16a99e05-321f-4cb7-86a7-e9052d409096 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.875509 Sep 27 01:44:26.232060 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1675/3300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:25 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:26.239857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:26.240734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:26.250329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.251481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.253325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.254281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.254900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.255496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.407009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.418131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.422419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.429597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:26.432320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2fcc3fca-7df7-42cf-a75e-6e30463b2eac tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.199002 Sep 27 01:44:26.432917 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1676/3301] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:26 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:26.438473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6880036f-14fa-4780-9b53-4ee516648f16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1275 microversion: 2.1 time: 0.354002 Sep 27 01:44:26.439057 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1626/3302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:26 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1275 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:26.458914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:26.462333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: aa11e6e4-a1c6-4e6c-a281-604b13bf2082] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:26.473638 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/aa11e6e4-a1c6-4e6c-a281-604b13bf2082/action HTTP/1.1 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 14 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:44:26.484424 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: {"rescue": {}} Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. Sep 27 01:44:26.486222 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aa11e6e4-a1c6-4e6c-a281-604b13bf2082', 'body': {'rescue': {}}} Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:44:26.487163 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. Sep 27 01:44:26.488494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:44:26.491193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 404 to user: Instance aa11e6e4-a1c6-4e6c-a281-604b13bf2082 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:26.492312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b838c91-5bd2-48ce-9120-7f4dc685572f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/aa11e6e4-a1c6-4e6c-a281-604b13bf2082/action" status: 404 len: 111 microversion: 2.1 time: 0.045592 Sep 27 01:44:26.496114 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1677/3303] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:26 2022] POST /compute/v2.1/servers/aa11e6e4-a1c6-4e6c-a281-604b13bf2082/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:44:26.503691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:26.504885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:26.516759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.517261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.517733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.518612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.518911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.519405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.723224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25ec667f-4572-4752-b3b2-978eb21be828 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action" status: 202 len: 0 microversion: 2.1 time: 0.223669 Sep 27 01:44:26.724354 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1627/3304] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:26 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:44:26.738975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:26.739780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:26.762438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.764584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.765554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:26.766307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:26.766780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:26.767210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.258282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:27.259593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:27.266545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:27.274308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.299055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.299374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.303868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.304380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.304829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.812214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:27.823445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50c9680d-9ed2-4bc2-819c-571e957e772e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.569361 Sep 27 01:44:27.833675 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1628/3305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:27 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:27.839198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:27.839983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:27.857487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.858740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.859341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.860211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.860832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.861441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.951382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:27.964280 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-779ec33d-5f12-4205-92fc-6d08c2c682a9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1522 microversion: 2.1 time: 1.235854 Sep 27 01:44:27.969804 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1678/3306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:26 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1522 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:27.974818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:27.975422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:27.990048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.990586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.991022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:27.991741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:27.992199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:27.992621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:28.142872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:28.157927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:28.159663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:28.170933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71edc8bf-405d-41a8-9af4-b7b4c16d8308 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.199758 Sep 27 01:44:28.171537 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1679/3307] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:27 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:28.471455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:28.481069 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30b3ecbd-7821-4e98-b107-a2cee9273734 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.645391 Sep 27 01:44:28.496681 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1629/3308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:27 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:28.846026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:28.847001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:28.858440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:28.859876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:28.860820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:28.862593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:28.864939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:28.866148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:28.993204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:28.994234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:29.014483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.015253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.015863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.019002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.024565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.025559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.489455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:29.511439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50a2ed28-037a-4e76-8557-736176cf1c00 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.669215 Sep 27 01:44:29.513743 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1680/3309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:28 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:29.532330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:29.534592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:29.546580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.548540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.549151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.550936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.553776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.567985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.779464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:29.791584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:29.794168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:29.798155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:29.803779 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b7ebf68-3e87-497a-972f-5e55ec9c0491 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.279561 Sep 27 01:44:29.819137 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1681/3310] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:29 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:29.826359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:29.827116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:29.837488 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a818052-2648-4c02-948e-42e94a25184c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1502 microversion: 2.1 time: 0.847346 Sep 27 01:44:29.838988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1630/3311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:28 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1502 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:29.844608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-plugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:29.853394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.858258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.858665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.859058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.872748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.873249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.874230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.874559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] Creating event network-vif-plugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:44:29.875063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.875946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.883555 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-549a85cf-b15c-447c-9fbf-fce9c230acf2 req-4acbbd71-7bf6-4876-aab6-021dfa5820c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Sep 27 01:44:29.885523 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1631/3312] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:29.895884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:29.899631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:29.911553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.912463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.913246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.914508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:29.915291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:29.916001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:29.964642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'flavor' on Instance uuid b0da0c08-6152-4018-8292-eecd8bddfbbf {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:44:29.979977 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Cannot 'rescue' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state paused Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action HTTP/1.1 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 14 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:44:29.981975 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: {"rescue": {}} Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:44:29.983295 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'rescue' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state paused Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'b0da0c08-6152-4018-8292-eecd8bddfbbf', 'body': {'rescue': {}}} Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf in vm_state paused. Cannot rescue while the instance is in this state. Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:29.985254 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state paused Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state paused Sep 27 01:44:29.986530 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:29.988989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 409 to user: Cannot 'rescue' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state paused {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:29.988989 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9a6de62-ffdc-4f62-bd70-437fc80d43d5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action" status: 409 len: 144 microversion: 2.1 time: 0.096406 Sep 27 01:44:29.988989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1632/3313] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:29 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action => generated 144 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:44:30.002822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:30.009038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:30.031459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.031892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.032332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.034033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.034817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.035332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.071073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:30.130707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:30.142230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-225d70b2-cad4-43c8-a77e-affda2adaff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.329713 Sep 27 01:44:30.143071 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1682/3314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:29 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:30.195280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:30.208738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbee7b80-f17c-45e5-a46e-018db3f704d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action" status: 202 len: 0 microversion: 2.1 time: 0.216547 Sep 27 01:44:30.211065 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1633/3315] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:29 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:44:30.217088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.220337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.220985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.226089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:30.228067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:30.249501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.250113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.251923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] Creating event network-changed:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h2-859358-1 Sep 27 01:44:30.252906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.254870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.255348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.255783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.261310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-49326ac3-4dca-4b24-84f1-b4a1e89fed3e req-62bf461b-7021-48a7-b5b5-2e3656be1160 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070757 Sep 27 01:44:30.265086 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1683/3316] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:30.541980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:30.542635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:30.560755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.563206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.563934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.565006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.565750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.566518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.719569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:30.728905 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef7b13d3-e001-4e6b-8b10-a92f8e4788e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1509 microversion: 2.1 time: 0.513074 Sep 27 01:44:30.729536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1634/3317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:30 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:30.814217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:30.826874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bef76c80-1f37-413f-ba93-211e2e38bfaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1364 microversion: 2.1 time: 0.287827 Sep 27 01:44:30.829268 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1684/3318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:30 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:30.848598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:30.851006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:30.857319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.858174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.858819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.859736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:30.860409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:30.861037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:30.972699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:30.991934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:30.993697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.000460 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68273807-6fa6-4d37-9cc0-bf8071fdf0e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1533 microversion: 2.91 time: 0.160762 Sep 27 01:44:31.001127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1635/3319] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:30 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1533 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:31.031884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:31.032843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.049851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.052189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.055113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.058049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.059970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.060687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.168905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:31.169882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.181110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.182102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.182916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.183876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.184582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.185463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.260970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lazy-loading 'services' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:44:31.287062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68434df8-8ae1-45ee-8ab7-145a690da0b2 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1938 microversion: 2.91 time: 0.258878 Sep 27 01:44:31.288630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1685/3320] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:31 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1938 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:31.315223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:31.316142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.324074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.324574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.325232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.326279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.326897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.327493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.359158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lazy-loading 'flavor' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:44:31.389589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:31.522296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.540942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f696ced-a4bc-475d-b59e-4f9e2f11da08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.372010 Sep 27 01:44:31.542145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1636/3321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:31 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:31.710805 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5dacbd7-59fd-486f-9a43-0035446860f2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action" status: 202 len: 0 microversion: 2.91 time: 0.399324 Sep 27 01:44:31.711476 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1686/3322] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:44:31 2022] POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:44:31.720296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:31.721101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.729565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.730575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.731045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.731811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.732429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.732917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.753600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:31.755985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.764111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.764615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.765313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.766189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.767026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.767566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.773687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:31.823239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.833050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.834563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.840948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-394f1ef8-ab3c-4a0d-8a12-8f4e932c15ef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.125237 Sep 27 01:44:31.841773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1637/3323] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:31 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:31.852885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:31.853626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:31.860454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.860876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.861377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.862079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:31.862527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:31.862952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:31.981964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:31.991273 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cdf6c4d3-d90c-4af6-b025-411a3ba0f132 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1517 microversion: 2.1 time: 0.241730 Sep 27 01:44:31.992303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1687/3324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:31 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:32.152784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:32.163685 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6526a260-8694-4560-9efa-6ed53ed6b62f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1551 microversion: 2.1 time: 0.312902 Sep 27 01:44:32.185627 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1638/3325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:31 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1551 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:32.190727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:32.191460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:32.201084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.201968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.202414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.203130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.203635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.204074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.303522 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f18d866-9804-4f37-81b1-6d762e2852e3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118407 Sep 27 01:44:32.304207 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1688/3326] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:44:32 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:32.566966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:32.567962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:32.582049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.582543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.583506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.584448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.585055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.585874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.879137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:32.880332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:32.901783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.903612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.904556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.907104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:32.909922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:32.910916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:32.940279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:32.949916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e5a3981-141b-4a5c-9ab0-4bf5d9197f75 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.386029 Sep 27 01:44:32.950528 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1639/3327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:32 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:33.241667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:33.283359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:33.285043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:33.304000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ec619d0-3078-4fe6-9b0b-a2f1954ff54e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.429701 Sep 27 01:44:33.304745 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1689/3328] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:32 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:33.981756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:33.982540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:33.997107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:33.997758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:33.998306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:33.999128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:33.999685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.000386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.345108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:34.345754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:34.360323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.360829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.361266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.365958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.367573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.369226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.516755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:34.553391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96356d5a-3433-4a19-94bf-8e48fd72674c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.554598 Sep 27 01:44:34.562660 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1640/3329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:33 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:34.592116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:34.612608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:34.617248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:34.634992 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6eb994a5-9ef8-40dd-817e-d4b4c0e82efc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.298537 Sep 27 01:44:34.641429 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1690/3330] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:34 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:34.679758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:34.682570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:34.698461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.698996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.699737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.701039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.701526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.701966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.730640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'flavor' on Instance uuid b0da0c08-6152-4018-8292-eecd8bddfbbf {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:44:34.835167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a21869d-d533-4506-b125-24177ef76ff4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action" status: 200 len: 32 microversion: 2.1 time: 0.161765 Sep 27 01:44:34.836613 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1641/3331] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:34 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:44:34.848008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:34.848576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:34.857898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.860586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.861311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.863645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:34.864389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:34.865035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:34.884251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:35.512682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:35.528163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:35.535653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:35.536611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:35.537764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:35.541056 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3462831a-bfd4-44a6-847b-b6887dba60eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.698415 Sep 27 01:44:35.555435 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1691/3332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:34 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:35.571005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] Creating event network-changed:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:44:35.577821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:35.580130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:35.581414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e62334c3-4437-47d2-84dc-1fd99cd92657 req-9a8a839c-efb6-4d15-bff1-be0cc62c4f88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074114 Sep 27 01:44:35.583191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1642/3333] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:35.586791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:35.587260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:35.592361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:35.593735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:35.596147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:35.597286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:35.671693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:35.672636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:35.684727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:35.685580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:35.686198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:35.688940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:35.689615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:35.690249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:35.847839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:35.868312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:35.875015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:35.883746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:35.888855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b12a7ea0-e004-4aa8-96e0-7f79b6643197 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.221767 Sep 27 01:44:35.890573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1643/3334] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:35 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:35.895129 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-583147ad-e745-48ee-a8a6-849afca7d720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.321042 Sep 27 01:44:35.897873 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1692/3335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:35 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:36.446149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "name": "network-vif-plugged", "status": "completed", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:36.466246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.468363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.470355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.520831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] Creating event network-vif-plugged:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h2-859358-1 Sep 27 01:44:36.532320 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e3f586d3-5e36-45a6-94f2-2c942cc9f561 req-fa9e8d80-f124-4ddd-87e9-f4055adc8230 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091263 Sep 27 01:44:36.540623 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1644/3336] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:44:36.572773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:36.573425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:36.593752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.598009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.598468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.599214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.599704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.600131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.844232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:36.856400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8872a4e8-1b72-4861-adea-04f8b74ff270 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.292100 Sep 27 01:44:36.879302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1693/3337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:36 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:36.921814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:36.922787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:36.925072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:36.926067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:36.930398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.931135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.931783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.932719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.933316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.933928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.946851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.947468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.949572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:36.950802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:36.951659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:36.952457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:37.156996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:37.170036 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7589ea8-deca-4eef-af87-47aa4c173089 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.247797 Sep 27 01:44:37.171028 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1694/3338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:36 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:37.191958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:37.219222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:37.220036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:37.255517 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f148bb79-1069-45b0-8d66-41fa48f1e333 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.341236 Sep 27 01:44:37.257637 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1645/3339] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:36 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:37.883161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:37.883908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:37.896936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:37.897652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:37.898190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:37.898998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:37.899740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:37.900600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:38.165865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:38.182575 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39ad9a39-b8e9-45dc-b646-d033360b886d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.297431 Sep 27 01:44:38.183828 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1695/3340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:37 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:38.198160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:38.198771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:38.205859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:38.206647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:38.207238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:38.208216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:38.209626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:38.210327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:38.288825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:38.289707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:38.292645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:38.296478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:38.297046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:38.297589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:38.298512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:38.299037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:38.299671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:38.392335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:38.398059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:38.404270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:38.407901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b468309e-e9ac-4255-afa5-9463d6a19712 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1317 microversion: 2.1 time: 0.213530 Sep 27 01:44:38.408413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:38.414419 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1646/3341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:38 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:38.418125 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d5130d09-2f03-489d-b010-b42e4b8f6fa4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.134916 Sep 27 01:44:38.419334 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1696/3342] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:38 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:44:39.207501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:39.208128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:39.230913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.231665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.231999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.232716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.233209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.233678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.441255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:39.442032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:39.465462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.466778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.467873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.469902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.470628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.472292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.678899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:39.687276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd5e2483-f80e-45b3-801d-fc46b7ddd8a5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.483779 Sep 27 01:44:39.687859 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1647/3343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:39 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:39.703993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:39.704791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:39.715804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.716616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.717228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.718129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:39.718747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:39.719489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:39.744650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:39.768238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:39.779655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d7323b37-e5ba-40ab-a19a-e4f0eff9431b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.344934 Sep 27 01:44:39.781089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1697/3344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:39 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:39.914444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1872876508", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:39.964997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:39.979254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:39.983225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:40.000166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c774aa50-95fc-4b8e-9a23-0a6fe2ec71ff tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.305723 Sep 27 01:44:40.001156 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1648/3345] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:39 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:40.032758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] validate_networks() for [('62292327-c629-4d4e-864a-c80a2131f473', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:40.715901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:40.716528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:40.736561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:40.737070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:40.738738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:40.741067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:40.741581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:40.742023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:41.047494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:44:41.048435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:44:41.049091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:44:41.049785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:44:41.050385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:44:41.068854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:41.069918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:41.071091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:41.081730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:41.082466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:41.083071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:41.113887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Getting quotas for project 8879eb61c6f94947921dd34a1e0931ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:41.122062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Getting quotas for user 2b585ddc3a2741d79a920bc96f5c21c4 and project 8879eb61c6f94947921dd34a1e0931ea. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:41.159198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:44:41.167082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:41.315392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad0b990f-fb6d-4c4a-ad8e-70b45965388d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405090 Sep 27 01:44:41.318703 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1698/3346] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:44:41.342563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:41.346486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:41.359573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:41.360376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:41.361598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:41.362594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:41.364045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:41.364658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:41.482403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:41.495257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73c3b4f5-85c0-4c9d-bda7-9195a7ad53fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.784049 Sep 27 01:44:41.496371 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1649/3347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:40 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:41.504864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef846839-a96e-4acc-bc6c-cd6c01b0aca9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:41.508317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef846839-a96e-4acc-bc6c-cd6c01b0aca9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:41.564389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:41.609102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:41.609102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:41.610522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef846839-a96e-4acc-bc6c-cd6c01b0aca9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:41.617082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef846839-a96e-4acc-bc6c-cd6c01b0aca9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1217 microversion: 2.1 time: 0.119105 Sep 27 01:44:41.622862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1650/3348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:41 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:41.637167 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d36949c-6fc6-4fc0-b46f-c8ca8bda38cc tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.315791 Sep 27 01:44:41.637800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1699/3349] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:41 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:42.525488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:42.526015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:42.547634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.553602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.554073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:42.554844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.557229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.557698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:42.650679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:42.652305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:42.674235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.675938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.679613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:42.686263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.688169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.689112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:42.908716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:42.920135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b692556e-d996-4730-a495-b722eedd0d03 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1213 microversion: 2.1 time: 0.270952 Sep 27 01:44:42.921620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1700/3350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:42 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1213 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:42.935000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:42.935859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:42.959086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.960286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.961881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:42.982478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:42.983010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:42.983457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:43.271488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:43.281388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:43.290662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:43.319074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47a13a5a-5239-453b-9292-709585ceafe2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.391004 Sep 27 01:44:43.320549 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1701/3351] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:42 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:43.950192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:43.950821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:43.997725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:43.998235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:43.998670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:43.999396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:43.999843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:44.000269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:44.168786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:44.170023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:44.184854 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f99bfe1f-bd82-4034-91b9-7247bbd85170 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 1.664376 Sep 27 01:44:44.185483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1651/3352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:42 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:44.196700 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a72e2444-60c1-4c38-b470-1a4986ced683 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1275 microversion: 2.1 time: 0.256555 Sep 27 01:44:44.199832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c6dbbe4-52e4-4435-bbee-c8905056db3c"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:44.221786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:44.224603 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1702/3353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:43 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:44.229221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:44.230051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:44.230643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:44.231517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:44.232133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:44.232741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:44.350527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:44.351140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:44.360299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:44.362834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:44.364445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:44.366691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:44.372649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:44.373432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:44.504116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:44.526877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:44.542483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:44.551394 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cee8caf-d99c-41eb-9c14-7aee2ce4d8c2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.205044 Sep 27 01:44:44.552501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1703/3354] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:44 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:44.686791 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-932d299a-3d5c-44d9-b75c-b35db1faf920 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "POST /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490587 Sep 27 01:44:44.688383 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1652/3355] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:44:44 2022] POST /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:44.968702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-365b8db7-8c3a-46b3-bb42-f04ed5a5b89a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Action: 'create', calling method: .version_select at 0x7f24d6a45820>, body: {"keypair": {"name": "tempest-keypair-1414622618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ70AdtS8FocKBr7ZMCzQrDH8Eo0LeOLSYKrI8zTsTs9vfI0F5Cn3u8Ti+cqT9VR/umWLJWY1N3vdCq90ZgdVMP91A4LmazAsECTxHAgPd6F0ACWd1YJ753+r9xFoCAiNg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:45.004060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-365b8db7-8c3a-46b3-bb42-f04ed5a5b89a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Getting quotas for project fe2017bbe6d24c0ea3f62e8aa2792293. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:45.011646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-365b8db7-8c3a-46b3-bb42-f04ed5a5b89a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Getting quotas for user 42a30d026a1d4f96b6526604d185ddf7 and project fe2017bbe6d24c0ea3f62e8aa2792293. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:45.061277 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-365b8db7-8c3a-46b3-bb42-f04ed5a5b89a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.097173 Sep 27 01:44:45.068625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1704/3356] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:44:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:44:45.221796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:45.222924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:45.230037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:45.230862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:45.242544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.247551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.247940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.248114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.248894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.249393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.249838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.250387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.252054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.264289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.265824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.266387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.541314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:45.553640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cf5d9a1-f769-4a29-8778-fdc9b5a26970 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1275 microversion: 2.1 time: 0.327691 Sep 27 01:44:45.554252 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1705/3357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:45 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:45.588822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:45.590583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:45.612615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.613925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.618611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.619946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:45.620638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:45.621788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:45.790383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:45.800773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:45.802251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:45.819209 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-258b84f4-3643-49f6-a48b-7772302e5574 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.236441 Sep 27 01:44:45.822194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1706/3358] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:45 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:46.651261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:46.665136 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1aa30d1d-bd2c-4940-9d04-b8549646e16a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 1.448610 Sep 27 01:44:46.673160 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1653/3359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:45 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:46.680676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:46.695158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:46.729094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:46.729629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:46.730446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:46.731183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:46.731639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:46.736600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:46.762151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1429910472", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8e004cdc-75a7-4e8c-b29f-892b7a57b96c"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:46.901547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] validate_networks() for [('8e004cdc-75a7-4e8c-b29f-892b7a57b96c', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:47.228621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:47.237273 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf3641ae-ef0a-4e1a-a82f-8e5b0f2b262f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.562706 Sep 27 01:44:47.237929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1654/3360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:46 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:47.267514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:47.270811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:47.284931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:47.287057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:47.290868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:47.291831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:47.292518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:47.293149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:47.422827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:47.436213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:47.440393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:47.471552 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d3af01a-e8c0-4875-93a9-a530f6b05413 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.211476 Sep 27 01:44:47.473245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1655/3361] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:47 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:47.703122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:47.703842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:47.723069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:47.723714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:47.725285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:47.726146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:47.728019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:47.729109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.131571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:48.156126 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6c866d5-3abd-4a44-a6d9-a55e3411a817 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.459692 Sep 27 01:44:48.177362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1656/3362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:47 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:48.267325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:48.267952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:48.278342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.281700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.283479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.285730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.289400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.290174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.524831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:44:48.525287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:44:48.525810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:44:48.526236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:44:48.526651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:44:48.551798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.560220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.560916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.562170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.562849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.563447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.602822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Getting quotas for project 93ec49b8ae4348ac8085b0db2095ed46. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:48.621199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Getting quotas for user 82092e9239f64422bed6b899b6291aeb and project 93ec49b8ae4348ac8085b0db2095ed46. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:48.665833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Going to run 3 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:44:48.682415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:48.759025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=342edb38-6731-4d4f-a15d-c32dd7c3d79b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:48.828689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:48.834411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=13c2d685-a6fd-41ab-9f4a-912f9d9913bd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:48.846188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-890edbf9-c7cf-4957-92de-eff573a96426 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.583909 Sep 27 01:44:48.847113 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1657/3363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:48 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:48.859809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48354f0c-9436-4e58-9c2b-ee3c7bc37022", "tag": "698fe172-c277-4247-8948-3f222cc81bb2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:48.898040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.904888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.906046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.936674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] Creating event network-changed:698fe172-c277-4247-8948-3f222cc81bb2 for instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 on n-h1-859358-1 Sep 27 01:44:48.948878 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ac94bfc3-8c6a-4e80-8c5d-769862f67f97 req-befac6d4-1fab-43bc-bf47-9694eb7187f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099418 Sep 27 01:44:48.950334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1658/3364] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:48.966578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:48.967519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:48.981310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.985604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.986211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:48.987070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:48.987646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:48.993881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.024503 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01d9a315-13e2-4756-b5ea-3fa712187d75 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.648269 Sep 27 01:44:49.025149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1707/3365] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:44:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:44:49.039837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:49.065623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.068968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:44:49.100774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.101581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.102375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.103432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.104517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.105115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.144033 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df7f1f4a-5f99-4d52-9c85-19d0aa9e9068 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.110336 Sep 27 01:44:49.146430 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1708/3366] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:44:49 2022] GET /compute/v2.1/servers => generated 1018 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:44:49.163637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d24e7a7e-03b2-4c7f-9fbb-379d99cb47e1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:49.164534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d24e7a7e-03b2-4c7f-9fbb-379d99cb47e1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:49.213509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.236248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.238199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.252783 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b7f48d9-193a-4d81-acd1-de3bd7e6d908 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.297809 Sep 27 01:44:49.258379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1659/3367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:48 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:49.272881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:49.278933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:49.292133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.293605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.299533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.300638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.301231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.301810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.495992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d24e7a7e-03b2-4c7f-9fbb-379d99cb47e1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.503067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d24e7a7e-03b2-4c7f-9fbb-379d99cb47e1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1223 microversion: 2.1 time: 0.347436 Sep 27 01:44:49.509419 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1709/3368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:49 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1223 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:49.688724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:49.699853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d4c6f93-a34b-4b83-b576-7b18e1a93fb0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.440256 Sep 27 01:44:49.702649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1660/3369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:49 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:49.872953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:49.873603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:49.888207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.888701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.893254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:49.895505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:49.899079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:49.899566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:50.286174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:50.287109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:50.299573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:50.300071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:50.303383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:50.305202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:50.307181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:50.308835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.091316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.109720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa0533fc-9412-41b8-ab8c-d91b3cb69ac6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 1.236189 Sep 27 01:44:51.110873 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1710/3370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:49 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:51.117652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-19b18447-0ad9-4f30-9dfb-3604ea3005b5 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:51.118520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-19b18447-0ad9-4f30-9dfb-3604ea3005b5 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:51.157298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.198680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.207811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.232260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8769e924-bc08-47fb-beec-4b3511b9f9b9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.947907 Sep 27 01:44:51.234139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1661/3371] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:50 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:51.258425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:51.259689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:51.277677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.279078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.281923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.283859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.285684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.290746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.428514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-19b18447-0ad9-4f30-9dfb-3604ea3005b5 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.441028 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-19b18447-0ad9-4f30-9dfb-3604ea3005b5 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1223 microversion: 2.1 time: 0.328778 Sep 27 01:44:51.459945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1711/3372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:51 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1223 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:51.493705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-8232368", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3eac0baf-d726-4151-ba16-b2cec23b58cf"}, {"port": "daa72d51-9283-4a45-9a26-05910ede5e8b", "tag": "port-1"}, {"port": "83e451ef-fe7f-4e7b-851d-9bd4130b3f12", "tag": "port-2"}, {"uuid": "260aef37-4441-4208-887d-601c36546f43", "tag": "net-1"}, {"uuid": "260aef37-4441-4208-887d-601c36546f43"}, {"uuid": "86f3c3a6-48d9-4127-b0ab-58285f0a0e00", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "86f3c3a6-48d9-4127-b0ab-58285f0a0e00", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0b585a83-9cd2-48e3-8982-4736c59e3290", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "833751aa-af34-48cb-b00f-7d5b550b7c7e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "81904bc0-ef2c-465c-874e-181fa3c43fd5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--299815447"}], "key_name": "tempest-keypair-1414622618", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:51.616363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:51.625014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:51.649269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9dcfefc-e092-413e-8e09-283f460e1119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1503 microversion: 2.1 time: 0.412513 Sep 27 01:44:51.666339 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1662/3373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:51 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:51.698179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5d2ee4c-d529-4e66-a366-f58c2d30442c"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:51.701631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:51.709914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.710864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.711610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.712644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.713420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.714137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.748962 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Cannot 'attach_volume' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state rescued Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/os-volume_attachments HTTP/1.1 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 74 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:44:51.751566 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: {"volumeAttachment": {"volumeId": "f5d2ee4c-d529-4e66-a366-f58c2d30442c"}} Sep 27 01:44:51.753069 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'attach_volume' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state rescued Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'b0da0c08-6152-4018-8292-eecd8bddfbbf', 'body': {'volumeAttachment': {'volumeId': 'f5d2ee4c-d529-4e66-a366-f58c2d30442c'}}} Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:44:51.753945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state rescued Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:44:51.758163 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:44:51.759409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:44:51.759409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state rescued Sep 27 01:44:51.759409 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:44:51.762130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 409 to user: Cannot 'attach_volume' instance b0da0c08-6152-4018-8292-eecd8bddfbbf while it is in vm_state rescued {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:44:51.764059 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17ccdf8a-d7b5-4560-aede-92e51b252fd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071306 Sep 27 01:44:51.765545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1663/3374] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:44:51 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:44:51.785088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:51.786173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:51.794181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.795268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.796011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.797037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.797828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.798665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.835044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] validate_networks() for [('3eac0baf-d726-4151-ba16-b2cec23b58cf', None, None, None, None, None), (None, None, 'daa72d51-9283-4a45-9a26-05910ede5e8b', None, None, None), (None, None, '83e451ef-fe7f-4e7b-851d-9bd4130b3f12', None, None, None), ('260aef37-4441-4208-887d-601c36546f43', None, None, None, None, None), ('260aef37-4441-4208-887d-601c36546f43', None, None, None, None, None), ('86f3c3a6-48d9-4127-b0ab-58285f0a0e00', '10.2.2.100', None, None, None, None), ('86f3c3a6-48d9-4127-b0ab-58285f0a0e00', '10.2.2.200', None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:51.899294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:51.914692 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43f0c68c-27f0-45df-95b9-28920fb17043 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action" status: 202 len: 0 microversion: 2.1 time: 0.140997 Sep 27 01:44:51.916151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1664/3375] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:44:51 2022] POST /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:44:51.929429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:51.930149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:51.937201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.938430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.938661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:51.939739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:51.940353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:51.941071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:52.186237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:52.196429 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3acc0717-7034-41fc-89ea-d640ba039879 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1511 microversion: 2.1 time: 0.273213 Sep 27 01:44:52.198410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1665/3376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:51 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:52.204046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:52.204965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:52.212144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:52.213093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:52.215411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:52.216497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:52.217229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:52.218382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:52.587591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:52.601433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bbd0cce4-e68f-4998-921f-64b50285a679 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.401567 Sep 27 01:44:52.618269 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1666/3377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:52 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:52.643992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:52.649661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:52.672312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:52.672811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:52.673250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:52.673985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:52.674500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:52.674922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:53.064226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:53.081507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:53.086957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:53.104183 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0475ad53-a366-4164-8b42-b19144968731 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.484460 Sep 27 01:44:53.142568 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1667/3378] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:52 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:53.148227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:53.149271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:53.160697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:53.168771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:53.169800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:53.178580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:53.179951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:53.181052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:53.181755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:53.340159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:53.351529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de0fc7fd-d01e-4706-b547-6a6f40afbce0 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1275 microversion: 2.1 time: 0.207369 Sep 27 01:44:53.365658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1668/3379] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:53 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:53.366778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:53.368369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:53.400544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:53.401034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:53.404186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:53.405012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:53.405526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:53.406005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.171672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.199845 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74aa9ed8-c44b-45c3-bbea-ae4d847d13a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1511 microversion: 2.1 time: 0.828658 Sep 27 01:44:54.219999 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1669/3380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:53 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1511 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:54.236019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:54.236926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:54.244714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.245205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.245680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.246388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.255641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.256248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.564291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.582300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5f56f5e-8f64-41cc-93e2-81d57ea24119 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.360933 Sep 27 01:44:54.583010 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1670/3381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:54 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:54.588244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:54.588862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:54.603243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.603746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.614012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.614604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.615155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.618499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.743314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.751920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.753401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.759963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4313725d-c52d-4a2f-bae3-cdc3e77cdaa7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.175397 Sep 27 01:44:54.760887 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1671/3382] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:54 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:54.765689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:54.766558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:54.774183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.774972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.775609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.776520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:54.777138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:54.777754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:54.857075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:54.868185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1010cff7-842f-4d30-9a23-11ccf04af9af tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1281 microversion: 2.1 time: 0.105976 Sep 27 01:44:54.872898 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1672/3383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:54 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:55.228155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:55.230279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:55.239426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:55.242433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:55.243207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:55.244182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:55.245002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:55.245681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:55.432344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:55.442015 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b3215d3-1364-4114-b174-adcb33e0142f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1511 microversion: 2.1 time: 0.218250 Sep 27 01:44:55.442605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1673/3384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:55 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:55.518449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2018352820", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "947ed297-9995-477e-88e0-abbc7c329cc1"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:55.578928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] validate_networks() for [('947ed297-9995-477e-88e0-abbc7c329cc1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:44:55.985218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:44:55.986074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:44:55.986822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:44:55.987834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:44:55.988338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:44:56.010467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.011341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.011800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.012539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.012993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.013449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.032131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Getting quotas for project 6cc310fc5ad64d42a50e18cd4c4170e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:44:56.039990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Getting quotas for user c53c23b450dc465bba6bd56d67deecbb and project 6cc310fc5ad64d42a50e18cd4c4170e8. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:44:56.055891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:44:56.058279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:44:56.122567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e35184e7-c518-4b21-8ac0-b093b0b2c233 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677883 Sep 27 01:44:56.123854 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1674/3385] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:44:56.128831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:56.129933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:56.142753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.143685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.144793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.145253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.145872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.146552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.393205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.404330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-731e0439-4083-433c-8780-076c586ad3f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.279240 Sep 27 01:44:56.405517 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1675/3386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:56 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:56.412363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:56.413189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:56.422164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.422810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.423409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.424871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.425852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.426864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.544119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.568868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.573114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.584399 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f18ed9d8-f521-4491-9b13-91fcc77a2317 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.176014 Sep 27 01:44:56.586387 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1676/3387] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:56 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:56.594515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:56.595430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:56.633490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.635169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.636697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.638532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.639865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.640944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.740166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.751135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28ba4230-c539-49a1-8c1b-5c78996dfe98 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1281 microversion: 2.1 time: 0.163144 Sep 27 01:44:56.751840 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1677/3388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:56 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:56.756449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be823b1c-8336-4c51-9ba0-8f0971526164 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:56.757653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be823b1c-8336-4c51-9ba0-8f0971526164 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:56.819716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be823b1c-8336-4c51-9ba0-8f0971526164 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:56.827198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be823b1c-8336-4c51-9ba0-8f0971526164 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1216 microversion: 2.1 time: 0.074250 Sep 27 01:44:56.828091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1678/3389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:56 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:56.836059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:56.837201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:56.845139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.845889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.846430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:56.847225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:56.847785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:56.848310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.016110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:57.025016 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b3332eb-2c99-49e3-aac3-6fb398826455 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1511 microversion: 2.1 time: 0.195635 Sep 27 01:44:57.038332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1679/3390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:56 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:57.438331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:57.440731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:57.454915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.455761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.456418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.457537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.458276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.458929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.690407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:57.698544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3df5446d-58bb-46a8-8bff-2ff31352253e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.269471 Sep 27 01:44:57.699129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1680/3391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:57 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:57.713091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:57.713729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:57.733109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.733632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.734070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.734785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.735246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.735665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.860705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:57.872171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:57.874540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:57.901909 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c6a7f9c-2fb6-42de-b6b8-ab28be4fc8ed tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.192490 Sep 27 01:44:57.902287 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1681/3392] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:57 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:44:57.911316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48354f0c-9436-4e58-9c2b-ee3c7bc37022", "name": "network-vif-plugged", "status": "completed", "tag": "698fe172-c277-4247-8948-3f222cc81bb2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:44:57.922981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.923472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.923908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.936700 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] Creating event network-vif-plugged:698fe172-c277-4247-8948-3f222cc81bb2 for instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 on n-h1-859358-1 Sep 27 01:44:57.943273 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2aa90f04-e3c2-4342-9ce0-b5692df9fb21 req-d2f4f22f-1610-4aca-9924-bb9f4fb19176 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039357 Sep 27 01:44:57.947876 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1682/3393] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:44:57.953412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:57.954121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:57.961201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.961735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.962257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:57.962974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:57.964676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:57.965123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:58.220465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:58.228013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:58.230913 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0110f4a-0b8e-4d88-a27a-5cc21b562f08 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.281713 Sep 27 01:44:58.247656 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1683/3394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:57 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:58.252771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:58.253414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:58.260520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:58.261016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:58.261553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:58.262329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:58.262787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:58.263226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:58.497737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:58.507282 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0eb78fe-2200-4c3b-9aaa-415100f710b5 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1276 microversion: 2.1 time: 0.258250 Sep 27 01:44:58.510969 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1684/3395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:58 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:58.524308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:58.525304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:58.563186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:58.566679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:58.567405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:58.568962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:58.571544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:58.572829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:59.122428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:44:59.203172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:59.215567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7319af0-c302-4eec-a029-45523ba7858b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1517 microversion: 2.1 time: 0.703224 Sep 27 01:44:59.216061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1685/3396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:58 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1517 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:59.234552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:59.242948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:59.259189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:59.259453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:59.259943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:59.260592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:59.261049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:59.261509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:59.826801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:44:59.845071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cdbe0e2-5eea-4671-a8f2-812a82bdb78d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1317 microversion: 2.1 time: 0.627929 Sep 27 01:44:59.850136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1686/3397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:44:59 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:44:59.860518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:44:59.862947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:44:59.877947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:59.878848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:59.879373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:59.880959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:44:59.881862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:44:59.882605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:44:59.998962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:00.020408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:00.025004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:00.053978 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca4477fb-2c39-4d58-8706-936d63b9dd4d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1560 microversion: 2.91 time: 0.201809 Sep 27 01:45:00.071565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1687/3398] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:44:59 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:00.071565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:00.071565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:00.090844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.091634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.092330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.093210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.093807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.094323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.230431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:45:00.230936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:45:00.231481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:45:00.232340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:45:00.232964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:45:00.252028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.252531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.253617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.254373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.254839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.260027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.326709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Getting quotas for project fe2017bbe6d24c0ea3f62e8aa2792293. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:45:00.332299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:00.333901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Getting quotas for user 42a30d026a1d4f96b6526604d185ddf7 and project fe2017bbe6d24c0ea3f62e8aa2792293. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:45:00.375477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:00.384582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67aaa54e-df97-4d17-bc90-ec4fb61628ca tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.322778 Sep 27 01:45:00.399890 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1688/3399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:00 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:00.408284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:00.409471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:00.417457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.418707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.419534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.420704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:00.422037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:00.422919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:00.593412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:45:00.596473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0b585a83-9cd2-48e3-8982-4736c59e3290',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='833751aa-af34-48cb-b00f-7d5b550b7c7e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81904bc0-ef2c-465c-874e-181fa3c43fd5',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:45:01.322606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.340733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c33161fa-5861-4f8c-9eb2-556593fc183d tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.877997 Sep 27 01:45:01.352930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-112e804a-9d27-48f0-8716-b3dc4064a3f9 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.949159 Sep 27 01:45:01.355849 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1689/3400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:00 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:01.369351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:01.371485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:01.372248 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1712/3401] 10.222.0.52 () {62 vars in 1189 bytes} [Tue Sep 27 01:44:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 9911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:45:01.389707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.394433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:01.394580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.394992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:01.395106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:01.400406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.402790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.403925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:01.414542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.416186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.416636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:01.418935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.420596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.422183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:01.628458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.631608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:01.648694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.651171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.670436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20d96122-271d-4764-9888-4991030775cd tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.294666 Sep 27 01:45:01.671227 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1713/3402] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:01 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:01.688891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:01.689953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:01.845603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.852492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=27 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:01.862319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.868844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.884407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:01.890490 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49bd5a10-9d14-4869-be60-e4b932fd9bb6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1283 microversion: 2.32 time: 0.217450 Sep 27 01:45:01.891398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1714/3403] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:01 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:01.906110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ff0d815-84dd-4ef5-be6c-b21921844784 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1505 microversion: 2.1 time: 0.528989 Sep 27 01:45:01.906110 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1690/3404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:01 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:01.914030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:01.914030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:01.933658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.950205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.951130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:01.952056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:01.953113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:01.953650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:02.243746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "556e459e-0a72-4088-ada7-6a0e19774d95"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:02.254322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:02.292031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:02.294632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:02.295924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:02.297094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:02.298198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:02.300006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:02.602875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] HTTP exception thrown: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Request method failure captured: Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments/3c6dbbe4-52e4-4435-bbee-c8905056db3c HTTP/1.1 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 74 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlU_wi08wcPkB68yj-TnVpXIqqbiurKBzVifiAx_qenUQLp8qnRujn5ouxUN0pdMcWO1xZ60DVARXJJRgU4iROzG0hvFOMqrjc5qH-RJxOwiXg-YvQfqUTlf0w_743b5ZkDD1SyxleLe6iR3tu63RLbhLClbrZ6mz9trJIs6JKyuscM Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6b8832a9d37a4dab8f9a0d7775e7dcc5 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 01:45:02.650997 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b8832a9d37a4dab8f9a0d7775e7dcc5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6b8832a9d37a4dab8f9a0d7775e7dcc5 Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-1166822137-project-admin Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ed472df7e09f4dc09abd010a6691949b Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-1166822137-project-admin Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: {"volumeAttachment": {"volumeId": "556e459e-0a72-4088-ada7-6a0e19774d95"}} Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:02.653014 n-d-859358-1 devstack@n-api.service[128779]: exception: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': '74dcb45f-119a-413c-bc1e-e0699e25285f', 'id': '3c6dbbe4-52e4-4435-bbee-c8905056db3c', 'body': {'volumeAttachment': {'volumeId': '556e459e-0a72-4088-ada7-6a0e19774d95'}}} Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:45:02.654231 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. (HTTP 404) (Request-ID: req-cd76dffb-2e71-495c-bba6-e7ff0391eefe) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:45:02.655575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:02.658119 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. Sep 27 01:45:02.663282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:02.668253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Returning 400 to user: Volume 556e459e-0a72-4088-ada7-6a0e19774d95 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:02.668253 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5486d67f-9175-42ad-9d04-206b17c3e4f4 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments/3c6dbbe4-52e4-4435-bbee-c8905056db3c" status: 400 len: 107 microversion: 2.1 time: 0.772712 Sep 27 01:45:02.669198 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1691/3405] 10.222.0.52 () {60 vars in 1433 bytes} [Tue Sep 27 01:45:01 2022] PUT /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments/3c6dbbe4-52e4-4435-bbee-c8905056db3c => generated 107 bytes in 776 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:02.678649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:02.680982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:02.715398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:02.715903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:02.716352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:02.728286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:02.728902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:02.729391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:02.820214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:02.923790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:02.942344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f4c9688-3723-4946-944a-00c50b9cc359 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 1.046389 Sep 27 01:45:02.945542 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1715/3406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:01 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:02.968032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342edb38-6731-4d4f-a15d-c32dd7c3d79b", "tag": "8ab984b6-ecc0-499d-aead-95b76905185d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:03.013287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.018495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.021077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.057617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a23edcf5-5eb1-4039-b753-cf61ccbcf377 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 204 len: 0 microversion: 2.1 time: 0.385772 Sep 27 01:45:03.061270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1692/3407] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:02 2022] DELETE /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:03.067182 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] Creating event network-changed:8ab984b6-ecc0-499d-aead-95b76905185d for instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b on n-h2-859358-1 Sep 27 01:45:03.071038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00e6c42b-d361-47b6-873f-5aa5efe4d93f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: .version_select at 0x7f24da541ee0>, body: {"keypair": {"name": "tempest-keypair-695262552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC784VjloODZ1Ax9ZO6HwTcvncb1P+o6/HokDglYOY6gb/U601WVvRGKQNGY3l1UCFirgpcjuN1q1q8/eOthjLKq+Hyl/8GuIugjVbBLAxysmw/ARsU+wXTj0iOWteNI2Q=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:03.078745 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e084dbe6-c6ec-4a8a-b74a-78038215cc05 req-be4bcff1-14ce-49be-b7de-702195a5669c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127835 Sep 27 01:45:03.082053 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1716/3408] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:03.097606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:03.099363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:03.107619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-00e6c42b-d361-47b6-873f-5aa5efe4d93f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for project 99af1ee801894ee689caadc33ccfd96c. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:45:03.113793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.114293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.117259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.117489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-00e6c42b-d361-47b6-873f-5aa5efe4d93f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for user 82cdaa103d9f4862baa7a76a2def10fe and project 99af1ee801894ee689caadc33ccfd96c. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:45:03.118415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.120273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.123600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.170260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00e6c42b-d361-47b6-873f-5aa5efe4d93f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107680 Sep 27 01:45:03.177553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1693/3409] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:45:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:03.182516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d31506-b20d-498c-8c2a-25fd313d84e6", "tag": "9b781dbd-a9a5-458c-9de2-e33721361e9c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:03.209127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.209656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.210088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.232594 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] Creating event network-changed:9b781dbd-a9a5-458c-9de2-e33721361e9c for instance 21d31506-b20d-498c-8c2a-25fd313d84e6 on n-h1-859358-1 Sep 27 01:45:03.241218 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c005793e-c787-4cfc-81d5-5c9be4b1f18a req-13832ff4-15d2-4c49-ab54-66a780b4762c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062309 Sep 27 01:45:03.242474 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1694/3410] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:03.247617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:03.248312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:03.266835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.267637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.268251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.269144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.269798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.270386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.530213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:03.543332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:03.547580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:03.552996 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38e65ef6-b595-4f32-b69a-4726f41d0aef tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.309336 Sep 27 01:45:03.573808 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1695/3411] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:03 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:03.579733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:03.580451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:03.587410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.587878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.588307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.589005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.589673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.590079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.701739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lazy-loading 'services' on Instance uuid 74dcb45f-119a-413c-bc1e-e0699e25285f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:03.799114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:03.809978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b6103b5-03df-4c20-9e95-198a788e807e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.724097 Sep 27 01:45:03.810779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1717/3412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:03 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:03.832739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:03.834781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:03.841682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.842938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.843683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.844902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.845651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.846309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.864264 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4746f5ad-b9aa-47b8-8425-2e07925f0d3c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "DELETE /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments/3c6dbbe4-52e4-4435-bbee-c8905056db3c" status: 202 len: 0 microversion: 2.1 time: 0.288879 Sep 27 01:45:03.864900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1696/3413] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:45:03 2022] DELETE /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments/3c6dbbe4-52e4-4435-bbee-c8905056db3c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:45:03.875840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:03.876551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:03.879714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:03.884673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.885158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.902068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:03.903048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:03.903679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:03.904481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.303331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.326174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.328022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.329200 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-959bf8e2-f598-4cbf-b3e9-42c69add5085 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1525 microversion: 2.32 time: 0.506313 Sep 27 01:45:04.329806 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1718/3414] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:03 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1525 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:04.345776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:04.348216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:04.368548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.369048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.376987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.380922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.381553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.382003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.455281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87515f50-5b8d-4380-85ce-1a6eddfb302d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122731 Sep 27 01:45:04.457770 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1719/3415] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:04 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:04.472221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:04.475415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:04.493178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.496112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.497146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.498021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.498490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.498976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.581208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.602233 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f049ba6b-a8c4-4742-a7cd-d51ec36aeb31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1511 microversion: 2.1 time: 0.736028 Sep 27 01:45:04.602837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1697/3416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:03 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:04.621796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:04.622732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:04.634840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.639500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.644754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.646468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.647153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.647785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.746963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.756170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e97e214d-c36b-44ad-8688-62f8cf002b23 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.293238 Sep 27 01:45:04.757211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1720/3417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:04 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:04.765940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.780353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.783564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:04.790742 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82cc35c7-29f5-4038-93aa-ef25f5cc7752 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.186663 Sep 27 01:45:04.791332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1698/3418] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:04 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:04.834637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:04.835392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:04.841883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.842378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.843032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:04.856346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:04.857114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:04.857607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.103509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:05.117045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b46142c8-b3fd-4eab-817b-3182fcff3241 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.286151 Sep 27 01:45:05.118518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1721/3419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:04 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:05.376928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:05.379248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:05.390937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.393574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.395108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.396812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.399120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.400148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.470602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:05.475111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:05.492513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.493805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.495933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.496911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.500102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.500795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.575293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d45d3139-e9e6-4424-8d7a-366cda36d9e0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107302 Sep 27 01:45:05.578954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1722/3420] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:05 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:05.589385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c2d685-a6fd-41ab-9f4a-912f9d9913bd", "tag": "20ea02f5-8583-495e-9449-93512cb888b0"}, {"name": "network-changed", "server_uuid": "2a7779e9-fefc-41d9-b5e9-c4cb13ef3799", "tag": "17a09508-77ae-4077-9663-d42afc2e6107"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:05.636143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.639076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.640738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.685829 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Creating event network-changed:20ea02f5-8583-495e-9449-93512cb888b0 for instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd on n-h1-859358-1 Sep 27 01:45:05.686346 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] Creating event network-changed:17a09508-77ae-4077-9663-d42afc2e6107 for instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 on n-h2-859358-1 Sep 27 01:45:05.705754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-eadf28e2-a15a-4ad5-b4be-67a6a86daaed req-c4628457-44be-4285-8dbf-f15e021db083 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.125273 Sep 27 01:45:05.706665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1723/3421] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:05.714275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:05.715219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:05.724778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.725280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.725760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.726476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.726947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.727377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.772367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:05.798057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:05.800861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:05.802495 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-480d37e7-449a-4e03-b9f3-ab6a4b7d270f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1517 microversion: 2.32 time: 0.439449 Sep 27 01:45:05.805523 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1699/3422] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:05 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:05.826522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:05.827503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:05.842534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.843458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.844267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.846589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:05.847365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:05.848200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:05.905815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:06.009356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.021715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:06.032651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bcda5130-7b10-4c76-8afe-462240f56fe5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1511 microversion: 2.1 time: 0.324521 Sep 27 01:45:06.033580 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1724/3423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:05 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:06.055561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:06.056186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:06.077191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.077725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.078177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.078891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.079506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.079945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.165791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.174851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab9f9e9a-350f-4753-b8e1-c6271d454f73 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.367931 Sep 27 01:45:06.175527 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1700/3424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:05 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:06.180636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:06.181262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:06.196891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.197419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.197868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.198593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.199059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.199488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.240871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.252329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.253824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.284208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f288412c-bdbd-4934-98cf-06d64d7f32e4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.249542 Sep 27 01:45:06.284809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1725/3425] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:06 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:06.470000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-971587209", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568e538e-5e79-4b38-9778-13586420219d"}], "security_groups": [{"name": "tempest-securitygroup--1148249521"}], "key_name": "tempest-keypair-695262552", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:06.625513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:06.684994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] validate_networks() for [('568e538e-5e79-4b38-9778-13586420219d', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:45:06.692836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6fc69f3-a3ab-4798-ac6c-4e9e1ba2092e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.516110 Sep 27 01:45:06.697253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1701/3426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:06 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:06.708837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:06.714826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:06.729259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.734980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.735800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.736658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.737377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.737896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.797295 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3168eea-1ab6-43a0-9dca-4ea4185a6894 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095356 Sep 27 01:45:06.807694 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1702/3427] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:06 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:06.831061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48354f0c-9436-4e58-9c2b-ee3c7bc37022", "name": "network-vif-deleted", "tag": "698fe172-c277-4247-8948-3f222cc81bb2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:06.841629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.842096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.842521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.858373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] Creating event network-vif-deleted:698fe172-c277-4247-8948-3f222cc81bb2 for instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 on n-h1-859358-1 Sep 27 01:45:06.865529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e3e90f86-a48d-4569-a5eb-e81c720f7393 req-95139d13-45da-480d-9e38-591ad4921ea8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054886 Sep 27 01:45:06.867029 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1703/3428] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:06.876187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:06.879901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:06.883951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.884674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.885204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:06.886787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:06.887355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:06.888491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.024027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:07.038227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:07.042552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:07.043894 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c410158b-5619-4d2e-a8c7-467e3576f245 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1573 microversion: 2.32 time: 0.173032 Sep 27 01:45:07.045439 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1704/3429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:06 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:07.079924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:07.080560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:07.094398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.095031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.095477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.097638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.098112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.098543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.158129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.158585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.159022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.160025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'fault' on Instance uuid 48354f0c-9436-4e58-9c2b-ee3c7bc37022 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:07.245302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:07.257482 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8daa69da-1a57-450c-afbb-91bf1d87bf20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1307 microversion: 2.1 time: 0.205606 Sep 27 01:45:07.275490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1705/3430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:07 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:07.281973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:07.282755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:07.298461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.298937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.299407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.300068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.300520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.300941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.586336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:45:07.587026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:45:07.587692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:45:07.588259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:45:07.588829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:45:07.605634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.606423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.607090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.608042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.608669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.610004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.637623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:45:07.643552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Getting quotas for user 82cdaa103d9f4862baa7a76a2def10fe and project 99af1ee801894ee689caadc33ccfd96c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:45:07.657465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:45:07.660094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:45:07.695776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:07.705711 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cef0d7e2-6a82-49df-8f69-978e8c393b42 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.429055 Sep 27 01:45:07.711152 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1706/3431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:07 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:07.742184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:07.742962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:07.762015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.762505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.762942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.763646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.765692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.767367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.774771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f248dfee-5249-4e6e-a024-8b4fbbf78696 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.322188 Sep 27 01:45:07.782209 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1726/3432] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:45:07.787672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:07.794011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:07.807327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.826313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.827613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:07.843677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:07.845060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:07.847518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.066582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.093092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.099734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.112132 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1caed696-450a-40b4-8e1b-b6b5fbc69a07 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.399271 Sep 27 01:45:08.142144 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1707/3433] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:07 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:08.175470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d029469d-3902-4235-b3dc-0ca95e06b3ee tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:08.176580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d029469d-3902-4235-b3dc-0ca95e06b3ee tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:08.398877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.420738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a7b1d41-e594-40d7-af83-462f722434d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.633166 Sep 27 01:45:08.421449 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1727/3434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:07 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:08.441377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:08.450036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:08.450865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d029469d-3902-4235-b3dc-0ca95e06b3ee tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.466426 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d029469d-3902-4235-b3dc-0ca95e06b3ee tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1244 microversion: 2.1 time: 0.320640 Sep 27 01:45:08.469842 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1708/3435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:08 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1244 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:08.487409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:08.491322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:08.507273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.508662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.515195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.518789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.519454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.520139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.521486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.522005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.522449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.523175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.548261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.551084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.741231 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-42bbf2bb-ca2b-41b5-9e2d-07242a12efd0 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.316430 Sep 27 01:45:08.744229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1728/3436] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:08 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:08.760416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:08.761647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:08.779585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.781984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.784113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.786942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.789354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.790870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.820395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.841152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.846301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.853041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-597dbf5d-69be-4f8b-b515-d754b198dd76 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1591 microversion: 2.32 time: 0.381905 Sep 27 01:45:08.854136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1709/3437] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:08 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1591 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:08.863680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:08.864649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:08.879107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.882778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.883682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.884762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.885494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.886158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.889168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:08.889971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:08.890573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:08.891282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'fault' on Instance uuid 48354f0c-9436-4e58-9c2b-ee3c7bc37022 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:08.948112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:08.956698 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed608232-c12d-4a0e-8630-6706fc99860e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 200 len: 1307 microversion: 2.1 time: 0.206176 Sep 27 01:45:08.958790 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1729/3438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:08 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:09.151112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:09.151938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:09.162693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.168643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.182004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.186772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.189393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.190326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.290667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:09.305449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:09.307233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:09.313232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74adf1d7-ff8a-4ab3-b091-e94cca0d16e7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.166266 Sep 27 01:45:09.326079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1730/3439] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:09 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:09.335212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:09.344330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b9e434c-b246-487e-ba33-04d63a0c648f tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.488858 Sep 27 01:45:09.344911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1710/3440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:08 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:09.445526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:09.447201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:09.474843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.475508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.477936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.478689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.479156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.479596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.493103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:09.493943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:09.504153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.504955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.506866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.509430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:09.512605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:09.514860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:09.963212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:09.988078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.001808 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2dd08bc-2c3c-4904-9e89-62b942f9ef26 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1296 microversion: 2.1 time: 0.509037 Sep 27 01:45:10.003134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f4af361-a206-4bd4-8a29-fc09a7fc01a0 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.562846 Sep 27 01:45:10.007449 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1711/3441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:09 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1296 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:10.023024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.025074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1731/3442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:09 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:10.032878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.043299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.046910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.052062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.052871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.054966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.055970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.058779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.059619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.072575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.073210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.080752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.091243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.098896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.100282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.166537 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9457808d-653b-408f-a0a0-a46ea16c89ef tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157717 Sep 27 01:45:10.168845 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1712/3443] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:10.187113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.187739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.214877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.215377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.215819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.216532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.216983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.217433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.320000 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 HTTP/1.1 Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:10.325242 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:45:10.326765 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48354f0c-9436-4e58-9c2b-ee3c7bc37022'} Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:10.327565 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:45:10.328881 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:10.337191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:10.341232 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90536ba4-ffdc-4104-a60d-612d18a591e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 404 len: 111 microversion: 2.1 time: 0.171263 Sep 27 01:45:10.350063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1713/3444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:10.377504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c2d685-a6fd-41ab-9f4a-912f9d9913bd", "name": "network-vif-plugged", "status": "completed", "tag": "20ea02f5-8583-495e-9449-93512cb888b0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:10.398131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.402118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.403234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.436187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] Creating event network-vif-plugged:20ea02f5-8583-495e-9449-93512cb888b0 for instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd on n-h1-859358-1 Sep 27 01:45:10.450090 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b8a55da4-02b5-4a72-a4d4-5d07bb27a850 req-a31c8842-77a1-4659-bdb1-a8ed0122ba85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095153 Sep 27 01:45:10.451479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1714/3445] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:10.480277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.484247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.494954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.495545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.496101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.497230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.497818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.498402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.499129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.522327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.527357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.528597 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d2acd57-0970-45c7-a419-f516678a0abb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1591 microversion: 2.32 time: 0.498664 Sep 27 01:45:10.556088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1732/3446] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1591 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:10.572332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.572332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.592537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.593361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.593823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.594566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.599602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.600224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.611721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:10.875525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.886344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.894555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:10.908754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ddddb9f-4b37-4a3a-822f-588c53e9f29c tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.350118 Sep 27 01:45:10.914704 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1733/3447] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:10.931815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:10.932812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:10.944794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.948753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.949475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:10.950492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:10.952109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:10.955261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.129878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:11.140603 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f9878cc-ec4a-41c9-ac1e-94f594ddf675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.671253 Sep 27 01:45:11.146645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1715/3448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:11.165824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:11.166695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:11.173470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.177920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.178768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.179740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.180436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.181859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.632545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:11.646608 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fd2e278-2af9-40dd-bc52-c2f701e19e17 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.498566 Sep 27 01:45:11.647199 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1716/3449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:11 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:11.662475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:11.663096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:11.695660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.696151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.698580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.700572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.702686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.703389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.868818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:11.882552 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19f6f721-953e-47b5-b368-e892a4b7e0d9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1302 microversion: 2.1 time: 0.234279 Sep 27 01:45:11.883787 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1717/3450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:11 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1302 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:11.891668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:11.896418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:11.914059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:11.916251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.916980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.917690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.918636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.919299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.919951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.927004 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7225110d-d66b-47c5-8650-f82bd98d57a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 1.010626 Sep 27 01:45:11.928745 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1734/3451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:10 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:11.942844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:11.943917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:11.961064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.961948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.963146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:11.966757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:11.970948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:11.971853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.502080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:12.519464 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-396e103d-fcec-41a3-996b-de24cb084322 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.588453 Sep 27 01:45:12.521118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1735/3452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:12.532876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:12.539253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:12.557351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.557970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.559678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.560460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.560929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.561377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.623575 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-652c470c-1e44-4c2b-a7d1-316ce92f7f15 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099750 Sep 27 01:45:12.628194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1736/3453] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:12 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:12.631224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:12.632577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:12.640261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.642647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.643108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.643848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.644312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.644739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.858833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:12.869772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc64c9f3-2f50-44a6-a22e-8d4d0e291ac8 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.984624 Sep 27 01:45:12.872441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1718/3454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:11 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:12.878861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:12.880404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:12.889056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.889249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:12.890013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.890660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.891580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.892294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.892916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:12.915868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:12.918615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:12.925554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:12.927411 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2d6251d4-f860-4da7-9ab4-576f9f61ee8a tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1658 microversion: 2.32 time: 0.300651 Sep 27 01:45:12.938872 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1737/3455] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:12 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1658 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:12.947263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1bbaaeb-568e-4676-a0d7-6981591d8321 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1bbaaeb-568e-4676-a0d7-6981591d8321 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 163 Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:12.952628 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": 12345, "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:12.954417 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 12345 Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:12.955361 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:12.957012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:12.959037 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 27 01:45:12.959037 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:12.960380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1bbaaeb-568e-4676-a0d7-6981591d8321 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:12.961469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1bbaaeb-568e-4676-a0d7-6981591d8321 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.020967 Sep 27 01:45:12.962559 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1738/3456] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:12 2022] POST /compute/v2.1/servers => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:12.970162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d31506-b20d-498c-8c2a-25fd313d84e6", "name": "network-vif-plugged", "status": "completed", "tag": "9b781dbd-a9a5-458c-9de2-e33721361e9c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:12.983287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:12.984725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:12.985937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.002244 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] Creating event network-vif-plugged:9b781dbd-a9a5-458c-9de2-e33721361e9c for instance 21d31506-b20d-498c-8c2a-25fd313d84e6 on n-h1-859358-1 Sep 27 01:45:13.009208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6acd963c-e79f-49a0-a940-a9143002bcee req-d54bc472-24ef-453e-bd5a-328eb263808c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045119 Sep 27 01:45:13.010787 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1739/3457] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:13.018330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:13.019370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:13.030326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.031567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.032227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.033364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.034102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.034784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.116573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.129984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.134903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.141103 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bf80c24-0e35-4962-bde4-66230ca4cffa tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.266524 Sep 27 01:45:13.142291 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1719/3458] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:12 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:13.166378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:13.167555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:13.175704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.176550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.177256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.178322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.179613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.180269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.353097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.363418 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-092fdff5-9ea5-466d-93d8-6a83fd26d123 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.350756 Sep 27 01:45:13.369452 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1740/3459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:13 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:13.380972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:13.382094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:13.405418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.406434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.407985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.408987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.409669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.410616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.556634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.565844 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70f44f06-9de7-4b35-ab48-3efea41aca86 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1302 microversion: 2.1 time: 0.194875 Sep 27 01:45:13.585603 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1741/3460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:13 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1302 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:13.591816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:13.592532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:13.599903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.600487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.601008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.601827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.602346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.602843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.795877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:13.809192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2bae0f98-c115-479f-90dd-9f632f52291c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.221962 Sep 27 01:45:13.810572 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1742/3461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:13 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:13.816770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2119062417"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:13.820922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:13.827979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.829759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.830429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:13.831366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:13.832111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:13.832874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.105281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-590432ce-3baf-4575-b526-686ea43f2e94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.293032 Sep 27 01:45:14.107074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1743/3462] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:45:13 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 27 01:45:14.127773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.134121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.147172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.147949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.148602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.150474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.151274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.151934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.181314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.189484 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-892c9f72-f8e4-4e37-a9f3-d6bc74609786 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 1.045349 Sep 27 01:45:14.190071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1720/3463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:13 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:14.204904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.205865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.213231 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-145604bd-08be-4feb-a11c-70e8eb1ac04a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102999 Sep 27 01:45:14.216781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.217267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.219151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1744/3464] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:14.219861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.220653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.221318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.229118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.231724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.232531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.254434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:14.257227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.257758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.258290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.264627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.267279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.267769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.526527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.535381 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47e817ef-5b0e-450c-980c-e498f6c7b70d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1316 microversion: 2.1 time: 0.315006 Sep 27 01:45:14.537163 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1745/3465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:14.541912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.542522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.558425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.560109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.561457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.562561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.563035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.563469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.716760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.725527 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53ade79c-ff34-436a-ba6c-dc7bc1089b7b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.534368 Sep 27 01:45:14.729323 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1721/3466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:14.754181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.763774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.774731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.775509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.776663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.778471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.785326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.787045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.840466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.852819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.854351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.855884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4ac74521-93f6-4cdb-8e09-b140b54bb954 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1658 microversion: 2.32 time: 0.317648 Sep 27 01:45:14.874057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1746/3467] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1658 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:14.900344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:14.901063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:14.919413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.924064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.924915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.926421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:14.927361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:14.927975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:14.948585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.957678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.960307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:14.972862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed170a07-d754-4ef9-9480-4dae8f743472 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.230200 Sep 27 01:45:14.978595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1722/3468] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:15.134890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:15.144650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-393e166d-2a07-4595-9a73-b17fb6280a12 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.268427 Sep 27 01:45:15.147121 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1747/3469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:14 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:15.212530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:15.214199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:15.227383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:15.229893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:15.232758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.233554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.234707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.238702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.240008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.240702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.248775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.249503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.255605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.257807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.258519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.258740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.340492 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd509f6d-4b2e-428f-b025-08a39dc9f71c tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118163 Sep 27 01:45:15.341803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1748/3470] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:15 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:15.395180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342edb38-6731-4d4f-a15d-c32dd7c3d79b", "name": "network-vif-plugged", "status": "completed", "tag": "8ab984b6-ecc0-499d-aead-95b76905185d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:15.419781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.420396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.420719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.460885 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] Creating event network-vif-plugged:8ab984b6-ecc0-499d-aead-95b76905185d for instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b on n-h2-859358-1 Sep 27 01:45:15.473979 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8c66af3a-e30e-425a-bffe-6ee7c6b03288 req-31208b3f-a463-4478-8c48-bd040e2471fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092267 Sep 27 01:45:15.476221 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1749/3471] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:15.564665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:15.565924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:15.584544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.587361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.588049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.588961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:15.590302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:15.606999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:15.916808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:15.922232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:15.941870 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1c864e2-11e2-41dc-bd53-e18562a3959f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1504 microversion: 2.1 time: 0.380118 Sep 27 01:45:15.945813 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1750/3472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:15 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:15.971386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:15.972141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.008213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.014605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.015786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.019273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.023729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.024207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.398609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.414433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a01d576-51ab-450e-83d5-4e3d35c071d2 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 1.206052 Sep 27 01:45:16.415635 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1723/3473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:15 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:16.422569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:16.426112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.450063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.453967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.455019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.457543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.459957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.460978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.463082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.479446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.481945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.483318 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3b5fc55f-a53d-407c-851e-f5c050283c41 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1704 microversion: 2.32 time: 0.534600 Sep 27 01:45:16.509557 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1751/3474] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:15 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1704 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:16.522088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:16.522088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.534550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.535051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.535487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.542088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.542474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.543044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.549141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:16.737413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3c6624d-2224-4f49-a8e8-b3c196b1bfcf tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 204 len: 0 microversion: 2.1 time: 0.319180 Sep 27 01:45:16.741984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1724/3475] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:16 2022] DELETE /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:16.744511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.749322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:16.750987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.758604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.759371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.759976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.760890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.761667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.762257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.764983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.770860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:16.791123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ed956c0-2b9b-4563-902e-13e8adbccd72 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.280313 Sep 27 01:45:16.798933 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1752/3476] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:16 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:16.814515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:16.817235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.830053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.831706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.832415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.833537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.834205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.834841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.875006 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d7e2767-627c-4045-8a21-da73cc98d762 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071438 Sep 27 01:45:16.882266 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1753/3477] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:16 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:16.887540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:16.888509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:16.897156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.898123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.898780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:16.899734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:16.900403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:16.901107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.083689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.092713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99e80a44-5de7-459a-9c11-4302c7932245 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.349308 Sep 27 01:45:17.096488 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1725/3478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:16 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:17.138723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:17.156862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.157631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.158260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.184697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] Creating event network-changed:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:45:17.188604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.195590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a3cde97d-2989-47e7-99cd-ca4a3dbe6a1e req-34d31f46-bb6f-45d5-b8c7-2aafcadfa78d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060484 Sep 27 01:45:17.199453 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1726/3479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:45:17.203850 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3f78f11-6be9-49cb-bf82-96db4984373f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1510 microversion: 2.1 time: 0.318823 Sep 27 01:45:17.204958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1754/3480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:16 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:17.440122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:17.440986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:17.455239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.460159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.460736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.462946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.465057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.466665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.512657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7779e9-fefc-41d9-b5e9-c4cb13ef3799", "name": "network-vif-plugged", "status": "completed", "tag": "17a09508-77ae-4077-9663-d42afc2e6107"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:17.590232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.598057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.599571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.625092 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] Creating event network-vif-plugged:17a09508-77ae-4077-9663-d42afc2e6107 for instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 on n-h2-859358-1 Sep 27 01:45:17.635697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:17.642712 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1f41ccb1-69a1-4685-a748-6ea6d999d415 req-480116e9-b19d-447e-9320-edc2e46b14e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135131 Sep 27 01:45:17.647930 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1755/3481] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:17.656886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:17.670082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:17.682232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:17.684971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.687399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.688107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.689213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.690016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.690748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.811513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.821208 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb234b88-1b74-4074-acb2-eb1970c6ff09 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.385046 Sep 27 01:45:17.822374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1727/3482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:17 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:17.829466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:17.830437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:17.837278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.838098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.838735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.839823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:17.840479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:17.841167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:17.948530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.960046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.967115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:17.982676 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9ae049b-cb8f-477d-b621-26ce7c931aaf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.156741 Sep 27 01:45:17.983634 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1728/3483] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:17 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:17.993087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:17.994719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:18.001637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:18.005515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:18.007517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:18.008928 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-527811b4-4726-4eb6-b76c-7f1d2b42ddac tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1704 microversion: 2.32 time: 0.359700 Sep 27 01:45:18.010030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1756/3484] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:17 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1704 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:18.012780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.016147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.019226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.020185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.025693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.026307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.105701 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3395a493-b573-4a52-8408-2997dd561ff4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120248 Sep 27 01:45:18.112144 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1729/3485] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:17 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:18.125857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:18.127470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:18.144357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.148991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.150265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.155107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.161012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.162470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.237071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:18.238141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:18.268832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.274131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.274727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.275583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.276308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.276844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.457496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:18.481247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:18.493856 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eba06fcc-efde-4544-ab9c-37b67b6124d6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.368707 Sep 27 01:45:18.512186 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1757/3486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:18 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:18.587809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:18.597303 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61d71ddb-8275-40e6-bb5a-5a94bb68b73f tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1510 microversion: 2.1 time: 0.367516 Sep 27 01:45:18.599316 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1730/3487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:18 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:18.769939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1831e67-b11c-4d3e-b5ce-73c7cae163f5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1168975222", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aae2bb72-f2b0-47aa-84c8-11f83c291834", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:18.845534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:18.846502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:18.856938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a1831e67-b11c-4d3e-b5ce-73c7cae163f5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. Sep 27 01:45:18.857416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.862116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.862940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.864917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.865636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.866647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1831e67-b11c-4d3e-b5ce-73c7cae163f5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 358 Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:18.873719 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:18.875237 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1168975222", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "aae2bb72-f2b0-47aa-84c8-11f83c291834", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: exception: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1168975222', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'aae2bb72-f2b0-47aa-84c8-11f83c291834'}], 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 27 01:45:18.875888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 27 01:45:18.876866 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1831e67-b11c-4d3e-b5ce-73c7cae163f5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Block Device aae2bb72-f2b0-47aa-84c8-11f83c291834 is not bootable. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1831e67-b11c-4d3e-b5ce-73c7cae163f5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.109911 Sep 27 01:45:18.878191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1758/3488] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:18.885467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:18.886079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:18.896837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.897409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.897800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:18.898521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:18.898964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:18.899383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.092898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.105758 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c285da13-f299-4efd-927d-7b32757bbcba tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1323 microversion: 2.1 time: 0.263962 Sep 27 01:45:19.107690 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1731/3489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:18 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:19.113579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.115009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.122481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.122680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.123536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.124381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.125372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.126054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.126968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.131272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9cd89a59-8abf-405a-b039-36f228848c35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.249369 Sep 27 01:45:19.132306 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1759/3490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:19.137470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.138311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.145168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.146343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.146789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.147510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.147968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.148394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.220883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.232593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.234260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.242122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f04b7fb-ae4f-4ac7-be93-34929939b1ea tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.130726 Sep 27 01:45:19.242741 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1732/3491] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:19.257536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.257536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.283579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.284110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.284696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.285702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.287128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.288162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.338842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.349608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.356622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.358801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7af9584b-56fe-41c3-b415-c8afa9c6aefe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1704 microversion: 2.32 time: 0.225451 Sep 27 01:45:19.359621 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de3b0d7d-46d0-4ef1-9795-36d56a0583ec tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112579 Sep 27 01:45:19.361277 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1760/3492] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1704 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:19.361702 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1733/3493] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:19.366512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.367327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.374001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.374738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.375332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.376282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.376885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.377661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.522006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.522632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.532996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.533527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.533965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.534672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.540228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.540960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.552666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.562896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8d4e309-4eda-4956-b939-272789473d57 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.199975 Sep 27 01:45:19.564054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1734/3494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:19.623164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:19.623786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:19.633812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.634357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.635271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.635993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.637640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.638082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.642972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:19.820648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.832393 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efe20cf6-4e4c-456c-a863-c1ed4bc88212 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.315805 Sep 27 01:45:19.834107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1761/3495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:19.948504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-plugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:19.964748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:19.971738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:19.973354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:19.976272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:19.979150 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f25ccb3f-d23e-4094-b7ad-7728dc15f38e tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1510 microversion: 2.1 time: 0.360161 Sep 27 01:45:19.983659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1735/3496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:19 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:20.034628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] Creating event network-vif-plugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:45:20.066823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c371163d-d678-4e90-83fb-77ecd27e1e00 req-e3146832-995c-45e6-8cc6-0f81ddc263c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122565 Sep 27 01:45:20.068541 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1762/3497] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:45:20.132776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.133604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.145065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:20.166780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.170152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.170980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.171886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.173978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.174955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.272959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.273972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.285263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.285893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.286505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.287499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.288123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.288555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.389020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.400089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bb42b86-1899-4aa9-bb07-74136916af87 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1516 microversion: 2.1 time: 0.272082 Sep 27 01:45:20.401604 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1736/3498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:20.406490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.409086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.415914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.416607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.417198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.418126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.418756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.419337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.420960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.434542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.437229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.445500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-572c2e0a-b3f5-4eda-b0b3-887c6fce9844 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.177603 Sep 27 01:45:20.446783 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1763/3499] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:20.452320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.453108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.460189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.461095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.461785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.462911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.463538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.464121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.474107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d875946-c3f7-446f-9290-3ef86efca4fe tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071239 Sep 27 01:45:20.474754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1737/3500] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:20.479528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.480137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.486302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.486851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.487206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.487899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.488347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.488768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.777740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.794411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.806775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.812507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03ea9009-b82f-45d0-978a-eab4dc74fa62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1704 microversion: 2.32 time: 0.362613 Sep 27 01:45:20.814904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1764/3501] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1704 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:20.856369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:20.858663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:20.870941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.876344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.878096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.881646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:20.882593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:20.887658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:20.979792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:20.990122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6571e6f5-c614-4ed0-932b-59a56dc4567c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd" status: 200 len: 1517 microversion: 2.1 time: 0.512806 Sep 27 01:45:20.992863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1738/3502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:21.007856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.008481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.054405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.058271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.059589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.065802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.067588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.068332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.139701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.151099 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bcf22ed4-21c0-4d0f-a358-1f14b59896e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.299008 Sep 27 01:45:21.152434 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1765/3503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:20 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:21.177004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.179132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.188540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.189210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.190312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.191184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.191852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.192525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.419974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.436130 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea41c9a5-e3b8-4472-b97c-97a908cc5743 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 200 len: 1516 microversion: 2.1 time: 0.263939 Sep 27 01:45:21.448211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1766/3504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:21.472319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.473275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.485439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.495346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.495849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.496292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.496982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9954fa19-40aa-424c-898a-cd22f8a26ce7 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1510 microversion: 2.1 time: 0.492898 Sep 27 01:45:21.498203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1739/3505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:21.502910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.504057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.504421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.505091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.505666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.514812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.515541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.516221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.518739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.519515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.520705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.580500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:21.641143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.662626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.669947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:21.681951 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0f66222-e17c-4962-8bf0-e43dc35f6814 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.182523 Sep 27 01:45:21.683458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1740/3506] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:21.689088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.691754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.700643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.701615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.702341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.703654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.704774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.705573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.787602 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e38c75c-1e91-440f-b7d3-88d458ec6c64 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "DELETE /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 204 len: 0 microversion: 2.1 time: 0.319681 Sep 27 01:45:21.788515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1767/3507] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:21 2022] DELETE /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:45:21.797532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.800713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.801912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-daae903a-4363-44be-8cdd-1467e45fe70f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115117 Sep 27 01:45:21.802685 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1741/3508] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:21.815334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.816197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.816814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.818257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.818907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.819506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.847845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:21.848953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:21.865171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.866999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.867644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.871071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:21.871918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:21.872802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:21.882970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:22.070939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:22.082163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3d44152-6ae9-46b8-ae03-9331f249b331 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 200 len: 1522 microversion: 2.1 time: 0.288864 Sep 27 01:45:22.083389 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1768/3509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:22.118056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-849831222", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "71a5ac60-f8c3-4705-8478-fc095e3e91e5"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:22.193486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] validate_networks() for [('71a5ac60-f8c3-4705-8478-fc095e3e91e5', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:45:22.461155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:22.476578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:22.491396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:22.496270 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b906cac6-6be6-4e4d-83c6-5e0df87c1c9f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1704 microversion: 2.32 time: 0.653463 Sep 27 01:45:22.510008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1742/3510] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:21 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1704 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:22.528855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:22.529521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:22.563116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:22.563617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:22.564048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:22.564751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:22.565205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:22.565649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.125953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:23.152051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25663f50-20c1-4924-b81d-3a7224eeabb5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.625165 Sep 27 01:45:23.152994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1743/3511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:22 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:23.186037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:23.187262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:23.214064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.214799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.215410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.216297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.216906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.217515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.357269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:45:23.358334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:45:23.359829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:45:23.360485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:45:23.361092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:45:23.379071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.380331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.382776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.383778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.384420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.385890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.444482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:45:23.460805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Getting quotas for user 34c031568af44507940568f7d2e14085 and project a31e4a8e1db94013be04c1ebfc32c6c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:45:23.493428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:45:23.499937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:45:23.585174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8ce02c9-8b5e-4c22-9e49-46c890dc99a8 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471279 Sep 27 01:45:23.593377 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1769/3512] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:45:23.597789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e6d7075-bbfc-40be-af35-c80a8b3a816e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-916503538", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7f94860-9c0a-4587-87f9-f17df944ca27", "destination_type": "local"}, {"source_type": "volume", "uuid": "2728f678-c758-480e-acc4-154fed8284f4", "destination_type": "invalid"}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e6d7075-bbfc-40be-af35-c80a8b3a816e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 494 Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:23.621583 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:23.623729 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-916503538", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7f94860-9c0a-4587-87f9-f17df944ca27", "destination_type": "local"}, {"source_type": "volume", "uuid": "2728f678-c758-480e-acc4-154fed8284f4", "destination_type": "invalid"}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-916503538', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2728f678-c758-480e-acc4-154fed8284f4', 'destination_type': 'invalid'}], 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 27 01:45:23.624482 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'invalid' Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:23.628272 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:23.630003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e6d7075-bbfc-40be-af35-c80a8b3a816e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:23.631959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e6d7075-bbfc-40be-af35-c80a8b3a816e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.033796 Sep 27 01:45:23.640056 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1770/3513] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:23 2022] POST /compute/v2.1/servers => generated 155 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:23.668975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:23.670016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:23.681597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.682100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.706305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.707312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.713592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.714506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.879965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:23.913476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:23.915246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:23.938118 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ae23f03-cbb2-4496-966f-4bdd11c7c0bf tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1555 microversion: 2.91 time: 0.296940 Sep 27 01:45:23.939654 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1771/3514] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:23 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:23.946301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:23.946899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:23.954185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.960992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.961630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.962410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:23.962893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:23.963335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:23.965904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:23.978889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4f11beb-914b-4c95-88a6-eb1f1f349868 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1510 microversion: 2.1 time: 0.821529 Sep 27 01:45:23.980059 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1744/3515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:23 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1510 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:23.992119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:23.992739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:24.010765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.011266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.011704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.012412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.012861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.013282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.217763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:24.231175 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22bed866-64bb-4536-9d1d-8d76b81c760b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 200 len: 1522 microversion: 2.1 time: 0.290174 Sep 27 01:45:24.232282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1772/3516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:23 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:24.238093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2703006-f257-4603-845e-fb3ff2316e87 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:24.239783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2703006-f257-4603-845e-fb3ff2316e87 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:24.301059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2703006-f257-4603-845e-fb3ff2316e87 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:24.312750 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2703006-f257-4603-845e-fb3ff2316e87 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1217 microversion: 2.1 time: 0.079151 Sep 27 01:45:24.321914 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1773/3517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:24 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:24.321914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:24.321914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:24.329054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.331477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.333299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.334242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.336088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.337672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.802521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:24.819246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8bf1dfe-48c6-4169-b926-9a8ec08455b9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.503606 Sep 27 01:45:24.819844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1774/3518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:24 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:24.830971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d31506-b20d-498c-8c2a-25fd313d84e6", "name": "network-vif-deleted", "tag": "9b781dbd-a9a5-458c-9de2-e33721361e9c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:24.871596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.872267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.873921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.890977 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] Creating event network-vif-deleted:9b781dbd-a9a5-458c-9de2-e33721361e9c for instance 21d31506-b20d-498c-8c2a-25fd313d84e6 on n-h1-859358-1 Sep 27 01:45:24.896290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fe6b8604-01ad-4ffd-86a2-c95a4856196d req-1a168133-7a8d-4225-a208-c1aa897064c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075304 Sep 27 01:45:24.896908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1775/3519] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:24.902304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:24.903109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:24.910467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.911547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.912271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:24.913002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:24.913487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:24.913921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.127520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.139242 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-37f5deba-3049-4128-b1d3-c1a4a9a58405 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.238122 Sep 27 01:45:25.144454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1776/3520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:24 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:25.150409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.151025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.157536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.158036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.158472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.159317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.160144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.161279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.381110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.398883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.400543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.411561 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36cf7b8d-a0c9-46bf-8659-4e35be93befe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1750 microversion: 2.32 time: 1.428662 Sep 27 01:45:25.413711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1745/3521] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:23 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1750 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:25.418677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.422010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.433664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.436356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.438055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.442668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.443709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.444397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.495872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.505021 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1817511d-3234-4274-82dd-bcff1acf54f7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.358206 Sep 27 01:45:25.505812 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1777/3522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:25.513056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.513709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.522194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.522617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.523061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.523779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.524395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.524831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.569145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.569682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.570298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.571497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lazy-loading 'fault' on Instance uuid 21d31506-b20d-498c-8c2a-25fd313d84e6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:25.608272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.617396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.622276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53c23b450dc465bba6bd56d67deecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc310fc5ad64d42a50e18cd4c4170e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.624201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.631888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98c6b1b1-17d1-4f4d-98bc-755b95eb5150 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 200 len: 1306 microversion: 2.1 time: 0.125150 Sep 27 01:45:25.645734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1778/3523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:25.645734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.645734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.645734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.648127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.648597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.649318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.649887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.650367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.658150 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f87cd54f-e944-4c0d-9506-8177cf107615 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1537 microversion: 2.91 time: 0.243086 Sep 27 01:45:25.667546 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1746/3524] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:25.675476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.676146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.693055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.693616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.694341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.695285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.695980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.696676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.862809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:25.874939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a529c1e8-6771-49b1-a5a2-110003c353c9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 200 len: 1522 microversion: 2.1 time: 0.240421 Sep 27 01:45:25.876133 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1779/3525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:25.882325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-626a2966-13bc-4a15-a66f-39721bb31918 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-549498243", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-626a2966-13bc-4a15-a66f-39721bb31918 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 491 Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:25.888306 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:25.889828 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-549498243", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-549498243', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:25.890473 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:25.890962 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:25.892013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 27 01:45:25.893934 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:25.897208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-626a2966-13bc-4a15-a66f-39721bb31918 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:25.898431 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-626a2966-13bc-4a15-a66f-39721bb31918 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020898 Sep 27 01:45:25.899704 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1780/3526] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:25 2022] POST /compute/v2.1/servers => generated 624 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:25.910921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:25.912251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:25.922325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.923332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.924216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:25.925311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:25.927814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:25.928668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:26.090901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:26.099892 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ca2a981-2805-44ad-89b4-3bb24ee48a6a tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1269 microversion: 2.1 time: 0.430940 Sep 27 01:45:26.103362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1747/3527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1269 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:26.168271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:26.169398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:26.182147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:26.189799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:26.199896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:26.201102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:26.201838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:26.202540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:26.272947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:26.284133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f1fc2b9-6415-4b6b-8924-5eb66d5f7386 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.379658 Sep 27 01:45:26.284906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1781/3528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:25 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:26.311360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:26.311974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:26.315049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:26.331366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:26.331862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:26.332295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:26.333048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:26.333531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:26.333960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:26.996355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.016047 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-246bf4db-0be1-4e38-a08b-fb2cfaf1d7f8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.849435 Sep 27 01:45:27.028770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.030637 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1748/3529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:26 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:27.044481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.045910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.061751 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b193b720-a685-49ac-a00d-8a161b763220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.746524 Sep 27 01:45:27.064761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.066001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.067798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.070079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.071484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.074042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.077815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1782/3530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:26 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:27.101629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.103788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.121464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.122248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.124832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.126883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.129071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.129893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.166865 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 HTTP/1.1 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:27.169857 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.171541 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '21d31506-b20d-498c-8c2a-25fd313d84e6'} Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:27.172574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.174675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.180827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:27.182683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05280e21-7357-4683-bb94-4d29f341510d tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 404 len: 111 microversion: 2.1 time: 0.103678 Sep 27 01:45:27.185518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1783/3531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:27.198130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.203330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.219560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.220080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.221869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.224476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.225156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.225812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.443592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.455112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.467599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.478005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45f61f1e-7c1a-4880-8bbe-02d0f1592cdc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1796 microversion: 2.32 time: 0.436859 Sep 27 01:45:27.481122 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1749/3532] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1796 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:27.488463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.491141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.503412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.503937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.504406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.505191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.510939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.524009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.524987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.525476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.530320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.546883 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f022fef4-1833-4c0b-b4f7-d789a10782e8 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1540 microversion: 2.91 time: 0.358200 Sep 27 01:45:27.547683 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1784/3533] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1540 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:27.556012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342edb38-6731-4d4f-a15d-c32dd7c3d79b", "name": "network-vif-deleted", "tag": "8ab984b6-ecc0-499d-aead-95b76905185d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:27.580613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.581222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.581700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.604220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] Creating event network-vif-deleted:8ab984b6-ecc0-499d-aead-95b76905185d for instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b on n-h2-859358-1 Sep 27 01:45:27.618817 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c81a8d1b-5dc4-4c62-b288-7b46a4196824 req-b37e1128-7e2c-4ca3-884c-0646c54743a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069944 Sep 27 01:45:27.625724 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1785/3534] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:27.631885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.632585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.648559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.649499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.650211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.650741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.651180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 342edb38-6731-4d4f-a15d-c32dd7c3d79b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:27.651311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.651649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.654781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.654781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.654781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.717404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.732547 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98399c2d-4bca-40c2-884c-8650f808d4b9 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 200 len: 1313 microversion: 2.1 time: 0.250197 Sep 27 01:45:27.737647 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1750/3535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:27.744550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1670746853", "metadata": {"image_type": "test"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:27.752147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.768161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.769162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.769855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.771334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.772005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.772645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.796195 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6/action HTTP/1.1 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 112 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:27.798364 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1670746853", "metadata": {"image_type": "test"}}} Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:27.799772 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '21d31506-b20d-498c-8c2a-25fd313d84e6', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1670746853', 'metadata': {'image_type': 'test'}}}} Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.800659 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.801926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.803145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:27.803145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:27.803145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:27.803145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.804375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:27.807580 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-819acf30-b3e7-483f-9e52-daa471e72b90 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "POST /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6/action" status: 404 len: 111 microversion: 2.1 time: 0.067973 Sep 27 01:45:27.808348 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1751/3536] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Sep 27 01:45:27 2022] POST /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:27.818849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e81f58d-989c-4c6f-a463-a66fae5664d8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e81f58d-989c-4c6f-a463-a66fae5664d8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 416 Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:27.827025 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:27.828643 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:27.829725 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:27.830473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.832026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:45:27.833681 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.837759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e81f58d-989c-4c6f-a463-a66fae5664d8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:27.840042 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e81f58d-989c-4c6f-a463-a66fae5664d8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028294 Sep 27 01:45:27.840920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:27.841222 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1752/3537] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:27 2022] POST /compute/v2.1/servers => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:27.853239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:27.853868 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d83eb1e-7ae9-475e-94af-b041d6e22f14 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1275 microversion: 2.1 time: 0.226839 Sep 27 01:45:27.854450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1786/3538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:27.859549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.875288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.875557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1399093598", "metadata": {"image_type": "test"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:27.878930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Failed to fetch instance by id tempest-invalid-1137175069 {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:45:27.879251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.880535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.880688 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance tempest-invalid-1137175069 could not be found. Sep 27 01:45:27.881624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.882257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/tempest-invalid-1137175069/action HTTP/1.1 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 112 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:27.882392 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1399093598", "metadata": {"image_type": "test"}}} Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:27.883994 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance tempest-invalid-1137175069 could not be found. Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'tempest-invalid-1137175069', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1399093598', 'metadata': {'image_type': 'test'}}}} Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1137175069 could not be found. Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:27.885263 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1137175069 could not be found. Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1137175069 could not be found. Sep 27 01:45:27.886788 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:27.888312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance tempest-invalid-1137175069 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:27.888312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16f9ef2f-52f7-4aca-a4b9-be6ba104aa22 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-1137175069/action" status: 404 len: 101 microversion: 2.1 time: 0.012752 Sep 27 01:45:27.888312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1787/3539] 10.222.0.52 () {60 vars in 1249 bytes} [Tue Sep 27 01:45:27 2022] POST /compute/v2.1/servers/tempest-invalid-1137175069/action => generated 101 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:27.889117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.896801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:27.897929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:27.905363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:27.917653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.918408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.919255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:27.922266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:27.924265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:27.924896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.012823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-859358-1". {{(pid=128779) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 01:45:28.159771 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e3372b8-f3bd-4f85-9ebd-d6f6dbb5a44e tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action" status: 202 len: 0 microversion: 2.91 time: 0.316828 Sep 27 01:45:28.173768 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1753/3540] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:45:27 2022] POST /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:28.179420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-415100510"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:28.182521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:45:28.183056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 56 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:28.184665 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: {"createImage": {"name": "tempest-test-snap-415100510"}} Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:28.186607 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-415100510'}}} Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:28.187541 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.188804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.189989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:28.189989 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fe1c875-a551-4e87-bbc9-83808b04c656 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011248 Sep 27 01:45:28.189989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1754/3541] 10.222.0.52 () {60 vars in 1275 bytes} [Tue Sep 27 01:45:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:28.197378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:28.215276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:28.224980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.225598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.231215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.232237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.237244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.238053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.278437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:28.294981 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a1c1a6c-77c0-41cc-9ded-7cf5149583ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.404217 Sep 27 01:45:28.313278 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1788/3542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:27 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:28.330893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:28.333010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:28.345679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.353734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.354470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.356054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.357111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.357748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.531554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:28.546502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:28.553744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:28.570767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6d42ab1-5ca6-4d17-ace5-dc2512f5bd95 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1548 microversion: 2.91 time: 0.255360 Sep 27 01:45:28.594302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1789/3543] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:28 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1548 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:28.606371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-761003932"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:28.610189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:45:28.612980 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 56 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:28.618668 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: {"createImage": {"name": "tempest-test-snap-761003932"}} Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:28.620420 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-761003932'}}} Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:28.621403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 27 01:45:28.622828 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:28.624220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:28.624220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f78cbe8f-ffc6-4be3-b4ff-625b83f628d3 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027621 Sep 27 01:45:28.630881 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1790/3544] 10.222.0.52 () {60 vars in 1281 bytes} [Tue Sep 27 01:45:28 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:28.639852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:28.640728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:28.656072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.659077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.659613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.662705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.663234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.663674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.803284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:28.818643 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d8400a1-49d2-4fe2-bad7-ee01614b237f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.629044 Sep 27 01:45:28.835088 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1755/3545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:28 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:28.847802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:28.849569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:28.869109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.871582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.873739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:28.875437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:28.877841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:28.880118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.214744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:29.230764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:29.232707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:29.240470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb4aaa90-04ed-40fc-8815-75701873f574 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1842 microversion: 2.32 time: 0.403755 Sep 27 01:45:29.241761 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1756/3546] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:28 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1842 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:29.246606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.249733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:29.264138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.266050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.269856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.271561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.272248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.273070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.305417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 HTTP/1.1 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:29.311466 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.312979 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '21d31506-b20d-498c-8c2a-25fd313d84e6'} Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:29.313967 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.315644 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.318398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:29.319428 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a255329-a56d-4414-a462-0a7328be5eaa tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 404 len: 111 microversion: 2.1 time: 0.076516 Sep 27 01:45:29.328572 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1757/3547] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:29 2022] DELETE /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:29.337048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.337911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:29.350044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.350809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.351410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.359360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.360058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.360652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.383611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] HTTP exception thrown: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b HTTP/1.1 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:29.385494 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:29.387203 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '342edb38-6731-4d4f-a15d-c32dd7c3d79b'} Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:29.388113 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:29.389533 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.394211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 404 to user: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:29.394211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed9ac127-f244-42e9-8649-d5069aa707fb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 404 len: 111 microversion: 2.1 time: 0.054371 Sep 27 01:45:29.394211 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1758/3548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:29 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:29.403794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.404413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:29.419131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.419770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.420208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.420908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.422848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.423494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.550775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:29.560720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b156cea6-d949-416b-9888-57ea2dc26ab2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.932474 Sep 27 01:45:29.563373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1791/3549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:28 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:29.570331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.570948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] [instance: 21d31506-b20d-498c-8c2a-25fd313d84e6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:29.585892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.586391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.586815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.605206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.608877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.609359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.617479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:29.649039 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] HTTP exception thrown: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Request method failure captured: Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 HTTP/1.1 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWXVfwCsvYb57Cyeo-nakXlGZvOQg-g1tVOQ4H8Bcbm9EizItrkX3-pjXiAV5hifxtaymabyDGnDR4PMkD-oLuWstDFcuDLrkbhc8Ke_WRIfwFqX45zq4avt65ggo6vQaC60zFQjipf8k5YTTni0aZa4_hbgwgH7Z98f9kF8o2mS6w Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:29.650621 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6cc310fc5ad64d42a50e18cd4c4170e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6cc310fc5ad64d42a50e18cd4c4170e8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6cc310fc5ad64d42a50e18cd4c4170e8 Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1351878522 Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c53c23b450dc465bba6bd56d67deecbb Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesNegativeTestJSON-1351878522-project Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.652228 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '21d31506-b20d-498c-8c2a-25fd313d84e6'} Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:29.653111 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. Sep 27 01:45:29.654581 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:29.655866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] Returning 404 to user: Instance 21d31506-b20d-498c-8c2a-25fd313d84e6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:29.655866 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fd4d92b-7032-40b4-b10f-00de346fe0d2 tempest-ImagesNegativeTestJSON-1351878522 tempest-ImagesNegativeTestJSON-1351878522-project] 10.222.0.52 "GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6" status: 404 len: 111 microversion: 2.1 time: 0.087684 Sep 27 01:45:29.669502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1792/3550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:29 2022] GET /compute/v2.1/servers/21d31506-b20d-498c-8c2a-25fd313d84e6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:29.683203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.697777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:29.698705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:29.707451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.708282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.708973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.710136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.710598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.711044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.901743 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d553a0dc-0aff-4467-899e-b62d4f31f54c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.218328 Sep 27 01:45:29.914900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1793/3551] 10.222.0.52 () {58 vars in 1230 bytes} [Tue Sep 27 01:45:29 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:29.921705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:29.934344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:29.949442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.950140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.962021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:29.963051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:29.963673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:29.964279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.105557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:30.133849 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4218dd0-0e17-475c-8bf6-0fb731573932 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 0.742254 Sep 27 01:45:30.136498 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1759/3552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:29 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:30.144345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d27d002-2aa0-47eb-a09b-5e551b8d8adb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1110451244", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": -1, "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:30.178372 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3d27d002-2aa0-47eb-a09b-5e551b8d8adb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Flavor -1 could not be found. Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d27d002-2aa0-47eb-a09b-5e551b8d8adb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 206 Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:30.180324 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:30.182729 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1110451244", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": -1, "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: exception: Flavor -1 could not be found. Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1110451244', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': -1, 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 27 01:45:30.183552 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:30.184926 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d27d002-2aa0-47eb-a09b-5e551b8d8adb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d27d002-2aa0-47eb-a09b-5e551b8d8adb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.044395 Sep 27 01:45:30.186408 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1760/3553] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:30 2022] POST /compute/v2.1/servers => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:45:30.200781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:30.201504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:30.212082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.212581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.213025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.213822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.214279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.214708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.307515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:30.318872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:30.321069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:30.349448 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7758c4c0-4773-4170-a53a-32741d5e720d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1488 microversion: 2.91 time: 0.424563 Sep 27 01:45:30.366095 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1794/3554] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:29 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1488 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:30.376830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f52d377-ad6c-4178-9bfc-523442eb0cec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f52d377-ad6c-4178-9bfc-523442eb0cec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:30.381110 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 27 01:45:30.382485 n-d-859358-1 devstack@n-api.service[128778]: action_args: {} Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:30.383254 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:30.384716 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:30.385988 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:30.385988 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:30.385988 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 27 01:45:30.385988 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:30.390079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f52d377-ad6c-4178-9bfc-523442eb0cec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:30.391227 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f52d377-ad6c-4178-9bfc-523442eb0cec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023721 Sep 27 01:45:30.396882 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1795/3555] 10.222.0.52 () {58 vars in 1182 bytes} [Tue Sep 27 01:45:30 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:30.402344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:30.403299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:30.421935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.422624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.423161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.424121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.424798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.425501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.611945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:30.623166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8776bb63-5a95-4bb9-9248-dfc006ecea4d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.428915 Sep 27 01:45:30.624931 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1761/3556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:30 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:30.638140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:30.639025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:30.651318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.652651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.653280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:30.663385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:30.665842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:30.666398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.114974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.125151 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-458a53a7-783c-422b-a7ec-a0f78671cff3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.726788 Sep 27 01:45:31.130270 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1796/3557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:30 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:31.143325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.155517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.160115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:31.170331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.173818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.174487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.175470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.181526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.182050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.257224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:45:31.280366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.297843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.309710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.316719 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a0d913d-3933-4b3c-abb0-a49aacdd4700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1842 microversion: 2.32 time: 0.689458 Sep 27 01:45:31.318395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-daf9862f-94b3-4807-be1a-f9a1fedd9453 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.186312 Sep 27 01:45:31.321099 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1762/3558] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:30 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1842 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:31.327116 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1797/3559] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:31.332791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.333709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:31.343329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.344088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.344722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.345638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.346251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.346972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.361140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "b3bb06e2-fbe1-490a-b20e-57de6d615186"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:31.386086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.386572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.387009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.421974 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] Creating event network-changed:b3bb06e2-fbe1-490a-b20e-57de6d615186 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:31.429278 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fbab256c-5c80-48d0-91ed-7f41abf4e2f9 req-380f55fe-8aa0-4665-98b7-861e6e20904a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103644 Sep 27 01:45:31.430166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1763/3560] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:31.438563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.439692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:31.446838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.447613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.448206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.449072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.449770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.450350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.734555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.745967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4253b01e-5ec1-4312-812b-60ef7b8fe067 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.417024 Sep 27 01:45:31.746710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1798/3561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:31.760091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.768412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.768696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.servers [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Removing options 'limit' from query {{(pid=128778) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 27 01:45:31.774417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:31.785405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.786521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.787228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.787968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.788424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.794519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.863687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:45:31.931438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:31.946174 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2aa221a2-3a81-4958-b9de-c562202807d1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 0.514501 Sep 27 01:45:31.947080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1764/3562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:31.958391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.964456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-485663e5-e63e-4cc6-9f65-4c0d0668d291 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.216876 Sep 27 01:45:31.965386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1799/3563] 10.222.0.52 () {58 vars in 1144 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:31.966372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:31.971589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:31.972217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:31.989042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.989606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:31.990057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:31.997707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:31.998272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.000237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.001136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.002718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.006568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.010140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.012475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.015202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.317829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:32.328974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:32.342828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:32.362455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08b163ec-5173-4416-81ae-35c33b8f04d6 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.414070 Sep 27 01:45:32.369014 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1765/3564] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:32.374164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37d748f7-35cb-4446-82c0-cef8c1311f6b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-332870285", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37d748f7-35cb-4446-82c0-cef8c1311f6b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 172 Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:32.403660 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-332870285", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:32.405322 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-332870285', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi -1 Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:32.406271 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:32.407872 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:32.412738 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:32.412738 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 27 01:45:32.412738 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.412738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37d748f7-35cb-4446-82c0-cef8c1311f6b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:32.412738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37d748f7-35cb-4446-82c0-cef8c1311f6b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.034781 Sep 27 01:45:32.425658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1766/3565] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:32 2022] POST /compute/v2.1/servers => generated 145 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:32.439534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a12d8429-501f-4a45-9189-5815b35092d4 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a12d8429-501f-4a45-9189-5815b35092d4 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:32.463145 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 27 01:45:32.464593 n-d-859358-1 devstack@n-api.service[128779]: action_args: {} Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi '-1' Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:32.465498 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.466987 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 27 01:45:32.468356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:32.473033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a12d8429-501f-4a45-9189-5815b35092d4 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:32.474170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a12d8429-501f-4a45-9189-5815b35092d4 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.043837 Sep 27 01:45:32.476963 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1767/3566] 10.222.0.52 () {58 vars in 1142 bytes} [Tue Sep 27 01:45:32 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:32.485572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdd897c-48bf-4bc3-b44c-0c3c86e38cd3", "tag": "789fe85e-ee0e-4921-82bd-4401fd6dfc3a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:32.554819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.555304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.555747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.616291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] Creating event network-changed:789fe85e-ee0e-4921-82bd-4401fd6dfc3a for instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 on n-h2-859358-1 Sep 27 01:45:32.621825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:32.640090 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9692d92f-8041-4aa2-825d-13352362d060 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.673578 Sep 27 01:45:32.644087 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4da6ea53-f734-4f6c-a8b9-e9dda471f72a req-632c87e9-ba9d-42cc-a72b-046b16b60747 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162375 Sep 27 01:45:32.653831 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1768/3567] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:32.662007 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1800/3568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:31 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:32.670663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:32.671373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:32.677237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:32.682098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:32.690075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.691683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.692828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.693764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.694389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.695026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.715358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.715941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.716443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:32.717206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:32.725848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:32.726413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:33.219413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:33.238263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:33.245517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:33.250516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73557215-307c-43d6-b710-69e928083fea tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1863 microversion: 2.32 time: 0.594309 Sep 27 01:45:33.267124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1769/3569] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:32 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1863 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:33.288535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73faf65e-3a0b-45ad-8bbf-d63177218f0c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73faf65e-3a0b-45ad-8bbf-d63177218f0c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:33.303781 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 27 01:45:33.305253 n-d-859358-1 devstack@n-api.service[128779]: action_args: {} Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'testing' Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:33.306152 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.307668 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 27 01:45:33.308895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:33.312538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73faf65e-3a0b-45ad-8bbf-d63177218f0c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:33.313955 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73faf65e-3a0b-45ad-8bbf-d63177218f0c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.036227 Sep 27 01:45:33.317718 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1770/3570] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:45:33 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:33.328324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:33.330531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:33.360848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:33.366507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:33.368258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:33.371765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:33.374047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:33.387716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:33.857049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:33.889169 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b9737557-4630-49ae-ae23-66b585314402 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 1.215140 Sep 27 01:45:33.902903 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1801/3571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:32 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:33.912382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4bb2578-b785-430e-ab4b-f6ea8d28261c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:33.937682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4bb2578-b785-430e-ab4b-f6ea8d28261c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:33.944132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4bb2578-b785-430e-ab4b-f6ea8d28261c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:33.964184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.servers [None req-f4bb2578-b785-430e-ab4b-f6ea8d28261c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Flavor 'non_existing_flavor' could not be found {{(pid=128778) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 27 01:45:33.966442 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4bb2578-b785-430e-ab4b-f6ea8d28261c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.071426 Sep 27 01:45:33.970445 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1802/3572] 10.222.0.52 () {58 vars in 1178 bytes} [Tue Sep 27 01:45:33 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:33.986417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:33.990951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:34.031999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:34.036706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:34.058120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:34.078000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:34.078800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:34.079806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:34.312487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:34.651054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:34.671191 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5461790b-f63c-4eb6-96c5-c4e56840ef12 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 1.350559 Sep 27 01:45:34.675014 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1771/3573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:33 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:34.691577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "daa72d51-9283-4a45-9a26-05910ede5e8b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:34.716787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:34.717830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:34.718712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:34.745390 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] Creating event network-changed:daa72d51-9283-4a45-9a26-05910ede5e8b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:34.760170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-060dd164-f367-4907-a422-93098badfcf4 req-59064d5f-c59d-46a2-997e-737e5def59fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082293 Sep 27 01:45:34.763457 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1772/3574] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:34.772625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:34.780858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:34.796612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:34.800464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:34.801851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:34.804471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:34.806642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:34.807256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.032078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.047114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.059139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.076528 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c786bd9-bbd2-4bee-a005-b87bb8da61c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 1.102235 Sep 27 01:45:35.079905 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1803/3575] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:33 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:35.088789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:35.101218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:35.125832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.126655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.130003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.135439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.140610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.141465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.755313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.765831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-062f84d1-4c8a-4a24-a916-63fd873c7737 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 1.000502 Sep 27 01:45:35.767757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1773/3576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:34 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:35.775743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:35.789928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.791782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:35.804533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.805291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.805966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.809233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.809904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.811089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.887939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:35.896492 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4de561f4-cee7-4736-bfc6-28aa42337ed9 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.811562 Sep 27 01:45:35.906200 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1804/3577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:35 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:35.911667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:35.922173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:35.935327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.945932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.950001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:35.950933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:35.953134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:35.955013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.044409 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43b4db26-8aee-4828-ad87-c72a7d49c31b tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.275329 Sep 27 01:45:36.068514 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1774/3578] 10.222.0.52 () {58 vars in 1174 bytes} [Tue Sep 27 01:45:35 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:36.073310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:36.114204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.115388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.115895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.147132 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] Creating event network-vif-plugged:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:45:36.161182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aa38dfa2-13c9-4a3d-81f4-8eb0286679a8 req-a2ff2c21-394a-4d8a-ae50-f5cc55eb68d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090175 Sep 27 01:45:36.168116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1775/3579] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:36.181914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:36.184105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:36.198899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.201927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.202917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.205091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.207339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.208254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.606553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:36.622081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:36.624461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:36.628938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34c697b8-b633-4b79-90fc-a24630c2e600 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1884 microversion: 2.32 time: 0.721629 Sep 27 01:45:36.653831 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1805/3580] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:35 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1884 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:36.663544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d32c66e1-9825-446a-9305-ec1d80094825 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-118028018", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:36.681357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d32c66e1-9825-446a-9305-ec1d80094825 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d32c66e1-9825-446a-9305-ec1d80094825 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 215 Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:36.688216 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:36.689711 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-118028018", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-118028018', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:36.690417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 27 01:45:36.691565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:36.692920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d32c66e1-9825-446a-9305-ec1d80094825 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:36.694566 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d32c66e1-9825-446a-9305-ec1d80094825 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.039684 Sep 27 01:45:36.698274 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1806/3581] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:36.705850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:36.712210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:36.718720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:36.730561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.736014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.737308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.739139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.739781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.740298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.880091 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7b69a23-07df-4fa8-b747-20977fd0178d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.183196 Sep 27 01:45:36.881071 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1807/3582] 10.222.0.52 () {58 vars in 1184 bytes} [Tue Sep 27 01:45:36 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:36.885897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:36.886611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:36.893088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.893714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.894318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:36.895202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:36.895737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:36.896246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.021173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.030064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.031519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.059369 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7a7618f-ac48-4932-aa68-2fdfbea99e99 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.177031 Sep 27 01:45:37.059970 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1808/3583] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:36 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:37.071006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:37.071899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:37.096422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.101756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.103786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.104708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.114124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.114822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.542780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.552458 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a9daf53-f4c2-4def-84e6-057e48fe0b9b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.488861 Sep 27 01:45:37.557585 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1809/3584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:37 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:37.563724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:37.567123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:37.584087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.594463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f636e21-85ea-4fdc-aa8c-adbb040e22c4 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 1.423962 Sep 27 01:45:37.596821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.598428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.600145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.600805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1776/3585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:36 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:37.603459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.605126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.608386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.617843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:37.627393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.636250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:37.655077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.663035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.664024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.665015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.665655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.668324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.747923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:45:37.790534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:37.811617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.820140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:37.820634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:37.821125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:37.969902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:37.978864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c45bca8-62ed-4f67-a953-3313aec49148 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1370 microversion: 2.1 time: 0.419936 Sep 27 01:45:37.983566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1810/3586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:37 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:37.989776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "83e451ef-fe7f-4e7b-851d-9bd4130b3f12"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:38.020127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.020582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.021017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.044906 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] Creating event network-changed:83e451ef-fe7f-4e7b-851d-9bd4130b3f12 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:38.062456 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-000b37f4-3700-4a5d-bee8-3071c3bf74ec tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.458980 Sep 27 01:45:38.077841 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1777/3587] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:45:37 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:38.078262 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3baf1cea-fc6b-4d2d-889a-f4164d449974 req-693bad87-625a-4dc8-8e28-834c8bb68054 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079088 Sep 27 01:45:38.078262 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1811/3588] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:38.078417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:38.078417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:38.081706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.082248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.082695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.083402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.083857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.085089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:38.092751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:38.092846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.125536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.125906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.133589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.135182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.139206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.142063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.467057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.480623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9cefe39-d2e4-4ccc-a4e7-c62803997bd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.416536 Sep 27 01:45:38.510324 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1778/3589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:38 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:38.516661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:38.517269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:38.538500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.539007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.539446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.542155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.542632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.543075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.688236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.694612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.707961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.711092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.712644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.713957 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d8c2c33-72ed-49e5-81a0-ff830e6943a6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1884 microversion: 2.32 time: 0.647373 Sep 27 01:45:38.717713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.744836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2054f33-3eb4-40f0-9c8d-11aad6930e83 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.230757 Sep 27 01:45:38.747985 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1812/3590] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:38 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1884 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:38.763135 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1779/3591] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:38 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:38.768857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0d106b7-2e0c-41c7-8f95-ea590d4cf085 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:38.777374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0d106b7-2e0c-41c7-8f95-ea590d4cf085 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:38.793295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0d106b7-2e0c-41c7-8f95-ea590d4cf085 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.043859 Sep 27 01:45:38.794925 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1813/3592] 10.222.0.52 () {58 vars in 1178 bytes} [Tue Sep 27 01:45:38 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:45:38.802880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:38.810182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:38.811585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1767546480", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-key-207022295", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:38.821813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.822327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.822773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:38.823555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:38.824056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:38.824530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:39.210413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:39.213047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:39.228821 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cda59d15-3448-4e0d-b808-bf5018196ee1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 0.432594 Sep 27 01:45:39.229834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1814/3593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:38 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:39.239234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:39.264096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:39.276956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Searching by: {'deleted': False, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:45:39.299517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:39.300083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:39.300588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:39.335067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:39.335573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:39.348748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:39.451443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:45:39.531492 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b71638f-5eca-45d2-ad88-0aa13ad7f8df tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.300228 Sep 27 01:45:39.545903 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1815/3594] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:45:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:39.564042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:39.565221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:39.582027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:39.587373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:39.588352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:39.589253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:39.589945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:39.590551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:40.164292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:40.179063 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2d7eaba-8879-4fd3-9ab2-27922711b6f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1565 microversion: 2.1 time: 0.629621 Sep 27 01:45:40.181580 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1816/3595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:39 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1565 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:40.191468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:40.202513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:40.218416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:40.218951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:40.221255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:40.222064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:40.222537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:40.223543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:40.267953 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] HTTP exception thrown: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b HTTP/1.1 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:40.270235 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:40.272083 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '342edb38-6731-4d4f-a15d-c32dd7c3d79b'} Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:40.273215 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:40.275056 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:40.276749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 404 to user: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:40.276749 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b02b68f-7c2d-48b9-a7a4-c3d9a2a3fd22 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "DELETE /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 404 len: 111 microversion: 2.1 time: 0.088550 Sep 27 01:45:40.277126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1817/3596] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:40 2022] DELETE /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:40.292822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:40.293648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:40.305358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:40.306111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:40.306821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:40.313019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:40.313785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:40.314494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.184015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.195806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.197849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.199966 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f622e67b-6ff1-439b-9197-55d6d3f7b2e7 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1884 microversion: 2.32 time: 0.921730 Sep 27 01:45:41.202620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1818/3597] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:40 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1884 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:41.208158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:41.209111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:41.216830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.217704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.218328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.219951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.220567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.221157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.356074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.370613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.372473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:41.387966 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3142c6d0-0334-4372-ad26-425a3e385773 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.183609 Sep 27 01:45:41.389266 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1819/3598] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:41 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:41.406344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:41.407269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:41.419368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.426585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.427375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.428361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.429039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.433523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.623950 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6368634c-2bd3-4ad6-99ba-5b9d633024b0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221362 Sep 27 01:45:41.625658 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1820/3599] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:45:41 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:41.630900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:41.631897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:41.653260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.654058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.659313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:41.662488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:41.663159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:41.663773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.056496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:43.066297 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a01b2adb-bd8d-42b8-b702-ff8bc0ce5038 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 1.439415 Sep 27 01:45:43.070568 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1821/3600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:41 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:43.081106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:43.081974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:43.100931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.101764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.102564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.103543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.104289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.105202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.167245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:43.443236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f3de787-caf5-427d-ac81-f210ed79865a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "DELETE /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd" status: 204 len: 0 microversion: 2.1 time: 0.370952 Sep 27 01:45:43.444294 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1822/3601] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:43 2022] DELETE /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:43.449664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "2f06025e-abb7-45cf-8f89-9f6dac7a80f9"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:43.459802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.460454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.460971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.483074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] Creating event network-changed:2f06025e-abb7-45cf-8f89-9f6dac7a80f9 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:43.500594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fa85971d-1023-473e-bf1d-e2a77a026541 req-98420c92-cf08-4079-8215-d1c03d5f6d74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054620 Sep 27 01:45:43.501651 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1823/3602] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:43.506725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd897c-48bf-4bc3-b44c-0c3c86e38cd3", "name": "network-vif-plugged", "status": "completed", "tag": "789fe85e-ee0e-4921-82bd-4401fd6dfc3a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:43.532024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.534665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.535766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.567562 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] Creating event network-vif-plugged:789fe85e-ee0e-4921-82bd-4401fd6dfc3a for instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 on n-h2-859358-1 Sep 27 01:45:43.579257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ac5e0251-c874-4bca-8f25-6641f13f86c9 req-287d03ed-0f33-4487-bde6-ba3fff47891e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076110 Sep 27 01:45:43.586022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1824/3603] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:43.594413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:43.595297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:43.616110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.616800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.617472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:43.618296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:43.622024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:43.622664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:44.307137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.323641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.330418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.332562 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18874305-fb6b-41cc-b608-425277c10a48 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1884 microversion: 2.32 time: 0.744796 Sep 27 01:45:44.357651 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1825/3604] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:43 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1884 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:44.367603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:44.368708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:44.376891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:44.388878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:44.389716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:44.391233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:44.392432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:44.396941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:44.708868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.731177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.742270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:44.755822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0119add-990d-4c97-be33-b08ccf04171e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.396479 Sep 27 01:45:44.773471 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1826/3605] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:44 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:44.773471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:44.774817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:44.787271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:44.790300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:44.790300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:44.790539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:44.791279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:44.791863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:44.792519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:44.856530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:45.115444 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36f70198-fde5-4220-ba50-b59ccc209384 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 204 len: 0 microversion: 2.1 time: 0.350125 Sep 27 01:45:45.120267 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1827/3606] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:44 2022] DELETE /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:45.127378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:45.128386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:45.136124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:45.136938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:45.137613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:45.139431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:45.140217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:45.147318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:46.508035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:46.515843 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7203f123-f958-4e74-bf15-8591335d36f1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1317 microversion: 2.1 time: 1.393792 Sep 27 01:45:46.526276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1828/3607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:45 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1317 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:46.572898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:46.575589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 342edb38-6731-4d4f-a15d-c32dd7c3d79b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:46.588142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:46.591782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:46.591782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:46.592984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:46.594807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:46.595655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:46.635746 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] HTTP exception thrown: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b HTTP/1.1 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:46.644349 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:46.645956 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '342edb38-6731-4d4f-a15d-c32dd7c3d79b'} Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:46.646762 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. Sep 27 01:45:46.648081 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:46.649246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 404 to user: Instance 342edb38-6731-4d4f-a15d-c32dd7c3d79b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:46.649246 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb56518a-74b3-44c6-acaf-701504580a9d tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b" status: 404 len: 111 microversion: 2.1 time: 0.120425 Sep 27 01:45:46.654633 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1829/3608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:46 2022] GET /compute/v2.1/servers/342edb38-6731-4d4f-a15d-c32dd7c3d79b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:46.679214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:46.679951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:46.698163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:46.698664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:46.708183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:46.714195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:46.714796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:46.715255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.174997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.178144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:47.194665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.197853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.200704 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47e48136-4bb8-4b02-998b-ff6976620864 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.542977 Sep 27 01:45:47.217373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1830/3609] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:46 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:47.221940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "8e78f337-4d92-4245-a3bb-b449d93a8ff3"}, {"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "2ff3212d-e1ec-465b-ad65-471fe445567b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:47.247454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.249549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.250606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] validate_networks() for [('62292327-c629-4d4e-864a-c80a2131f473', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:45:47.251095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.275771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Creating event network-changed:8e78f337-4d92-4245-a3bb-b449d93a8ff3 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:47.276276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] Creating event network-changed:2ff3212d-e1ec-465b-ad65-471fe445567b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:47.281478 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-04777002-73d4-48b9-8cf5-72ac88235913 req-13211773-8635-439b-a75e-3e4f109f5c42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075723 Sep 27 01:45:47.282680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1831/3610] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:47.288360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:47.298785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.299553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.300172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.312541 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] Creating event network-changed:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:45:47.318813 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e695b8b7-f067-4957-b4d3-7094165968e9 req-85c4824b-f0fd-428f-819e-6340b2808e37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034612 Sep 27 01:45:47.322494 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1832/3611] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:47.327989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:47.328722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:47.341842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.342337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.342771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.343476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.343925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.344553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.460216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.472374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.473896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.480292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce08aaf0-13b6-40b1-9a10-0afc5ec6b591 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.156493 Sep 27 01:45:47.481245 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1833/3612] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:47 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:47.710656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:47.723048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Invalid key_name provided. Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 246 Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:47.732732 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:47.734491 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1767546480", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-key-207022295", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid key_name provided. Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1767546480', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'key_name': 'tempest-key-207022295', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 27 01:45:47.735457 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-207022295 not found for user 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:47.736879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:47.738992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid key_name provided. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:47.740312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Calling method '.version_select at 0x7f24da5318b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:47.743261 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c661d21d-3c5e-4d44-9c03-8c8712042cd8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 8.969962 Sep 27 01:45:47.747706 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1780/3613] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 8980 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:45:47.749305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:47.749958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:47.751746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.752235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.752871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.753621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.754896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.755575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.775099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:47.778288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.778789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.783053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.783910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.784737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.784869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.795360 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f3d9d19-c8e9-4650-a1ba-ce5e32d1a978 tempest-AbsoluteLimitsTestJSON-1002435992 tempest-AbsoluteLimitsTestJSON-1002435992-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.312502 Sep 27 01:45:47.808408 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1834/3614] 10.222.0.52 () {58 vars in 1122 bytes} [Tue Sep 27 01:45:47 2022] GET /compute/v2.1/limits => generated 511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:47.814370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:47.815314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:47.822748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.824023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.824806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.826081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.827889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.828544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.839714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:47.879383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:47.881001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:47.882305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:47.882431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:47.882867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 13c2d685-a6fd-41ab-9f4a-912f9d9913bd {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:47.960053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:47.973080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80132ebf-5dbd-4075-83d9-102b33738ef1 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd" status: 200 len: 1313 microversion: 2.1 time: 0.227075 Sep 27 01:45:47.978146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1781/3615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:47 2022] GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:47.985405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:47.989865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:48.018931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.019588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.020044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:48.020836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.021298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.025942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:48.596136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:48.606610 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a040260-e1dc-4a11-8bec-7c5490435d49 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1506 microversion: 2.1 time: 0.625092 Sep 27 01:45:48.611923 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1782/3616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:47 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:48.620843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:48.621501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:48.648813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.649405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.650949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:48.651685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.652150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.655847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:48.783256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:48.792116 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5de2beb-3e37-485b-9fc3-000449f2bf7a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.981605 Sep 27 01:45:48.796948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1835/3617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:48.808943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:48.809891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:48.818213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.819200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.819824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:48.834303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:48.835069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:48.835673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.414339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.428151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.434386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.435683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8f338bd-9107-486d-9b9f-5d8751848780 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.637486 Sep 27 01:45:49.437993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1836/3618] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:48 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:49.444024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:49.447922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:49.476782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.477622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.480495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.482192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.482873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.490480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.668515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.683350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db954114-cdf7-4a16-8e39-40ef58154a08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 1.070068 Sep 27 01:45:49.695026 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1783/3619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:48 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:49.714664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-717213548"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:49.723589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:49.730316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.751907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.754245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.755551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.758226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.761629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.762454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:49.764140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.766213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.782513 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ea5de94-f096-47f4-a1e3-af017e9c7d82 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.343246 Sep 27 01:45:49.788826 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1837/3620] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:49 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:49.795453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:49.796440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 13c2d685-a6fd-41ab-9f4a-912f9d9913bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:49.803968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.805222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.806022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.807204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.807892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.808571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.828925 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] HTTP exception thrown: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd HTTP/1.1 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:49.831354 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. Sep 27 01:45:49.833412 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '13c2d685-a6fd-41ab-9f4a-912f9d9913bd'} Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:49.834266 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. Sep 27 01:45:49.836781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:49.840974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 404 to user: Instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:49.842343 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7bc71d0-3186-40f6-83c9-3a9fa772584c tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd" status: 404 len: 111 microversion: 2.1 time: 0.051777 Sep 27 01:45:49.843495 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1838/3621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:49 2022] GET /compute/v2.1/servers/13c2d685-a6fd-41ab-9f4a-912f9d9913bd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:49.851003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c2d685-a6fd-41ab-9f4a-912f9d9913bd", "name": "network-vif-deleted", "tag": "20ea02f5-8583-495e-9449-93512cb888b0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:49.863730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.864603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.865504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.882675 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] Creating event network-vif-deleted:20ea02f5-8583-495e-9449-93512cb888b0 for instance 13c2d685-a6fd-41ab-9f4a-912f9d9913bd on n-h1-859358-1 Sep 27 01:45:49.890499 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3f386f17-700d-47a7-8244-bbc6047bab66 req-2b7f8a47-e206-4e4e-8b4c-c9632d6fc5cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045311 Sep 27 01:45:49.893233 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1839/3622] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:49.916168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "f614e123-3043-4e23-911c-17972ccd15fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:49.942419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:49.943328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:49.944111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:49.978823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] Creating event network-changed:f614e123-3043-4e23-911c-17972ccd15fd for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:45:49.991057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-69b02b23-9b90-4d7f-a1be-80aa8701e010 req-8e876702-5a66-4a9b-9c20-bf978be6b38f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093732 Sep 27 01:45:49.994754 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1840/3623] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:50.010718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:50.011638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:50.046913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.049238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.049963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.053620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.054357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.055240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.235571 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-610b8323-db06-478f-a150-577e6bd49acc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.525052 Sep 27 01:45:50.236985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1784/3624] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:45:49 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 27 01:45:50.262744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:50.294273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:50.329473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.329973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.330409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.331120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.331574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.338096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.402549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:50.417944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-350997f3-9c13-4c5f-b51a-c10a07e35dfd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.421561 Sep 27 01:45:50.426092 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1841/3625] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:49 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:50.455154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-unplugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:50.503175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.506341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.506827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.568523 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] Creating event network-vif-unplugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:45:50.579323 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b8435263-72d5-4571-a2f9-b125e1769785 req-be65bbef-552b-41d5-aae5-1f8bef9c8e61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151708 Sep 27 01:45:50.585062 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1842/3626] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:50.591777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:50.592847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:50.600753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.601625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.602393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:50.603341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:50.604024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:50.604692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.139324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.140298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.150362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.151797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.157394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-def47491-7b50-4095-9802-362b827b6313 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1522 microversion: 2.1 time: 0.918580 Sep 27 01:45:51.164035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8320bb0e-4d1d-42c9-ac3f-dcb0f71c777b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.577193 Sep 27 01:45:51.165581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1785/3627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:50 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1522 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:51.180847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1843/3628] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:50 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:51.195363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1811203703", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:51.198077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:51.200255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:51.217784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.218799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.219518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.220954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.221626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.222550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.377236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.392799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.394432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:51.418106 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91e4be4c-0904-4512-a46e-0185224e083e tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.235146 Sep 27 01:45:51.436399 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1844/3629] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:51 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:51.537183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cddfefe0-705d-4e03-b473-b21ae47a01fd"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:51.540033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:51.554572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.555040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.555455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.564331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.567395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.567858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.573828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Neutron security group does_not_exist not found {{(pid=128779) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 27 01:45:51.574931 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 258 Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:51.589209 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:45:51.590763 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1811203703", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1811203703', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 27 01:45:51.591520 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 27 01:45:51.592936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.596940 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.600487 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88bd4b72-0eb2-46e8-8139-0b978ddd2d35 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.424246 Sep 27 01:45:51.607960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1786/3630] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:51 2022] POST /compute/v2.1/servers => generated 106 bytes in 426 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:45:51.622263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:51.623629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:51.635930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.636432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.636874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.637621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.638082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.638518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.686109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] HTTP exception thrown: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Request method failure captured: Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: request: PUT /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3/os-volume_attachments/61dfaa86-2727-4d51-aa4d-6324b557c882 HTTP/1.1 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 74 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlU_wi08wcPkB68yj-TnVpXIqqbiurKBzVifiAx_qenUQLp8qnRujn5ouxUN0pdMcWO1xZ60DVARXJJRgU4iROzG0hvFOMqrjc5qH-RJxOwiXg-YvQfqUTlf0w_743b5ZkDD1SyxleLe6iR3tu63RLbhLClbrZ6mz9trJIs6JKyuscM Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6b8832a9d37a4dab8f9a0d7775e7dcc5 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 01:45:51.690151 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b8832a9d37a4dab8f9a0d7775e7dcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b8832a9d37a4dab8f9a0d7775e7dcc5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6b8832a9d37a4dab8f9a0d7775e7dcc5 Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1166822137 Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesAdminNegativeTest-1166822137-project-admin Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ed472df7e09f4dc09abd010a6691949b Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesAdminNegativeTest-1166822137-project-admin Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: {"volumeAttachment": {"volumeId": "cddfefe0-705d-4e03-b473-b21ae47a01fd"}} Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:51.691642 n-d-859358-1 devstack@n-api.service[128778]: exception: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': 'afdd897c-48bf-4bc3-b44c-0c3c86e38cd3', 'id': '61dfaa86-2727-4d51-aa4d-6324b557c882', 'body': {'volumeAttachment': {'volumeId': 'cddfefe0-705d-4e03-b473-b21ae47a01fd'}}} Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:45:51.692478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. (HTTP 404) (Request-ID: req-e3c2e015-1f1c-4231-b748-40593bf6f259) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:45:51.693603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:51.694783 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. Sep 27 01:45:51.696049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:51.701366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] Returning 404 to user: Volume 61dfaa86-2727-4d51-aa4d-6324b557c882 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:51.701366 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fe168a13-6663-49b4-8ef7-640e0db8cf35 tempest-VolumesAdminNegativeTest-1166822137 tempest-VolumesAdminNegativeTest-1166822137-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3/os-volume_attachments/61dfaa86-2727-4d51-aa4d-6324b557c882" status: 404 len: 109 microversion: 2.1 time: 0.168188 Sep 27 01:45:51.705688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1845/3631] 10.222.0.52 () {60 vars in 1433 bytes} [Tue Sep 27 01:45:51 2022] PUT /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3/os-volume_attachments/61dfaa86-2727-4d51-aa4d-6324b557c882 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:45:51.912587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7779e9-fefc-41d9-b5e9-c4cb13ef3799", "name": "network-vif-deleted", "tag": "17a09508-77ae-4077-9663-d42afc2e6107"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:51.950636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:51.952223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:51.955521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:51.989475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] Creating event network-vif-deleted:17a09508-77ae-4077-9663-d42afc2e6107 for instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 on n-h2-859358-1 Sep 27 01:45:52.001122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cbfb1dd0-c6b2-4357-a065-e9e1db6bd841 req-c7546eb3-bb77-44c8-adb8-95dc1f1439bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092453 Sep 27 01:45:52.016699 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1846/3632] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:52.193196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.195069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.196429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.213744 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23142e69-be80-45da-89ae-6c5668162200 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.602955 Sep 27 01:45:52.214175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.214680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.223798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.226715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.228473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.229902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.242008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1787/3633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:51 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:52.246894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.247509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.282295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.282903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.283340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.284052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.284505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.285012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.318393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.319182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.319905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.320621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:52.411030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.420216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f291ff39-acb6-4c94-915c-1f75224863fc tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1313 microversion: 2.1 time: 0.234855 Sep 27 01:45:52.424496 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1847/3634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:52 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:52.447430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.448065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.482814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.485904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.486605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.506104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.507985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.512677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.788069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.794548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.796979 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df91357e-d070-4f4e-adb4-52f848b566b1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.369085 Sep 27 01:45:52.797553 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1848/3635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:52 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:52.802446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.803279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.811068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.811739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.812367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.813254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.813969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.814563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.822143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.823586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.824751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4dc5298e-fcd9-4e9d-8f43-536d9e89b169 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.581720 Sep 27 01:45:52.837689 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1788/3636] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:52 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:52.840250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.840775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7a49e2a0-dfee-4050-a75a-8a4e5bde601c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.856707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/7a49e2a0-dfee-4050-a75a-8a4e5bde601c HTTP/1.1 Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:52.858352 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. Sep 27 01:45:52.859994 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7a49e2a0-dfee-4050-a75a-8a4e5bde601c'} Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:52.861048 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. Sep 27 01:45:52.862634 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:52.865191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 7a49e2a0-dfee-4050-a75a-8a4e5bde601c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:52.865191 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7428f66c-275b-4ce3-a00a-e8321887296b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a49e2a0-dfee-4050-a75a-8a4e5bde601c" status: 404 len: 111 microversion: 2.1 time: 0.031589 Sep 27 01:45:52.865191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1789/3637] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:52 2022] DELETE /compute/v2.1/servers/7a49e2a0-dfee-4050-a75a-8a4e5bde601c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:52.872686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:52.873362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:52.893482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.894236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.895267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.896038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:52.896627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:52.897132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:52.944270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.959660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.961111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:52.976042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d34c4832-1249-43ca-8e4c-8e5b3a2131c0 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.177367 Sep 27 01:45:52.985414 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1849/3638] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:52 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:53.142135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:53.151490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92756787-2f9c-4bb7-b8f0-8bafd19f8f22 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.283055 Sep 27 01:45:53.173902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1790/3639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:52 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:53.180597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.181601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.188527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.189261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.189984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.190869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.192086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.192687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.362625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:53.371518 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-659b8c6b-01dc-4694-9b10-b316d7615721 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.195637 Sep 27 01:45:53.372203 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1850/3640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:53.395423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.395989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:45:53.397298 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:45:53.399253 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 9223372036854775808 could not be found. Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '9223372036854775808'} Sep 27 01:45:53.400620 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:45:53.402073 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.403901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:53.405834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ec1ddca-d3ad-4d06-b890-712d5f31bf16 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010732 Sep 27 01:45:53.405834 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1791/3641] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Sep 27 01:45:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:45:53.411870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.413231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.421200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.421710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.422148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.423251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.423717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.424152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.450755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.451359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.458354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.459216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.459833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.460810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.461531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.462112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.521828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.522372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.522818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.523271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:53.620524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:53.624458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:53.632060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6da2032-481d-4e05-9ef1-c25679a90554 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1313 microversion: 2.1 time: 0.184929 Sep 27 01:45:53.632956 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee18ca35-c707-42a9-b00f-007a7f1c9b1a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.226609 Sep 27 01:45:53.634033 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1851/3642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:53.646771 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1792/3643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:53.657204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.657844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.664052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.664536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.664969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.665690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.666142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.666565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.813752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:53.817440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:53.827653 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a459561-3d64-473e-89eb-a8ded4841d78 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.174011 Sep 27 01:45:53.842398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1852/3644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:53.853460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.854533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.868443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.870210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.870924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.871804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.872721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.873546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Failed to fetch instance by id -1 {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:45:53.874901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.875665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance -1 could not be found. Sep 27 01:45:53.876310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:53.878195 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance -1 could not be found. Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '-1'} Sep 27 01:45:53.879746 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:45:53.880589 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 27 01:45:53.881832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:53.892048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:53.895157 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d094c98-6b9d-4957-bb16-20c3bc12c0e6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.033329 Sep 27 01:45:53.896027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1853/3645] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:45:53 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:45:53.920641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:53.921752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:53.934184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.935518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.936062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:53.936880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:53.937478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:53.938024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.170723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.185713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fe733924-24a9-440c-862e-e64c6f2d6a89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.281543 Sep 27 01:45:54.187758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1854/3646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:54.202026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:54.202879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:54.211278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.212501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.213730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.214620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.215767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.216411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.340905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.360104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.365901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.388231 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff67f4ac-7f06-45b3-98a6-18bb0cd89535 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.189714 Sep 27 01:45:54.391613 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1855/3647] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:54 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:54.401774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:54.404401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:54.420419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.421329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.423673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.426579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.427861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.428482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.749139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.762070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.764148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.765818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e2e48ee-a006-4ab3-b0b6-ce8cebdb45cf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.916841 Sep 27 01:45:54.766994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1793/3648] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:53 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:54.772515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:54.779354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:54.786699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.788690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.789601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.790634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.791614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.792314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.857840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:54.861193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:54.865669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:54.866484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:54.962440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:54.980307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc6360c8-465b-439b-9c40-5c8b4ca55923 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.586730 Sep 27 01:45:55.014737 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1856/3649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:54 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:55.026627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:55.027437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 1179a124-a894-4371-a569-ef8eb38c87a7] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.043917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.049856 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. Sep 27 01:45:55.056236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77743f3f-c2d0-4b59-90f1-e1e91844d092 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1313 microversion: 2.1 time: 0.285560 Sep 27 01:45:55.058805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1794/3650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:54 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/1179a124-a894-4371-a569-ef8eb38c87a7/action HTTP/1.1 Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 19 Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:55.060025 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: {"forceDelete": {}} Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:55.061627 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1179a124-a894-4371-a569-ef8eb38c87a7', 'body': {'forceDelete': {}}} Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:55.062588 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. Sep 27 01:45:55.064130 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:55.066904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 1179a124-a894-4371-a569-ef8eb38c87a7 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:55.067941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd441673-baa7-4fcb-af11-b502e92cd52a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/1179a124-a894-4371-a569-ef8eb38c87a7/action" status: 404 len: 111 microversion: 2.1 time: 0.045698 Sep 27 01:45:55.072837 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1857/3651] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:45:55 2022] POST /compute/v2.1/servers/1179a124-a894-4371-a569-ef8eb38c87a7/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:55.078459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.079974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.092253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.093810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.094187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.095308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.098590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.099331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.168331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.169075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.177925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.181954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.185643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.187348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.188331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.188926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.250083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:45:55.408225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.423099 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b9267b1-1e08-4dc7-9d8b-8df7dc8c5b88 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "DELETE /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 204 len: 0 microversion: 2.1 time: 0.258364 Sep 27 01:45:55.427990 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1858/3652] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:45:55 2022] DELETE /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:45:55.432137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:55.439912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.440979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.452163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29a66c8e-dbae-4c2f-819b-b06192b3b77c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.371801 Sep 27 01:45:55.463521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.464444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.465085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.465905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.466592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.467244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.482128 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1795/3653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:55 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:55.493493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.494459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.509318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.510126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.511378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.512321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.513850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.514620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.647432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.663733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.665196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.673931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1c2694c-a1b2-4a6d-a165-656416528f6a tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.244300 Sep 27 01:45:55.686019 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1859/3654] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:55 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:55.700652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.701597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.708929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.709728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.710342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.711326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.712001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.712597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.781902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:55.794252 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-998a9423-10bb-4fbe-91e0-9396fc36f165 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1512 microversion: 2.1 time: 0.317201 Sep 27 01:45:55.795078 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1796/3655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:55 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:55.804459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:55.811093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:55.827592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.838074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.838781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.840049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:55.840587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:55.847253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:55.987351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.000143 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6397a638-7491-4dac-aa1f-02d8ba417b71 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.312732 Sep 27 01:45:56.001143 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1860/3656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:55 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:56.028001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:56.030812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 2889164a-e304-479e-986c-ed21c65504a5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.045546 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/2889164a-e304-479e-986c-ed21c65504a5/action HTTP/1.1 Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 39 Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:56.051304 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: {"os-getConsoleOutput": {"length": 10}} Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:56.053150 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2889164a-e304-479e-986c-ed21c65504a5', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:56.054260 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. Sep 27 01:45:56.055832 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:56.059185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 2889164a-e304-479e-986c-ed21c65504a5 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:56.060280 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f97c33d5-7dce-407d-9c60-708102b12e4c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/2889164a-e304-479e-986c-ed21c65504a5/action" status: 404 len: 111 microversion: 2.1 time: 0.037804 Sep 27 01:45:56.065596 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1861/3657] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:45:56 2022] POST /compute/v2.1/servers/2889164a-e304-479e-986c-ed21c65504a5/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:45:56.077625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:56.082163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.116037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.117124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.117817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.121187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.123721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.124370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.348291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.365990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.371309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.375348 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d52c727-7ac8-4fe4-9f73-4e173b93b863 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.578888 Sep 27 01:45:56.376689 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1797/3658] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:55 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:56.383232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:56.384125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.392058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.393070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.394061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.395159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.396070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.396663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.406711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.419412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c4a151b-5c3d-4646-8688-8028e678de3f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.347337 Sep 27 01:45:56.421042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1862/3659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:56 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:56.432025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-plugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:56.440173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:56.447590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.448703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.449424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.450086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:56.479460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.480241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.480853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.493986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] Creating event network-vif-plugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:45:56.499852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6396eb19-a644-46d9-a477-d20f1ff490de req-ea82a1d2-f9dd-4dd4-bfb8-910ce5648fac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077431 Sep 27 01:45:56.500721 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1863/3660] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:45:56.507481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:56.509114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.516427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.517135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.517777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.518682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.519844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.520442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.651079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.661232 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa5c3db6-3b29-4ae2-8522-049228b016cb tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1313 microversion: 2.1 time: 0.283286 Sep 27 01:45:56.673562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1798/3661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:56 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:56.705502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:56.706258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.718648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.721083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.721926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.723789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.724642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.725236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.882827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.892153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.897902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:56.924682 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13d646e3-2cff-4349-b68e-d01615c9cee4 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.223156 Sep 27 01:45:56.929494 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1799/3662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:56 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:45:56.937067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:56.942430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:56.961678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.972380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.973265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:56.977415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:56.979342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:56.980320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.031917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.041114 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bf93d119-97ed-45fc-93f5-d749318cf748 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.538954 Sep 27 01:45:57.058006 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1864/3663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:56 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:57.074836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:57.075658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: f1fcbac1-6428-49d3-8145-5a62fb31b005] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:57.095436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/f1fcbac1-6428-49d3-8145-5a62fb31b005 HTTP/1.1 Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:57.101417 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. Sep 27 01:45:57.103255 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f1fcbac1-6428-49d3-8145-5a62fb31b005'} Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:57.104198 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. Sep 27 01:45:57.108136 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:57.111521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance f1fcbac1-6428-49d3-8145-5a62fb31b005 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:57.113890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9c8e21a-ec22-44ca-b0fc-2c5d1815a1f0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/f1fcbac1-6428-49d3-8145-5a62fb31b005" status: 404 len: 111 microversion: 2.1 time: 0.048265 Sep 27 01:45:57.116617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1865/3664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:57 2022] GET /compute/v2.1/servers/f1fcbac1-6428-49d3-8145-5a62fb31b005 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:57.127467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:57.128366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:57.147277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.148058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.148668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.149918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.151032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.152170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.336371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.344642 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc0fba06-b0a5-40e9-a45c-81c7b796d138 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1512 microversion: 2.1 time: 0.413728 Sep 27 01:45:57.348113 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1800/3665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:56 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:57.406229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:57.407369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:57.420392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.421537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.422229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.423246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.424263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.424884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.535772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.549661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85d214cf-4acc-4921-9857-56f04c89f39b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.429643 Sep 27 01:45:57.570799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1866/3666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:57 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:57.587984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:57.595281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:57.603014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.603460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.604310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.605393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:57.606062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:57.606652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:57.750098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:57.782097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:45:57.928357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.959906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.961674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:57.970984 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80c902a7-f88f-4413-ba70-68ae25968731 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.570424 Sep 27 01:45:57.981736 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1801/3667] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:57 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:57.990571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:57.998191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:58.021986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.022738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.024204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.025211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.026177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.029690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.134750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.136422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.138955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.140990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lazy-loading 'fault' on Instance uuid 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:45:58.273911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82092e9239f64422bed6b899b6291aeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ec49b8ae4348ac8085b0db2095ed46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.288400 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31bb23d8-a9c6-4732-aaa8-698f9f89c93a tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 200 len: 1313 microversion: 2.1 time: 0.301551 Sep 27 01:45:58.290056 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1802/3668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:57 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:58.295377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:58.296144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:58.303547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.304234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.304840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.305965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.306581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.307175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.405968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.419313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.420752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.437756 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-904b838d-9b20-4faa-9354-69162a6ae58b tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.146387 Sep 27 01:45:58.438657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1803/3669] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:58 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:45:58.443853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:58.445515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:58.483705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.484194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.484626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.485329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.485804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.486228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.514586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.524034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-508fda1e-1170-4618-8c07-616233c3c896 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.948131 Sep 27 01:45:58.529148 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1867/3670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:57 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:58.751987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53e28e86-de2f-4d8c-b973-f3b4e3de2953 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2073775876", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53e28e86-de2f-4d8c-b973-f3b4e3de2953 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 238 Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:58.778815 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:45:58.780378 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2073775876", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2073775876', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:58.781091 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:45:58.782447 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 27 01:45:58.783917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:58.788685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53e28e86-de2f-4d8c-b973-f3b4e3de2953 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:58.789853 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53e28e86-de2f-4d8c-b973-f3b4e3de2953 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042520 Sep 27 01:45:58.791049 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1868/3671] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:45:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:45:58.799338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:58.799950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:58.812281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.812687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.813117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.814102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:58.814718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:58.815575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:58.890459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:58.898772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e47e9c73-2095-413f-bb0a-1a9a2150b5eb tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1512 microversion: 2.1 time: 0.459037 Sep 27 01:45:58.916932 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1804/3672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:58 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:59.000330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:59.001790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:59.025095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.026215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.026841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.028218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.029041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.029675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.107746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:59.137102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e6bcdd9-cb32-4380-81a9-6f599f12fb6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.341319 Sep 27 01:45:59.153097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1869/3673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:58 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:45:59.178425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:59.179355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:59.188209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.188712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.189425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.190162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.190848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.191676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.693041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:45:59.701002 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23dc4022-b082-4827-8d3f-05ab0de1b22c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.532274 Sep 27 01:45:59.713474 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1870/3674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:59 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:45:59.718753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:59.719359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] [instance: 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:59.746685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.751514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.753734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.756681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.763991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.765797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.808956 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] HTTP exception thrown: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Request method failure captured: Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 HTTP/1.1 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlWOfe9R-IvwrSDS79m5EY4ZqhBxSed7nYlRNBtwjpdnKhLMZ492P_EQ-O6-57qoiBaH2i0xT-776YwB6R25nwkGoRLRlUVlYEwNDzeWE_RWbs8z2O2zjxM0BTVK5XE-2nlJPW1R6LQ4MsgNiJ9Q8J11Qku5t15fCOOfkcjWOkRRztg Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:45:59.810995 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/93ec49b8ae4348ac8085b0db2095ed46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_93ec49b8ae4348ac8085b0db2095ed46", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 93ec49b8ae4348ac8085b0db2095ed46 Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1073437836 Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82092e9239f64422bed6b899b6291aeb Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServersNegativeTestJSON-1073437836-project Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. Sep 27 01:45:59.812395 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2a7779e9-fefc-41d9-b5e9-c4cb13ef3799'} Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:45:59.813152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. Sep 27 01:45:59.814428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:45:59.821229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] Returning 404 to user: Instance 2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:45:59.826179 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e63702b-02ce-409d-a4f9-40072f3df387 tempest-ListServersNegativeTestJSON-1073437836 tempest-ListServersNegativeTestJSON-1073437836-project] 10.222.0.52 "GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799" status: 404 len: 111 microversion: 2.1 time: 0.107739 Sep 27 01:45:59.831429 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1871/3675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:45:59 2022] GET /compute/v2.1/servers/2a7779e9-fefc-41d9-b5e9-c4cb13ef3799 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:45:59.841635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:45:59.843367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:45:59.862881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.865973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.866497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:45:59.867300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:45:59.867965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:45:59.871002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.091641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.104649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.106119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.130296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd8553e1-9752-4c87-a6b1-2c146cef0879 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.296886 Sep 27 01:46:00.139318 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1872/3676] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:59 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:00.147806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1f97bc9-ad11-4623-b47d-45d986752229 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1166378763", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1f97bc9-ad11-4623-b47d-45d986752229 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 235 Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:00.170595 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:00.172028 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1166378763", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1166378763', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:00.172722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:00.174607 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:00.176594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1f97bc9-ad11-4623-b47d-45d986752229 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:00.177765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1f97bc9-ad11-4623-b47d-45d986752229 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.029449 Sep 27 01:46:00.177765 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1873/3677] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:46:00 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:46:00.182466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.193630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.197873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.202772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0f91d51c-a474-41dd-9da1-a476cde49afe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 1.206635 Sep 27 01:46:00.204429 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1805/3678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:45:58 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:00.209317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:00.209964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:00.213826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:00.219766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:00.234191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.235073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.235783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.236747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.237483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.238714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.248751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.249262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.256921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.257925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.258420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.258870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.754726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.766084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b82b0f92-a0cc-47f0-a792-73c02bba85a6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.557969 Sep 27 01:46:00.774052 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1806/3679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:00 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:00.803008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:00.804178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:00.818179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.820136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.820600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.821908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:00.822372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:00.825055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:00.880238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:00.889080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95bf5d91-5e15-437c-b2fc-ca5fe701e067 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1512 microversion: 2.1 time: 0.687870 Sep 27 01:46:00.909248 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1874/3680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:00 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1512 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:01.171227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:01.172265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:01.182614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.183407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.184912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.185857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.188860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.190522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.205955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:01.368767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:01.384803 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d3d9be2-05f6-4b09-9c8d-cf083ea8fa79 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.586929 Sep 27 01:46:01.389431 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1807/3681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:00 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:01.398995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:01.400118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:01.410546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.414223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.416178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.420560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:01.443808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.449125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.454224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.465531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:01.490521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:01.554474 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24226319-853f-46f1-a287-b89b5212f086 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1546 microversion: 2.91 time: 0.387294 Sep 27 01:46:01.559588 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1875/3682] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:01 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1546 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:01.567105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:01.567643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: ca8f12c0-beed-41e0-8647-15583ff8966e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:01.624165 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/ca8f12c0-beed-41e0-8647-15583ff8966e/action HTTP/1.1 Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 13 Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:01.643170 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: {"pause": {}} Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. Sep 27 01:46:01.645520 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ca8f12c0-beed-41e0-8647-15583ff8966e', 'body': {'pause': {}}} Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:01.647230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. Sep 27 01:46:01.649906 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:01.654269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance ca8f12c0-beed-41e0-8647-15583ff8966e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:01.656677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3bacee8a-9cf6-4e5d-aa90-c689726f6075 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/ca8f12c0-beed-41e0-8647-15583ff8966e/action" status: 404 len: 111 microversion: 2.1 time: 0.096364 Sep 27 01:46:01.658541 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1876/3683] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:01 2022] POST /compute/v2.1/servers/ca8f12c0-beed-41e0-8647-15583ff8966e/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:01.668953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd897c-48bf-4bc3-b44c-0c3c86e38cd3", "name": "network-vif-deleted", "tag": "789fe85e-ee0e-4921-82bd-4401fd6dfc3a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:01.717731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.718258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.718718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.769009 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] Creating event network-vif-deleted:789fe85e-ee0e-4921-82bd-4401fd6dfc3a for instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 on n-h2-859358-1 Sep 27 01:46:01.793183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b74a9d14-38ae-4a68-922d-612c04007613 req-468b5e4f-5555-48d0-bf5c-149b3a884633 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133153 Sep 27 01:46:01.798750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1877/3684] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:01.828710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:01.830901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:01.853031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.853705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.854255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:01.855073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:01.856411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:01.856960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:02.458944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:02.471977 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-479d869d-d107-4b51-8fba-512b12c789d5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.664931 Sep 27 01:46:02.490693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1878/3685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:01 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:02.499015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:02.502136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:02.527221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:02.528255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:02.530088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:02.531940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:02.533516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:02.534254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:02.646045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:02.648388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:02.648828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:02.650393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lazy-loading 'fault' on Instance uuid afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:02.791691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:02.818944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28e6bb5f-33b6-4658-bd01-8749278028e1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 200 len: 1307 microversion: 2.1 time: 0.326757 Sep 27 01:46:02.819552 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1879/3686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:02 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:02.855880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:02.862908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:02.896022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:02.896515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:02.899584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:02.903468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:02.906264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:02.909994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.033556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.054095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.059525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.068457 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f3e987c-051c-4178-bb56-93fc6205d9ff tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 1.676953 Sep 27 01:46:03.094458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1808/3687] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:01 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:03.107206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:03.111602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:03.130468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.131614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.134585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.137588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.140249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.140979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.319497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.388149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.390048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.411262 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3ca07d0-3788-42ac-8950-b43937243fa9 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1533 microversion: 2.91 time: 0.304868 Sep 27 01:46:03.414719 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1809/3688] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:03 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1533 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:03.456145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:03.458010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:03.466997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.473086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.473836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.476750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.478301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.479690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.614535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] Lazy-loading 'services' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:03.635813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:03.651531 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fffeb4c1-ef5f-458d-b1eb-87dd60673637 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.823381 Sep 27 01:46:03.655979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9af56dc-754c-4a4f-bba9-aa66ebd8b687 tempest-UnshelveToHostMultiNodesTest-2040146017 tempest-UnshelveToHostMultiNodesTest-2040146017-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1938 microversion: 2.91 time: 0.203439 Sep 27 01:46:03.656810 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1810/3689] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:03 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1938 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:03.662507 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1880/3690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:02 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:03.674584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:03.676461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:03.692770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.693376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.694057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.694975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.695621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.696236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.715386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:03.716360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:03.728398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.737764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.738288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.739064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.739351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:03.742028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.742681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.788159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:46:03.869620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d76341ee-6180-44b4-b650-f2492b517c8c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.198811 Sep 27 01:46:03.870770 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1811/3691] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:03 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:46:03.880301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:03.885254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: afdd897c-48bf-4bc3-b44c-0c3c86e38cd3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:03.912967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.916183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.916824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.917806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:03.918553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:03.921807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:03.981026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] HTTP exception thrown: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Request method failure captured: Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 HTTP/1.1 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUvdqrg12-dXpMKS2_Mc8fEPGsNxc7dRaABov27CRCnHw_2drH8v3G508RDxuf7SrK-g6AXsrM7trMLdSNvp93VpXbbBB3vYJB0cX50rK3KNYbZ15xtfrH14Yxef51xfTH4XAgyxJ-j9hkKiuVUTgoflIX0YSQiUAR00ErcRHfzP2g Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a31e4a8e1db94013be04c1ebfc32c6c9 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:03.985199 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a31e4a8e1db94013be04c1ebfc32c6c9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a31e4a8e1db94013be04c1ebfc32c6c9 Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-928115391-project Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 34c031568af44507940568f7d2e14085 Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-928115391-project Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. Sep 27 01:46:03.987023 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'afdd897c-48bf-4bc3-b44c-0c3c86e38cd3'} Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:03.988517 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. Sep 27 01:46:03.992255 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:03.995827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Returning 404 to user: Instance afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:03.995827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09cf92aa-3900-4158-8a55-705f5307ddd1 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3" status: 404 len: 111 microversion: 2.1 time: 0.121360 Sep 27 01:46:03.996651 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1812/3692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:03 2022] GET /compute/v2.1/servers/afdd897c-48bf-4bc3-b44c-0c3c86e38cd3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:04.012700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:04.013890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:04.020205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c240307e-62cd-4359-a671-f2f51ff07128 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 204 len: 0 microversion: 2.91 time: 0.314515 Sep 27 01:46:04.027212 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1881/3693] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:46:03 2022] DELETE /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:46:04.030290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.032171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:04.032786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.033329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.034313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:04.036813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.038213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.038862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.049017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.054858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.055761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.056729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.062421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.063147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.308201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:04.319367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:04.334565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:04.344505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20ded891-3e95-4f9b-8dce-37e0e9b71e85 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.317831 Sep 27 01:46:04.363783 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1882/3694] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:04 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:04.386765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:04.387696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:04.395352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.396052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.396653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.397587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:04.398193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:04.398767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:04.439308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:04.449507 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7398ed0-e85b-4d3f-ac74-0bf6b0d5fc4e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1510 microversion: 2.1 time: 0.447798 Sep 27 01:46:04.451380 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1813/3695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:03 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:05.186089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.196804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.207690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.208941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa3eebe9-678b-47cb-a03d-8c1dbf2766cb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.843790 Sep 27 01:46:05.214942 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1883/3696] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:04 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:05.381460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:05.382307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:05.391353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:05.398714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:05.399408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:05.400340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:05.400977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:05.401792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:05.570775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.582657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.584118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:05.594454 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f6ca8e6a-efc6-4563-b966-165462508ad2 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1539 microversion: 2.91 time: 0.218743 Sep 27 01:46:05.627284 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1884/3697] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:05 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:05.637804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:05.638445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:05.652057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Calling method '.version_select at 0x7f24d57eec10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:05.653891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:05.654564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:05.655175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:05.656179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:05.656803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:05.657420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:05.689291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:46:05.690227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Neutron security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:46:05.691789 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] HTTP exception thrown: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.691789 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Request method failure captured: Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/60585f41-fa48-4e8c-baf2-788fdc28c4ff HTTP/1.1 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlXdse8ddSVV_1NMb49pyDwA83tjTTNDgU-WGSZ6rNdBfDDREZyeT0S67oTCYgQecFZQ8fF9aKn0afhO9_WD4aueLwJCtPJ3JliUNaDZ10prnRRa8qelMTIedVPK5ULm0j1XI5fkurw6cjTl-KISqYkXloHUxZFHAKUv6c9c27ykdxM Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:05.693934 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed2521c5ccaf4a43a5feb161a48cb5d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 8c2cd73fc9ea4882aff1b9971802c9f0 Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.695625 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '60585f41-fa48-4e8c-baf2-788fdc28c4ff'} Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:05.696689 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.698157 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:05.699628 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] Sep 27 01:46:05.701242 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:05.703745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Returning 404 to user: Security group 60585f41-fa48-4e8c-baf2-788fdc28c4ff does not exist Sep 27 01:46:05.703745 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-fb6bffe2-fe82-483f-aa73-00afa87cf691'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:05.704874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a9de72d-660d-415e-a37a-3593137c16e6 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/60585f41-fa48-4e8c-baf2-788fdc28c4ff" status: 404 len: 194 microversion: 2.1 time: 0.342473 Sep 27 01:46:05.716906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1814/3698] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:46:05 2022] DELETE /compute/v2.1/os-security-groups/60585f41-fa48-4e8c-baf2-788fdc28c4ff => generated 194 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:05.724460 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82ceb894-b81c-4d56-87b1-223b908d1f55 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003875 Sep 27 01:46:05.733477 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1815/3699] 10.222.0.52 () {58 vars in 1164 bytes} [Tue Sep 27 01:46:05 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 01:46:05.739065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-363077a9-1e50-4207-b7f8-9173b49fa75d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Calling method '.version_select at 0x7f24d57a1dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:06.016218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:06.025569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b88cdea-d9da-4d46-b69c-5ab0e1b7ce40 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1490 microversion: 2.1 time: 0.397063 Sep 27 01:46:06.026774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1885/3700] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:05 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1490 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:06.054879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:06.055891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:06.069972 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-363077a9-1e50-4207-b7f8-9173b49fa75d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.334898 Sep 27 01:46:06.070730 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1816/3701] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:46:05 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:06.075511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.076347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.079082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.082938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.084996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.088118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Calling method '.version_select at 0x7f24d5fa6160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:06.090032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.173310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'pause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state paused Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 13 Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:06.177672 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: {"pause": {}} Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:06.179198 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'pause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state paused Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'pause': {}}} Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state paused. Cannot pause while the instance is in this state. Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:06.180026 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state paused Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state paused Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.181778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'pause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state paused {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:06.183245 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5efe3f6-a1ad-4559-bb04-bd54911d16f3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 143 microversion: 2.1 time: 0.129197 Sep 27 01:46:06.187055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1886/3702] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:06 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 143 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:46:06.200809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:06.201434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:06.212102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.212600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.213045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.218414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.222565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.223755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.349940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:46:06.351030 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 27 01:46:06.351030 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Request method failure captured: Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-security-groups/93ba9d9d-e3e9-4d01-9142-5f816874684c HTTP/1.1 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlXdse8ddSVV_1NMb49pyDwA83tjTTNDgU-WGSZ6rNdBfDDREZyeT0S67oTCYgQecFZQ8fF9aKn0afhO9_WD4aueLwJCtPJ3JliUNaDZ10prnRRa8qelMTIedVPK5ULm0j1XI5fkurw6cjTl-KISqYkXloHUxZFHAKUv6c9c27ykdxM Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:06.353462 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed2521c5ccaf4a43a5feb161a48cb5d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 8c2cd73fc9ea4882aff1b9971802c9f0 Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: exception: Insufficient rights for removing default security group. Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.355206 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '93ba9d9d-e3e9-4d01-9142-5f816874684c'} Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.356335 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.357925 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.359614 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.361397 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:06.361397 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:06.361397 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 27 01:46:06.361397 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] Sep 27 01:46:06.361397 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.363345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 27 01:46:06.363345 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-19d37dde-ed3d-4fe1-b85a-bc14b359bbbe'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:06.364537 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f24448a-660e-482e-9f7b-d90eb97412c2 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/93ba9d9d-e3e9-4d01-9142-5f816874684c" status: 400 len: 182 microversion: 2.1 time: 0.281328 Sep 27 01:46:06.368778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1817/3703] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:46:06 2022] DELETE /compute/v2.1/os-security-groups/93ba9d9d-e3e9-4d01-9142-5f816874684c => generated 182 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:46:06.372611 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ecea962-e9b1-4a3c-9590-650ea94d3adf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.184107 Sep 27 01:46:06.378866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:06.379795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:06.388222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1887/3704] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:06 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:46:06.401130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.402025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.403665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.407540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.408270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.409693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.412756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Calling method '.version_select at 0x7f24d6766a60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:06.523807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:46:06.524833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Neutron security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:46:06.525898 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] HTTP exception thrown: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.525898 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Request method failure captured: Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-security-groups/412d0593-f8d2-46d1-8eff-4d7c64695d15 HTTP/1.1 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlXdse8ddSVV_1NMb49pyDwA83tjTTNDgU-WGSZ6rNdBfDDREZyeT0S67oTCYgQecFZQ8fF9aKn0afhO9_WD4aueLwJCtPJ3JliUNaDZ10prnRRa8qelMTIedVPK5ULm0j1XI5fkurw6cjTl-KISqYkXloHUxZFHAKUv6c9c27ykdxM Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:06.528187 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed2521c5ccaf4a43a5feb161a48cb5d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 8c2cd73fc9ea4882aff1b9971802c9f0 Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.529868 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '412d0593-f8d2-46d1-8eff-4d7c64695d15'} Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.530890 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.532772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:06.534426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] Sep 27 01:46:06.536892 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:06.539217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Returning 404 to user: Security group 412d0593-f8d2-46d1-8eff-4d7c64695d15 does not exist Sep 27 01:46:06.539217 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-90e5a5fe-4357-4046-a70c-445b412f2a92'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:06.540050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5473c74e-55c9-4c5e-8d1b-b39bc6e28d59 tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/412d0593-f8d2-46d1-8eff-4d7c64695d15" status: 404 len: 194 microversion: 2.1 time: 0.147547 Sep 27 01:46:06.540773 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1888/3705] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:46:06 2022] GET /compute/v2.1/os-security-groups/412d0593-f8d2-46d1-8eff-4d7c64695d15 => generated 194 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:06.553782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:06.554814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:06.576277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.577263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.577976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.580367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:06.590399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:06.591394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:06.933911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:06.965461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:06.971968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:06.977171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:06.983202 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa665d9d-67e2-4794-b07f-3621ec7b8fef tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.612796 Sep 27 01:46:07.008226 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab57ee6a-1e21-464c-8be0-f37155de4df4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1497 microversion: 2.1 time: 0.465984 Sep 27 01:46:07.013101 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1818/3706] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:06 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:07.014071 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1889/3707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:06 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1497 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:07.019579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Action: 'update', calling method: .version_select at 0x7f24d5782ee0>, body: {"security_group": {"name": "tempest-sg-178419936", "description": "tempest-description-1234528268"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:07.050137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:07.051401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:07.055506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG neutronclient.v2_0.client [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist", "detail": ""}} {{(pid=128779) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:46:07.056692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.security_group_api [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Neutron security group be750333-ac59-48ba-9adf-4ef044fe8f7b not found {{(pid=128779) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:46:07.057569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] HTTP exception thrown: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.057569 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.072151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:07.072661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:07.073106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:07.073851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:07.074317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:07.074759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Request method failure captured: Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/os-security-groups/be750333-ac59-48ba-9adf-4ef044fe8f7b HTTP/1.1 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 101 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlXdse8ddSVV_1NMb49pyDwA83tjTTNDgU-WGSZ6rNdBfDDREZyeT0S67oTCYgQecFZQ8fF9aKn0afhO9_WD4aueLwJCtPJ3JliUNaDZ10prnRRa8qelMTIedVPK5ULm0j1XI5fkurw6cjTl-KISqYkXloHUxZFHAKUv6c9c27ykdxM Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:07.075240 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed2521c5ccaf4a43a5feb161a48cb5d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed2521c5ccaf4a43a5feb161a48cb5d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed2521c5ccaf4a43a5feb161a48cb5d5 Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279 Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 8c2cd73fc9ea4882aff1b9971802c9f0 Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1297466279-project Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: {"security_group": {"name": "tempest-sg-178419936", "description": "tempest-description-1234528268"}} Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:46:07.076688 n-d-859358-1 devstack@n-api.service[128779]: exception: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'be750333-ac59-48ba-9adf-4ef044fe8f7b', 'body': {'security_group': {'name': 'tempest-sg-178419936', 'description': 'tempest-description-1234528268'}}} Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:46:07.077551 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 27 01:46:07.078686 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.079864 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] Sep 27 01:46:07.081100 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:07.088965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] Returning 404 to user: Security group be750333-ac59-48ba-9adf-4ef044fe8f7b does not exist Sep 27 01:46:07.088965 n-d-859358-1 devstack@n-api.service[128779]: Neutron server returns request_ids: ['req-007ce67f-ed38-49d5-b18b-1be09308a73d'] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:07.093114 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d08c0134-7f49-4cca-accb-fca973f85a5d tempest-SecurityGroupsNegativeTestJSON-1297466279 tempest-SecurityGroupsNegativeTestJSON-1297466279-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/be750333-ac59-48ba-9adf-4ef044fe8f7b" status: 404 len: 194 microversion: 2.1 time: 0.075831 Sep 27 01:46:07.103292 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1819/3708] 10.222.0.52 () {60 vars in 1290 bytes} [Tue Sep 27 01:46:07 2022] PUT /compute/v2.1/os-security-groups/be750333-ac59-48ba-9adf-4ef044fe8f7b => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:07.191854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:07.192393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:07.192790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:07.193252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lazy-loading 'fault' on Instance uuid e05a170d-7b98-42e6-b37e-544f5f99078b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:07.295802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:07.328594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:07.330485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c171fd79cc57437fa1048733a17aba08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7615b03b04864814bd5266cea580c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:07.342184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e21a8999-9202-45bd-8295-f004e27661a7 tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 200 len: 1544 microversion: 2.91 time: 0.314497 Sep 27 01:46:07.348304 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1890/3709] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:07 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:08.013491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:08.014691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:08.040059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.042981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:08.043326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.043792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.044187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:08.044521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.044996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.047543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.056438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.060759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.061508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.068847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.069655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.070995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.108434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:08.562564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:08.574701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:08.576895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:08.578322 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5ab8cbe-0780-4d06-81a4-068b09700bfb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.569876 Sep 27 01:46:08.579588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1820/3710] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:08 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:08.586229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:08.587176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] [instance: e05a170d-7b98-42e6-b37e-544f5f99078b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:08.598468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.599198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.600605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.601568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.602225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.602831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.627502 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] HTTP exception thrown: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Request method failure captured: Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b HTTP/1.1 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUXW50PyufW6GEQqy5d9RR7xwgvFXq0avnDkK2O6HwdbOOSPeL5WXDLEbMRmjWz0YIXWyGO0054_6ADRgq4NUq6oKUiXBa1SP0dbKX0P1_faq-kZ53sPADCDMbYg48yuG927Pc1fpR7USQc4Ru9_oMOG8bLkl0NHUdv9hbloCHrQJg Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.91 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7615b03b04864814bd5266cea580c6af Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-919704046 Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:08.631229 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7615b03b04864814bd5266cea580c6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7615b03b04864814bd5266cea580c6af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7615b03b04864814bd5266cea580c6af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7615b03b04864814bd5266cea580c6af", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-919704046 Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7615b03b04864814bd5266cea580c6af Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-919704046 Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-UnshelveToHostMultiNodesTest-919704046-project Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c171fd79cc57437fa1048733a17aba08 Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-919704046-project Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. Sep 27 01:46:08.633047 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'e05a170d-7b98-42e6-b37e-544f5f99078b'} Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:08.634099 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. Sep 27 01:46:08.635726 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:08.642043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] Returning 404 to user: Instance e05a170d-7b98-42e6-b37e-544f5f99078b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:08.643174 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db546314-3182-46f8-8e88-8bfedb93ed1d tempest-UnshelveToHostMultiNodesTest-919704046 tempest-UnshelveToHostMultiNodesTest-919704046-project] 10.222.0.52 "GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b" status: 404 len: 111 microversion: 2.91 time: 0.061700 Sep 27 01:46:08.643958 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1821/3711] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:08 2022] GET /compute/v2.1/servers/e05a170d-7b98-42e6-b37e-544f5f99078b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:46:08.723214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:08.733014 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5da0cca2-03be-4b71-82eb-2455847584ee tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.694523 Sep 27 01:46:08.736580 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1891/3712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:08 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:08.770436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:08.771265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:08.780353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.781231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.783375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:08.784300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:08.785714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:08.786509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.299096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:09.317250 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93cb9665-94e0-46b0-a992-4fb8463ecef0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.541773 Sep 27 01:46:09.320937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1822/3713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:08 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:09.348989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:09.354376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:09.371053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.371947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.372608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.373629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.374311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.374966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.428103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action HTTP/1.1 Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 28 Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:09.446327 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: {"reboot": {"type": "SOFT"}} Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:09.447850 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '48354f0c-9436-4e58-9c2b-ee3c7bc37022', 'body': {'reboot': {'type': 'SOFT'}}} Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:09.448768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:09.450147 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:09.454708 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:09.454708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:09.454708 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4fc32e24-5436-479e-b2f8-889c47c771a8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action" status: 404 len: 111 microversion: 2.1 time: 0.104383 Sep 27 01:46:09.460368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:09.460991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:09.473427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.482189 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1892/3714] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:09 2022] POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:09.486126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.486605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.487368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.487896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.488339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.608346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:09.608975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:09.618578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.619085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.627634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.633967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:09.635573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:09.638820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:09.964159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:09.975029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54e669de-dbb1-4f3a-b49b-fa561d9e5d19 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.522083 Sep 27 01:46:09.979559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1823/3715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:09 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:10.009109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:10.010416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:10.024808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:10.025578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:10.030376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:10.031500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:10.032192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:10.032839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:10.974542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:10.988476 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c506fbb7-38e8-4df2-88ce-2b0140774cb8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.983137 Sep 27 01:46:10.993872 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1824/3716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:10 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:11.018444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:11.022402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: fc9097e9-a6ff-4d76-be85-fec329bbec77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:11.038407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/fc9097e9-a6ff-4d76-be85-fec329bbec77/action HTTP/1.1 Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 28 Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:11.043067 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: {"reboot": {"type": "SOFT"}} Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:46:11.045398 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'fc9097e9-a6ff-4d76-be85-fec329bbec77', 'body': {'reboot': {'type': 'SOFT'}}} Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:11.046856 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. Sep 27 01:46:11.048252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:11.053462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance fc9097e9-a6ff-4d76-be85-fec329bbec77 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:11.055440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-345757bb-12b3-4c23-b050-8c16021f24cc tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/fc9097e9-a6ff-4d76-be85-fec329bbec77/action" status: 404 len: 111 microversion: 2.1 time: 0.043390 Sep 27 01:46:11.057188 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1825/3717] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:11 2022] POST /compute/v2.1/servers/fc9097e9-a6ff-4d76-be85-fec329bbec77/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:11.071407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:11.073561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:11.091811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.092592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.094591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.098041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.098626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.099465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.357748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:11.397492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:11.401712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:11.403190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f9900f8-c691-4bd3-8b07-35e62c39d8a4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 1.798856 Sep 27 01:46:11.405501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1893/3718] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:09 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:11.414446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:11.417767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:11.431361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.434426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.435143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.442330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.443049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.443705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.512495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:46:11.694385 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5cdacd0f-00fb-431f-b317-7e56351b3239 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "DELETE /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 204 len: 0 microversion: 2.1 time: 0.287412 Sep 27 01:46:11.694983 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1894/3719] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:46:11 2022] DELETE /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:46:11.714962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:11.715679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:11.731963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.740223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.740950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.743310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.745610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.746286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.757276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:11.766020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e60c915-ad2d-493c-9729-c05982a69d0f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.704272 Sep 27 01:46:11.770723 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1826/3720] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:11 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:11.799253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:11.800899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:11.811320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.814481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.815173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.816724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:11.818583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:11.820820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:11.975936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:11.986174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d0f959a-3f17-4aeb-b733-a7d6db19577d tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1683 microversion: 2.1 time: 0.275373 Sep 27 01:46:11.990611 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1895/3721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:11 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1683 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:12.339134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:12.380307 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a233ce5c-3e0a-454d-9a33-1fc33a7c4945 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.585003 Sep 27 01:46:12.386961 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1827/3722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:11 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:12.411366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:12.417035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:12.436759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.445025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.445025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.445301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.445749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.453837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.461087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:12.461916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:12.477754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.478197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.478640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.479356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.479816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.480248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.482377 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action HTTP/1.1 Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 65 Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:12.491794 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:12.493203 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '48354f0c-9436-4e58-9c2b-ee3c7bc37022', 'body': {'rebuild': {'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27'}}} Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:12.494165 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:12.495403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:46:12.496728 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:12.498620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:12.499733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d411d6c4-dea5-4fd3-af07-9e1e73f70b01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action" status: 404 len: 111 microversion: 2.1 time: 0.096115 Sep 27 01:46:12.500848 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1896/3723] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:12 2022] POST /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:12.508785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:12.513150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:12.522541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.523122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.523641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.524562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.525800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.526469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.804691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:12.813862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-049d27e5-80ce-49a8-9589-05dd10ff8e28 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.308662 Sep 27 01:46:12.817799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1897/3724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:12 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:12.845984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:12.846605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:12.861245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.862042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.862670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:12.863739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:12.864191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:12.864749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.009648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.024393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.027837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.036041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-380fbcba-7655-467e-badb-8edcebb1774b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.600695 Sep 27 01:46:13.041503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1828/3725] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:12 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:13.054129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:13.055242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:13.062796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:13.064815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.066080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.067206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.068274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.070007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.070662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.280612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.292471 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32824e80-54be-404d-918e-d633d6be257e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.452039 Sep 27 01:46:13.310527 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1898/3726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:12 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:13.321482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:13.324911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 79610fb0-ce94-41c3-920d-d867e2a83ffe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:13.339154 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/79610fb0-ce94-41c3-920d-d867e2a83ffe/action HTTP/1.1 Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 65 Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:13.349869 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:13.351276 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '79610fb0-ce94-41c3-920d-d867e2a83ffe', 'body': {'rebuild': {'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27'}}} Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:13.352335 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:13.353694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:13.354975 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:13.354975 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:13.354975 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. Sep 27 01:46:13.354975 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:13.356793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 79610fb0-ce94-41c3-920d-d867e2a83ffe could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:13.358082 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51a07873-28fa-4755-b98e-6a2d7df206a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/79610fb0-ce94-41c3-920d-d867e2a83ffe/action" status: 404 len: 111 microversion: 2.1 time: 0.042300 Sep 27 01:46:13.362160 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1899/3727] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:13 2022] POST /compute/v2.1/servers/79610fb0-ce94-41c3-920d-d867e2a83ffe/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:13.370963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:13.376281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:13.392947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.393873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.395101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.397176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.398074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.398987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.458894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.480854 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0ccc544-ac16-42d6-917a-2081bb11e52f tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1683 microversion: 2.1 time: 0.432084 Sep 27 01:46:13.482651 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1829/3728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:13 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1683 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:13.898646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:13.907906 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1257a82-c8db-49a8-bf4a-d43ab2232392 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.543684 Sep 27 01:46:13.926843 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1900/3729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:13 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:13.945502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:13.947127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:13.962001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.962935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.965059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:13.969122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:13.970148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:13.970821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.206314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1870634128", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:14.318996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:46:14.319838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:46:14.320540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:46:14.321183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:46:14.322667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:46:14.363416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.366225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.367573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.373172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.373990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.375124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.441846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Getting quotas for project 34eb810f2eb04e28b93828e2b7908eb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:46:14.447560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Getting quotas for user ca01455afbcf4220af1487045e3370b4 and project 34eb810f2eb04e28b93828e2b7908eb6. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:46:14.475997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:46:14.478399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:46:14.599352 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6a2b1c0-f5b7-42af-b7df-27d75b1cd553 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.724236 Sep 27 01:46:14.601776 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1830/3730] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:46:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:46:14.613686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:14.614593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:14.636751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.637458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.638165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.640362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.641423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.642039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.911462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:14.924230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e811faa2-ee49-4a8a-83cf-c11576863f89 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.986454 Sep 27 01:46:14.927545 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1901/3731] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:13 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:14.936088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:14.942486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:14.953201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.957916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.958429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:14.959184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:14.959649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:14.960074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:15.276165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.293132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.298229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.300556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-096b4768-9f36-460c-b49d-867948ba62c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.697091 Sep 27 01:46:15.305519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1831/3732] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:14 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:15.321838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:15.324702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:15.358325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.368055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a9e3aab-765d-4d87-adfc-938bb5c78414 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1683 microversion: 2.1 time: 0.439159 Sep 27 01:46:15.389015 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1902/3733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:14 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1683 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:15.402477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:15.403345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 42ee9d1e-8e24-492f-87b0-8e761caca3d2] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:15.406697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:15.410130 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/42ee9d1e-8e24-492f-87b0-8e761caca3d2/action HTTP/1.1 Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:15.419625 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: {"restore": {}} Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:15.421324 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '42ee9d1e-8e24-492f-87b0-8e761caca3d2', 'body': {'restore': {}}} Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:15.422247 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. Sep 27 01:46:15.423501 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:15.426464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 42ee9d1e-8e24-492f-87b0-8e761caca3d2 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:15.435938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c55198c-8953-4f27-be53-736ce669bc6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/42ee9d1e-8e24-492f-87b0-8e761caca3d2/action" status: 404 len: 111 microversion: 2.1 time: 0.037361 Sep 27 01:46:15.442286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1903/3734] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:15 2022] POST /compute/v2.1/servers/42ee9d1e-8e24-492f-87b0-8e761caca3d2/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:15.457477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:15.458817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:15.491368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:15.492103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:15.492774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:15.492907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.494199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:15.494911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:15.496697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:15.508586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.512595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:15.516889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-736c582d-8fbc-4e72-935f-b440597310f2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1278 microversion: 2.54 time: 0.208425 Sep 27 01:46:15.528379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1832/3735] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:15 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:16.043305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:16.070038 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8176bd2d-733b-43d9-bdeb-42522a19f071 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.623207 Sep 27 01:46:16.072296 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1904/3736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:15 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:16.098891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:16.099798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:16.333714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:16.334249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:16.355817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:16.360626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:16.363968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:16.370568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:16.375437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:16.377106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:16.939538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:16.941729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:16.942442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:16.943328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:16.944263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:16.944872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.016672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.033238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.040633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.043158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93c77759-a94d-4124-8cfd-44f51039d700 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.713937 Sep 27 01:46:17.045484 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1905/3737] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:16 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:17.054600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:17.059439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:17.075994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.077854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.080355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.084392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.085225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.087380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.202468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.204461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.205150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.206007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lazy-loading 'fault' on Instance uuid 74dcb45f-119a-413c-bc1e-e0699e25285f {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:17.246929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.256446 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6c2a07f-edf1-40f2-a04c-865ca08bdd59 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 1.162200 Sep 27 01:46:17.257526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1833/3738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:16 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:17.275045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:17.276017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:17.293221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.294718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.295408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.297449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.299485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.301069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.345228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c031568af44507940568f7d2e14085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31e4a8e1db94013be04c1ebfc32c6c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.361891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bdf68589-29f2-4d1c-9415-c2b9a5201a74 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 200 len: 1332 microversion: 2.1 time: 0.314197 Sep 27 01:46:17.365789 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1906/3739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:17 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 1332 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:17.378862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dcb45f-119a-413c-bc1e-e0699e25285f", "name": "network-vif-deleted", "tag": "a4c916da-24cf-44b8-8816-d209db0cb8f7"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:17.430682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.434461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.435586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.460812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] Creating event network-vif-deleted:a4c916da-24cf-44b8-8816-d209db0cb8f7 for instance 74dcb45f-119a-413c-bc1e-e0699e25285f on n-h1-859358-1 Sep 27 01:46:17.468591 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-08456cb6-76e8-44f6-8766-4f9c7e1b9402 req-dee9459c-f87e-449c-bf5d-d7315c3cc3e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099213 Sep 27 01:46:17.470004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.470884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1907/3740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:17.479135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:17.480096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:17.490841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.491641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.492388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.493651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.494527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.495213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.497934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.499517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:17.500699 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec589a5c-b1e7-4489-8af4-5475c8312fd5 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1338 microversion: 2.54 time: 0.241904 Sep 27 01:46:17.501254 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1834/3741] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:17 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1338 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:17.512015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2388316d-1d83-4b88-a024-4040f98b3d48"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:17.514435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:17.536589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'restore' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:17.537067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.537887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.538333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.539044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.539501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.539929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:17.541654 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: {"restore": {}} Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:17.543056 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'restore' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'restore': {}}} Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state active. Cannot restore while the instance is in this state. Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:17.543883 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:17.545188 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:17.546171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'restore' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:17.551098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-138eb1ff-ff3c-42f0-a433-1d74a6f001e4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 145 microversion: 2.1 time: 0.077890 Sep 27 01:46:17.553216 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1908/3742] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:17 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:46:17.565901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:17.566884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:17.587268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.587906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.588510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.589065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:17.591071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:17.591527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:17.964076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:17.983720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.000555 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69e973df-cb7c-4b28-b559-4754fba05d25 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.443342 Sep 27 01:46:18.015321 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1909/3743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:17 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:18.230601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-110c1d11-b116-4abc-8c59-176cddea60a4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721617 Sep 27 01:46:18.232115 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1835/3744] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:46:17 2022] POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:18.244930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.245838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:18.256084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.256778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.257409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.258416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.258884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.259545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.323321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.328149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.328641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.331583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.333648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.336238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.337967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.392888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6fc878ed-a298-4c12-9eab-33e198b35be6 tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.376132 Sep 27 01:46:18.401027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1910/3745] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:18.407347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.408266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:18.417029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.417647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.418332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.419270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.419939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.420939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.424432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:18.509114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.525824 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27e1e788-96ab-477a-9c1b-9a82bd6e0ba0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.290214 Sep 27 01:46:18.526097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1836/3746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:18.553607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.560322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] [instance: 74dcb45f-119a-413c-bc1e-e0699e25285f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:18.578015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.578812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.579580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.583073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.584964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.587595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.620256 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] HTTP exception thrown: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Request method failure captured: Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f HTTP/1.1 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUvdqrg12-dXpMKS2_Mc8fEPGsNxc7dRaABov27CRCnHw_2drH8v3G508RDxuf7SrK-g6AXsrM7trMLdSNvp93VpXbbBB3vYJB0cX50rK3KNYbZ15xtfrH14Yxef51xfTH4XAgyxJ-j9hkKiuVUTgoflIX0YSQiUAR00ErcRHfzP2g Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a31e4a8e1db94013be04c1ebfc32c6c9 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:18.630966 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a31e4a8e1db94013be04c1ebfc32c6c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a31e4a8e1db94013be04c1ebfc32c6c9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a31e4a8e1db94013be04c1ebfc32c6c9 Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-928115391 Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesAdminNegativeTest-928115391-project Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 34c031568af44507940568f7d2e14085 Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesAdminNegativeTest-928115391-project Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. Sep 27 01:46:18.632597 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '74dcb45f-119a-413c-bc1e-e0699e25285f'} Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:18.633514 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. Sep 27 01:46:18.634944 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.638486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Returning 404 to user: Instance 74dcb45f-119a-413c-bc1e-e0699e25285f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:18.639523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61ecedb3-cbc8-4223-b8ad-bc8746ae0134 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f" status: 404 len: 111 microversion: 2.1 time: 0.092649 Sep 27 01:46:18.646838 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1837/3747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/servers/74dcb45f-119a-413c-bc1e-e0699e25285f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:18.655668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.659806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.663976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.664669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.669990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.671386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.672089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.707656 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87b5ed89-9945-4970-bb3b-b3665e36fc4c tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=n-d-859358-1" status: 200 len: 578 microversion: 2.1 time: 0.059087 Sep 27 01:46:18.708860 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1838/3748] 10.222.0.52 () {58 vars in 1172 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/os-services?host=n-d-859358-1 => generated 578 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:18.717830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.719138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:18.730432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.731197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.732026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.733852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.734883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.735833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.832135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.852963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.857094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.859271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad4e29a0-6181-412c-8571-4017330c8746 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.456078 Sep 27 01:46:18.875886 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1911/3749] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:18.887090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:18.888088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: f169ead8-ce9e-4da1-b727-a9faeb71fe49] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:18.898038 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/f169ead8-ce9e-4da1-b727-a9faeb71fe49/action HTTP/1.1 Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 14 Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:18.910532 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: {"resume": {}} Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. Sep 27 01:46:18.912068 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f169ead8-ce9e-4da1-b727-a9faeb71fe49', 'body': {'resume': {}}} Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:18.913264 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. Sep 27 01:46:18.914569 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:18.917593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance f169ead8-ce9e-4da1-b727-a9faeb71fe49 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:18.918733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.918978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b439ae9d-306f-4227-9d58-bec7b31d6b7a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/f169ead8-ce9e-4da1-b727-a9faeb71fe49/action" status: 404 len: 111 microversion: 2.1 time: 0.036333 Sep 27 01:46:18.920116 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1912/3750] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:18 2022] POST /compute/v2.1/servers/f169ead8-ce9e-4da1-b727-a9faeb71fe49/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:18.929316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3da99ed7-887b-4bad-b3e4-12e6f4402911 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] Calling method '.version_select at 0x7f24d61eaf70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.943808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.954793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:18.955956 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d15f592-aaec-457d-8312-d095f9c8e405 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1336 microversion: 2.54 time: 0.245778 Sep 27 01:46:18.961795 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1839/3751] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:18.971743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:18.979686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.983482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.986197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:18.988609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:18.994028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:18.994793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.006298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3da99ed7-887b-4bad-b3e4-12e6f4402911 tempest-VolumesAdminNegativeTest-928115391 tempest-VolumesAdminNegativeTest-928115391-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380817621" status: 202 len: 0 microversion: 2.1 time: 0.081511 Sep 27 01:46:19.008112 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1913/3752] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380817621 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:46:19.026971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:19.034394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:19.048402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.052223 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60c29447-96f3-41f9-8146-e739e317140d tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085887 Sep 27 01:46:19.055002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.055716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.056699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.058295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.061740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.064038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1840/3753] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 01:46:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:19.069273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:19.080138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.084880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.085551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.086241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.086700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.087116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.147757 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7f700fd-10f7-4ff6-af63-7b8e5c7afbaa tempest-ServicesAdminTestJSON-604973670 tempest-ServicesAdminTestJSON-604973670-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.082540 Sep 27 01:46:19.157523 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1841/3754] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:19 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:19.336795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:19.352125 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6e7d339-7c86-471f-9315-c8f392817bf0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.342564 Sep 27 01:46:19.353457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1914/3755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:19 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:19.388337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:19.388970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:19.414260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.414769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.415218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.427199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.429647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.433382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.836396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:19.871645 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9340060d-df24-4281-82f8-88c04ffc9510 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.489512 Sep 27 01:46:19.880305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1842/3756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:19 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:19.899543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:19.901797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:19.906344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:19.907173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:19.918482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.919375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.920058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.921010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.921714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.922361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.934763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.940282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.941931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.943972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:19.944938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:19.948485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:19.994209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'resume' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 14 Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:46:19.996377 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: {"resume": {}} Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:46:19.997926 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'resume' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'resume': {}}} Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state active. Cannot resume while the instance is in this state. Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:19.998823 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:46:20.000210 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:46:20.001388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'resume' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:20.002149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15b63cd9-49e0-4482-8dcd-5a30d8520e58 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 144 microversion: 2.1 time: 0.100542 Sep 27 01:46:20.003940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1843/3757] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:19 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 144 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:46:20.011764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:20.016020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:20.032768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.033397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.033855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:20.035199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.035655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.036077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:20.169003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.186586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.188299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.198341 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13bd2658-9c36-417d-bc0a-fecbdb0a4c53 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1336 microversion: 2.54 time: 0.190613 Sep 27 01:46:20.202287 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1844/3758] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:20 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1336 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:20.219623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:20.222566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:20.246502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.248944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.249780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:20.251178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.253565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.255064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:20.700104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.713920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.715383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.716588 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-878e29c3-7b72-46f1-a77b-54be8d58b505 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.821257 Sep 27 01:46:20.754547 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1915/3759] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:19 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:20.898713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:20.914529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-303405eb-31b9-4dee-9cfa-cf1e7d9e1f74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.710627 Sep 27 01:46:20.917560 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1845/3760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:20 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:20.944664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:20.947910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:20.978810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.980625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.981323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:20.982959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:20.985878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:20.986863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.231011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:21.232433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:21.253179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.258255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.259053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.260903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.261655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.264557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.400180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:21.415088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:21.417259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:21.419048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b11c9c96-c3be-4a97-82d5-3d51c5791fa2 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1336 microversion: 2.54 time: 0.192277 Sep 27 01:46:21.420770 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1846/3761] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:21 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:21.522830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:21.532010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51c7a961-3e5e-4c7e-bad2-b3454a7e0799 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.592355 Sep 27 01:46:21.533179 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1916/3762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:20 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:21.746912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:21.747527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:21.759471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.759962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.760395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.761095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.761604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.792140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.850159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24707c78-4bae-46ba-95eb-0642df1b1e51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24707c78-4bae-46ba-95eb-0642df1b1e51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 160 Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:21.854176 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "62292327-c629-4d4e-864a-c80a2131f473"}]}} Sep 27 01:46:21.855899 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'networks': [{'uuid': '62292327-c629-4d4e-864a-c80a2131f473'}]}}} Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:21.857031 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:46:21.858695 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:46:21.860316 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:46:21.860316 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:21.863994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24707c78-4bae-46ba-95eb-0642df1b1e51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:21.865043 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24707c78-4bae-46ba-95eb-0642df1b1e51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024655 Sep 27 01:46:21.881964 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1917/3763] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:46:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:46:21.892643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:21.893252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:21.916790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.917286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.917774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:21.918490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:21.918938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:21.930261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.242097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:22.255481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-79ee053a-1d35-4adb-80f3-16ac75421a51 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.365480 Sep 27 01:46:22.256573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1918/3764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:21 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:22.283755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:22.284750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:22.296768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.298928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.300861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.302952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.303628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.304232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.524907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:22.543170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:22.546317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:22.551278 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d363c12c-a056-41a8-aeac-150380463cbe tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.805502 Sep 27 01:46:22.552240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1847/3765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:21 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:22.559013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:22.559642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:22.576231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.576719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.577216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.577979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.578430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.579409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.679742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:22.690620 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-37a02e90-3f85-4504-bbfa-0bb0d5fd791d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.408957 Sep 27 01:46:22.692901 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1919/3766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:22 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:22.719179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:22.724711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 70b4c910-f22a-4bfb-8473-12bd2d7c2dba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:22.734827 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/70b4c910-f22a-4bfb-8473-12bd2d7c2dba/action HTTP/1.1 Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 14 Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:22.742320 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: {"shelve": {}} Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. Sep 27 01:46:22.744017 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '70b4c910-f22a-4bfb-8473-12bd2d7c2dba', 'body': {'shelve': {}}} Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:22.745088 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:22.746671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 70b4c910-f22a-4bfb-8473-12bd2d7c2dba could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:22.751996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2bdccbc-a9c1-4015-b2d7-db5051951f6e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/70b4c910-f22a-4bfb-8473-12bd2d7c2dba/action" status: 404 len: 111 microversion: 2.1 time: 0.032215 Sep 27 01:46:22.756027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1920/3767] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:22 2022] POST /compute/v2.1/servers/70b4c910-f22a-4bfb-8473-12bd2d7c2dba/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:22.765712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:22.766334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:22.781846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.782345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.782792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:22.783511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:22.783977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:22.784974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.285549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:23.302723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:23.311221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:23.313008 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-453bd823-2706-454b-863d-9b978eed6ffc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1357 microversion: 2.54 time: 0.759762 Sep 27 01:46:23.316199 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1848/3768] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:22 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1357 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:23.325195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:23.329589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:23.341871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.343032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.343833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.345268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.345983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.347197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.567894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:23.580746 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d03c1601-2ec0-406c-8a53-4c6d3d845474 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.823239 Sep 27 01:46:23.582718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1921/3769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:22 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:23.595546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39551cfa-7c4f-4286-9342-853d95763b34 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Action: 'create', calling method: .version_select at 0x7f24da735ee0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1914910641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv+w+qpabD+1Bgfyv9Q4YNAZeCq2QniJHjMdFO+sN8Y08tih2+/IrQq6N13i9mdXSafomcvdtAKc8SaPJIzG+7hVnjSmUJn72cjX6JmK8SakTzVQ0deZct1MBi2KSZ8Lw=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:23.641915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-39551cfa-7c4f-4286-9342-853d95763b34 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Getting quotas for project 34eb810f2eb04e28b93828e2b7908eb6. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:46:23.649016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-39551cfa-7c4f-4286-9342-853d95763b34 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Getting quotas for user ca01455afbcf4220af1487045e3370b4 and project 34eb810f2eb04e28b93828e2b7908eb6. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:46:23.684035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39551cfa-7c4f-4286-9342-853d95763b34 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.099333 Sep 27 01:46:23.685595 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1922/3770] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:46:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:46:23.713847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:23.717638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:23.737074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.738394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.738788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:23.741120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.742320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.743120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.743760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.750095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c66f2234-b329-43f4-aa19-7ff6bfc85e76 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.432551 Sep 27 01:46:23.754018 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1849/3771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:23.762102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:23.767303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:23.783175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.784937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.787735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:23.789046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:23.791829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:23.792671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.107611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:24.121692 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-982f8df4-fbca-480d-b9a9-632232329dcf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.362982 Sep 27 01:46:24.122315 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1850/3772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:23 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:24.136863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1914910641", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:24.150101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:24.166287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.170528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.171524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.172589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.175610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.176269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.226935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:24.245227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:24.248347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:24.252709 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9365636f-8dd3-4787-beea-3a3de72c57c1 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.554172 Sep 27 01:46:24.255142 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1923/3773] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:23 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:24.278554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-955181065"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:24.284367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:24.298750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.299591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.300929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.304301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.305064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.308800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.392125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:46:24.393769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:46:24.394580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:46:24.395006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:46:24.395430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:46:24.595604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:24.604806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.605661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.606276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.607182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.608476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.609751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.646014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ccf5d98-1008-44e3-bea2-7312261efd0e tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "POST /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06/action" status: 202 len: 1140 microversion: 2.54 time: 0.519746 Sep 27 01:46:24.647416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1851/3774] 10.222.0.52 () {62 vars in 1320 bytes} [Tue Sep 27 01:46:24 2022] POST /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06/action => generated 1140 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 27 01:46:24.653075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:24.653982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:24.661891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.663013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.664049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.665938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.666639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.667545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.693059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:24.699709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'flavor' on Instance uuid 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:24.795464 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98057c24-7183-4fab-a423-25775ccfc2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.538615 Sep 27 01:46:24.818451 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1924/3775] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:24 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 27 01:46:24.840715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:24.843060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:24.870097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.895471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.902864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:24.906115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:24.914288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:24.915650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.211042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:25.222498 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8366f318-1fbc-4350-8c49-63b4b9c8ae3c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.572828 Sep 27 01:46:25.223914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:25.226798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:25.228871 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1852/3776] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:24 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:46:25.246859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05b87424-795c-4ddb-a5ff-3ef0854b1a58 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.423123 Sep 27 01:46:25.248904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1925/3777] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:24 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:25.259524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:25.261795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:25.266104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:25.269304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:25.295743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.296455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.297764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.301529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.302302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.302928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.307126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.308458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.321154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.321154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.321154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.321154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.503809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:25.635987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:25.647131 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f36aa508-1b07-4b7d-a2cd-4858304ec82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.415169 Sep 27 01:46:25.651417 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1853/3778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:25 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:25.664647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:25.667354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:25.683905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.686099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.686819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.688949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.690200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.691332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.842530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:25.855971 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9083c221-c72c-496f-8556-e3a1f8e044ca tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.605938 Sep 27 01:46:25.856811 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1926/3779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:25 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:25.861591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "83e451ef-fe7f-4e7b-851d-9bd4130b3f12"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:25.887730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:25.888521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:25.889205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:25.914487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] Creating event network-vif-plugged:83e451ef-fe7f-4e7b-851d-9bd4130b3f12 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:25.929606 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bd60a110-968c-4412-9aba-8d093ab8aac5 req-1c4eb50c-599d-44d8-88b8-cec1a50f5f68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071081 Sep 27 01:46:25.930422 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1927/3780] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:26.063260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.082693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.085728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.086986 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88584023-ed83-4c39-b937-956ffcdf9491 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.433291 Sep 27 01:46:26.106132 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1854/3781] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:25 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:26.169146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1005046460", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:26.243292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:46:26.278434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:26.279132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:26.286034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.286524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.286965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:26.287938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.288398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.288829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:26.413223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.423325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.428581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.430462 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3c5435e-bac6-4d4a-bede-10e160188182 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.155824 Sep 27 01:46:26.431827 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1855/3782] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:26 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:26.673556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:26.674195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:26.684863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.685388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.685834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:26.686552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.687013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.687449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:26.862819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:26.872860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c19748e-8535-4f13-a0bf-8649337dcd43 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1687 microversion: 2.1 time: 0.203255 Sep 27 01:46:26.874347 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1856/3783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:26 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:26.880446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:26.881368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:26.888294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.889087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.889842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:26.890742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:26.891392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:26.892022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.059775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.076627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78b51bf9-200a-4236-a329-84206f69aa1d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.200536 Sep 27 01:46:27.077835 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1857/3784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:26 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:27.121253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:27.122594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:27.130402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.131268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.131892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.133318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.133975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.134565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.219758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:46:27.220300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:46:27.220652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:46:27.221069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:46:27.221565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:46:27.236281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.236787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.237801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.238542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.239058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.239424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.285369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Getting quotas for project 0e7bceb2b0074dda91bda793e4dae1d3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:46:27.294925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Getting quotas for user 50c5aefc8164443e9dd673cc3ca09f4a and project 0e7bceb2b0074dda91bda793e4dae1d3. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:46:27.336507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:46:27.336507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:46:27.364819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.375998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.377567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.379506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fcec98d-3ac2-4c55-b288-56ef0ddf0846 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.263001 Sep 27 01:46:27.380553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1858/3785] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:27 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:27.444861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2b81b41-4fe4-4dec-a43a-6bb952d6cce5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512955 Sep 27 01:46:27.463259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:27.464224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:27.468789 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1928/3786] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:46:27.472480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.478741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.479270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.480093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.480626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.481125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.488132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d7dadb6-806b-4ac9-86c4-322331779454 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:27.488798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d7dadb6-806b-4ac9-86c4-322331779454 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:27.622725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.638408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.640524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.642513 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-696af14b-ea50-4a88-8b1d-61498840f7b3 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.188540 Sep 27 01:46:27.644331 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1859/3787] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:27 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:27.901134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d7dadb6-806b-4ac9-86c4-322331779454 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:27.903353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:27.903986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:27.913287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.913873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.914430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:27.915251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:27.915777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d7dadb6-806b-4ac9-86c4-322331779454 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1214 microversion: 2.1 time: 0.445935 Sep 27 01:46:27.916255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:27.916631 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1929/3788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:27 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1214 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:27.916759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.094756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.101867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:28.102478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:28.118304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7c4909e-590a-4cf4-8c30-213770847fc1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1687 microversion: 2.1 time: 0.219321 Sep 27 01:46:28.118808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.119286 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1860/3789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:27 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:28.119429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.119730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.120425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.120878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.121308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.154671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "2f06025e-abb7-45cf-8f89-9f6dac7a80f9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:28.176515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.177000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.177474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.203957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] Creating event network-vif-plugged:2f06025e-abb7-45cf-8f89-9f6dac7a80f9 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:28.212347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9b0212bd-2e1e-4f07-9f07-481cd6994bea req-23b4a8c6-90f2-4576-9384-b70775e87a2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061883 Sep 27 01:46:28.214106 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1861/3790] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:28.411687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:28.412786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:28.430664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.431145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.431568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.441684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.443060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.457003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.500820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.513291 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ee040d4-2eaa-469e-aa8b-105130646472 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.415179 Sep 27 01:46:28.515701 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1930/3791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:28 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:28.672384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:28.680379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:28.703206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.704516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.705209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.706256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.706929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.710787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.885533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.903861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.912130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.918363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-822530a0-f481-498a-878b-06e35463deb7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.248309 Sep 27 01:46:28.922794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1931/3792] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:28 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:28.944231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.950996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:28.954510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:28.966404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.966987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.968430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.969118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.969963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:28.971111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fdf17d07-1796-4ab8-908e-c053aa3b6e19 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.566929 Sep 27 01:46:28.971232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:28.971746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:28.972251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:28.986464 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1862/3793] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:28 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:29.152316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:29.152963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:29.156042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:29.165096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.165917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.166616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:29.167503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.168064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:29.168487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.169081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:29.190483 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09d664dc-fea2-458f-a28b-7a94a1bebe99 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1266 microversion: 2.1 time: 0.253685 Sep 27 01:46:29.192555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1932/3794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:28 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:29.521238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:29.535038 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76a2d7d0-eca9-46c1-bf48-1e9999921393 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.396120 Sep 27 01:46:29.545679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:29.547014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:29.550374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1863/3795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:29 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:29.554140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.554658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.555083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:29.555783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.556233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.556654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:29.951356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:29.952321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:29.963986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.966146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.967464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:29.969983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:29.970681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:29.971989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.094022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:30.096820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:30.110128 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd3c1080-1271-4551-b353-c2ebbc384ff8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.569983 Sep 27 01:46:30.111370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1933/3796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:29 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:30.121433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:30.123269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:30.130346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:30.138704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.139209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.142434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.144828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.146489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.146960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.150118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:30.162263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:30.167354 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c59907c7-3c01-4aa0-9f77-075c8e6212cc tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.222596 Sep 27 01:46:30.171591 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1864/3797] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:29 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:30.213628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:30.214604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:30.218284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:30.232673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.236737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.238113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.244641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.245839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.247900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.432441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:30.441398 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eeee6590-0f93-465d-99bb-6053e8825cb4 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1272 microversion: 2.1 time: 0.232053 Sep 27 01:46:30.449684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1865/3798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:30 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:30.454671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "f614e123-3043-4e23-911c-17972ccd15fd"}, {"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "2ff3212d-e1ec-465b-ad65-471fe445567b"}, {"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "daa72d51-9283-4a45-9a26-05910ede5e8b"}, {"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "8e78f337-4d92-4245-a3bb-b449d93a8ff3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:30.476081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.479202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.479768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.505030 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Creating event network-vif-plugged:f614e123-3043-4e23-911c-17972ccd15fd for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:30.508720 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Creating event network-vif-plugged:2ff3212d-e1ec-465b-ad65-471fe445567b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:30.509443 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Creating event network-vif-plugged:daa72d51-9283-4a45-9a26-05910ede5e8b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:30.511436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] Creating event network-vif-plugged:8e78f337-4d92-4245-a3bb-b449d93a8ff3 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:30.523054 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-df190644-edc6-4ea8-9097-7d03210b3550 req-40f5614a-d404-4590-8944-f46407d5b0a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.071903 Sep 27 01:46:30.525867 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1866/3799] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:30.564742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:30.566232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:30.580587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.583830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.584394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:30.585246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:30.585838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:30.586650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.051790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:31.069597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:31.075403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:31.078727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85832212-9a29-4b98-aa4d-91f96f7bc03f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.966101 Sep 27 01:46:31.082174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1934/3800] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:30 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:31.136376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:31.137262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:31.153578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.157542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.161281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.163374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.166643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.169456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.660850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:31.677768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53910e4e-8584-45d6-9f59-d88bca53369c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.545421 Sep 27 01:46:31.678381 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1935/3801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:31 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:31.700465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:31.703247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:31.731620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.736239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.738043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.741417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.743543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.747607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.849112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:31.858327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62747da5-3cc7-49b7-bf27-d19074ed9ac1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 1.298614 Sep 27 01:46:31.864557 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1867/3802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:30 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:31.873098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:31.884430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:31.900465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.900465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.901825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.905587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:31.906165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:31.908452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:31.922513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:32.047197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:32.078770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:32.081789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:32.086757 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00c82374-4104-4c1e-a103-4292eb1ef353 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.406942 Sep 27 01:46:32.098254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1936/3803] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:31 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:32.120540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:32.128406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:32.156230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:32.156590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:32.157167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:32.159739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:32.162288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:32.164681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:32.664346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:32.681769 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcdb261f-02bf-419b-87d8-865cb382b944 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.812827 Sep 27 01:46:32.682372 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1868/3804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:31 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:32.700358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-plugged", "status": "completed", "tag": "b3bb06e2-fbe1-490a-b20e-57de6d615186"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:32.723730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:32.725593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:32.726279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:32.743855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] Creating event network-vif-plugged:b3bb06e2-fbe1-490a-b20e-57de6d615186 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:32.751435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bfd79acd-88d1-4b42-a9bc-918f3d3f3bba req-e3d24d29-180e-4d1f-96d5-0e66aba6c51c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056084 Sep 27 01:46:32.752703 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1869/3805] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:46:32.761555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:32.762689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:32.788063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:32.788677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:32.792310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:32.793194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:32.794146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:32.794589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.281305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.291028 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e2f87fa-0c8f-4d7b-b8bd-2d2bfad8ec5c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.536619 Sep 27 01:46:33.297194 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1870/3806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:32 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:33.319463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:33.321213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:33.334324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.338518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.339972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.341088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.341978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.342584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.631370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.647029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0acdcd93-8d4e-4a39-b305-c376197ed82e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.341900 Sep 27 01:46:33.650737 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1871/3807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:33 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:33.668427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:33.671140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:33.690605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.693681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.694981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.696079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.697787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.699455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.880608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.894401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.903278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.906968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.907341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.913829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:33.915451 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-126a44bf-5e2c-4e06-9974-74136f32b98a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.263705 Sep 27 01:46:33.916287 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1872/3808] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:33 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:33.918986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f8869a1-9d4a-4683-9109-8356dc711a51 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 1.802374 Sep 27 01:46:33.933387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1937/3809] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:32 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:33.952733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:33.953755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:33.963926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.967597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.968358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:33.972171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:33.977164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:33.977876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.247117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b33e1e0-584e-44fa-9acc-3371e6fcd529", "tag": "cde34b2a-afca-4c1c-9203-0990b1c1b22f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:34.275430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:34.277402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.277901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.294236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.303411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:34.319578 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02e96706-1a98-400e-af41-63e47b533fc5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.384357 Sep 27 01:46:34.321099 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1873/3810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:33 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:34.332433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:34.334340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:34.344975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.345783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.346501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.349147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] Creating event network-changed:cde34b2a-afca-4c1c-9203-0990b1c1b22f for instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 on n-h1-859358-1 Sep 27 01:46:34.369774 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-505f7966-c3e9-445f-b885-00d5b20ec008 req-74a51b5b-fb3e-472f-8c57-efd036ec7759 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123570 Sep 27 01:46:34.371955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.378235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.378498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.382863 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1938/3811] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:34.537906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:34.542881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:34.552510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.553102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.553808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.554623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.555191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.555698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.615593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'flavor' on Instance uuid ed495a20-430a-4b48-86ba-5518488b5f1e {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:34.741005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:34.752583 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25584e84-3cfa-4cc2-b5b6-0a5c84d3c8e7 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.427863 Sep 27 01:46:34.756720 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1874/3812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:34 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:34.778345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:34.780638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:34.787146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.788102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.788730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.789650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.790270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.790883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.914366 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-21062994-7066-4742-8dcc-4e76b9834d06 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/action" status: 200 len: 32 microversion: 2.1 time: 0.381453 Sep 27 01:46:34.919473 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1939/3813] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:46:34 2022] POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/action => generated 32 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:46:34.928976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-plugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:34.959901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:34.960389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:34.960821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:34.978731 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] Creating event network-vif-plugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:46:34.994877 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-002a5faa-08cd-4c22-bc42-b9c99bf80a55 req-b7aa5ff3-7985-44d6-afbe-1e3a12a3d0f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073858 Sep 27 01:46:34.996093 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1940/3814] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:35.001935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:35.003129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:35.022837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.023625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.024243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.025148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.025795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.026390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.175048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.186267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4459272-ace8-499e-bc9a-d33a52b4329a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.411519 Sep 27 01:46:35.207476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1875/3815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:34 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:35.218425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:35.225665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:35.239437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.241483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.242205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.245270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.246044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.247831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.434071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.447547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.451995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.456748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cae7b2e4-00fe-4268-9ad0-c7452a1dcac4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.245234 Sep 27 01:46:35.473262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1876/3816] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:35 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:35.485907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:35.486589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:35.494696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.495225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.495667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.496444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.496964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.497450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.637014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.649721 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ff40a7f-df8d-475f-a079-2a12c7b906b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.649051 Sep 27 01:46:35.650366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1941/3817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:34 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:35.672122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:35.673197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:35.685628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.686386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.687019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.687901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.689118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.689743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.915148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.935030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.938493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:35.938493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f823357e-00e9-45b2-8f64-69e706865b56 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1872 microversion: 2.32 time: 0.458987 Sep 27 01:46:35.940807 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1877/3818] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:35 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1872 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:35.946311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:35.946937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:35.953892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.954389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.954837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:35.955546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:35.956050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:35.956484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.178632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.189627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e22eaac5-865d-4638-b846-cd537d56fb62 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.247106 Sep 27 01:46:36.190525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1878/3819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:35 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:36.219326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:36.220508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:36.231195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.231698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.232148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.234296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.234810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.235251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.312711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.320833 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-136a96a1-d210-492b-aca6-70a9b52b9132 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.654079 Sep 27 01:46:36.321425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1942/3820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:35 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:36.395234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.403934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c75be7aa-a9fa-45cb-8f85-dab215fd6f5a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.188381 Sep 27 01:46:36.417363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1879/3821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:36 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:36.492578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:36.493196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:36.501063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.501829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.502358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.503517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.505887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.506459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.630671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.644912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.646519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.647816 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69cad54b-7d8b-4370-878b-6cb4892c89ba tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.161842 Sep 27 01:46:36.649223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1943/3822] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:36 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:36.681533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:36.682822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:36.692514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.693028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.693734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.694476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.694944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.695386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.849923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:36.862032 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa77d582-da46-4981-b9b3-d233fe8b72b7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.183085 Sep 27 01:46:36.862032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1880/3823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:36 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:36.964267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:36.965216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:36.983341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.985703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.985703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:36.985703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:36.985703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:36.986079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.216013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:37.216820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:37.227941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.229580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.230230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.234219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.234906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.235496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.261405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:37.400931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.415158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f37c36d-d676-49ec-b3be-a36c4273584b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.206848 Sep 27 01:46:37.429963 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1881/3824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:37 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:37.439385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:37.441082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:37.454250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.455323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.456474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.457380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.457985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.458559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.619670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.629633 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8019d3f-9376-4076-97e9-ade1d5914989 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.198391 Sep 27 01:46:37.636130 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1882/3825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:37 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:37.649154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:37.650155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:37.657672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.659121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.659828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.660986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.661472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.662084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.853011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.862743 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02f7839b-6208-414d-aafd-7014dab74f5f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.223204 Sep 27 01:46:37.878435 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1883/3826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:37 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:37.885061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:37.885879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:37.892945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.894165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.894706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.895709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:37.896289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:37.896807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:37.913922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:37.962778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.978479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.982487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.986490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:37.988587 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ceb7340b-56c6-4f6b-a0ca-091dc1d7ae62 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2823 microversion: 2.32 time: 1.028123 Sep 27 01:46:37.989456 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1944/3827] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:36 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2823 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:37.999691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:38.000531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:38.016371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:38.018060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:38.019399 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b798d81-8295-422e-95f4-dff849fddd09 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.139549 Sep 27 01:46:38.023251 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1884/3828] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:37 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:38.029896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.031263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.031951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.032839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.033754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.035060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.041045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:38.041899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:38.053316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.056157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.056710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.057767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.058341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.058874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.087407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:38.223349 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59fef20d-d79f-43dd-977a-593807e59ce5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.196872 Sep 27 01:46:38.225439 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1885/3829] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:46:38 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f/os-interface => generated 1830 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:38.444343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:38.445091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:38.470392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.471860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.479771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.483813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.484583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.485364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.517062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:38.544605 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6be0bf7d-28c2-4812-a1c7-5175d48477b6 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.552080 Sep 27 01:46:38.558332 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1945/3830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:37 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:38.652043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:38.652664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:38.665825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.669438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.674186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.675232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:38.677982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:38.678689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:38.910886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:38.922741 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d81f7806-ba2d-4d48-a502-31cb1419aad1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.482387 Sep 27 01:46:38.923645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1886/3831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:38 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:39.079843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c1ad53d-2753-4698-85ac-3836b03bfc9f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Action: 'create', calling method: .version_select at 0x7f24d58eb430>, body: {"keypair": {"name": "tempest-keypair-1124612091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbMfiJ6uBcmUeWvzp2hgXPWryLU8NahySwSWI+hSEvyQOsAVgpPvdiLufO/OWPisRjg5J2cA8ksHEq6vG6E1V3A/UyUQLSJ/FGN1tiHBcRK1Ocsql0XuB8qMQ9Q89lbUQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:39.124728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c1ad53d-2753-4698-85ac-3836b03bfc9f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:46:39.134832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c1ad53d-2753-4698-85ac-3836b03bfc9f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for user 02ca1ec526fc44b69f52626ce3731ac6 and project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:46:39.195742 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c1ad53d-2753-4698-85ac-3836b03bfc9f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270926 Sep 27 01:46:39.202358 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1887/3832] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:46:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:39.202358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:39.202358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:39.225085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.225470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.227954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.228693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.229168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.231431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:39.234799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.248862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5afcee58-08fc-4749-8a12-9cc8b94d91ca tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.596318 Sep 27 01:46:39.253857 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1946/3833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:38 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:39.265571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:39.280675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:39.314750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.320402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.320855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.327235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.328554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.329017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.500031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:39.517245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:39.519064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:39.520432 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-10933da1-16de-41f4-8895-27000e7d01c0 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.265040 Sep 27 01:46:39.521529 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1947/3834] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:39 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:39.578128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:39.579029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:39.588759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.593792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.595539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.599493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.602568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.604699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.851617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:39.865565 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de9de123-39e9-4f5c-bcef-bf6f9bf81e8b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.662801 Sep 27 01:46:39.881367 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1888/3835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:39 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:39.947664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:39.948337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:39.958568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.959121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.959575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:39.960302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:39.960773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:39.961210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.105164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:40.143802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9175c013-ff9a-46e9-a09c-33f7309532fd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.566249 Sep 27 01:46:40.165485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1948/3836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:39 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:40.277850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:40.278544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:40.286789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.287287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.287982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.288678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.289134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.289595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.377692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:40.387946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f62b2b8f-4249-4b14-a519-5f28b6f88bc1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.442486 Sep 27 01:46:40.388885 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1889/3837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:39 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:40.547975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:40.548600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:40.555593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.556090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.556532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.557245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.558237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.558237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.723844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:40.738837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:40.740405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:40.741746 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbeb0725-f4a5-4eaf-bd24-b1869faf50a6 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.197792 Sep 27 01:46:40.755631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1890/3838] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:40 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:40.770499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "tag": "b3bb06e2-fbe1-490a-b20e-57de6d615186"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:40.794201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.806047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.806900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.819539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] Creating event network-changed:b3bb06e2-fbe1-490a-b20e-57de6d615186 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:46:40.836868 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f820247b-7613-4ce1-951a-631cf92c86e8 req-e636d318-6ee8-4296-ad29-d88528ea0c15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070597 Sep 27 01:46:40.837754 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1891/3839] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:40.896183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:40.896899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:40.911228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.916556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.917404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:40.918671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:40.919363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:40.919964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.103675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:41.110302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:41.125789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e227560-83b2-4081-92d4-34b45a90c650 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.851938 Sep 27 01:46:41.131984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1949/3840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:40 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:41.180536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:41.181578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:41.194968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.197020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.197730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.199279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.201803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.202562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.296137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:41.309330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f246ca3a-0fd5-4879-923f-289cc9e33736 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.419140 Sep 27 01:46:41.315547 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1892/3841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:40 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:41.417375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:41.418443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:41.437463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.438018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.441479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.445309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.449694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.450612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.843997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:41.855426 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e7404f7-d8d7-4924-9102-c02db0402b18 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.439914 Sep 27 01:46:41.857911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1893/3842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:41 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:41.869534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:41.875066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:41.881303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:41.889363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.890003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.890557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.894984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:41.895586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:41.896253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9e764f4-46c9-4141-99af-1aadc659e2f1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.724649 Sep 27 01:46:41.896387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:41.897126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1950/3843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:41 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:42.041950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:42.051252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:42.059022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:42.060437 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d31113d-0734-4036-9c19-b7527a3c6208 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.200826 Sep 27 01:46:42.065734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1894/3844] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:41 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:42.162773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:42.163739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:42.170233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.170948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.171543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.172438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.173055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.173697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.339871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:42.340667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:42.350077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.359901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.360528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.361496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.362694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.363252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.880514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:42.909201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-879e87eb-7019-4b51-8c15-074c8bc45002 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.741577 Sep 27 01:46:42.932026 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1951/3845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:42 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:42.937485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:42.938122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:42.946320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:42.956025 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-466d3d4e-e71e-46c5-b7f8-ffda7fbec71b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.620417 Sep 27 01:46:42.958727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.959949 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1895/3846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:42 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:42.970913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.972381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.973778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:42.984011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:42.986448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:42.988686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:42.992789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:43.005423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.016468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.020276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.022222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.024629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.025393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.381754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:43.392023 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-58ea525a-1465-42da-a330-3e1d035b7109 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1532 microversion: 2.1 time: 0.458487 Sep 27 01:46:43.413141 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1952/3847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:42 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1532 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:43.425999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:43.426641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:43.441877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.445758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.446278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.447034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.447602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.447922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.591848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:43.631663 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a15fece5-4e40-4150-9bd5-328a13387afd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.666299 Sep 27 01:46:43.632627 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1896/3848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:42 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:43.737353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:43.749712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:43.755473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:43.757049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c23a978-8f0a-4156-9706-ff8ac482dee8 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.342803 Sep 27 01:46:43.761200 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1953/3849] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:43 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:43.942219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:43.943100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:43.956902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.960242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.960938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.962547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:43.964405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:43.966029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:43.987883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:43.989650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:44.010066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.012043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.015334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.016319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.019893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.021805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.297291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:44.309430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8909b2e8-5e2e-4bc7-9ac7-8c6582ee7cb5 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.373346 Sep 27 01:46:44.311196 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1897/3850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:43 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:44.416326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:44.416954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:44.434192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.434780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.435949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.436725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.443686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.445669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.587117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:44.596422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-761bb0a6-fc35-4c30-82e4-2ee10542a8c6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.617660 Sep 27 01:46:44.599423 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1954/3851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:43 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:44.661163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:44.663029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:44.677724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.682506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.684453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.687903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.692176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.693089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:44.899852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:44.934461 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-119cc008-d400-49df-9dc5-4e4a6cdd9220 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1532 microversion: 2.1 time: 0.521685 Sep 27 01:46:44.946202 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1898/3852] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:44 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1532 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:44.960644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:44.962679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:44.995453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:44.998295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:44.999033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.002063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:45.003516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:45.005271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.156995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:45.169654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:45.171363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:45.172802 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-78bac0fb-3f91-4efa-9bc5-9d03c90a03f7 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.224538 Sep 27 01:46:45.176526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1899/3853] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:44 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:45.335758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:45.336779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:45.350105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:45.352742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:45.354415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.364078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:45.365394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:45.366144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.542567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:45.552070 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08e3e0ed-e41b-498c-99a7-ea1cf63d772a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.895938 Sep 27 01:46:45.565419 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1955/3854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:44 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:45.628044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:45.628670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:45.646400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:45.647056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:45.648139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.648379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:45.658689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:45.659263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:45.990993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.003751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba928025-72b4-4925-a0d1-1a3c721e964c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.673294 Sep 27 01:46:46.023812 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1900/3855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:45 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:46.029113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:46.043021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:46.048767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.050468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.051136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.052875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.058592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.059473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.060075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.060205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b90ace3-4543-449a-88e8-9195a89a967d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.436944 Sep 27 01:46:46.060692 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1956/3856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:45 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:46.100310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b33e1e0-584e-44fa-9acc-3371e6fcd529", "name": "network-vif-plugged", "status": "completed", "tag": "cde34b2a-afca-4c1c-9203-0990b1c1b22f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:46.136958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.137508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.137955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.176046 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] Creating event network-vif-plugged:cde34b2a-afca-4c1c-9203-0990b1c1b22f for instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 on n-h1-859358-1 Sep 27 01:46:46.203847 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cc82ed8e-8419-45e1-9914-086c48f5f0a5 req-854b49b5-93fd-4bf4-a979-b221b157cb9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104212 Sep 27 01:46:46.208403 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1957/3857] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:46.232369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:46.237774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:46.264613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.265873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.266324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.271547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.272031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.272473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.399776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.415145 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e6f2543-14bd-42a9-955e-885e35b27ce0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1532 microversion: 2.1 time: 0.387554 Sep 27 01:46:46.417906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1901/3858] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:46 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1532 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:46.522628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.538183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.548678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.551676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-307d2e90-b14c-404a-9396-ce8fbf7efab9 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.338829 Sep 27 01:46:46.558958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1958/3859] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:46 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:46.587893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:46.588653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:46.606704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.608769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.609575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.612940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:46.614740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:46.616319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:46.885055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:46.894514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4606a80-a91b-4f25-bbf2-b4e0fdba562b tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.311196 Sep 27 01:46:46.896362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1902/3860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:46 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:47.051405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:47.052172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:47.078184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.078833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.081023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.085281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.093007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:47.094169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:47.099414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.100182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.106774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.107492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.108193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.109222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.121986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.123520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.336774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.350631 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bce980f-a29f-4b95-a5c5-1b6baa3e1551 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.262454 Sep 27 01:46:47.351871 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1903/3861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:47.372919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.387821 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-296ab9be-82a4-4540-98e9-595c63d210af tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1314 microversion: 2.1 time: 0.341677 Sep 27 01:46:47.388419 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1959/3862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:47 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:47.444237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:47.445311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:47.472065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.472818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.473782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.475375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.476069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.476911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.509488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:47.584162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:47.584781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:47.596175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.602473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.602964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.603727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.604203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.604632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.664450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.672649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5dfbd5f1-1ca1-48a9-82f9-b2ab9a7cc7a3 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1532 microversion: 2.1 time: 0.236044 Sep 27 01:46:47.682676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1904/3863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:47 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1532 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:47.800969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.817851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.819731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:47.823482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ddfeeaa8-3538-4b46-ba1b-f11b4da1f825 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.242842 Sep 27 01:46:47.825157 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1960/3864] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:47 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:47.921016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:47.922337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:47.932291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.933710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.935536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:47.936685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:47.937888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:47.941672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.214638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:48.230088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7016477-c128-420f-ae6b-fd7dc64af152 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.313505 Sep 27 01:46:48.231216 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1905/3865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:47 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:48.372296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "name": "network-vif-plugged", "status": "completed", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:48.380272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:48.381193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:48.401111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.404994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.405773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.406665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.407443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.408121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.409027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.410054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.413423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.432405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] Creating event network-vif-plugged:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h2-859358-1 Sep 27 01:46:48.451858 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6bdb7279-838b-4e00-962f-947ed25c9493 req-6d547f56-86af-4777-bf39-3c3e74ffecbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079610 Sep 27 01:46:48.452986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1961/3866] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:48.464974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:48.470377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:48.478945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.479682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.480313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.481184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.481815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.482403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.757914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:48.770274 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d839c1bf-649a-4d04-a4c1-afd4cdd86d3d tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1463 microversion: 2.1 time: 0.315819 Sep 27 01:46:48.770870 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1962/3867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:48 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1463 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:48.820129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:48.831396 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca70901a-35dd-4018-8942-aa8b8cffa6e8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.454249 Sep 27 01:46:48.832742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1906/3868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:48 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:48.849329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:48.849992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:48.866403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.866934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.867348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:48.868286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:48.868903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:48.870384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.004708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c16439e-df59-4acf-99d1-30b0638b5b9f tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.014527 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c16439e-df59-4acf-99d1-30b0638b5b9f tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.218336 Sep 27 01:46:49.015845 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1963/3869] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:49.145271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:49.154649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a24d1b8e-f079-4365-9260-9e0962d7efef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.314666 Sep 27 01:46:49.175162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1907/3870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:48 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:49.180175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.180796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:49.182918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:49.192746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.193267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.193728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.194913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.195581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.196183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.269492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Calling method '.version_select at 0x7f24d622b820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.281672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:49.286876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.287854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.288468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.291869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:49.293364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:49.300704 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59cc668a-17a9-4974-9a97-35ce5aa0e639 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.124366 Sep 27 01:46:49.305981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.307406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.307868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.309849 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1908/3871] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:49.324957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ad6c376-b297-4457-b235-7883f9501fec tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.341720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33470710-ccc6-4a1f-bb35-3a206d6b0b39 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/0e7bceb2b0074dda91bda793e4dae1d3?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832" status: 200 len: 695 microversion: 2.1 time: 0.318021 Sep 27 01:46:49.342695 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1964/3872] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/os-simple-tenant-usage/0e7bceb2b0074dda91bda793e4dae1d3?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832 => generated 695 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:49.350195 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ad6c376-b297-4457-b235-7883f9501fec tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.039188 Sep 27 01:46:49.351055 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1909/3873] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:49.356407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.357251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:49.364157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.364643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.365081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.365930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.366381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.366796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.375832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '.version_select at 0x7f24d57acf70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.397894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:49.401371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.401983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.402656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.421171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.421927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.422955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.450060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48215d5c-54c4-4d01-90eb-881716224512 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/0e7bceb2b0074dda91bda793e4dae1d3?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832" status: 200 len: 695 microversion: 2.1 time: 0.079044 Sep 27 01:46:49.451095 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1910/3874] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/os-simple-tenant-usage/0e7bceb2b0074dda91bda793e4dae1d3?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832 => generated 695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:46:49.456145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f328c621-d44d-460f-8fd3-30faad2d8551 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.466249 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f328c621-d44d-460f-8fd3-30faad2d8551 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014010 Sep 27 01:46:49.467170 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1911/3875] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:49.473155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Calling method '.version_select at 0x7f24d6774f70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.490391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.491226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.491871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.508006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.508587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.509263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.583484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:49.594121 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-184c8551-02c4-454e-8985-b32281cf2dbe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.243520 Sep 27 01:46:49.595312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1965/3876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:49.601074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22244d72-99a2-471f-8051-2260cfa2fd5b tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.620053 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22244d72-99a2-471f-8051-2260cfa2fd5b tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022024 Sep 27 01:46:49.621232 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1966/3877] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:49.638783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83912a24-3b76-4b14-b33a-b85106a0cd18 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.670545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e18d984c-3448-4eba-a91f-bbff9ef2d759 tempest-TenantUsagesTestJSON-2038192406 tempest-TenantUsagesTestJSON-2038192406-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832&detailed=1" status: 200 len: 43429 microversion: 2.1 time: 0.201480 Sep 27 01:46:49.671554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1912/3878] 10.222.0.52 () {58 vars in 1335 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-26T01%3A46%3A48.797832&end=2022-09-28T01%3A46%3A48.797832&detailed=1 => generated 43429 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:46:49.704270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83912a24-3b76-4b14-b33a-b85106a0cd18 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.073392 Sep 27 01:46:49.716891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1967/3879] 10.222.0.52 () {58 vars in 1165 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:49.725074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.725501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:49.729921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fedc936b-1528-4c6c-9b46-b21d5a18049a tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.737884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fedc936b-1528-4c6c-9b46-b21d5a18049a tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013427 Sep 27 01:46:49.745120 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1968/3880] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:46:49.745289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.745289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.745289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.745289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.745736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.745736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.752184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfa3edc2-4f05-483b-9762-82e4e8c14498 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.777381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:46:49.804254 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cfa3edc2-4f05-483b-9762-82e4e8c14498 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.056580 Sep 27 01:46:49.812064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1969/3881] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:49.824227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4441943-3b59-4f77-9a65-38b74950b9a6 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.839248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4441943-3b59-4f77-9a65-38b74950b9a6 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019566 Sep 27 01:46:49.840036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1970/3882] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:49.854913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6f3e6a4-d887-4536-b5b6-5bb12e38e860 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.863081 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6f3e6a4-d887-4536-b5b6-5bb12e38e860 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012511 Sep 27 01:46:49.863866 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1971/3883] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:46:49.876047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:49.876669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:49.890027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.890027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.890027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.890027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:49.890552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:49.890552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:49.944815 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2760fd54-2460-41c8-83a9-b743887921c0 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 204 len: 0 microversion: 2.1 time: 0.224798 Sep 27 01:46:49.946363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1913/3884] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:46:49 2022] DELETE /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:46:49.954245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b56fc8d-e265-4ebc-8811-2a9b3188034e tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.012449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b56fc8d-e265-4ebc-8811-2a9b3188034e tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.064480 Sep 27 01:46:50.023923 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1914/3885] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.023923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.023923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:50.041838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.042610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.047792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.048708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.050830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.051368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.094300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.107360 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03f297f8-029b-43bb-a7ca-e57b4239f436 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.235116 Sep 27 01:46:50.107945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1972/3886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:49 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.118421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eaca88a1-31fb-4a77-b20e-671b2606962f tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.148685 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eaca88a1-31fb-4a77-b20e-671b2606962f tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033897 Sep 27 01:46:50.156740 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1973/3887] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:50.166665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55a3a6a5-30e0-44f8-a33b-38b33032f760 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.189250 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55a3a6a5-30e0-44f8-a33b-38b33032f760 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.030916 Sep 27 01:46:50.193109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1974/3888] 10.222.0.52 () {58 vars in 1144 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.202124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.202124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:50.210470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.210970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.211414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.212123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.212582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.215138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.261147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.278149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30445526-f285-4630-8d64-1429a8d49930 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1469 microversion: 2.1 time: 0.263617 Sep 27 01:46:50.282001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1915/3889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.286897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6268d1fd-2efc-419c-aec4-b54ab00833be tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.316283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6268d1fd-2efc-419c-aec4-b54ab00833be tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031846 Sep 27 01:46:50.317766 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1916/3890] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:50.337061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.340356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:50.350855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.351786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.352713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.353690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.354225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.354733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.445644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.462934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cde37d66-62e6-4b42-ab4c-79d78daef720 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.268713 Sep 27 01:46:50.463519 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1975/3891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.474501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64d322d0-64b5-4f97-89dc-dc071d2e63b3 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.488480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.496123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64d322d0-64b5-4f97-89dc-dc071d2e63b3 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030831 Sep 27 01:46:50.497224 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1976/3892] 10.222.0.52 () {58 vars in 1148 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.511505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.513081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d45e1be-7799-49a5-b040-e285115f13e8 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.517266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.522646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46a7b8e3-44ba-483b-a322-fd8ad07c35ac tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.190987 Sep 27 01:46:50.523874 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1917/3893] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:50.527914 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d45e1be-7799-49a5-b040-e285115f13e8 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020246 Sep 27 01:46:50.528958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1977/3894] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:50.547023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-409236cd-d237-40e4-bc40-c6252be1f50a tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.556612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-409236cd-d237-40e4-bc40-c6252be1f50a tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016163 Sep 27 01:46:50.557293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1918/3895] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:50.572419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a228ecd-c5bd-419c-9320-c74e79ced0db tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.620052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.620586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:50.624848 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a228ecd-c5bd-419c-9320-c74e79ced0db tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.055491 Sep 27 01:46:50.627680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1978/3896] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.630748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.631460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.632329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.633393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:50.635597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:50.636220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:50.644389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2d82fe4c-8401-43c8-8ec9-8c047cf655d1 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.668689 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2d82fe4c-8401-43c8-8ec9-8c047cf655d1 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031167 Sep 27 01:46:50.669298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1979/3897] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:50.690946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-064a58c7-a12c-48d1-a193-e574110b3b30 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:50.699391 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-064a58c7-a12c-48d1-a193-e574110b3b30 tempest-FlavorsV2TestJSON-1181377377 tempest-FlavorsV2TestJSON-1181377377-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012789 Sep 27 01:46:50.712774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1980/3898] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:50.810179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:50.823825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a0aa04a-1e4f-457d-9b92-ffb975cf0a4c tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.207621 Sep 27 01:46:50.824725 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1919/3899] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:50 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:51.134955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:51.135559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:51.141218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.142144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.142422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.144161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.144795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.145118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.304953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:51.306311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:51.315314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.315820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.316268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.317126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.317466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.317904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.325798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.337301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a17db1e8-cdbd-4b39-a8f2-0f432183c170 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1682 microversion: 2.1 time: 0.206244 Sep 27 01:46:51.337846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1981/3900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:51 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:51.491343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:51.491918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:51.505637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.506913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.507626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.509858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.511168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.512421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.544790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:51.605085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.616677 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bf62e8d-ad9a-4ba5-8712-1f425b0ba466 tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1469 microversion: 2.1 time: 0.315364 Sep 27 01:46:51.617950 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1920/3901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:51 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:51.624610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:51.625226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:51.632385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.632933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.633385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.634236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.634690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.635152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.736328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.746600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.748271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.749626 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36812ac9-c57d-4c3e-9bd9-852262891789 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1409 microversion: 2.54 time: 0.130630 Sep 27 01:46:51.750305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1921/3902] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:51 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:51.777981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:51.793210 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84416dc1-f08e-432e-8db0-d9141708c2f6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.306645 Sep 27 01:46:51.794269 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1982/3903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:51 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:51.849468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:51.850893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:51.859186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.860105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.860707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:51.862051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:51.862526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:51.863582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.087310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:52.098991 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-008399b8-ab09-4b56-98f0-df912f3452a2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.253963 Sep 27 01:46:52.109391 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1922/3904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:51 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:52.376323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:52.377121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:52.387603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b33e1e0-584e-44fa-9acc-3371e6fcd529", "name": "network-vif-deleted", "tag": "cde34b2a-afca-4c1c-9203-0990b1c1b22f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:52.389009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.389543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.389983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.391915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.392383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.396341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.404075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.405112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.405767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.420326 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] Creating event network-vif-deleted:cde34b2a-afca-4c1c-9203-0990b1c1b22f for instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 on n-h1-859358-1 Sep 27 01:46:52.427180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ca274424-09dd-43de-8c0b-152ce0a1cedf req-3fd43c4f-a924-41d6-90eb-38a677fbf698 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043057 Sep 27 01:46:52.436295 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1923/3905] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:52.644913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:52.646642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:52.657731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.659611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.660122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.662981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.664214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.666263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.763090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.764560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.765941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.767251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lazy-loading 'fault' on Instance uuid 3b33e1e0-584e-44fa-9acc-3371e6fcd529 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:46:52.870511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c5aefc8164443e9dd673cc3ca09f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7bceb2b0074dda91bda793e4dae1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:52.888519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-692c30e9-375a-4d06-ba3f-45caa2f1fe6a tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 200 len: 1304 microversion: 2.1 time: 0.245913 Sep 27 01:46:52.903394 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1924/3906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:52 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 1304 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:46:52.915150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:52.916338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:52.929568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.931550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.932026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:52.934696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:52.934696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:52.935293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.001031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.010674 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bb17f6f9-30c9-4135-a2a0-d038cea4c704 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.638975 Sep 27 01:46:53.011651 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1983/3907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:52 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:53.016459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:53.017069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:53.023998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.029657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:53.033800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.034603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.035343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.036324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.038081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.038793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.041742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.043495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.044759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7f9b853-0e7d-4c99-9936-e642c4ade990 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1415 microversion: 2.54 time: 0.140169 Sep 27 01:46:53.053461 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1925/3908] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:52 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1415 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:53.125582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:53.127424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:53.140557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.141982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.142862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.144021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.144838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.145687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.384747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.399928 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77287bd8-a75a-4bac-a1c1-f897562168ed tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.385566 Sep 27 01:46:53.400787 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1984/3909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:53.465103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:53.479145 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3820636d-7fb4-41d0-bf3b-d3aed8da49fb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.357785 Sep 27 01:46:53.480833 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1926/3910] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:53 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:53.917146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:53.919375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] [instance: 3b33e1e0-584e-44fa-9acc-3371e6fcd529] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:53.937550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.938896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.939344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.940618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:53.941067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:53.941527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:53.972553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] HTTP exception thrown: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Request method failure captured: Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 HTTP/1.1 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlXwPm6qgAZA78Q2rTVGOoGhBrRq-K6yLAXpHCoTs4D5AWjV037QRo-Urqg9ZNLdHEhxXt926w_j8my5wBK2RT69VywXd90IwKph79cuZr7XN_SuLZwFP6_1yYEoiO8cGnpu-eLusGwoXpPEEvo27bJWL8NMzwgjb1hhR9Ju-0r2K_Y Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0e7bceb2b0074dda91bda793e4dae1d3 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TenantUsagesTestJSON-1062601427 Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:46:53.974209 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e7bceb2b0074dda91bda793e4dae1d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0e7bceb2b0074dda91bda793e4dae1d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0e7bceb2b0074dda91bda793e4dae1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0e7bceb2b0074dda91bda793e4dae1d3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TenantUsagesTestJSON-1062601427 Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0e7bceb2b0074dda91bda793e4dae1d3 Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1062601427 Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TenantUsagesTestJSON-1062601427-project Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 50c5aefc8164443e9dd673cc3ca09f4a Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TenantUsagesTestJSON-1062601427-project Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. Sep 27 01:46:53.975907 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3b33e1e0-584e-44fa-9acc-3371e6fcd529'} Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:46:53.976772 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. Sep 27 01:46:53.979418 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:46:53.980998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] Returning 404 to user: Instance 3b33e1e0-584e-44fa-9acc-3371e6fcd529 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:46:53.982119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18fa2301-8d55-4b3c-97b7-2113bbe3f49c tempest-TenantUsagesTestJSON-1062601427 tempest-TenantUsagesTestJSON-1062601427-project] 10.222.0.52 "GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529" status: 404 len: 111 microversion: 2.1 time: 0.069539 Sep 27 01:46:53.983365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1985/3911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:53 2022] GET /compute/v2.1/servers/3b33e1e0-584e-44fa-9acc-3371e6fcd529 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:46:54.075463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:54.076375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:54.088772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.089622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.090699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.093237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.094289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.094850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.429695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:54.431143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:54.454209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.457266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.459413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.461943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.463138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.464624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.627406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:54.643263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:54.651057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:54.654233 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd47bfe2-bae4-4a8a-a948-9828595c91b1 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1415 microversion: 2.54 time: 0.581981 Sep 27 01:46:54.669363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1927/3912] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:54 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1415 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:54.677272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:54.684911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:54.710395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.710892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.711339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.715890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:54.716118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:54.716521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:54.720492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:54.763069 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6313595-ae5c-469c-94b2-7bdd130f372b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.341680 Sep 27 01:46:54.767316 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1986/3913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:54 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:54.991812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:55.005036 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50087603-e2d6-42da-b3d4-775e7b96ec45 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.347758 Sep 27 01:46:55.006118 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1928/3914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:54 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:55.684408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:55.685019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:55.710776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:55.715004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:55.717691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:55.724680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:55.725561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:55.727028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:55.795283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:55.796047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:55.810284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:55.811925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:55.812395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:55.813142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:55.816092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:55.816831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:55.912227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:55.930270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:55.932832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:55.934656 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-941b8830-a722-4e5d-91a2-caa17ebae68b tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1415 microversion: 2.54 time: 0.254271 Sep 27 01:46:55.936989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1987/3915] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:55 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1415 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:56.037021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:56.037963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:56.040365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:56.055353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:56.055915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:56.056364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:56.057099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:56.057587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:56.058008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:56.141790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:56.159184 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12f71ce8-1dae-4e5d-bc1d-7f74d8761e86 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.368958 Sep 27 01:46:56.163169 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1929/3916] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:55 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:56.359343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-unplugged", "status": "completed", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:46:56.395557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:56.398707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:56.399166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:56.428822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] Creating event network-vif-unplugged:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:46:56.443829 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3cc972b3-048a-4840-a40b-796814e533f4 req-a743de14-7f4f-40ab-9ec0-5bf4bf254fc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088275 Sep 27 01:46:56.445212 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1930/3917] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:46:56.975342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:56.976109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:56.997079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:56.999436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.002793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.005755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.007183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.007914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.181397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.182651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.184346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.185979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ea677d8-cd72-4e17-8124-c0941781e308 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1400 microversion: 2.54 time: 0.225414 Sep 27 01:46:57.187035 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1931/3918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:56 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1400 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:57.192013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:57.192854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:57.200136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.200877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.201509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.202413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.203043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.203644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.278277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.295955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e9ed695-be54-455b-ba19-8283428704f4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 1.266117 Sep 27 01:46:57.314803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1988/3919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:56 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:57.320937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d431182-4b88-48e4-bdd5-5a0e6e2af74a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '.version_select at 0x7f24d611c4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:57.355432 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d431182-4b88-48e4-bdd5-5a0e6e2af74a tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1914910641" status: 204 len: 0 microversion: 2.54 time: 0.038379 Sep 27 01:46:57.356409 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1989/3920] 10.222.0.52 () {60 vars in 1319 bytes} [Tue Sep 27 01:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1914910641 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:46:57.370276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:57.371533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:57.392091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.393366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.394185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.395283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.396248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.396877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.444810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:46:57.612251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f723de79-9308-4f26-b501-333fa46ca8ea tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 204 len: 0 microversion: 2.54 time: 0.247607 Sep 27 01:46:57.614776 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1990/3921] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:46:57 2022] DELETE /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:46:57.625012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:57.626012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:57.647065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.647702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.648257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.649050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:57.649610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:57.650109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:57.798759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.806866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.813956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.821613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:57.823147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c7015d2-ec1c-42f7-9c00-f43e6ec5b2a4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1406 microversion: 2.54 time: 0.203849 Sep 27 01:46:57.823980 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed057aad-635f-458c-a90c-d014e4a4aa15 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.635625 Sep 27 01:46:57.824582 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1932/3922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:57 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:57.837964 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1991/3923] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:57 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:46:58.332288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:58.333793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:58.344680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.352615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.355337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:58.357528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.359093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.360510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:58.734535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:58.757059 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-276cc0c6-9caa-4854-b0a6-bf9a0910319f tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.439263 Sep 27 01:46:58.758947 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1933/3924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:58 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:58.861186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:58.862002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:58.862824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:58.864799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:58.880485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.883193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.883838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.884461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.886115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:58.887892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:58.891385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.891844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:58.894660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.895833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:58.896615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:58.897380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:59.234975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:59.269025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:59.275227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:59.284446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ab592dc-df9b-4e6d-bf6c-53944445662c tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1406 microversion: 2.54 time: 0.434408 Sep 27 01:46:59.297373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:46:59.298361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1992/3925] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:46:58 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1406 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:46:59.298487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13f0f8f7-5e04-46f1-9c06-91a3a865ab9e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.445421 Sep 27 01:46:59.312226 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1934/3926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:58 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:46:59.786803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:46:59.788734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:46:59.800807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:46:59.805131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:59.808230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:59.808861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:46:59.811334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:46:59.816175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:46:59.817481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:00.316107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:00.317069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:00.330159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:00.336956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:00.337490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:00.338046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:00.338767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:00.340488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:00.341298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:00.436325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:00.436859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:00.438000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:00.438477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lazy-loading 'fault' on Instance uuid eb44d70b-c330-4941-b33d-45a854d38c06 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:47:00.571622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:00.578967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:00.612977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:00.614309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9822275c-1c2f-4997-96db-fc0787697ee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.833700 Sep 27 01:47:00.618152 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1993/3927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:46:59 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:00.620691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca01455afbcf4220af1487045e3370b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34eb810f2eb04e28b93828e2b7908eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:00.627263 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bff2f822-dbb3-4ab8-be0d-8e7e715d10c4 tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 200 len: 1411 microversion: 2.54 time: 0.313946 Sep 27 01:47:00.630820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1935/3928] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:47:00 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 1411 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:47:00.632433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:00.633715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:00.644743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:00.650355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:00.651780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:00.656157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:00.657304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:00.660229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:01.051818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:01.067578 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f83cbda5-71d8-4688-bf1e-49e2898a7e80 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.445519 Sep 27 01:47:01.083613 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1994/3929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:00 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:01.644209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:01.646544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:01.660256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:01.662347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] [instance: eb44d70b-c330-4941-b33d-45a854d38c06] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:01.681784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:01.684847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:01.685664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:01.686340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:01.687914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:01.688284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:01.690358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:01.691126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:01.692388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:01.695160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:01.695859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:01.701784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:01.739008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] HTTP exception thrown: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Request method failure captured: Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 HTTP/1.1 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlXlr-HiLl2zPdpEevdkSLeuNf-3wbTPoxjQVc9bQY2Eig6RU1_3kBivnpOsnRZc-Mb6Zp6ge_Iu0zuSB1nRD4_mpkPksq9WRqeR-DctOztt_4wSXrIM3C69QfRUChUU0MRPxgZ_KVDS68WyUyBVC6f1m9qgMYxHOOBbhraK6sxiKWg Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.54 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 34eb810f2eb04e28b93828e2b7908eb6 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerShowV254Test-2140689047 Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:01.741193 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34eb810f2eb04e28b93828e2b7908eb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/34eb810f2eb04e28b93828e2b7908eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/34eb810f2eb04e28b93828e2b7908eb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_34eb810f2eb04e28b93828e2b7908eb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerShowV254Test-2140689047 Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 34eb810f2eb04e28b93828e2b7908eb6 Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerShowV254Test-2140689047 Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerShowV254Test-2140689047-project Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ca01455afbcf4220af1487045e3370b4 Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerShowV254Test-2140689047-project Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. Sep 27 01:47:01.743466 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'eb44d70b-c330-4941-b33d-45a854d38c06'} Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:01.744390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. Sep 27 01:47:01.745903 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:01.752845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] Returning 404 to user: Instance eb44d70b-c330-4941-b33d-45a854d38c06 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:01.757199 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-759b25e9-e2ec-4aa2-b095-e1dc6db48c7f tempest-ServerShowV254Test-2140689047 tempest-ServerShowV254Test-2140689047-project] 10.222.0.52 "GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06" status: 404 len: 111 microversion: 2.54 time: 0.103440 Sep 27 01:47:01.758875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1995/3930] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:47:01 2022] GET /compute/v2.1/servers/eb44d70b-c330-4941-b33d-45a854d38c06 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:47:02.024563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:02.037988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68f53c45-e265-470e-917c-8819cc8b8f13 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.398787 Sep 27 01:47:02.065410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1936/3931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:01 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:02.099166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:02.100403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:02.124588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:02.129768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:02.133504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:02.136283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:02.137931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:02.138898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:02.773808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:02.787954 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3b55a0a9-aa04-415b-8526-a02851d07482 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.694722 Sep 27 01:47:02.792996 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1996/3932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:02 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:03.068844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:03.070271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:03.082215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:03.083821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:03.087151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:03.091708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:03.093541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:03.094519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:03.498165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:03.508748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba5c5eef-e0b1-491e-802c-b7908fa6a921 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.447470 Sep 27 01:47:03.517233 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1937/3933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:03 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:03.707536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2047055394", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:03.815644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:03.816583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:03.826319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:03.827506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:03.828130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:03.829833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:03.832742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:03.833564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:04.245846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:04.260964 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0affe1e8-4d22-4e1e-8580-f97838ba3fa2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.444638 Sep 27 01:47:04.266258 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1938/3934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:03 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:04.532627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:04.533200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:04.543070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:04.543567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:04.544012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:04.544719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:04.545187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:04.545637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:04.794205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:04.804097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f6d9542-9b0b-45eb-a253-ec35eb7639cd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.274676 Sep 27 01:47:04.805226 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1939/3935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:04 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:05.293401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:05.295690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:05.313897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:05.314856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:05.317633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:05.318539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:05.320719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:05.322119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:05.619914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:05.632364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7c172dd-bac4-425c-b5ee-8b4811b66c20 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.345826 Sep 27 01:47:05.637151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1940/3936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:05 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:05.828508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:05.829414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:05.842312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:05.842810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:05.843339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:05.848106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:05.851133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:05.854153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:06.256545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:06.272041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-000840f9-511a-472d-ac0c-e02c41437d43 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.448135 Sep 27 01:47:06.276155 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1941/3937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:05 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:06.657364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:06.658998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:06.672332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:06.672839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:06.673269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:06.674759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:06.675147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:06.675636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:07.607354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:07.612391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:07.629153 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abeca673-8d7c-4fcd-bc06-ff03d22f81be tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.975767 Sep 27 01:47:07.662202 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1942/3938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:06 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:07.674927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:07.677181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:07.690778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:07.692799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:07.693371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:07.694310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:07.696022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:07.697294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:08.151790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:08.168247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cf4bc31-57f7-4031-b321-dc1254657aa7 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.498738 Sep 27 01:47:08.206105 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1943/3939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:07 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:08.222280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:08.230580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:08.249867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:08.259829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:08.261002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:08.267836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:08.270632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:08.272334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:08.570838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] validate_networks() for [('e2de58ae-986d-4494-92ee-73fbfb5b9f8d', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:08.586314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:08.599097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9be0c67-9849-42e9-abc2-1daacea1be0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.391501 Sep 27 01:47:08.602774 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1944/3940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:08 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:08.614023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b366ffa-fcf7-4e93-9b8e-042ccea0bdda tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d6bd6a60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:10.332017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:47:10.333038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:47:10.334127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:47:10.334990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:47:10.335403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:47:10.400667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:10.401515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:10.404772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:10.409932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:10.410968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:10.414913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:10.503506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Getting quotas for project 3a83889d9e154610a95d9731581eaac7. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:10.519454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Getting quotas for user 5c30541b7e1c4f36aa873067f4d0d886 and project 3a83889d9e154610a95d9731581eaac7. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:10.576003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:47:10.583132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:47:10.724924 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-149b3570-bc16-4fc4-bec1-e2373e14347f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.484550 Sep 27 01:47:10.728430 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1997/3941] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 7489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:47:10.738792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:10.739745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:10.755197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:10.758570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:10.770242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:10.771412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:10.774414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:10.794835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:11.296374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b366ffa-fcf7-4e93-9b8e-042ccea0bdda tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef" status: 200 len: 636 microversion: 2.1 time: 2.686179 Sep 27 01:47:11.298262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1945/3942] 10.222.0.52 () {58 vars in 1233 bytes} [Tue Sep 27 01:47:08 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef => generated 636 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:11.333004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:11.333835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:11.348460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:11.349840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:11.368958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:11.370258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:11.371464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:11.381729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:11.802844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:11.811982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb5b32af-bd12-4516-8aff-7b5119735876 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1735 microversion: 2.1 time: 0.509442 Sep 27 01:47:11.826616 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1946/3943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:11 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1735 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:11.848023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89166f5b-f4df-48a4-b2f6-b0e2b92c0164 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:11.848656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89166f5b-f4df-48a4-b2f6-b0e2b92c0164 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:11.861318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:11.870575 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f7ec312-814d-4dbd-80b0-3d32b4432a01 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 1.141012 Sep 27 01:47:11.879616 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1998/3944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:10 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:11.886137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:11.899248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:11.921674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:11.922189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:11.922638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:11.931284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:11.931883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:11.932337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:12.061029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89166f5b-f4df-48a4-b2f6-b0e2b92c0164 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:12.071465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89166f5b-f4df-48a4-b2f6-b0e2b92c0164 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1224 microversion: 2.1 time: 0.243728 Sep 27 01:47:12.077466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1947/3945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:11 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1224 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:12.102155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6241d467-8ef4-4021-b91d-0774f315b821 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24d5fc5040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:12.214746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6241d467-8ef4-4021-b91d-0774f315b821 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:12.225561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6241d467-8ef4-4021-b91d-0774f315b821 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:12.626144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:12.641235 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97b01fc9-2668-4874-b152-1a65204df670 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.760448 Sep 27 01:47:12.643309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 1999/3946] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:12.670849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:12.671824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:12.685069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:12.685650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:12.686100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:12.688677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:12.690160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:12.691571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:12.739249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:12.791150 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6241d467-8ef4-4021-b91d-0774f315b821 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712318 Sep 27 01:47:12.796149 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1948/3947] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:12 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:12.802501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eb6ce66-16cb-4882-b05d-45cb0ce9a2bd tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d685d4c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:13.183179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:13.193012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-688c2c28-30ad-4d41-8704-07861e2f6c55 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.527198 Sep 27 01:47:13.197617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2000/3948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:12 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:13.206526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:13.207387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:13.236628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.242306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.245881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.247484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.248167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.248886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.428265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2eb6ce66-16cb-4882-b05d-45cb0ce9a2bd tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "DELETE /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.630810 Sep 27 01:47:13.429633 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1949/3949] 10.222.0.52 () {58 vars in 1296 bytes} [Tue Sep 27 01:47:12 2022] DELETE /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_version => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:13.439584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:13.441102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:13.454422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.455293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.455840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.456667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.458248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.459695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.646709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:13.661064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93ac5c76-289e-497c-a082-12dc6c918ab0 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1715 microversion: 2.1 time: 0.460980 Sep 27 01:47:13.664537 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2001/3950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:13 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1715 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:13.685419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:13.688322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:13.717011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.717829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.719933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.722748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.724710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.725353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.894640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:13.906906 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e612408-34d5-4698-8ae5-927e5a405ac4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.475879 Sep 27 01:47:13.918278 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1950/3951] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:13 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:13.934061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:13.934964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:13.953262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.954073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.955257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:13.957611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:13.958935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:13.963368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.098296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:14.110297 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86a3a4fe-f03d-4569-a70c-6f757cf2dca5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1284 microversion: 2.1 time: 0.443612 Sep 27 01:47:14.111064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2002/3952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:13 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1284 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:14.125866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9885713-df65-4e99-b92a-f75c50133bb6 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24da56d1f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:14.217624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:14.228074 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7855dbf2-42f1-458b-a05d-fac4e96a48fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.303675 Sep 27 01:47:14.234503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1951/3953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:13 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:14.250553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:14.251502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:14.270810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.271507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.272145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.273662 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9885713-df65-4e99-b92a-f75c50133bb6 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 37 microversion: 2.1 time: 0.160040 Sep 27 01:47:14.274474 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2003/3954] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:14 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 37 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:14.275664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.278436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.278732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.285524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:14.288139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:14.302802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.308004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.308004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.308004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.315998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.318134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.529087 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Cannot 'detach_volume' instance ed495a20-430a-4b48-86ba-5518488b5f1e while it is in vm_state rescued Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments/2388316d-1d83-4b88-a024-4040f98b3d48 HTTP/1.1 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:14.530851 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:47:14.532733 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'detach_volume' instance ed495a20-430a-4b48-86ba-5518488b5f1e while it is in vm_state rescued Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'ed495a20-430a-4b48-86ba-5518488b5f1e', 'id': '2388316d-1d83-4b88-a024-4040f98b3d48'} Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed495a20-430a-4b48-86ba-5518488b5f1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:14.533682 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ed495a20-430a-4b48-86ba-5518488b5f1e while it is in vm_state rescued Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ed495a20-430a-4b48-86ba-5518488b5f1e while it is in vm_state rescued Sep 27 01:47:14.535465 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:14.539050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7050e7a0-fb93-494c-b6e0-539257214653 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.257019 Sep 27 01:47:14.539050 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2004/3955] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:14 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:47:14.542277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 409 to user: Cannot 'detach_volume' instance ed495a20-430a-4b48-86ba-5518488b5f1e while it is in vm_state rescued {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:14.543427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1a58460-baca-41dd-90eb-5d568c5e7d17 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments/2388316d-1d83-4b88-a024-4040f98b3d48" status: 409 len: 152 microversion: 2.1 time: 0.306361 Sep 27 01:47:14.560440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91a5f76e-d6f0-4670-ac35-24042475bd8e tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24da56d820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:14.566348 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1952/3956] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:47:14 2022] DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments/2388316d-1d83-4b88-a024-4040f98b3d48 => generated 152 bytes in 330 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:14.584185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:14.584969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:14.600148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:14.604832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.608343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.608952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.611582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:14.612260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:14.614664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:14.687818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-91a5f76e-d6f0-4670-ac35-24042475bd8e tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:14.694620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-91a5f76e-d6f0-4670-ac35-24042475bd8e tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:14.975221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:14.985258 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7aca9789-602f-40ca-a508-638a323421ae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1671 microversion: 2.1 time: 0.415200 Sep 27 01:47:14.993912 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1953/3957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:14 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1671 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:15.026503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:15.030754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:15.047450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.048886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.049565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.050481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.052413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.053040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.255927 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2420eb3-979d-4cfd-a309-50113f54e4c4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.258049 Sep 27 01:47:15.257847 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1954/3958] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:14 2022] POST /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:47:15.268994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:15.271254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:15.283637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.285439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.286455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.287508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.288959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.289895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.355803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91a5f76e-d6f0-4670-ac35-24042475bd8e tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.807898 Sep 27 01:47:15.356532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2005/3959] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:14 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:15.365513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:15.366596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:15.381909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.382686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.387452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.388585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.389225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.390027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.639542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:15.648686 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0bd466a-e123-436f-aa11-02491a6c812c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1282 microversion: 2.1 time: 0.290907 Sep 27 01:47:15.649282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2006/3960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:15 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:15.661926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:15.662541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:15.684800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.685302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.694090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.695118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:15.695394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:15.695828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:15.747668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:15.759857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b188a807-e1f8-4c9d-b0cd-41b234bddab8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.500428 Sep 27 01:47:15.765203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1955/3961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:15 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:15.773498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbde3586-a662-422e-911c-6d42f12f16c2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d6ce6430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:15.862064 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbde3586-a662-422e-911c-6d42f12f16c2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092520 Sep 27 01:47:15.863759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1956/3962] 10.222.0.52 () {58 vars in 1290 bytes} [Tue Sep 27 01:47:15 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_distro => generated 33 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:15.875220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51540310-dc85-43b4-900c-872598968b19 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24d5fa6d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:15.998311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-51540310-dc85-43b4-900c-872598968b19 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:16.032216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-51540310-dc85-43b4-900c-872598968b19 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:16.479298 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51540310-dc85-43b4-900c-872598968b19 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.608519 Sep 27 01:47:16.480122 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1957/3963] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:15 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:16.487007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:16.487636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:16.496772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.497591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:16.498210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:16.499218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.499838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:16.500430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:16.751145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:16.761709 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df659ffe-a014-4242-bcb2-73c2af8838fe tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1723 microversion: 2.1 time: 1.104107 Sep 27 01:47:16.781403 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2007/3964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:15 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1723 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:16.791356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2e2fc00-65a3-479c-ae1b-c75235dc5efb tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24da6584c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:16.884594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2e2fc00-65a3-479c-ae1b-c75235dc5efb tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.110036 Sep 27 01:47:16.895212 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2008/3965] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:16 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:16.917238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:16.918198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:16.925757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:16.933077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.934454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:16.935591 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43a0fdd2-3658-4b12-959a-353bb9e51fbb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1671 microversion: 2.1 time: 0.454016 Sep 27 01:47:16.935955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:16.937627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.938371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:16.939209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:16.945670 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1958/3966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:16 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1671 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:16.962487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:16.963188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:16.988430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.993381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:16.993985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:16.995169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:16.995704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:17.006024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:17.086542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:17.103664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ddbdb3bc-2413-422e-9e0e-e8278ffd136b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1282 microversion: 2.1 time: 0.205636 Sep 27 01:47:17.108030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2009/3967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:16 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:17.117069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7224a9fc-adff-4c3c-8692-3d372e5a2d2d tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24da6eaf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:17.218991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7224a9fc-adff-4c3c-8692-3d372e5a2d2d tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:17.226359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7224a9fc-adff-4c3c-8692-3d372e5a2d2d tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:17.256791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:17.268066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bbff4a1-b8dd-4c32-9cb7-0e05f1d44535 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1527 microversion: 2.1 time: 0.320262 Sep 27 01:47:17.292991 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1959/3968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:16 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1527 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:17.478158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7224a9fc-adff-4c3c-8692-3d372e5a2d2d tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.368537 Sep 27 01:47:17.479245 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2010/3969] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:17 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:17.493974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dde7006f-6d09-468c-b0a6-1ca77b54dbc8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24d69c60d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:17.576671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dde7006f-6d09-468c-b0a6-1ca77b54dbc8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:17.587537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dde7006f-6d09-468c-b0a6-1ca77b54dbc8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:17.802040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:17.803002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:17.819432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:17.820156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:17.820877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:17.821914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:17.827727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:17.830894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.133541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dde7006f-6d09-468c-b0a6-1ca77b54dbc8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 64 microversion: 2.1 time: 0.646566 Sep 27 01:47:18.135990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1960/3970] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:17 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 64 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:18.149787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:18.151675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:18.166480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.166980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.171570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.172515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.172994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.174382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.554491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:18.569199 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-164e288d-d7bd-42cc-84fb-6920076c2fc5 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1723 microversion: 2.1 time: 0.773701 Sep 27 01:47:18.573741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2011/3971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:17 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1723 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:18.586496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:18.587937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:18.603033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.603786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.604775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.605791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.610135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.611493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.670454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:18.685935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9d9acb8-0a29-4c2c-8215-b8e26eea7f79 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1671 microversion: 2.1 time: 0.542845 Sep 27 01:47:18.686639 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1961/3972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:18 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1671 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:18.706090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc819eed-b72c-4e18-ad40-d190e86de9f8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d6211670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:18.782265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc819eed-b72c-4e18-ad40-d190e86de9f8 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 64 microversion: 2.1 time: 0.093312 Sep 27 01:47:18.784006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1962/3973] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:18 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 64 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:18.794698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:18.795384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:18.809610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.810114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.810552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.811264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:18.811712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:18.818000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:18.929401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:18.941996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1105787-278c-43f7-8dd6-5a4c82451e74 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.366678 Sep 27 01:47:18.944793 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2012/3974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:18 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:18.952579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad0d448f-5196-4f95-a6bc-ee9a7f0bcca2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24da6c5940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:19.025962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ad0d448f-5196-4f95-a6bc-ee9a7f0bcca2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:19.039037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ad0d448f-5196-4f95-a6bc-ee9a7f0bcca2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:19.351747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:19.366397 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c26bd161-fbdd-4a57-98ef-d8470f0d237e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1509 microversion: 2.1 time: 0.580541 Sep 27 01:47:19.367214 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1963/3975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1509 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:19.600545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:19.600941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:19.608487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:19.610771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:19.611409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:19.613056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:19.613837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:19.614591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:19.634264 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad0d448f-5196-4f95-a6bc-ee9a7f0bcca2 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.687660 Sep 27 01:47:19.634948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2013/3976] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:18 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:19.658251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0bcce68-816d-4b2f-9a7e-df00d7e5b504 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update', calling method: .version_select at 0x7f24da6b1670>, body: {"meta": {"os_version": "alt"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:19.774490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c0bcce68-816d-4b2f-9a7e-df00d7e5b504 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:19.791914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-c0bcce68-816d-4b2f-9a7e-df00d7e5b504 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:20.037441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:20.049500 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99a12e8e-7c5e-47a9-8876-6d124ea417af tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1729 microversion: 2.1 time: 0.453298 Sep 27 01:47:20.051934 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1964/3977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:19 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1729 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:20.058232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:20.087902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.098211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.098692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.124831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] Creating event network-changed:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:47:20.130960 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-63a34c0e-4fbd-473f-80e0-25ba9e60d379 req-cd69f377-7bea-4ca6-9355-4a444b27e0a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076748 Sep 27 01:47:20.132321 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1965/3978] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:20.139877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:20.141021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:20.148860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.149760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.150361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.151513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.152308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.152934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.267276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0bcce68-816d-4b2f-9a7e-df00d7e5b504 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.623068 Sep 27 01:47:20.272989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2014/3979] 10.222.0.52 () {60 vars in 1313 bytes} [Tue Sep 27 01:47:19 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata/os_version => generated 31 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:20.273874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:20.275300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:20.283702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.285267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.286022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.287026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.288062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.288793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.482231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:20.510818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:20.523245 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2759961e-8f89-4417-b7cc-8fd87bd46821 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.389304 Sep 27 01:47:20.524603 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1966/3980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:20 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:20.529762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:20.530550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:20.538072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.538906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.539942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.540891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.541569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.542153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.547956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:20.549726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:20.569179 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0770db7-e7d3-4e5a-bcf0-c7ec1e6bf46c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.299319 Sep 27 01:47:20.570173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2015/3981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:20 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:20.575299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1d9acf7-64ec-4704-b63e-5157a169d7cd tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d61d6f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:20.637167 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1d9acf7-64ec-4704-b63e-5157a169d7cd tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 58 microversion: 2.1 time: 0.065489 Sep 27 01:47:20.638546 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2016/3982] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:20 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 58 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:20.649258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:20.651056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:20.660680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.662514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.663589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.664842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.665849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.667231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.675730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ca5fde8-f84f-4869-a1e2-b433573c87dd tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149521 Sep 27 01:47:20.677535 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1967/3983] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:47:20 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:20.689369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "name": "network-vif-unplugged", "status": "completed", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:20.709842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.710817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.713072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.739832 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] Creating event network-vif-unplugged:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h2-859358-1 Sep 27 01:47:20.753406 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-69359605-7126-416b-b4ff-3ff6625a0f13 req-baeec5f0-a224-4946-b9a6-3c5936ebdb75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073711 Sep 27 01:47:20.759256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1968/3984] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:20.769865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:20.775800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:20.790552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.791868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.792893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.794678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:20.795667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:20.797068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:20.885466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14e3aa0e-53d2-460e-bc03-a217a560ba8e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 200 len: 322 microversion: 2.1 time: 0.124262 Sep 27 01:47:20.894905 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1969/3985] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:20 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:20.901759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecf8eaf8-6a72-4df1-b3ee-b635217c24b1 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'update_all', calling method: .version_select at 0x7f24d62113a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:21.037352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ecf8eaf8-6a72-4df1-b3ee-b635217c24b1 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:21.054185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ecf8eaf8-6a72-4df1-b3ee-b635217c24b1 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:21.206570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:21.260066 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5c890b2-6d46-439c-b46d-839672a2ccf8 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1509 microversion: 2.1 time: 0.620006 Sep 27 01:47:21.285395 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2017/3986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:20 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1509 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:21.293686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:21.294697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:21.304221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:21.309538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:21.310425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:21.311046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:21.311947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:21.312755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:21.313375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:21.631722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecf8eaf8-6a72-4df1-b3ee-b635217c24b1 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 61 microversion: 2.1 time: 0.740634 Sep 27 01:47:21.633119 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1970/3987] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:20 2022] PUT /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 61 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:21.642052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:21.643313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:21.659074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:21.659867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:21.662298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:21.664042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:21.665031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:21.667013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.044548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:22.069303 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9984e09-d606-4a9b-8368-7b9e0cd0ac1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.782126 Sep 27 01:47:22.073030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2018/3988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:21 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:22.084580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6aa3ff6-43cb-460e-bce0-ac1a69fb03e5 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Action: 'create', calling method: .version_select at 0x7f24d6507160>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:22.231025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b6aa3ff6-43cb-460e-bce0-ac1a69fb03e5 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:22.238678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b6aa3ff6-43cb-460e-bce0-ac1a69fb03e5 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Getting quotas for user 89dfec701e874808b161c3e5e998e23f and project 39f7a7e62e714e52b2c27a1cdf337808. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:22.410060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:22.428994 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e95238f6-5cb2-41ff-98d8-cd03bd66da7e tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.794568 Sep 27 01:47:22.429625 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1971/3989] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:21 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:22.441912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:22.443447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:22.459115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.459891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.462052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.463170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.463643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.465532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.815401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:22.827763 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7784c94b-fc7a-4aa0-b5e0-ef39c702bf44 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.393544 Sep 27 01:47:22.831363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1972/3990] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:22.843053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:22.846725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:22.862998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.863473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.865573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.867780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.868458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.870491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.956113 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6aa3ff6-43cb-460e-bce0-ac1a69fb03e5 tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "POST /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 85 microversion: 2.1 time: 0.879741 Sep 27 01:47:22.962036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2019/3991] 10.222.0.52 () {60 vars in 1281 bytes} [Tue Sep 27 01:47:22 2022] POST /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 85 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:22.970752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:22.972324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:22.991509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.992012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.992448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:22.993160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:22.993637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:22.994060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:23.166377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:23.180035 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06299384-ca4b-4ffa-a082-0d9461ee9dff tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1452 microversion: 2.1 time: 0.346718 Sep 27 01:47:23.180631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1973/3992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:22 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1452 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:23.191374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-208ce8a3-3b7a-4cad-a629-5434f6372eca tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] Calling method '.version_select at 0x7f24d6407ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:23.262017 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-208ce8a3-3b7a-4cad-a629-5434f6372eca tempest-ImagesMetadataTestJSON-1414754462 tempest-ImagesMetadataTestJSON-1414754462-project] 10.222.0.52 "GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080314 Sep 27 01:47:23.267941 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1974/3993] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:23 2022] GET /compute/v2.1/images/c45f3652-ece7-44b7-ad8f-47b52edccfef/metadata => generated 85 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:47:23.269309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-645867191", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1cfdec1a-60a0-4038-b69b-fb87aba5c98f"}], "security_groups": [{"name": "tempest-securitygroup--308987573"}], "key_name": "tempest-keypair-1124612091", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e92f928e-e4a9-4ab2-a7ed-69d0c49cce4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:23.338262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:23.354500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bedc4736-5bdb-4a38-98f4-b8c67ae18dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.389765 Sep 27 01:47:23.359287 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2020/3994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:23.376235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:23.377108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:23.384867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:23.387373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:23.390156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:23.391141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:23.391944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:23.392795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:23.527728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] validate_networks() for [('1cfdec1a-60a0-4038-b69b-fb87aba5c98f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:23.680177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:23.691146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0c6baea-14ee-47c6-bd81-733251b931cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1452 microversion: 2.1 time: 0.330668 Sep 27 01:47:23.691730 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2021/3995] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:23 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1452 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:23.711903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:23.712772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:23.720923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:23.721680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:23.722286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:23.723293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:23.723933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:23.724528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.026261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:24.042763 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d7161d7-803e-42d3-8ae5-2306722e9187 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.348832 Sep 27 01:47:24.043638 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2022/3996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:24.077882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:24.080495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:24.096327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.097105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.101440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.102742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.103510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.104169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.559075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:24.570800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for user 02ca1ec526fc44b69f52626ce3731ac6 and project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:24.609301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:47:24.609832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:47:24.611108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:47:24.611712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:47:24.612383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:47:24.631187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.633900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.637177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.638014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.638474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.639104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.665564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:24.672059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Getting quotas for user 02ca1ec526fc44b69f52626ce3731ac6 and project f46aa42ec88e4ecfaf7f3b8c3729d87c. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:24.748670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:47:24.754271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e92f928e-e4a9-4ab2-a7ed-69d0c49cce4f',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:47:24.800328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:24.809540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38961972-a7c0-4df4-91e5-bcfafd9783df tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.749411 Sep 27 01:47:24.812046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2023/3997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:24 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:24.817083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:24.817641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:24.824815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.825584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.826246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.827478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:24.827986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:24.828590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:24.832934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:24.856963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'flavor' on Instance uuid 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:47:24.872171 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'shelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state shelved_offloaded Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 14 Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:24.874754 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: {"shelve": {}} Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:47:24.876618 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'shelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state shelved_offloaded Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'shelve': {}}} Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:24.877760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state shelved_offloaded Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:24.879428 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:24.880998 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state shelved_offloaded Sep 27 01:47:24.880998 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:24.882096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'shelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state shelved_offloaded {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:24.883241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-949ab25f-4d53-4611-bab0-0171bc7cd31f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 155 microversion: 2.1 time: 0.069920 Sep 27 01:47:24.884235 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2024/3998] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:24 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 155 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:24.890968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1342648409", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "23594c01-9d6b-41da-b812-329d1c79b6da"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:24.981043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] validate_networks() for [('23594c01-9d6b-41da-b812-329d1c79b6da', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:25.018319 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cf468ec-5467-4de8-857a-b77d1f7df181 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.752075 Sep 27 01:47:25.026546 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1975/3999] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:47:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:47:25.033862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:25.059381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:25.060486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:25.061835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:25.083244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] Creating event network-changed:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:47:25.098068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-60540abe-fa7c-4f0d-8014-3d01ed1ccb22 req-ebea2774-8b9f-461c-a32a-2bd6f2eac959 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071942 Sep 27 01:47:25.098829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1976/4000] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:25.111715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:25.112851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:25.122581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:25.130754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:25.131491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:25.132774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:25.133425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:25.134051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:25.208119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128779) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 01:47:25.355150 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f047dd8e-2d72-41a1-8b74-0dad94dd943f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.254688 Sep 27 01:47:25.358407 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1977/4001] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:25 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:47:25.374877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4689890-9a92-4ec9-aa80-58c7d141eb3e tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:25.375312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4689890-9a92-4ec9-aa80-58c7d141eb3e tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:25.862427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4689890-9a92-4ec9-aa80-58c7d141eb3e tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:25.872831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4689890-9a92-4ec9-aa80-58c7d141eb3e tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1121 microversion: 2.1 time: 0.506775 Sep 27 01:47:25.892539 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1978/4002] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:25 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1121 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:25.907633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:25.914154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:25.935133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:25.941882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:25.942721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:25.943764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:25.944492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:25.947026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.427838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:26.457101 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d804370f-d7e3-49cb-85be-42ca4f0c6309 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1460 microversion: 2.1 time: 0.563346 Sep 27 01:47:26.466604 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1979/4003] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:25 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1460 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:26.491477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:26.493102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:26.513907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.514415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.514864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.519548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.520042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.520490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.742278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:47:26.745761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:47:26.748198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:47:26.748783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:47:26.749387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:47:26.774605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.775459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.776062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.776988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.778757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.780589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.833205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:26.849063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:26.886117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:47:26.893172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:47:26.903183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:26.914117 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95e97c2c-e39f-42ea-89d0-faf925476dda tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.446395 Sep 27 01:47:26.927614 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1980/4004] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:26 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:26.943510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:26.944141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:26.957216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:26.960965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.961627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.961960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:26.962684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:26.963135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:26.969770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:27.018433 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2fb3369d-8173-4d2c-8ca4-58b39a0fdd20 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132811 Sep 27 01:47:27.020972 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2025/4005] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:47:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:47:27.032939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-abd77d8d-69aa-4931-a92e-5d4114b29382 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:27.035167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-abd77d8d-69aa-4931-a92e-5d4114b29382 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:27.299605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-abd77d8d-69aa-4931-a92e-5d4114b29382 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:27.319736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-abd77d8d-69aa-4931-a92e-5d4114b29382 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1215 microversion: 2.1 time: 0.288188 Sep 27 01:47:27.321671 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2026/4006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:27 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:27.429891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:27.446819 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d54fc7af-b96d-463b-8fa4-3aceafde89be tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1219 microversion: 2.1 time: 0.515357 Sep 27 01:47:27.448191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1981/4007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:26 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1219 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:27.483169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:27.509520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:27.510215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:27.510664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:27.557909 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] Creating event network-changed:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:47:27.575355 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b45e0126-0d48-4cf1-ba19-dcf3fc611f9f req-e396efd2-c448-4944-bba6-12de16af63d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108065 Sep 27 01:47:27.579985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1982/4008] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:27.599569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:27.607805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:27.635752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:27.639799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:27.642782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:27.643882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:27.652188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:27.653070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:27.789242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-275a9b52-a240-4e78-bf40-9168a0d30a7c tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Calling method '.version_select at 0x7f24da5565e0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:27.876988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-275a9b52-a240-4e78-bf40-9168a0d30a7c tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-275a9b52-a240-4e78-bf40-9168a0d30a7c tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/images/7a085a1d-918f-4a70-8cec-6705709bbec6/metadata/os_distro HTTP/1.1 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:27.888141 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'image_id': '7a085a1d-918f-4a70-8cec-6705709bbec6', 'id': 'os_distro'} Sep 27 01:47:27.890140 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:27.891328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a085a1d-918f-4a70-8cec-6705709bbec6 Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:27.894611 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a085a1d-918f-4a70-8cec-6705709bbec6 could not be found. Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:27.896298 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:27.898597 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:27.903775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-275a9b52-a240-4e78-bf40-9168a0d30a7c tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:27.903775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-275a9b52-a240-4e78-bf40-9168a0d30a7c tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "DELETE /compute/v2.1/images/7a085a1d-918f-4a70-8cec-6705709bbec6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.555480 Sep 27 01:47:27.903775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2027/4009] 10.222.0.52 () {58 vars in 1293 bytes} [Tue Sep 27 01:47:27 2022] DELETE /compute/v2.1/images/7a085a1d-918f-4a70-8cec-6705709bbec6/metadata/os_distro => generated 62 bytes in 557 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:47:27.947767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc40b8af-ff41-4785-8034-893c64ca0215 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Calling method '.version_select at 0x7f24da70c3a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:28.004382 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-dc40b8af-ff41-4785-8034-893c64ca0215 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc40b8af-ff41-4785-8034-893c64ca0215 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/images/f8ee138e-19b6-4be0-8c99-63ce68fcf009/metadata/os_version HTTP/1.1 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:28.007167 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: exception: Image not found. Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'image_id': 'f8ee138e-19b6-4be0-8c99-63ce68fcf009', 'id': 'os_version'} Sep 27 01:47:28.009208 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.010328 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f8ee138e-19b6-4be0-8c99-63ce68fcf009 Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.011801 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f8ee138e-19b6-4be0-8c99-63ce68fcf009 could not be found. Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:28.013438 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:28.015010 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.018874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc40b8af-ff41-4785-8034-893c64ca0215 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:28.019954 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc40b8af-ff41-4785-8034-893c64ca0215 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "GET /compute/v2.1/images/f8ee138e-19b6-4be0-8c99-63ce68fcf009/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.109655 Sep 27 01:47:28.020687 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2028/4010] 10.222.0.52 () {58 vars in 1293 bytes} [Tue Sep 27 01:47:27 2022] GET /compute/v2.1/images/f8ee138e-19b6-4be0-8c99-63ce68fcf009/metadata/os_version => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:28.031743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:28.035437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:28.058219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.059252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.061470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.064343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.065091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.066739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.107780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:28.120987 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c762e967-baff-4e36-8ec2-d8925ea2ef1f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1462 microversion: 2.1 time: 0.538490 Sep 27 01:47:28.135920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1983/4011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:27 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1462 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:28.157177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b110527-800d-4e4f-a6f3-80062d2c3433 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Calling method '.version_select at 0x7f24d6bc3790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:28.208212 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1b110527-800d-4e4f-a6f3-80062d2c3433 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b110527-800d-4e4f-a6f3-80062d2c3433 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/images/33d82688-ac78-46dc-9efa-fae38286b711/metadata HTTP/1.1 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:28.211977 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'image_id': '33d82688-ac78-46dc-9efa-fae38286b711'} Sep 27 01:47:28.213702 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.214621 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33d82688-ac78-46dc-9efa-fae38286b711 Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.215878 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33d82688-ac78-46dc-9efa-fae38286b711 could not be found. Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:28.218880 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.222088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b110527-800d-4e4f-a6f3-80062d2c3433 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:28.226838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b110527-800d-4e4f-a6f3-80062d2c3433 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "GET /compute/v2.1/images/33d82688-ac78-46dc-9efa-fae38286b711/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070328 Sep 27 01:47:28.226838 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1984/4012] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:47:28 2022] GET /compute/v2.1/images/33d82688-ac78-46dc-9efa-fae38286b711/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:28.243282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f18172da-00d8-474b-8be1-e774e19a9d71 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Action: 'update_all', calling method: .version_select at 0x7f24d588c4c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:28.281128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f18172da-00d8-474b-8be1-e774e19a9d71 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f18172da-00d8-474b-8be1-e774e19a9d71 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/images/7bc675c8-a507-4312-abad-bca32dc436ea/metadata HTTP/1.1 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 57 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:28.284279 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:47:28.285894 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'image_id': '7bc675c8-a507-4312-abad-bca32dc436ea', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.286888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7bc675c8-a507-4312-abad-bca32dc436ea Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.290957 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bc675c8-a507-4312-abad-bca32dc436ea could not be found. Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:28.292543 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:28.293985 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.295403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f18172da-00d8-474b-8be1-e774e19a9d71 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:28.295403 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f18172da-00d8-474b-8be1-e774e19a9d71 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "PUT /compute/v2.1/images/7bc675c8-a507-4312-abad-bca32dc436ea/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057201 Sep 27 01:47:28.295403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1985/4013] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:47:28 2022] PUT /compute/v2.1/images/7bc675c8-a507-4312-abad-bca32dc436ea/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:28.306428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07d53e1a-2bb5-49a1-b2ec-3a68023fb058 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Action: 'update', calling method: .version_select at 0x7f24d65bb280>, body: {"meta": {"os_distro": "alt"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:28.391746 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-07d53e1a-2bb5-49a1-b2ec-3a68023fb058 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07d53e1a-2bb5-49a1-b2ec-3a68023fb058 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/images/dc2b424c-9d54-4591-83eb-d012e21a7c6a/metadata/os_distro HTTP/1.1 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 30 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:28.399249 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: {"meta": {"os_distro": "alt"}} Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:47:28.401079 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'image_id': 'dc2b424c-9d54-4591-83eb-d012e21a7c6a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.402359 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc2b424c-9d54-4591-83eb-d012e21a7c6a Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.404724 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc2b424c-9d54-4591-83eb-d012e21a7c6a could not be found. Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:28.408464 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:28.416328 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.420410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07d53e1a-2bb5-49a1-b2ec-3a68023fb058 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:28.420410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07d53e1a-2bb5-49a1-b2ec-3a68023fb058 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "PUT /compute/v2.1/images/dc2b424c-9d54-4591-83eb-d012e21a7c6a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.114129 Sep 27 01:47:28.420410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1986/4014] 10.222.0.52 () {60 vars in 1310 bytes} [Tue Sep 27 01:47:28 2022] PUT /compute/v2.1/images/dc2b424c-9d54-4591-83eb-d012e21a7c6a/metadata/os_distro => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:28.420410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:28.420410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:28.450233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.450751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.461750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.462951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.463460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.463980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.690679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:28.699619 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64a2c61b-136d-4770-9efc-1d665c2ba8d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1219 microversion: 2.1 time: 0.287351 Sep 27 01:47:28.705670 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1987/4015] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:28 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1219 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:28.716079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99c10f49-91f1-4e9b-b292-d5ebeccaceb1 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Action: 'create', calling method: .version_select at 0x7f24d5ec84c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:28.777273 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-99c10f49-91f1-4e9b-b292-d5ebeccaceb1 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] HTTP exception thrown: Image not found. Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99c10f49-91f1-4e9b-b292-d5ebeccaceb1 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Request method failure captured: Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/images/a45dadb5-ff25-4bc4-b854-65ff75f04c1d/metadata HTTP/1.1 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 57 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYvt3sI5IUwdWs6jqsmHKs7XfXFsFaTJ-L0UqyoPs9vITuXQ4vVky_V0b1Ze1FSg7eZMmd381K9VFjipSn9j5P5Kx-he-FPC6om8hP4GoN73zmzj0AOqXAz-GcPbTsCpVP9tMyyILEfTkCT3AVS9Yk8t824ccSttThoApBgaekrnDc Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:28.779392 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1789a648c5c24f519ca6473708fecc69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1789a648c5c24f519ca6473708fecc69", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1789a648c5c24f519ca6473708fecc69 Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-163939442 Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4ee1384025ae4399baf6b057e40338ef Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-163939442-project Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: exception: Image not found. Sep 27 01:47:28.780921 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'image_id': 'a45dadb5-ff25-4bc4-b854-65ff75f04c1d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.782836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a45dadb5-ff25-4bc4-b854-65ff75f04c1d Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 27 01:47:28.784616 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a45dadb5-ff25-4bc4-b854-65ff75f04c1d could not be found. Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:28.786446 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 27 01:47:28.788500 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:28.794280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99c10f49-91f1-4e9b-b292-d5ebeccaceb1 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] Returning 404 to user: Image not found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:28.794280 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99c10f49-91f1-4e9b-b292-d5ebeccaceb1 tempest-ImagesMetadataNegativeTestJSON-163939442 tempest-ImagesMetadataNegativeTestJSON-163939442-project] 10.222.0.52 "POST /compute/v2.1/images/a45dadb5-ff25-4bc4-b854-65ff75f04c1d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.073950 Sep 27 01:47:28.796142 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1988/4016] 10.222.0.52 () {60 vars in 1281 bytes} [Tue Sep 27 01:47:28 2022] POST /compute/v2.1/images/a45dadb5-ff25-4bc4-b854-65ff75f04c1d/metadata => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:28.814655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:28.815361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:28.832986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.839850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.840418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.848129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:28.848724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:28.849192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:28.886796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:28.896354 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c5deeb4-0f02-4abb-b972-2cd2a03ac267 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.874403 Sep 27 01:47:28.900612 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2029/4017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:28 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:29.001319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:29.015216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68684153-b318-4ecf-9057-36e81486621b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1237 microversion: 2.1 time: 0.217683 Sep 27 01:47:29.026863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1989/4018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:28 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:29.149900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:29.150970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:29.163630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.164129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.164564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:29.165285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.165774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.169312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:29.733940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:29.734755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:29.744788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.747341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.751257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:29.752322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.752998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.753664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:29.912367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:29.928166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3843ff5b-8c44-41b5-8813-b8b5635ec5f8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1285 microversion: 2.1 time: 0.199709 Sep 27 01:47:29.940701 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1990/4019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:29 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:29.952756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:29.953521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:29.968702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.969217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.969720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:29.970443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:29.970895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:29.971326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:30.281746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:30.292899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebe3bcdc-a556-405f-b96e-044c8e3d83e1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.350835 Sep 27 01:47:30.296814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1991/4020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:29 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:30.328291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:30.331966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:30.347368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:30.352165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:30.352887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:30.354023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:30.354712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:30.355417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:30.452653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:30.468943 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee1016fc-1f33-41b1-ab73-98e87a6aab52 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 1.323240 Sep 27 01:47:30.471579 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2030/4021] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:29 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:30.679231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:30.691569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61247ec0-11cd-4b91-8898-310627790b19 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1304 microversion: 2.1 time: 0.372901 Sep 27 01:47:30.692793 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1992/4022] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:30 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1304 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:30.961573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:30.962202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:31.004866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.009701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.013485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.016054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.016858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.018299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.191201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "name": "network-vif-plugged", "status": "completed", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:31.214088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.214570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.220096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.224686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:31.257039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] Creating event network-vif-plugged:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:47:31.273788 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bfe5bbc4-b8ba-46f5-84fd-7407b6ad1da4 req-e3ab5fca-90a7-423a-909d-34e9beba143c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085592 Sep 27 01:47:31.274746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1993/4023] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:31.326034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:31.326913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:31.338829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.339329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.343308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.344328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.345545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.348783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.513114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:31.522012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5c40e60-325a-4078-8e4d-63a2fd62ca13 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1273 microversion: 2.1 time: 0.567198 Sep 27 01:47:31.523114 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2031/4024] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:30 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1273 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:31.537138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:31.541091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:31.552411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.552947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.555974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.556749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.558486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.558935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.926161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:31.956429 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7831d57-1481-48bb-b2cd-678d93b5ca3c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1324 microversion: 2.1 time: 0.634127 Sep 27 01:47:31.958401 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1994/4025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:31 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1324 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:31.976407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:31.978439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:31.992778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.994172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:31.995508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:31.998730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:31.999480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:32.002490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:32.003297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:32.024409 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c91accf0-1e47-4ce5-9632-b8bcc542053d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.498986 Sep 27 01:47:32.026271 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2032/4026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:31 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:32.539559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:32.557220 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f0b1410-c475-4d26-9724-952458c5ef34 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1304 microversion: 2.1 time: 0.595580 Sep 27 01:47:32.558601 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1995/4027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:31 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1304 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:32.570049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:32.605393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:32.609863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:32.612642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:32.649168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] Creating event network-changed:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h1-859358-1 Sep 27 01:47:32.668934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-848ae6f1-1948-4bad-9261-effe53cad642 req-cddb1312-3097-4c33-aceb-b224cd88a7fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107598 Sep 27 01:47:32.674869 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1996/4028] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:32.690136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:32.694649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:32.712182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:32.713082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:32.713759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:32.714892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:32.715714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:32.716424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:32.784103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2142278886", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "f7729e38-06bf-469e-8111-eb367be7aeaa"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:32.883967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] validate_networks() for [('f7729e38-06bf-469e-8111-eb367be7aeaa', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:33.170353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:33.193445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65a31057-2909-40af-9bb1-1ccd776b6b94 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.512069 Sep 27 01:47:33.194094 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1997/4029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:32 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:33.233775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:33.238498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:33.278254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:33.278254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:33.278254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:33.285514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:33.287030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:33.290292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:33.830833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:33.843932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:33.849959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:33.857674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95d4645b-534c-4cd4-b3fd-0b40b806b636 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2941 microversion: 2.32 time: 0.658582 Sep 27 01:47:33.874168 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1998/4030] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:47:33 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2941 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:47:33.890471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:33.892064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:33.898595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:33.899545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:33.900286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:33.901312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:33.902090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:33.903075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.097283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:47:34.097858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:47:34.098203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:47:34.098611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:47:34.099025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:47:34.116733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.117231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.117707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.118439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.118892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.119321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.128273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:34.137312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2b18bae-494f-4428-880b-5039b820f2f5 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1521 microversion: 2.1 time: 0.260513 Sep 27 01:47:34.141421 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 1999/4031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:33 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:34.146389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:34.154832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:34.171624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Getting quotas for project a9bf77280c5c498ab36c92b1649d9a7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:34.174860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.175375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.175826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.176557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.177016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.178824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.190894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Getting quotas for user ec94e2d23bf142c9ad6ed5c6720f6c73 and project a9bf77280c5c498ab36c92b1649d9a7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:34.214476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:47:34.218283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:47:34.317186 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f29339dc-cc77-49d9-b7d3-692976c0585f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.152606 Sep 27 01:47:34.318206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2033/4032] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:47:34.322805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0b7136-86dd-496f-8080-3e5cfc02ea29", "tag": "3055f70b-2034-44ee-ae98-2d81e453f68a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:34.343618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.347276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.348221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.379992 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] Creating event network-changed:3055f70b-2034-44ee-ae98-2d81e453f68a for instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 on n-h1-859358-1 Sep 27 01:47:34.385317 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cdf48b08-40c5-4b1a-93c0-ac68cfec4340 req-df2060b5-7f4b-493b-ae56-f9229248b542 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065865 Sep 27 01:47:34.386241 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2034/4033] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:34.392662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:34.393672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:34.402257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.402991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.403831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.404748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.405410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.406013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.650533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:34.655327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:34.670867 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31fc1d56-86a9-4f2d-bee5-2a09f55e10fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.528077 Sep 27 01:47:34.685245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2000/4034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:34 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:34.929818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b821695a-a282-4a8b-ad96-b113724cb914 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24da7124c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRVO1XoBmWY2uYIHC1wGYyA5SNqCbwFaAhmoqTtegkBOW1Mqb9Z62XxisSc8DglWtM8b9ZX7/MUV+1dXsFlP62+AnUOTJu6Je+X3YT+nF3cwwt5l5oK3cO5nMULWAulbw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b821695a-a282-4a8b-ad96-b113724cb914 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 257 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:34.945280 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRVO1XoBmWY2uYIHC1wGYyA5SNqCbwFaAhmoqTtegkBOW1Mqb9Z62XxisSc8DglWtM8b9ZX7/MUV+1dXsFlP62+AnUOTJu6Je+X3YT+nF3cwwt5l5oK3cO5nMULWAulbw=="}} Sep 27 01:47:34.947104 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRVO1XoBmWY2uYIHC1wGYyA5SNqCbwFaAhmoqTtegkBOW1Mqb9Z62XxisSc8DglWtM8b9ZX7/MUV+1dXsFlP62+AnUOTJu6Je+X3YT+nF3cwwt5l5oK3cO5nMULWAulbw=='}}} Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:47:34.948224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:34.950394 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:47:34.953798 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 27 01:47:34.955936 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:34.955936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b821695a-a282-4a8b-ad96-b113724cb914 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:34.955936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b821695a-a282-4a8b-ad96-b113724cb914 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.269615 Sep 27 01:47:34.955936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2001/4035] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:47:34.965321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:34.965855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:34.974285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.974784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.975223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:34.976127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:34.976748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:34.977278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:35.000514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:35.021029 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce931423-76e6-4536-8e79-8b909797d59c tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1304 microversion: 2.1 time: 0.633065 Sep 27 01:47:35.022829 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2035/4036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:34 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1304 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:35.028243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60265e97-9721-4add-ad62-55807a51198d tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'create', calling method: .version_select at 0x7f24d5be2ee0>, body: {"pool": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:35.309649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1b5983c-c267-43ee-8c6e-019c5a684900 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.356059 Sep 27 01:47:35.310269 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2002/4037] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:47:34 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f/os-interface => generated 1830 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:47:35.320763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:35.320763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:35.334857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:35.342259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:35.342721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:35.343476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:35.343938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:35.344983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:35.806067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:35.817377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50e8ea9c-e19e-43e9-94b5-e77f35bf6ba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.505969 Sep 27 01:47:35.818980 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2003/4038] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:35 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:35.834816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:35.836209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:35.850341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:35.851229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:35.855756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:35.856908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:35.861382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:35.862337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:35.909892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=30 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:35.964569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:35.975646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17c255f1-b69c-47a2-91ee-fd5eb4ca34ff tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1224 microversion: 2.1 time: 0.154223 Sep 27 01:47:35.977017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2004/4039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:35 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:35.982772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24d64f9f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-530199635", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:36.006416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:36.026155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for user 58b7c418bdcf470dbd2baf1b638fdd5d and project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:36.069597 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 2166 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-530199635", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:36.084273 n-d-859358-1 devstack@n-api.service[128779]: exception: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-530199635', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:36.087427 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:36.092050 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f38ef25-975d-44f9-92d0-47f635323477 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.107739 Sep 27 01:47:36.097098 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2005/4040] 10.222.0.52 () {60 vars in 1160 bytes} [Tue Sep 27 01:47:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:47:36.106939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:36.113319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:36.134654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:36.139037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:36.144695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:36.145809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:36.148983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:36.156827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:36.627330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:36.663898 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87bba6a9-4fa1-4d36-89fc-21a5e1c76275 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.565862 Sep 27 01:47:36.664987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2006/4041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:36 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:36.684550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:36.687194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:36.710932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:36.711478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:36.711937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:36.715574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:36.716071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:36.719971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:37.372800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:37.383503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8096f462-336e-48df-b481-377f6cd05730 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1304 microversion: 2.1 time: 0.714459 Sep 27 01:47:37.384933 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2007/4042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:36 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1304 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:37.400651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63de3a36-bc1f-4160-9b9e-765b7c80784b tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24d5ec80d0>, body: {"keypair": {"name": "tempest-keypair-365192995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItwBfT/ApOobOWLWPiZA0D7IDJ4d+6iKXjyY3oy8gSqiz4aJg9bb98ViTUXW0A/QbfVcGNSAKD3/VWM/rQa5vkuSee5MvZSZ5ZOwhsANkphmAJ/ddHj0D2Ufvh7biGrGA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:37.434804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63de3a36-bc1f-4160-9b9e-765b7c80784b tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:37.443321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63de3a36-bc1f-4160-9b9e-765b7c80784b tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for user 58b7c418bdcf470dbd2baf1b638fdd5d and project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:37.503135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63de3a36-bc1f-4160-9b9e-765b7c80784b tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113620 Sep 27 01:47:37.504070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2008/4043] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:37.522847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a39c788-af69-4e40-b24a-8fda7795f9ac", "tag": "21e02012-d309-409f-b774-340ceefa8373"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:37.556826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:37.562176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:37.562679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:37.601823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] Creating event network-changed:21e02012-d309-409f-b774-340ceefa8373 for instance 3a39c788-af69-4e40-b24a-8fda7795f9ac on n-h2-859358-1 Sep 27 01:47:37.625024 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6fe5fa03-7f8b-4fb9-a65b-23c613e03577 req-da6aa887-cd0e-4ed9-a4ec-8bb13795a194 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118623 Sep 27 01:47:37.628130 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2009/4044] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:37.637056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:37.638171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:37.660555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:37.661737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:37.665706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:37.666745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:37.667503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:37.668053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:38.233578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:38.244484 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34f400aa-eb3a-4f5f-b8e8-4b5a90fb8651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.613795 Sep 27 01:47:38.247749 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2010/4045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:37 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:38.261011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:38.261990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:38.276686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:38.277618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:38.278287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:38.279803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:38.280661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:38.281383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:38.458760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:38.476555 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30cc41ab-1859-4c23-87da-2c530457917c tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1286 microversion: 2.1 time: 0.226630 Sep 27 01:47:38.485099 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2011/4046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:38 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1286 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:38.506144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24d6853ca0>, body: {"keypair": {"name": "tempest-keypair-365192995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNMbbwRTDbf+eRQfxVVPxmByjx3MxrS9rYhmR+87M5/UPxiGYQFsjzW5iI+OkPYSoLhgrBTOvYx3ANgD8T78rtHcv57L2rAQz4goE5ku4qcykftKDx/tnvTHFfpCFutfA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:38.581494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:38.600674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for user 58b7c418bdcf470dbd2baf1b638fdd5d and project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:38.675092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] HTTP exception thrown: Key pair 'tempest-keypair-365192995' already exists. Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 272 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: {"keypair": {"name": "tempest-keypair-365192995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNMbbwRTDbf+eRQfxVVPxmByjx3MxrS9rYhmR+87M5/UPxiGYQFsjzW5iI+OkPYSoLhgrBTOvYx3ANgD8T78rtHcv57L2rAQz4goE5ku4qcykftKDx/tnvTHFfpCFutfA=="}} Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: exception: Key pair 'tempest-keypair-365192995' already exists. Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-365192995', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNMbbwRTDbf+eRQfxVVPxmByjx3MxrS9rYhmR+87M5/UPxiGYQFsjzW5iI+OkPYSoLhgrBTOvYx3ANgD8T78rtHcv57L2rAQz4goE5ku4qcykftKDx/tnvTHFfpCFutfA=='}}} Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '58b7c418bdcf470dbd2baf1b638fdd5d-tempest-keypair-365192995' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.723558 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi session.flush() Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result.read() Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 01:47:38.729600 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '58b7c418bdcf470dbd2baf1b638fdd5d-tempest-keypair-365192995' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 27, 1, 47, 38, 660489), 'updated_at': None, 'name': 'tempest-keypair-365192995', 'user_id': '58b7c418bdcf470dbd2baf1b638fdd5d', 'fingerprint': '2e:fb:38:49:57:be:5f:5f:cf:cf:fb:3c:20:92:cd:04', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNMbbwRTDbf+eRQfxVVPxmByjx3MxrS9rYhmR+87M5/UPxiGYQFsjzW5iI+OkPYSoLhgrBTOvYx3ANgD8T78rtHcv57L2rAQz4goE5ku4qcykftKDx/tnvTHFfpCFutfA==', 'type': 'ssh'}] Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair.create() Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._create() Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-365192995' already exists. Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-365192995' already exists. Sep 27 01:47:38.736200 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-365192995' already exists. Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 409 to user: Key pair 'tempest-keypair-365192995' already exists. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c77133d4-7b25-425d-bb77-28e56635ebe4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.241696 Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2012/4047] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:38 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 244 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:38.747836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:38.749930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:38.749930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:38.749930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:38.750510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:38.751507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:38.751947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.019532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:39.032792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60d42378-c62f-4c1f-9fff-acc3aff7521c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.302225 Sep 27 01:47:39.036469 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2013/4048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:38 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:39.055336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:39.058075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:39.074886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.075398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.075837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.080353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.082286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.082740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.300543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:39.311060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e9886b5-9754-4a93-a8e2-39230c482947 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.273180 Sep 27 01:47:39.311960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2014/4049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:39 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:39.316373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9af17808-ca82-4b59-890f-10c55e9f4e15 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Calling method '.version_select at 0x7f24d69c6820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:39.338580 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9af17808-ca82-4b59-890f-10c55e9f4e15 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-365192995" status: 202 len: 0 microversion: 2.1 time: 0.025733 Sep 27 01:47:39.339204 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2015/4050] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-365192995 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:47:39.343794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:39.345269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:39.352255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.352736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.353191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.353908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.354380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.354803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.458257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60265e97-9721-4add-ad62-55807a51198d tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.434089 Sep 27 01:47:39.470260 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2036/4051] 10.222.0.52 () {60 vars in 1170 bytes} [Tue Sep 27 01:47:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:39.476385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-346bf953-2e4b-4f24-845e-bf605ed9c6b4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24d5be2700>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCMZyDq+kncJAI+QzFpeSPPX3Polpw7lyoTF1ymK5fRce0hVRqKUqK4woMyxksdaSOmsg0zO2eHZ3X98qWVWBJMD/hGwoIwDnVRIYkOOaTd9EwWYxbOOcM97zHgHYmbqQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-346bf953-2e4b-4f24-845e-bf605ed9c6b4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 247 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCMZyDq+kncJAI+QzFpeSPPX3Polpw7lyoTF1ymK5fRce0hVRqKUqK4woMyxksdaSOmsg0zO2eHZ3X98qWVWBJMD/hGwoIwDnVRIYkOOaTd9EwWYxbOOcM97zHgHYmbqQ=="}} Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCMZyDq+kncJAI+QzFpeSPPX3Polpw7lyoTF1ymK5fRce0hVRqKUqK4woMyxksdaSOmsg0zO2eHZ3X98qWVWBJMD/hGwoIwDnVRIYkOOaTd9EwWYxbOOcM97zHgHYmbqQ=='}}} Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:47:39.480494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-346bf953-2e4b-4f24-845e-bf605ed9c6b4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:39.486576 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-346bf953-2e4b-4f24-845e-bf605ed9c6b4 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010396 Sep 27 01:47:39.489271 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2037/4052] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:47:39.500042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:39.501758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24da5f0430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1169679170", "public_key": " "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:39.501947 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d62581bf-b621-4623-80f1-6146f764bcbc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.160619 Sep 27 01:47:39.501947 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2016/4053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:39 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:39.509193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:39.510196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:39.512525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=41 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:39.514347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:39.517953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.518555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.519093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.519950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:39.520479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:39.520862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for user 58b7c418bdcf470dbd2baf1b638fdd5d and project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:39.521154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:39.546261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:39.546524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 95 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1169679170", "public_key": " "}} Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: exception: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1169679170', 'public_key': ' '}}} Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.549894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.555608 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.560119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:39.560119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5bf00766-2d5e-470a-adb9-07bef6545128 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069340 Sep 27 01:47:39.560653 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2038/4054] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Sep 27 01:47:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:47:39.575909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ba2e2ac-21ee-4acd-aaf7-dc4b87337811 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24d69dcee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjvIfXKV1ZLLJFd0bsXJ9yG5tlNW/owbsWNmXppS//ht54YByS5UaPsZovCvhE33rGudUH75PUc8alvO9pTjqJb+rN72YTpn/wQ3F0BconJbGLo5UErcNCZi7GO9dnujA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ba2e2ac-21ee-4acd-aaf7-dc4b87337811 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 507 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjvIfXKV1ZLLJFd0bsXJ9yG5tlNW/owbsWNmXppS//ht54YByS5UaPsZovCvhE33rGudUH75PUc8alvO9pTjqJb+rN72YTpn/wQ3F0BconJbGLo5UErcNCZi7GO9dnujA=="}} Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjvIfXKV1ZLLJFd0bsXJ9yG5tlNW/owbsWNmXppS//ht54YByS5UaPsZovCvhE33rGudUH75PUc8alvO9pTjqJb+rN72YTpn/wQ3F0BconJbGLo5UErcNCZi7GO9dnujA=='}}} Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 27 01:47:39.581278 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 27 01:47:39.585614 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.588852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ba2e2ac-21ee-4acd-aaf7-dc4b87337811 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:39.590020 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ba2e2ac-21ee-4acd-aaf7-dc4b87337811 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018955 Sep 27 01:47:39.591057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2039/4055] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:39 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:47:39.622683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Action: 'create', calling method: .version_select at 0x7f24da524670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-171179086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:39.665874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:39.680340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Getting quotas for user 58b7c418bdcf470dbd2baf1b638fdd5d and project 3bd19ac4767d4b7f9d564fd754f30786. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:39.714663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 117 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-171179086", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: exception: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-171179086', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 27 01:47:39.716502 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93cb3a46-1931-46ef-8f49-b84665893574 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.121366 Sep 27 01:47:39.722112 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2040/4056] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:47:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:47:39.725525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-269651498", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:39.798291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] validate_networks() for [('e2de58ae-986d-4494-92ee-73fbfb5b9f8d', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:40.108333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:40.117151 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bec592ef-c7ef-4bce-8ea2-9f765b9e7663 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.614285 Sep 27 01:47:40.124753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2017/4057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:39 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:40.129964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b993dc1-e1fa-4023-bb80-fe67f90ca146 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Calling method '.version_select at 0x7f24d6d299d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:40.145107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1b993dc1-e1fa-4023-bb80-fe67f90ca146 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b993dc1-e1fa-4023-bb80-fe67f90ca146 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Request method failure captured: Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-216511370 HTTP/1.1 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlY1yCtR_aBasWDew3mqCR0jqokWFCAidEl3zXCbb4hB4XmCaIXqXq5mwLc5Sf68BZNxe1hXuybl4x-6AcplmkAfkxYFzSoZTE0kf0-jFgeVgOPAFTWJx_wupmuDpZFf6tUNjegQT0RrIF2kZ31tzDPnL6CSFN_pPJUGJFjQnxtA_b0 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3bd19ac4767d4b7f9d564fd754f30786"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3bd19ac4767d4b7f9d564fd754f30786", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3bd19ac4767d4b7f9d564fd754f30786 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-875428955 Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-KeyPairsNegativeTestJSON-875428955-project Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: exception: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'tempest-keypair-non-existent-216511370'} Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise self.value Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:40.147536 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d Sep 27 01:47:40.152132 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:40.156058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b993dc1-e1fa-4023-bb80-fe67f90ca146 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] Returning 404 to user: Keypair tempest-keypair-non-existent-216511370 not found for user 58b7c418bdcf470dbd2baf1b638fdd5d {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:40.157292 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b993dc1-e1fa-4023-bb80-fe67f90ca146 tempest-KeyPairsNegativeTestJSON-875428955 tempest-KeyPairsNegativeTestJSON-875428955-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-216511370" status: 404 len: 144 microversion: 2.1 time: 0.032754 Sep 27 01:47:40.162359 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2018/4058] 10.222.0.52 () {58 vars in 1257 bytes} [Tue Sep 27 01:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-216511370 => generated 144 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:47:40.169114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:40.170064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:40.178597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.179620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.180936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.181903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.182578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.183226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.272617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:47:40.273570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:47:40.274236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:47:40.274842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:47:40.275659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:47:40.290464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.291495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.292368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.294309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.295055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.296284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.325398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Getting quotas for project 3a83889d9e154610a95d9731581eaac7. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:40.336152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Getting quotas for user 5c30541b7e1c4f36aa873067f4d0d886 and project 3a83889d9e154610a95d9731581eaac7. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:40.353779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:47:40.356123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:47:40.369455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:40.415058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:40.424405 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ef6120f-abcf-4f49-aae9-2fa1b3c33dba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.260390 Sep 27 01:47:40.425007 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2019/4059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:40 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:40.429741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:40.430413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:40.437080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.437606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.438934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.439395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.439849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.440284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.464071 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-582a11aa-1b10-49a3-a788-476f92fe611b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731265 Sep 27 01:47:40.467362 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2041/4060] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:47:40.517463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c60ac178-2cfb-474a-848e-f9aa002d6222 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:40.519356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c60ac178-2cfb-474a-848e-f9aa002d6222 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:40.625238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:40.638485 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dcb8053-4d90-4a6b-b3d5-941e9770fced tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.212239 Sep 27 01:47:40.639458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2020/4061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:40 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:40.650056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:40.650684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:40.655759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:40.661981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c60ac178-2cfb-474a-848e-f9aa002d6222 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:40.662186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.662684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.663371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.664179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:40.664640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:40.665064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:40.674773 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c60ac178-2cfb-474a-848e-f9aa002d6222 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1223 microversion: 2.1 time: 0.197143 Sep 27 01:47:40.697696 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2042/4062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:40 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1223 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:40.845538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:40.856015 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcbd2aab-637f-482d-9943-5942adfb3641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.215697 Sep 27 01:47:40.857480 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2021/4063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:40 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:41.149367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:41.150077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:41.160270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.165690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.167151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.169738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.174161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.174933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.450084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:41.450703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:41.471053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.471534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.472231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.472663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.473116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.473573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.627771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:41.639486 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17dd4fab-8bd5-45e1-a051-7e748a30398f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.492663 Sep 27 01:47:41.640314 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2043/4064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:41 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:41.666276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:41.667084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:41.679834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.680807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.681650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.683361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.684127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.685308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.793974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:41.809377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d8fe751-96b7-429e-832a-780fb4fd5cd1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.363114 Sep 27 01:47:41.810093 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2022/4065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:41 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:41.814727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:41.815336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:41.836291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.836712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.837389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.838284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.838902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.839644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.949779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:41.959230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18c61ac5-8643-4fe9-8048-674b01565c22 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1227 microversion: 2.1 time: 0.148071 Sep 27 01:47:41.959818 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2023/4066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:41 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1227 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:41.965330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:41.966358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:41.975686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.976646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.977264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:41.978179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:41.978834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:41.979435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:42.301698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:42.315210 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21a62bda-4800-480d-a744-c634ce8747b0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.353934 Sep 27 01:47:42.316518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2024/4067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:41 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:42.355548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "569322bb-20b6-42f6-9eb1-21a4555ab5c5", "tag": "6edc2454-f1e9-4b31-ae66-2fbc5b752e3a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:42.383532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:42.389969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:42.390398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:42.473968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] Creating event network-changed:6edc2454-f1e9-4b31-ae66-2fbc5b752e3a for instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 on n-h2-859358-1 Sep 27 01:47:42.473968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8fede37c-d3d5-4987-862a-96488ede361f req-4f32c537-8acd-4730-92f7-6828aab58154 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121290 Sep 27 01:47:42.478667 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2025/4068] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:42.637971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:42.648064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f57523d-ec91-491c-a583-d6b5efb18185 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.987765 Sep 27 01:47:42.652175 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2044/4069] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:41 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:42.665369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:42.666783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:42.678314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:42.679098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:42.679778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:42.681502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:42.682196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:42.682917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:42.836567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:42.837288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:42.857442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:42.858410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:42.858922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:42.859731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:42.865587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:42.867022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.104390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:43.114816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:43.118004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1378d7c-9921-4cdf-a198-60dcc48eb47a tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.455969 Sep 27 01:47:43.119707 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2026/4070] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:42 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:43.124592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32e81bb7-2a0a-4075-bccf-d3bf707a2933 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.293478 Sep 27 01:47:43.125162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2045/4071] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:42 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:43.143934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:43.144899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:43.151993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.152899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.153775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.155035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.155728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.158150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.276184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:43.288142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-57ad536c-2645-4097-813e-b177da5f5938 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1227 microversion: 2.1 time: 0.166720 Sep 27 01:47:43.295363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2027/4072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:43 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1227 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:43.340211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:43.341509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:43.352811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.353834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.354455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.355424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.356040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.356638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.583715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:43.593739 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e5e85d4-58aa-4198-b7b3-38c2a80e757c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.257955 Sep 27 01:47:43.606403 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2046/4073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:43 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:43.676295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:43.677798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:43.691288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.692318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.694516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.697513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:43.698421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:43.699123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:43.882592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:43.892230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06057ffb-60c2-4b5b-abc1-c8347e5a3972 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.222844 Sep 27 01:47:43.892821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2028/4074] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:43 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:43.911767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0744b491-ed54-4b71-9d1f-c4d56f12bfd5 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d5be2430>, body: {"keypair": {"name": "tempest-keypair-1377318116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOgtSlb7xvNoNJ68b0sW4kujfUTDz2jj92AMoa7LK7E9J/uuE9EQxeVIolaJuhkEaMZuXzaYZe9Se+y2LZ2Ny6hpS8YZdOFw9ADrT1eBDAtFkAYXKpBHNAk8abKNk5ULg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:43.930008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0744b491-ed54-4b71-9d1f-c4d56f12bfd5 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:43.935680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-0744b491-ed54-4b71-9d1f-c4d56f12bfd5 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:43.974735 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0744b491-ed54-4b71-9d1f-c4d56f12bfd5 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.245466 Sep 27 01:47:43.978235 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2047/4075] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:43.988628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9919bbaf-5731-44ac-b110-5695c30c481b tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d64f98b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:43.997695 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9919bbaf-5731-44ac-b110-5695c30c481b tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1377318116" status: 200 len: 513 microversion: 2.2 time: 0.013535 Sep 27 01:47:44.005962 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2029/4076] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Sep 27 01:47:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1377318116 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:44.011232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a11df159-03a3-4c87-8ec0-c595f90e13e4 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d5903af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.036623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a11df159-03a3-4c87-8ec0-c595f90e13e4 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377318116" status: 204 len: 0 microversion: 2.2 time: 0.029200 Sep 27 01:47:44.037230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2048/4077] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Sep 27 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377318116 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:47:44.051359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b0aee81-705a-439f-96b5-b848b77b8454 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d69e7790>, body: {"keypair": {"name": "tempest-keypair-178346889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8QoJv/a5sq/TRiP7o1M4ThZbkEpGnh/CYpDSoBv42o+K7TCj6llJ8gFVT2O3XL8fktPZgUh2/GMgfYCxsCaSRphLIMe4Q5QRXR06A130KTpW2XeZXTP3CPlTP/njEufw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:44.091709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0b0aee81-705a-439f-96b5-b848b77b8454 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:44.099884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0b0aee81-705a-439f-96b5-b848b77b8454 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:44.150199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.151765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:44.157230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b0aee81-705a-439f-96b5-b848b77b8454 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.088855 Sep 27 01:47:44.160016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2030/4078] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:44.164929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.169827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.170647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.172065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.173925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.174844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.176399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.176987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:44.186552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.187308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.187749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.189000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.189585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.190017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.384988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:44.397135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fad8201e-c5d7-4379-bbd4-4f73fd6afddb tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.259521 Sep 27 01:47:44.397903 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2049/4079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:44.414242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f866e37-727b-490f-8a14-5362ced047ca tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d5903ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.444606 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f866e37-727b-490f-8a14-5362ced047ca tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178346889" status: 204 len: 0 microversion: 2.2 time: 0.033423 Sep 27 01:47:44.451167 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2050/4080] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Sep 27 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178346889 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:44.463633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.465726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:44.477433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.480238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:44.486162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.486612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.487412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.487873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.488299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.492729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4390f5c-9c82-4ed0-85c0-42f104d58b9d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.330175 Sep 27 01:47:44.496232 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2031/4081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:44.501815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33ef102e-28f4-43d1-8d97-3efa943ccac1 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d6245ca0>, body: {"keypair": {"name": "tempest-keypair-1947674344", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:44.521893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-33ef102e-28f4-43d1-8d97-3efa943ccac1 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:44.528924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-33ef102e-28f4-43d1-8d97-3efa943ccac1 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:44.566102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33ef102e-28f4-43d1-8d97-3efa943ccac1 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.068181 Sep 27 01:47:44.573052 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2032/4082] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:44 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:44.578636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6fe43fe-bf08-4625-a4c1-1d40b2e77dc2 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d613f820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.585244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:44.596034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3564488f-d3d7-4248-89cd-2614def171c1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1227 microversion: 2.1 time: 0.143402 Sep 27 01:47:44.603194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2051/4083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1227 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:44.619988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6fe43fe-bf08-4625-a4c1-1d40b2e77dc2 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947674344" status: 204 len: 0 microversion: 2.2 time: 0.045699 Sep 27 01:47:44.621244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2033/4084] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Sep 27 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947674344 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:44.631142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.631819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:44.635051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e65ecc73-30a4-44bc-8d9f-e0cf166706b6 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d70933a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1706191745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLhrG5ve0gR+YQs9MVGwNXQ5FTLXoxQo76/9RMCP03b0523nZLUj0MnT/oVMugOFmjwJi7Tugtd+SZNMVrdcPc5u7VkwnCScAeYaE2TOyMZXfwrcVtcRNndv9iPtnuZSg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:44.638105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.638725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.639281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.640033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.640488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.640970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.653186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e65ecc73-30a4-44bc-8d9f-e0cf166706b6 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:44.659427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e65ecc73-30a4-44bc-8d9f-e0cf166706b6 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:44.689504 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e65ecc73-30a4-44bc-8d9f-e0cf166706b6 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.059162 Sep 27 01:47:44.690495 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2034/4085] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:44 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 27 01:47:44.706439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c1e7fef-91a9-4711-9f72-7e532794f384 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d5fa6ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-612205851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1NZXdJA/BQsGWINtMxdeK0YpZ0erCFgsdROh9GxDOc0QdtT0qA6a22hlw4yLauSfBLQubPlJBIxLTqwkBlQDVRPzxsZg5JRvdqZAu/GKRHs9LmnuOi+1B9g0Huc1zWPA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:44.731338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9c1e7fef-91a9-4711-9f72-7e532794f384 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:44.738966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9c1e7fef-91a9-4711-9f72-7e532794f384 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:44.799236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c1e7fef-91a9-4711-9f72-7e532794f384 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.094196 Sep 27 01:47:44.808237 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2035/4086] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:44.813137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f226241-3504-4a25-a2d8-0b60572a261f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d62458b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-463391570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrfzco3/eaUBnvB2/iDrNVmWMNlEzMo3TsbjkT8HZ8MIvhYHwxXxD3vflllJIuck1iounHVo6ip1VXbpWTXA5r1uXeB5/tMISySI1tfaYHuHxOOvrxeQJBy3nBHvFbAlw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:44.832880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4f226241-3504-4a25-a2d8-0b60572a261f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:44.841780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4f226241-3504-4a25-a2d8-0b60572a261f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:44.876041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f226241-3504-4a25-a2d8-0b60572a261f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.066741 Sep 27 01:47:44.882322 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2036/4087] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:44.883057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:44.892391 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c137ae6f-ea82-4df4-a723-07343f0ebdc8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.274158 Sep 27 01:47:44.892968 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2052/4088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:44.897265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e02a2b7-3670-46f7-8b80-7054259ba580 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d6bc3d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.901278 n-d-859358-1 devstack@n-api.service[128779]: WARNING oslo_db.sqlalchemy.utils [None req-2e02a2b7-3670-46f7-8b80-7054259ba580 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:47:44.915701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.916991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:44.922816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e02a2b7-3670-46f7-8b80-7054259ba580 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.031208 Sep 27 01:47:44.925918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.926664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.927313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.928234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:44.928912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:44.929579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:44.941859 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2037/4089] 10.222.0.52 () {60 vars in 1177 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:44.948997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1c62d31-fca1-4f99-9e76-7a110792e565 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d6407ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:44.985301 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1c62d31-fca1-4f99-9e76-7a110792e565 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-463391570" status: 204 len: 0 microversion: 2.2 time: 0.041081 Sep 27 01:47:44.986385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2038/4090] 10.222.0.52 () {60 vars in 1318 bytes} [Tue Sep 27 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-463391570 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:44.996121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-077e276a-0400-49e2-a037-d8d9262fd2bc tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24da6cc430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.021720 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-077e276a-0400-49e2-a037-d8d9262fd2bc tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-612205851" status: 204 len: 0 microversion: 2.2 time: 0.030922 Sep 27 01:47:45.022917 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2039/4091] 10.222.0.52 () {60 vars in 1318 bytes} [Tue Sep 27 01:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-612205851 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:45.032996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77952e70-427a-4753-97e8-315423d929f9 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d62455e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.059768 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77952e70-427a-4753-97e8-315423d929f9 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1706191745" status: 204 len: 0 microversion: 2.2 time: 0.030858 Sep 27 01:47:45.062202 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2040/4092] 10.222.0.52 () {60 vars in 1321 bytes} [Tue Sep 27 01:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1706191745 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:47:45.075016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad590bcd-a5cb-4743-92a8-08aca7d1263f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24d62b49d0>, body: {"keypair": {"name": "tempest-keypair-1468871121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoJqcYvxuLXR6Kc2dNuJ5PUrD9Ccva42DCPyP+ZGqYyrPrrnPRcO7MUqJ531WqhYi0q0VtQCV2RooD7FuFsQ3rFGWwWzLexl2w/YWf1FPi3nFJRabeFE0oyZeU2VRNlSw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:45.090314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:45.099994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ad590bcd-a5cb-4743-92a8-08aca7d1263f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:45.106204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ad590bcd-a5cb-4743-92a8-08aca7d1263f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:45.144440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad590bcd-a5cb-4743-92a8-08aca7d1263f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.073930 Sep 27 01:47:45.151859 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2041/4093] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Sep 27 01:47:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 27 01:47:45.186770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:45.195585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c597674-98cb-4532-9ed2-6b9e4ada9817 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.284139 Sep 27 01:47:45.196149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2053/4094] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:44 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:45.201448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7471f7cb-7b65-44c3-94cd-26a07585982a tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d57b1430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.209671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7471f7cb-7b65-44c3-94cd-26a07585982a tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1468871121" status: 200 len: 513 microversion: 2.2 time: 0.012527 Sep 27 01:47:45.210443 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2054/4095] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1468871121 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:45.228609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41391cbb-0f9f-4015-b4ef-4db0e31e0e92 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d59030d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.231919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a39c788-af69-4e40-b24a-8fda7795f9ac", "name": "network-vif-plugged", "status": "completed", "tag": "21e02012-d309-409f-b774-340ceefa8373"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:45.233278 n-d-859358-1 devstack@n-api.service[128778]: WARNING oslo_db.sqlalchemy.utils [None req-41391cbb-0f9f-4015-b4ef-4db0e31e0e92 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:47:45.240793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41391cbb-0f9f-4015-b4ef-4db0e31e0e92 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017059 Sep 27 01:47:45.241736 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2055/4096] 10.222.0.52 () {60 vars in 1177 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:45.254367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-858fa769-215e-444c-a0fb-0b3a5492c929 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d5be2040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.264216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.264702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.265138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.277598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-858fa769-215e-444c-a0fb-0b3a5492c929 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468871121" status: 204 len: 0 microversion: 2.2 time: 0.028419 Sep 27 01:47:45.278186 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2056/4097] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Sep 27 01:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468871121 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:47:45.287804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] Creating event network-vif-plugged:21e02012-d309-409f-b774-340ceefa8373 for instance 3a39c788-af69-4e40-b24a-8fda7795f9ac on n-h2-859358-1 Sep 27 01:47:45.288682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Action: 'create', calling method: .version_select at 0x7f24da6c5820>, body: {"keypair": {"name": "tempest-keypair-2075409547", "type": "x509"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:45.293239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c0b3cbc1-bc1b-46ce-98a5-b5e0dd7d6d64 req-ed74c02e-d38a-473c-8c3a-afe5636b9084 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145365 Sep 27 01:47:45.294070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2042/4098] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:45.306271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:45.311433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:45.327422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.processutils [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpx8jap2m0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpx8jap2m0/temp.key -subj /CN=a985d2141dc947e39afe52d015d75f3d -extensions v3_req_client {{(pid=128778) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 27 01:47:45.422846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.424588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:45.433161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.433668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.434102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.434796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.435247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.435669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.587360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:45.595683 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-824b1a16-2be9-4b31-80d7-50a91d0d2055 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.177604 Sep 27 01:47:45.599682 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2043/4099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:45.604366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.604986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:45.612142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.612635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.613066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.614789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.614789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.614789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.774459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.processutils [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpx8jap2m0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpx8jap2m0/temp.key -subj /CN=a985d2141dc947e39afe52d015d75f3d -extensions v3_req_client" returned: 0 in 0.446s {{(pid=128778) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 27 01:47:45.775324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.processutils [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpx8jap2m0/temp.key -password pass: {{(pid=128778) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 27 01:47:45.816329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:45.822145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.processutils [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpx8jap2m0/temp.key -password pass:" returned: 0 in 0.046s {{(pid=128778) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 27 01:47:45.824558 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de87e5ac-b3ec-4731-9e49-06cbcc8be7ba tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.223817 Sep 27 01:47:45.825133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2044/4100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:45.839692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.841010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:45.847343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.847921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.848382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.849061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:45.849550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:45.849976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:45.913412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:45.942693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Getting quotas for user a985d2141dc947e39afe52d015d75f3d and project 57515985ed7e4a75937d52ea2e318926. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:45.944294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:45.962260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3c73ddf-170d-49dd-ab96-4ee3c52bfa8f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1227 microversion: 2.1 time: 0.135371 Sep 27 01:47:45.965161 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2045/4101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1227 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:45.974666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:45.975290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:45.982798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e69faab6-9cd7-4f75-89cc-183d247b2217 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.698280 Sep 27 01:47:45.984718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2057/4102] 10.222.0.52 () {62 vars in 1198 bytes} [Tue Sep 27 01:47:45 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 700 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:46.011610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9a8d6a2-e3ce-4973-a199-903c9777ea12 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d5be2940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.014437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.018045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.018749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.019685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.020308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.020911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.040660 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9a8d6a2-e3ce-4973-a199-903c9777ea12 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-2075409547" status: 200 len: 1534 microversion: 2.2 time: 0.041770 Sep 27 01:47:46.042870 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2058/4103] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2075409547 => generated 1534 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:46.058287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5fff1ecc-60a3-4bd2-bed6-9afd98380347 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24d5bd0430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.065426 n-d-859358-1 devstack@n-api.service[128778]: WARNING oslo_db.sqlalchemy.utils [None req-5fff1ecc-60a3-4bd2-bed6-9afd98380347 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:47:46.078942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5fff1ecc-60a3-4bd2-bed6-9afd98380347 tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.024328 Sep 27 01:47:46.080192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2059/4104] 10.222.0.52 () {60 vars in 1177 bytes} [Tue Sep 27 01:47:46 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:46.090724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4a68e28-b3a6-4446-8ef3-726b78f33d1f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] Calling method '.version_select at 0x7f24da524160>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.112660 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4a68e28-b3a6-4446-8ef3-726b78f33d1f tempest-KeyPairsV22TestJSON-1693401994 tempest-KeyPairsV22TestJSON-1693401994-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075409547" status: 204 len: 0 microversion: 2.2 time: 0.025595 Sep 27 01:47:46.113638 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2060/4105] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Sep 27 01:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075409547 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:47:46.224537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.225229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:46.229079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:46.234096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.234619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.236417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.237202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.237693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.238085 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c9fcd82-e869-4989-93af-4c408bd65fa4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.271833 Sep 27 01:47:46.238543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.238692 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2046/4106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:45 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:46.385167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:46.394052 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0d55a07-9a8a-4e73-a12e-239e26f8673f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.177895 Sep 27 01:47:46.394626 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2061/4107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:46 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:46.619161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.619769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:46.625864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.626354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.626782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.627555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.627922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.628530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.758352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:46.766816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0b6764c-5e51-4450-99e3-51a117402321 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.151238 Sep 27 01:47:46.768023 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2047/4108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:46 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:46.850462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.850991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:46.867845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.868345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.868775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.869509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:46.870142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:46.870733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:46.902499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:46.990215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:46.991303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:47.006215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.006718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.007273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.008384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.009143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.009360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.019002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:47.090520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:47.105962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-30a12a87-a3da-4581-9126-d81bdb57653a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.259509 Sep 27 01:47:47.106553 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2062/4109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:46 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:47.127717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:47.136573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c8c5ce4-d74e-4ff5-b78f-b35e537e2220 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1219 microversion: 2.1 time: 0.153831 Sep 27 01:47:47.137678 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2048/4110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:46 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:47.262124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:47.262756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:47.268768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.269255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.269738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.270443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.270897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.271328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.415301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:47.420009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:47.420626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:47.423875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ae99333-990b-4e46-b364-43f5c729228b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1315 microversion: 2.1 time: 0.165449 Sep 27 01:47:47.424643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2063/4111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:47 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:47.429213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.429749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.430187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.430899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.431486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.432106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.578906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:47.589125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-651a23e9-d7af-420e-9ae3-35f42d14c6bb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.172825 Sep 27 01:47:47.601393 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2049/4112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:47 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:47.763401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Calling method '.version_select at 0x7f24d611c550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:47.774445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.774924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.775361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.776088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.776545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.776972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.791604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:47.792242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:47.798822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8e1bbc8-a13a-4c7a-8aca-a6fc41475c3d tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.156095 Sep 27 01:47:47.799418 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2064/4113] 10.222.0.52 () {58 vars in 1122 bytes} [Tue Sep 27 01:47:47 2022] GET /compute/v2.1/limits => generated 511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:47.809573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:47.855427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1734495294", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:47.912588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:47:47.937741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:47.945856 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be22d0c8-8942-4f48-95a7-4d7ff66857e8 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.158298 Sep 27 01:47:47.946525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2050/4114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:47 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:48.130818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.139622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.151798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Getting quotas for project 207cd66f0dcf44c59a7afc9d3ae0a6f0. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:47:48.154301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.155239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.155836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.156586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.161230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.161712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.165375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Getting quotas for user 7d413547fc57412694cf186b4516581f and project 207cd66f0dcf44c59a7afc9d3ae0a6f0. Resources: dict_keys(['metadata_items']) {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:47:48.168835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:DELETE=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:48.199160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Request method failure captured: Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 1752 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZDpKLo3_YDE5KE_LrFHE7GMTS6SzQBM7DEOEX62sXZ3NSjYxb4hGNahWicG4wRYN-8rzryywNenXQz4WfpbtZxfhYhA7F2g4jzrshhrRgx7QlOE3zXEi2xeeboRB-jF9P7NQSnHcFaI9fzkGOvLKi32fS6mHV4zODsj-1UN6h5nqo Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 207cd66f0dcf44c59a7afc9d3ae0a6f0 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-594516793 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/207cd66f0dcf44c59a7afc9d3ae0a6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/207cd66f0dcf44c59a7afc9d3ae0a6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/207cd66f0dcf44c59a7afc9d3ae0a6f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_207cd66f0dcf44c59a7afc9d3ae0a6f0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-594516793 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 207cd66f0dcf44c59a7afc9d3ae0a6f0 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-594516793 Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-594516793-project Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 7d413547fc57412694cf186b4516581f Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-594516793-project Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1734495294", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:47:48.201122 n-d-859358-1 devstack@n-api.service[128778]: exception: Maximum number of metadata items exceeds 128 Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1734495294', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:48.204917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:48.209189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b10eea16-ac02-4882-9af9-6191f1ab6bc5 tempest-AbsoluteLimitsNegativeTestJSON-594516793 tempest-AbsoluteLimitsNegativeTestJSON-594516793-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.351392 Sep 27 01:47:48.217792 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2065/4115] 10.222.0.52 () {60 vars in 1148 bytes} [Tue Sep 27 01:47:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 367 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Sep 27 01:47:48.223083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.223710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.252908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.253453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.253902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.254631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.255085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.255519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.395976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:48.397153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:48.405427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-206e77af-7982-474a-adf9-0e46d2ff28b6 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1275 microversion: 2.1 time: 0.186501 Sep 27 01:47:48.406174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2066/4116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:48.406438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b467a3ea-ef24-4701-abff-a67adc4f83a4 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.279888 Sep 27 01:47:48.418055 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2051/4117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:48.447510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.448119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.454634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.455116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.455549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.456229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.456682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.457101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.590796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:48.598479 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a096918-6367-457e-995b-193e60697f4f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1502 microversion: 2.1 time: 0.154865 Sep 27 01:47:48.599055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2067/4118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:48.614247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.615090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.621566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.622182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.622358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:48.622872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.624046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.624700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.625965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.632657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.633011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.633581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.707167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Going to try to stop instance {{(pid=128778) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:47:48.792436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17033dae-7551-452c-87a7-05d20ab8ba32 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac/action" status: 202 len: 0 microversion: 2.1 time: 0.174645 Sep 27 01:47:48.793439 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2068/4119] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:48 2022] POST /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:47:48.819247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.819853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.831362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.831853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.832285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.833290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.833791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.834314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.956261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:48.965901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25b0d71b-f515-4d9a-8eae-ae5cd0ead6e6 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.355913 Sep 27 01:47:48.966721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2052/4120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:48.971969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:48.972572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:48.978480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.979169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.979914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:48.980812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:48.981479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:48.982062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.111680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:49.119703 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83065670-35b8-4f4e-b83d-d665733050c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.308573 Sep 27 01:47:49.120293 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2069/4121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:49.125015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569322bb-20b6-42f6-9eb1-21a4555ab5c5", "name": "network-vif-plugged", "status": "completed", "tag": "6edc2454-f1e9-4b31-ae66-2fbc5b752e3a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:49.142191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:49.143014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:49.143775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.156195 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] Creating event network-vif-plugged:6edc2454-f1e9-4b31-ae66-2fbc5b752e3a for instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 on n-h2-859358-1 Sep 27 01:47:49.165623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1db53582-52a9-4d1b-9dc7-f95f3c54d343 req-76fbcf0f-a2f7-4879-9558-c1b2431cbd5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043818 Sep 27 01:47:49.166805 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2070/4122] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:49.326020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:49.334951 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a20b8a0b-9991-404f-ab48-fe6655e288a7 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.367045 Sep 27 01:47:49.335538 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2053/4123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:48 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:49.436032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:49.436650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:49.441431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:49.442229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:49.449981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:49.450812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:49.450976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:49.451418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:49.451945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.459512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.459512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:49.459512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:49.459512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.461423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:49.474392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:49.475059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:49.530627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:49.541632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-78b3a004-75eb-4d6b-857c-5c2d6bd2a6da tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1281 microversion: 2.1 time: 0.113490 Sep 27 01:47:49.542489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2071/4124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:49 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:49.681310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:49.690211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8720c0c-751c-43cf-ae9e-339c0e9786b5 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.260345 Sep 27 01:47:49.691123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2054/4125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:49 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:49.994915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:49.995736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:50.005038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.005732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.006178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.006895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.007626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.008678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.144321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:50.145043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:50.156478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.157330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.157798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.158511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.159047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.164526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.192589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:50.204300 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-abd1a3e6-219a-4764-853d-d83a64779851 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.216002 Sep 27 01:47:50.215218 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2072/4126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:49 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:50.362039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:50.362807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:50.372949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.373865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.374500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.376575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.377800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.378440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.431781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:50.443700 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ff09e6c-84ce-4176-9cbd-af26a8c8134b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.303748 Sep 27 01:47:50.459296 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2055/4127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:50 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:50.565166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:50.574232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:50.580479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.580964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.588294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.589060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.590216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.590834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.697008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:50.715923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18c2dbe3-ac91-4b86-a5e6-a4c718e3844e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1328 microversion: 2.1 time: 0.360742 Sep 27 01:47:50.719841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2073/4128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:50 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:50.731496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:50.732478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:50.749525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.749757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.750557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.751857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:50.753061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:50.753061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:50.873509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:50.888842 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-288a7ce7-8104-4239-aa75-9c3c41986e09 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.325120 Sep 27 01:47:50.892474 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2056/4129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:50 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:51.005969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:51.019864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12ee0d09-4ebf-4338-bdf5-a80befe5687d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.298306 Sep 27 01:47:51.020908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2074/4130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:50 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:51.226832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:51.227447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:51.234875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.235647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.236078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.236951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.237450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.237877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.519235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5729ea-b3ad-45da-b543-5a954b998ab1", "tag": "79a13365-8e57-49a5-bd85-23dc60df97a9"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:51.529753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.530477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.531082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.545463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] Creating event network-changed:79a13365-8e57-49a5-bd85-23dc60df97a9 for instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 on n-h1-859358-1 Sep 27 01:47:51.550457 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5dd702d3-777b-41aa-8d1f-b95dd1cc5e15 req-a77b18cf-0a41-42f3-a656-ea4220cdce72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175177 Sep 27 01:47:51.551074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2075/4131] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:51.556108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:51.556866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:51.563499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.563979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.564414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.565100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.565643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.566068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.589908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:51.597984 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d76e005-f114-4169-a258-fcf0200278ad tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.374887 Sep 27 01:47:51.598908 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2057/4132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:51 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:51.707747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:51.717655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d77dc886-2f13-46cf-baf0-1aa8ddaf6d47 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.165244 Sep 27 01:47:51.727932 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2076/4133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:51 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:51.741518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:51.742380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:51.748974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.749767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.750876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.751772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.752441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.752966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.920013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:51.920674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:51.931421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.932782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.936033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.936399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:51.939634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.941961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.942651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.946914 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e30af96a-2e33-4820-8435-2e4c3f1893e0 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1527 microversion: 2.1 time: 0.210527 Sep 27 01:47:51.948698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2058/4134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:51 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1527 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:51.971913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:51.973018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:51.981675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.982244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.983068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:51.983847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:51.985640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:51.986159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.178531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:52.189415 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8040737-9ed7-4499-ab22-10ce7e9a0b2f tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.276797 Sep 27 01:47:52.202306 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2077/4135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:51 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:52.207290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:52.212836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.213733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.220796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.221560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.221751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.222640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.223095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.223522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.229408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a50c94b-7593-43e0-95e1-3abdce33b6fe tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1527 microversion: 2.1 time: 0.251561 Sep 27 01:47:52.230677 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2059/4136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:51 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1527 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:52.385048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.385824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.393264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.394017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.394768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.395783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.396431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.397026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.415907 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] HTTP exception thrown: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Request method failure captured: Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 HTTP/1.1 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYzJNzM1HH87oxE19Hu9Rttbs5FkvyfOWoo_bBKtiJVLC3RPtbbisDCHhMxo0JoOH2R5ARybdeGQFtEQNTXmc3NjAK79BGzburvXn_eWMqCreL-k8R4SOlIz5tLMTQTQcMxT4UVrYQH23DWa4f-dCZDFPvW4LkG8wNP-YWUrA1aSiE Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4e606f6e1b534b8e85e9c46d359ef0a9 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e606f6e1b534b8e85e9c46d359ef0a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4e606f6e1b534b8e85e9c46d359ef0a9 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestMultiTenantJSON-96357867-project Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a5b2ab799a074d30b4a1143c71d07c22 Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867-project Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '569322bb-20b6-42f6-9eb1-21a4555ab5c5'} Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:47:52.418304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Returning 404 to user: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:52.424945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50accf48-1cfb-455b-8812-6dd5f9bf0da1 tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] 10.222.0.52 "DELETE /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 404 len: 111 microversion: 2.1 time: 0.167456 Sep 27 01:47:52.426541 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2060/4137] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:47:52 2022] DELETE /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:47:52.431890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.432693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.440693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.441250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.442005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.443077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.443857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.444560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.476795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:52.486430 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d7609e40-90f6-45b4-81d1-344d98225861 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.282754 Sep 27 01:47:52.487338 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2078/4138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:52 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:52.614466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:52.621976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.622589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.624697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a71fd9fe-5b2e-43db-8edf-1be499d66a2d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1527 microversion: 2.1 time: 0.198286 Sep 27 01:47:52.625355 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2061/4139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:52 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:52.634301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.634909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.635583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.636705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.637397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.637925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.647964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Action: 'update', calling method: >, body: {"server": {"name": "569322bb-20b6-42f6-9eb1-21a4555ab5c5_new"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:52.651212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.659143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.659887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.660548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.661600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.662258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.663136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.680020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] HTTP exception thrown: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Request method failure captured: Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 HTTP/1.1 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 64 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYzJNzM1HH87oxE19Hu9Rttbs5FkvyfOWoo_bBKtiJVLC3RPtbbisDCHhMxo0JoOH2R5ARybdeGQFtEQNTXmc3NjAK79BGzburvXn_eWMqCreL-k8R4SOlIz5tLMTQTQcMxT4UVrYQH23DWa4f-dCZDFPvW4LkG8wNP-YWUrA1aSiE Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4e606f6e1b534b8e85e9c46d359ef0a9 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4e606f6e1b534b8e85e9c46d359ef0a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4e606f6e1b534b8e85e9c46d359ef0a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4e606f6e1b534b8e85e9c46d359ef0a9 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestMultiTenantJSON-96357867-project Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a5b2ab799a074d30b4a1143c71d07c22 Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-96357867-project Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "569322bb-20b6-42f6-9eb1-21a4555ab5c5_new"}} Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '569322bb-20b6-42f6-9eb1-21a4555ab5c5', 'body': {'server': {'name': '569322bb-20b6-42f6-9eb1-21a4555ab5c5_new'}}} Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:47:52.683314 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:52.689525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:47:52.691755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] Returning 404 to user: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:52.692804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0bba8aa-4573-4efb-902c-80f80e2c394f tempest-ServersNegativeTestMultiTenantJSON-96357867 tempest-ServersNegativeTestMultiTenantJSON-96357867-project] 10.222.0.52 "PUT /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 404 len: 111 microversion: 2.1 time: 0.049386 Sep 27 01:47:52.697542 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2062/4140] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:47:52 2022] PUT /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:47:52.703124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "name": "network-vif-plugged", "status": "completed", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:52.714348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.715123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.715730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.730982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] Creating event network-vif-plugged:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h1-859358-1 Sep 27 01:47:52.736407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-cc8b25b8-f92e-4e4e-86b2-198374419665 req-68dc6675-a147-447e-9ef3-ddc1ef8708ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 Sep 27 01:47:52.737706 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2063/4141] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:52.743889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.744983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.753555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.754042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.754479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.755185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.755635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.756052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.784393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:47:52.884472 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65da5244-b1e7-4b4d-978e-e351c222980d tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "DELETE /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 204 len: 0 microversion: 2.1 time: 0.144681 Sep 27 01:47:52.892408 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2064/4142] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:47:52 2022] DELETE /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:47:52.898904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.899870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.910161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.910662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.911077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.911968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.912599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.913274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.922748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:52.947340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:52.967706 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3687e9c-1bfc-4aca-9397-9344533a1da8 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.349596 Sep 27 01:47:52.968310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2079/4143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:52 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:52.973233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:52.974118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:52.980878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.981688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.982342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:52.983249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:52.983697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:52.984303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:53.098484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:53.107147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e6be08e-3449-4f52-99a5-957d9e036565 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.213208 Sep 27 01:47:53.108077 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2065/4144] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:52 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:53.214649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:53.215410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:53.221475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:53.222029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:53.222488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:53.223193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:53.223639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:53.224061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:53.241812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:53.251786 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2de05f38-e3bf-469c-acc6-a96e35bd1971 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1533 microversion: 2.1 time: 0.281657 Sep 27 01:47:53.252546 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2080/4145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:52 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1533 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:53.365484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:53.373738 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2252d6f6-ad14-4660-9137-7173d976b4e8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.162925 Sep 27 01:47:53.374588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2066/4146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:53 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:53.512231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:53.512949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:53.519359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:53.519942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:53.521097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:53.521912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:53.522444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:53.522887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:53.525909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:53.745992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:53.755673 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd44c992-5c84-4715-91a8-035a2b8fec31 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.247301 Sep 27 01:47:53.756925 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2081/4147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:53 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:53.992645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:53.993299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:53.999619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.000106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.000935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.001676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.002130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.002553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.132164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:54.132696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:54.148377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.148883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.149320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.150195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.150927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.151353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.506723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:54.520670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6add0aca-fbfb-481c-9941-3a6694fbd258 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.389631 Sep 27 01:47:54.526974 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2082/4148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:54 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:54.541329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:54.542566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:54.555167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.560122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.560964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.563409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.564185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.564870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.740334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:54.751370 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58c9c2c1-c562-4233-a33f-577130014968 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.761997 Sep 27 01:47:54.768173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2067/4149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:53 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:54.773117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:54.781108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:54.798456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.799252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.799882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:54.800781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:54.802201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:54.803684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.041861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:55.056247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7ed4697-f6c0-43df-85df-093ac3e87b4e tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1533 microversion: 2.1 time: 0.526226 Sep 27 01:47:55.059963 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2083/4150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:54 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1533 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:55.073094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:55.076947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:55.096764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.097271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.106130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.106809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.107290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.107728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.115448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=36 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:55.231021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:55.240164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f3ca6fd-0e10-4e28-af00-43a4552faaff tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.470781 Sep 27 01:47:55.241256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2068/4151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:54 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:55.246561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:55.247271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:55.254399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.254828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.261982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.263090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.264104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.264801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.353142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:55.362630 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f81edac8-9955-441b-a83e-19e9aad91a48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.300760 Sep 27 01:47:55.363215 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2084/4152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:55 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:55.391177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'services' on Instance uuid ed495a20-430a-4b48-86ba-5518488b5f1e {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:47:55.498468 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1bd2d1b-8af2-439d-b4c2-29f837b3151d tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments/2388316d-1d83-4b88-a024-4040f98b3d48" status: 202 len: 0 microversion: 2.1 time: 0.255736 Sep 27 01:47:55.501527 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2069/4153] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:47:55 2022] DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments/2388316d-1d83-4b88-a024-4040f98b3d48 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:47:55.514745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:55.518017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:55.525192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.527003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.528245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.529224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.530216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.530824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.556389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:55.557628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:55.578698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.583078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.583781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.586242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.586892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.587506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.652765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-be27d102-905a-48f0-b473-42a0caaa66dc tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144258 Sep 27 01:47:55.654367 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2085/4154] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:47:55 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:55.787160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:55.787778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:55.804980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.805526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.805971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.808027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:55.808498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:55.808917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:55.976426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:55.999394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf38cd9d-7240-4814-bd04-bf743d2fdfe9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.457970 Sep 27 01:47:56.003620 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2070/4155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:55 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:56.009020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569322bb-20b6-42f6-9eb1-21a4555ab5c5", "name": "network-vif-deleted", "tag": "6edc2454-f1e9-4b31-ae66-2fbc5b752e3a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:56.027973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.028719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.029548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.046612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] Creating event network-vif-deleted:6edc2454-f1e9-4b31-ae66-2fbc5b752e3a for instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 on n-h2-859358-1 Sep 27 01:47:56.053950 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0a7f3680-8cf4-4eaf-8275-5c956cc12555 req-6933c4b8-6ea3-4020-a46e-2403efa71b6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048029 Sep 27 01:47:56.055317 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2071/4156] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:56.096257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:56.097146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:56.111745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.112249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.112682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.113437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.113893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.114316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.170280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.171133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.172487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.173120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lazy-loading 'fault' on Instance uuid 569322bb-20b6-42f6-9eb1-21a4555ab5c5 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:47:56.232537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:56.252369 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-92b28890-bf49-45e9-bf5a-d45386fbf2fe tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.469453 Sep 27 01:47:56.252979 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2086/4157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:55 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:47:56.279661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec94e2d23bf142c9ad6ed5c6720f6c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9bf77280c5c498ab36c92b1649d9a7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:56.290378 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfef7a9e-05bc-4437-b299-e38ffccd6f3f tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 200 len: 1318 microversion: 2.1 time: 0.206167 Sep 27 01:47:56.304655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2072/4158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:56 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:56.305369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:56.306065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:56.313621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.315496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.316136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.318065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.318882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.319309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.389108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:56.389980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:56.397812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.399230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.399994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.401758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.402613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.403294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.811860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:56.830103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22e848c7-2ad7-4953-a63a-35ed4cdf22a1 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.549059 Sep 27 01:47:56.845611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:56.847766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff476fea-4985-4eae-8422-3e552e0bb2e1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1518 microversion: 2.1 time: 0.464602 Sep 27 01:47:56.848556 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2073/4160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:56 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:56.848735 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2087/4160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:56 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:56.861843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:56.864860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:56.872593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.873160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.873551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.877927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:56.878641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:56.879604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:56.955275 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11a051bf-42e1-4c3f-9487-6c530632eda1 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105417 Sep 27 01:47:56.961012 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2074/4161] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:47:56 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:57.028099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:57.028715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:57.042565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.043063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.043503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.044224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.044679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.045108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.158719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0b7136-86dd-496f-8080-3e5cfc02ea29", "name": "network-vif-plugged", "status": "completed", "tag": "3055f70b-2034-44ee-ae98-2d81e453f68a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:57.177575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.178849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.179471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.199323 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] Creating event network-vif-plugged:3055f70b-2034-44ee-ae98-2d81e453f68a for instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 on n-h1-859358-1 Sep 27 01:47:57.215924 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6fc1d1c9-4edf-4196-ae48-627ab6d87a83 req-b93dfe22-18cc-4450-885e-f1862c94360d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066499 Sep 27 01:47:57.217099 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2075/4162] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:47:57.279008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:57.280190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:57.299265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.299864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.302100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.302953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.310134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.310950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.484768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:57.505681 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4de8197-9532-4d9f-87a2-4a4da8bbe81d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.480806 Sep 27 01:47:57.506780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2088/4163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:57 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:57.512482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:57.513186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] [instance: 569322bb-20b6-42f6-9eb1-21a4555ab5c5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:57.535185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.536554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.539801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.541004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.542048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.542769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.576300 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] HTTP exception thrown: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Request method failure captured: Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 HTTP/1.1 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlYlKqcsy2OY937K0xQSRpWeKgayreZ3lFb0MMOe-5puxkxFQCXBJcGdHy03KJdjOOarNQXgvyyA6HltdQCgBrettyYPkx7buxRrhOZ_Grs60LkuvxrmsB82ATJRKaVgeAUQBhVmJfbVh2yyEjWmyWkCVxWL2TaFebUHw0K-HjCDnXc Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a9bf77280c5c498ab36c92b1649d9a7e Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2147116103 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9bf77280c5c498ab36c92b1649d9a7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a9bf77280c5c498ab36c92b1649d9a7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a9bf77280c5c498ab36c92b1649d9a7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a9bf77280c5c498ab36c92b1649d9a7e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2147116103 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a9bf77280c5c498ab36c92b1649d9a7e Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2147116103 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2147116103-project Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ec94e2d23bf142c9ad6ed5c6720f6c73 Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2147116103-project Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '569322bb-20b6-42f6-9eb1-21a4555ab5c5'} Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:57.580905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. Sep 27 01:47:57.587565 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:57.590029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] Returning 404 to user: Instance 569322bb-20b6-42f6-9eb1-21a4555ab5c5 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:57.591386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b0d1461-eb8a-4c31-bc9a-9dbed8a12891 tempest-ServersNegativeTestMultiTenantJSON-2147116103 tempest-ServersNegativeTestMultiTenantJSON-2147116103-project] 10.222.0.52 "GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5" status: 404 len: 111 microversion: 2.1 time: 0.082912 Sep 27 01:47:57.592172 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2089/4164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:57 2022] GET /compute/v2.1/servers/569322bb-20b6-42f6-9eb1-21a4555ab5c5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:47:57.721777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:57.731780 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d460b365-ecde-41b6-838b-5b0cbfc33c41 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.459257 Sep 27 01:47:57.750738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2076/4165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:57 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:57.859332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:57.861055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:57.872022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:57.872947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:57.886129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:57.892317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.893790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.895860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.899101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.899953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.900408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.904858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.905706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.906449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:57.907815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:57.908449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:57.909654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.148675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:58.156975 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18880f68-6f7e-444f-a2ff-0b45e227630b tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.300866 Sep 27 01:47:58.158410 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2090/4166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:57 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:58.175052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:58.177517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:58.183952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=33 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:47:58.186241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.186962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.187901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.189533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.190228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.191440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.230340 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b11b7993-7fa9-45bd-817b-f20a56aa18d4 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059335 Sep 27 01:47:58.231154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2091/4167] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:47:58 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:58.278276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:58.314480 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ead79ca1-9b2d-4d99-8b9a-ad3c892c7332 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.447141 Sep 27 01:47:58.315410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2077/4168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:57 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:58.333822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0621d10b-cfa4-4f4e-a2ea-ba7fad89c012 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d56c9670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1954995220", "description": "tempest-description-220135538"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:58.343141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:58.343826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:58.371714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.376482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.377023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.377818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.378286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.378715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.628435 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0621d10b-cfa4-4f4e-a2ea-ba7fad89c012 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.395972 Sep 27 01:47:58.629400 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2092/4169] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:47:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:58.634807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:58.635605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:58.643224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.643708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.644136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.644830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.645282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.645725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.802508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:58.812204 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bd94e46-4de0-4f1b-a724-6b383c0fad6a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.473572 Sep 27 01:47:58.814075 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2078/4170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:58 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:58.827705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d1db0e6-0eda-42ed-bfd5-5ce0eab10a63 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d6d29280>, body: {"security_group_rule": {"parent_group_id": "18639917-f16a-4abd-a4a2-3799ea6fb10a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:58.896965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:58.907164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99be234b-c37c-42fd-803d-ffe6770099d5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.276467 Sep 27 01:47:58.908370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2093/4171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:58 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:58.914573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:58.919304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:58.931199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.931696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.932135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:58.932847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:58.933297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:58.933768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.246531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:59.255635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-72c29f61-a71e-4ff5-a042-d3bbd49d1acb tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1292 microversion: 2.1 time: 0.346000 Sep 27 01:47:59.257425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2094/4172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:58 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1292 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:59.262314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:59.263485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:59.270310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.271373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.272179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.273253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.273965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.274606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.526161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:59.538407 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1d113b2e-219d-4593-85eb-133494c9c2a1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.279549 Sep 27 01:47:59.539729 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2095/4173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:59 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:59.545604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:59.546472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:59.554250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.555085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.555701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.556659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.557286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.557918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.727173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:47:59.740224 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f20cbbf-2aaa-4605-be63-efdef9586bc8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.198151 Sep 27 01:47:59.754265 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2096/4174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:59 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:47:59.761516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:59.765225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:59.771989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.772782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.773479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.775079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.775718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.776329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.836059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b94facdf-08ec-4f2c-922a-fbddb62dece8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079860 Sep 27 01:47:59.837021 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2097/4175] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:47:59 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:47:59.852764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09ba10e6-f90b-4708-a550-a9a8301def39 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:47:59.858891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-09ba10e6-f90b-4708-a550-a9a8301def39 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09ba10e6-f90b-4708-a550-a9a8301def39 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/4346cc4f-d843-46e0-b2de-734ac1e77102/action HTTP/1.1 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: {"os-stop": {}} Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4346cc4f-d843-46e0-b2de-734ac1e77102', 'body': {'os-stop': {}}} Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:47:59.869840 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. Sep 27 01:47:59.875452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:47:59.877733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09ba10e6-f90b-4708-a550-a9a8301def39 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 4346cc4f-d843-46e0-b2de-734ac1e77102 has no mapping to a cell. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:47:59.878811 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09ba10e6-f90b-4708-a550-a9a8301def39 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/4346cc4f-d843-46e0-b2de-734ac1e77102/action" status: 404 len: 117 microversion: 2.1 time: 0.040749 Sep 27 01:47:59.879908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2098/4176] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:47:59 2022] POST /compute/v2.1/servers/4346cc4f-d843-46e0-b2de-734ac1e77102/action => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:47:59.888227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:47:59.889096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:47:59.905809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.906978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.907442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:47:59.908205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:47:59.908662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:47:59.909094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.109975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:00.121801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-96ac5c5f-f6dd-4953-96da-1cd7e53fbf5a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.237732 Sep 27 01:48:00.123528 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2099/4177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:47:59 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:00.131748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.133813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.143581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.145230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.145963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.146875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.148005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.148769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.160931 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d1db0e6-0eda-42ed-bfd5-5ce0eab10a63 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.344987 Sep 27 01:48:00.161990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2079/4178] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:47:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:00.166664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.167275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.180354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.181013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:00.181239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.181843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.182726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.183344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.183948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.343757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:00.352572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84bc5435-66ca-4abd-a3e5-edd3d2e75ae2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.226888 Sep 27 01:48:00.368814 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2100/4179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:00 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:00.373550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90849674-19a4-452d-8f7c-17c496129708 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d56c9e50>, body: {"security_group_rule": {"parent_group_id": "18639917-f16a-4abd-a4a2-3799ea6fb10a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:00.406354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:00.416587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30435187-835f-4b7a-8351-6fa9dd5e1f48 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.253623 Sep 27 01:48:00.419691 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2080/4180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:00 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:00.432173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.433060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.447865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.448706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.449356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.450641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.452797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.454291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.467540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-90849674-19a4-452d-8f7c-17c496129708 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90849674-19a4-452d-8f7c-17c496129708 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 138 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "18639917-f16a-4abd-a4a2-3799ea6fb10a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: exception: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': '18639917-f16a-4abd-a4a2-3799ea6fb10a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:00.469375 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:00.474378 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:00.474378 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a Sep 27 01:48:00.474378 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.476715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90849674-19a4-452d-8f7c-17c496129708 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: This rule already exists in group 18639917-f16a-4abd-a4a2-3799ea6fb10a {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:00.478247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90849674-19a4-452d-8f7c-17c496129708 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.108218 Sep 27 01:48:00.478859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2101/4181] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:00 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:48:00.484344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:00.484802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: ee48b6d8-ef88-481f-a420-6922592ef2fb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.502581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/ee48b6d8-ef88-481f-a420-6922592ef2fb/action HTTP/1.1 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: {"suspend": {}} Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ee48b6d8-ef88-481f-a420-6922592ef2fb', 'body': {'suspend': {}}} Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:00.504568 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:00.510711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:00.510711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:00.510711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. Sep 27 01:48:00.510711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:00.512411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance ee48b6d8-ef88-481f-a420-6922592ef2fb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:00.513521 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2e349cd-498c-4195-91c4-7894d13772ef tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/ee48b6d8-ef88-481f-a420-6922592ef2fb/action" status: 404 len: 111 microversion: 2.1 time: 0.033774 Sep 27 01:48:00.514630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2102/4182] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:00 2022] POST /compute/v2.1/servers/ee48b6d8-ef88-481f-a420-6922592ef2fb/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:00.519943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5729ea-b3ad-45da-b543-5a954b998ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79a13365-8e57-49a5-bd85-23dc60df97a9"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:00.533221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.534068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.534699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.550960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] Creating event network-vif-plugged:79a13365-8e57-49a5-bd85-23dc60df97a9 for instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 on n-h1-859358-1 Sep 27 01:48:00.556655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c8ed7997-c4da-4b9b-9fd7-a07a146777d2 req-d0f3e064-a88c-4bb6-bc8e-ef434cbc17ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Sep 27 01:48:00.557538 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2103/4183] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:00.565328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f10bff8b-4b3d-4280-a5dd-6b26babe42a1 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24da524af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.768483 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f10bff8b-4b3d-4280-a5dd-6b26babe42a1 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/58660366-7c72-470a-a344-fc6cf9f6d623" status: 202 len: 0 microversion: 2.1 time: 0.209325 Sep 27 01:48:00.769493 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2104/4184] 10.222.0.52 () {58 vars in 1287 bytes} [Tue Sep 27 01:48:00 2022] DELETE /compute/v2.1/os-security-group-rules/58660366-7c72-470a-a344-fc6cf9f6d623 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:00.777737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.778673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.792494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.793001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.793470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.794177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.794630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.795053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.809729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:00.819617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab9f5a35-476a-428c-9249-a3b6d912301b tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1483 microversion: 2.1 time: 0.398840 Sep 27 01:48:00.820207 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2081/4185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:00 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1483 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:00.833370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:00.834948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:00.846734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.849521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.853868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:00.855003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:00.855644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:00.858569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.027531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:01.052266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b9d470f9-fffa-46f2-8340-672cb960cea6 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.281521 Sep 27 01:48:01.078185 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2105/4186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:00 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:01.081266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:01.084322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3fb041f-268c-40c1-bd5f-7a104f1924b2 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d67fbdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-311209542", "description": "tempest-description-1176793561"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:01.095143 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f392307-7af8-4ac1-bb16-dbaae8d8a1ae tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1323 microversion: 2.1 time: 0.266053 Sep 27 01:48:01.096802 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2082/4187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:00 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:01.104384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:01.106602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.126579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.127525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.129176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.137048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.137857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.138423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.143952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:01.337657 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3fb041f-268c-40c1-bd5f-7a104f1924b2 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.257638 Sep 27 01:48:01.338986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2106/4188] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:48:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:01.344589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:01.347085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.361709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.362209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.362654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.363368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.363826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.364257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.402331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2236f9cd-0601-4bae-92fb-f04adc661e52 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061906 Sep 27 01:48:01.402845 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2107/4189] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:48:01 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:01.407915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:01.408526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.417537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.418037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.418474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.419190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.419645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.420328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.642602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:01.654551 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c5b2ae3-8b1a-46ec-9e01-aa4cc60bfe0e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.250582 Sep 27 01:48:01.669373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2108/4190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:01 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:01.670299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a190c05-d8e8-4ca5-8071-8f2c8bf2f195 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d56c9b80>, body: {"security_group_rule": {"parent_group_id": "224295e3-f4e2-4274-bdc3-224932690eb7", "ip_protocol": "tcp", "from_port": 1326605789, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:01.720471 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df5cdb6c-b970-4fd7-82ad-cc5de51ef9c3 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.622265 Sep 27 01:48:01.728299 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2083/4191] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:48:01 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29/os-interface => generated 285 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:01.728299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:01.728299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.734086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:01.748921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.749453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.751304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.752035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.752491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.752921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.761808 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7a190c05-d8e8-4ca5-8071-8f2c8bf2f195 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Invalid port range 1326605789:22. Former value cannot be greater than the later Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a190c05-d8e8-4ca5-8071-8f2c8bf2f195 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 146 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "224295e3-f4e2-4274-bdc3-224932690eb7", "ip_protocol": "tcp", "from_port": 1326605789, "to_port": 22}} Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid port range 1326605789:22. Former value cannot be greater than the later Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': '224295e3-f4e2-4274-bdc3-224932690eb7', 'ip_protocol': 'tcp', 'from_port': 1326605789, 'to_port': 22}}} Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1326605789:22. Former value cannot be greater than the later Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1326605789:22. Former value cannot be greater than the later Sep 27 01:48:01.764763 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1326605789:22. Former value cannot be greater than the later Sep 27 01:48:01.773545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.776018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a190c05-d8e8-4ca5-8071-8f2c8bf2f195 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: Invalid port range 1326605789:22. Former value cannot be greater than the later {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:01.777462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a190c05-d8e8-4ca5-8071-8f2c8bf2f195 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.120927 Sep 27 01:48:01.778727 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2109/4192] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:01 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:48:01.787292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:01.788422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.796529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.797468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.798166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.799159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.800571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.801256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.829817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'flavor' on Instance uuid 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:01.933247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c190588-1217-4dfb-a0d8-91f75f8fe380 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.152785 Sep 27 01:48:01.934314 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2110/4193] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:01 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:01.941780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb3d9c8-e059-4cf5-b142-c71554c8099f tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d64e0280>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1290639407", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:01.944126 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ecb3d9c8-e059-4cf5-b142-c71554c8099f tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Security group id should be uuid Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb3d9c8-e059-4cf5-b142-c71554c8099f tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 131 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1290639407", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group id should be uuid Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1290639407', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:01.945710 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:01.952271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 27 01:48:01.952271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:01.952271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb3d9c8-e059-4cf5-b142-c71554c8099f tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: Security group id should be uuid {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:01.952271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecb3d9c8-e059-4cf5-b142-c71554c8099f tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.011737 Sep 27 01:48:01.952271 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2111/4194] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:01 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:48:01.957030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:01.961722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:01.972801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.973913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.974382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:01.975611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:01.976072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:01.976512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.179833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:02.189818 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cefe260d-0eb8-4216-9d63-18075e5447f2 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1513 microversion: 2.1 time: 0.239398 Sep 27 01:48:02.191130 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2112/4195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:01 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:02.197629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c5c7d8d-c6dd-434c-bfd5-e53b44f70f47 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d56bae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-737401108", "description": "tempest-description-1063468215"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:02.492682 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c5c7d8d-c6dd-434c-bfd5-e53b44f70f47 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.300229 Sep 27 01:48:02.493797 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2113/4196] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:48:02 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:02.498527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:02.499364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:02.506910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.508022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.508959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.510064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.510895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.511787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.665225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:02.675355 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98c10d3c-0e9d-4f11-be26-e3d4e2da31d8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 200 len: 1519 microversion: 2.1 time: 0.180458 Sep 27 01:48:02.676820 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2114/4197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:02 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:02.682621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:02.686084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:02.694760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.696332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.697241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.698279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.699438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.700121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.745304 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d60768ec-2f03-4deb-8c5a-f08ac846be40 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066779 Sep 27 01:48:02.746065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2115/4198] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:48:02 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:02.752332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cd0ffc1-ce5f-4e41-8b1a-87efa6100891 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d570cc10>, body: {"security_group_rule": {"parent_group_id": "6de2b6e7-66a5-4b16-b246-f4f33e528e07", "ip_protocol": "tempest-999-2034869714", "from_port": 22, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:02.819399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7cd0ffc1-ce5f-4e41-8b1a-87efa6100891 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Invalid IP protocol tempest-999-2034869714. Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cd0ffc1-ce5f-4e41-8b1a-87efa6100891 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 157 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "6de2b6e7-66a5-4b16-b246-f4f33e528e07", "ip_protocol": "tempest-999-2034869714", "from_port": 22, "to_port": 22}} Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid IP protocol tempest-999-2034869714. Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6de2b6e7-66a5-4b16-b246-f4f33e528e07', 'ip_protocol': 'tempest-999-2034869714', 'from_port': 22, 'to_port': 22}}} Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2034869714. Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2034869714. Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:02.820937 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2034869714. Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cd0ffc1-ce5f-4e41-8b1a-87efa6100891 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: Invalid IP protocol tempest-999-2034869714. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7cd0ffc1-ce5f-4e41-8b1a-87efa6100891 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.075274 Sep 27 01:48:02.829510 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2116/4199] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:02 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 27 01:48:02.843088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.63"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:02.860771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:02.872417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.872417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.873426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.879480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:02.880177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:02.881836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:02.921052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:48:02.924293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquired lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:48:02.960067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:02.973389 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af9a51b6-529b-40f1-88cc-81980dd912f9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 1.250404 Sep 27 01:48:02.975495 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2084/4200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:01 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:02.980725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-758f443c-2322-4ea5-b640-72fbd0ca0c00 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d6245700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-753689267", "description": "tempest-description-1172096338"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:03.542966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-758f443c-2322-4ea5-b640-72fbd0ca0c00 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.565989 Sep 27 01:48:03.558173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2085/4201] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:48:02 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:03.569938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:03.574358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:03.583955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:03.584856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:03.585511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:03.586426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:03.587336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:03.588355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:03.867637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:03.884965 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-954080c0-6c46-4814-a528-30d4934fb0fd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1496 microversion: 2.1 time: 0.325150 Sep 27 01:48:03.886271 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2086/4202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:03 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1496 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:03.899266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3f2bdde-e983-40e2-8a03-e957f43b5f34 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d6245b80>, body: {"security_group_rule": {"parent_group_id": "768426da-6c29-4f2a-86af-a15c0f6c0843", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:03.997664 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e3f2bdde-e983-40e2-8a03-e957f43b5f34 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3f2bdde-e983-40e2-8a03-e957f43b5f34 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 138 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: {"security_group_rule": {"parent_group_id": "768426da-6c29-4f2a-86af-a15c0f6c0843", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'security_group_rule': {'parent_group_id': '768426da-6c29-4f2a-86af-a15c0f6c0843', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 27 01:48:04.002302 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 27 01:48:04.006769 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.011350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3f2bdde-e983-40e2-8a03-e957f43b5f34 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:04.012528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3f2bdde-e983-40e2-8a03-e957f43b5f34 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.120307 Sep 27 01:48:04.013735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2087/4203] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:03 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:48:04.020460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:04.023136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:04.030757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.032246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.032949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.033964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.034654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.035339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.079291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9a5b1b8-05b4-4ab1-9546-a76c88918a48 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064221 Sep 27 01:48:04.079886 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2088/4204] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 01:48:04 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:48:04.084611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:04.085148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:04.110329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.110823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.111307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.112019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.112468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.112890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.147884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lazy-loading 'flavor' on Instance uuid 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:04.163974 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'suspend' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state suspended Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 15 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: {"suspend": {}} Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'suspend' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state suspended Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'suspend': {}}} Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 27 01:48:04.166325 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state suspended Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state suspended Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'suspend' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state suspended {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70110546-0109-46b1-a8ea-bc7ed611a899 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 148 microversion: 2.1 time: 0.087411 Sep 27 01:48:04.171071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2089/4205] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:04 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 148 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:04.193621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:04.201378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:04.209723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.210382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.210946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.211796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:04.212374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:04.212940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:04.621014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:04.633147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa074ca1-6135-4e59-a12f-903df187e4a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.461655 Sep 27 01:48:04.635285 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2090/4206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:04 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:04.648172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c9b72e2-5349-4aa0-870b-edc0b7fa4bed tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d5fad0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-166459734", "description": "tempest-description-1778348123"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:04.958202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:05.040377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c9b72e2-5349-4aa0-870b-edc0b7fa4bed tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.403826 Sep 27 01:48:05.041909 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2091/4207] 10.222.0.52 () {60 vars in 1180 bytes} [Tue Sep 27 01:48:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:05.047354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:05.047902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:05.067228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.067732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.068171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.069101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.069590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.070209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.211920 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa641355-877d-4175-944c-dca243810716 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 202 len: 0 microversion: 2.1 time: 0.168308 Sep 27 01:48:05.216174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2092/4208] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:05 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:05.226308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:05.237470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:05.255035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.255539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.260988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.263645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.264139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.264585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.321471 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Cannot 'reboot' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action HTTP/1.1 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 28 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: {"reboot": {"type": "HARD"}} Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'reboot' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f49f1896-6732-4612-b2f2-b3f2f0a2f885', 'body': {'reboot': {'type': 'HARD'}}} Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:05.324142 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:05.332159 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:05.334114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 409 to user: Cannot 'reboot' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:05.336471 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3dbe896b-5eaf-4bb8-ad1c-e42af5949bd2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action" status: 409 len: 145 microversion: 2.1 time: 0.118366 Sep 27 01:48:05.338030 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2093/4209] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:05 2022] POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action => generated 145 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:05.346037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:05.348460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:05.356607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.357468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.358323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.359310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.360679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.361304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.806371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Updating instance_info_cache with network_info: [{"id": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37", "address": "fa:16:3e:ad:67:23", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4bb9ae5c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:05.827916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Releasing lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:48:05.829613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0cbf4dd-0290-4cd4-811d-e39c4eee8045 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action" status: 202 len: 0 microversion: 2.1 time: 2.998865 Sep 27 01:48:05.833592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2117/4210] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:02 2022] POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action => generated 0 bytes in 3010 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:48:05.836833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:05.844073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0b7136-86dd-496f-8080-3e5cfc02ea29", "tag": "3055f70b-2034-44ee-ae98-2d81e453f68a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:05.855611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.856505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.857137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.860773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d1be9f0-e922-4f08-8c62-13dee3517137 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1483 microversion: 2.1 time: 0.521249 Sep 27 01:48:05.866414 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2094/4211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:05 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1483 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:05.877359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:05.880050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] Creating event network-changed:3055f70b-2034-44ee-ae98-2d81e453f68a for instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 on n-h1-859358-1 Sep 27 01:48:05.893320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e24b4baa-3054-40cd-84cb-1a3ac8ef9faf req-dbd55a68-171b-4bdb-9c26-eb989ff5bd07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058394 Sep 27 01:48:05.894269 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2118/4212] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:05.901862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-824eb629-9ab9-4034-9b83-6bff7b3a3d45 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24d56ba040>, body: {"security_group_rule": {"parent_group_id": "ad5b0955-175e-4f13-b273-7f8acf04c349", "ip_protocol": "tcp", "from_port": 22, "to_port": 161631745}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:05.909957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.910986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.911628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.925382 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] Creating event network-changed:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:48:05.936782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b629e93f-6287-4e19-aeb8-f1ddd0bb8584 req-12dcb54f-3a0a-45e0-8ba5-348297fbba17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064593 Sep 27 01:48:05.939186 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2095/4213] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:05.952211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:05.953327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:05.974270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.976175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.978090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:05.980480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:05.981179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:05.983175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.063938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-824eb629-9ab9-4034-9b83-6bff7b3a3d45 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-824eb629-9ab9-4034-9b83-6bff7b3a3d45 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 145 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "ad5b0955-175e-4f13-b273-7f8acf04c349", "ip_protocol": "tcp", "from_port": 22, "to_port": 161631745}} Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ad5b0955-175e-4f13-b273-7f8acf04c349', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 161631745}}} Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 Sep 27 01:48:06.066563 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-824eb629-9ab9-4034-9b83-6bff7b3a3d45 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 400 to user: Invalid port range 22:161631745. Valid TCP ports should be between 1-65535 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-824eb629-9ab9-4034-9b83-6bff7b3a3d45 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.172623 Sep 27 01:48:06.074446 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2119/4214] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:05 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:48:06.080727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:06.083637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:06.094212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.094715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.095158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.095886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.096344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.096799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.145873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Cannot 'rebuild' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action HTTP/1.1 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 65 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'rebuild' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f49f1896-6732-4612-b2f2-b3f2f0a2f885', 'body': {'rebuild': {'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27'}}} Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:06.147974 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued Sep 27 01:48:06.152572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.155913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 409 to user: Cannot 'rebuild' instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 while it is in vm_state rescued {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:06.157141 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e81b6c1-90ca-41e1-b756-a94030971269 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action" status: 409 len: 146 microversion: 2.1 time: 0.082389 Sep 27 01:48:06.158307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2120/4215] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:06 2022] POST /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885/action => generated 146 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:06.163426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:06.164331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:06.209212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.210163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.216101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.218133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.219942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.220794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.516056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:06.523988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-037623bd-fa44-4b38-ac6c-99608677726b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1502 microversion: 2.1 time: 0.581957 Sep 27 01:48:06.524789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2096/4216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:05 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1502 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:06.529718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.63"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:06.533051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:06.540232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.540923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.541374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.542262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.542893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.543329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.583758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:48:06.584453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquired lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:48:06.625517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:06.635937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ea44e25-776d-4231-aae8-bff5137bf15c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.476169 Sep 27 01:48:06.637027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2121/4217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:06 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:06.643947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Action: 'create', calling method: .version_select at 0x7f24da735ca0>, body: {"security_group_rule": {"parent_group_id": "4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:06.682368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:48:06.682995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Neutron security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 not found {{(pid=128778) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 27 01:48:06.686410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.686410 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 138 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: {"security_group_rule": {"parent_group_id": "4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:48:06.690240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 404 to user: Security group 4e3e6cf2-d4ce-4b70-86f4-4dc42f8468f9 does not exist Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-b3613429-6377-406d-88ea-3001ea02b652'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:06.694750 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b8f00f4-3a39-4ad1-a388-b921fbad380a tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.053298 Sep 27 01:48:06.699092 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2122/4218] 10.222.0.52 () {60 vars in 1195 bytes} [Tue Sep 27 01:48:06 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:06.704578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:06.705142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:06.714556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.715309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.715881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.716549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.717034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.718141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.750843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:06.841287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:06.868709 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89dfe257-68ac-430f-9f62-6ab0bc9a2222 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 204 len: 0 microversion: 2.1 time: 0.168115 Sep 27 01:48:06.869457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2123/4219] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:06 2022] DELETE /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:06.875497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d571aa60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:06.903200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG neutronclient.v2_0.client [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist", "detail": ""}} {{(pid=128778) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 27 01:48:06.904127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.security_group_api [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Neutron security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 not found {{(pid=128778) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 27 01:48:06.904797 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] HTTP exception thrown: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.904797 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Request method failure captured: Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-security-group-rules/5b295444-cbee-4cd4-8258-82fa9f6dd116 HTTP/1.1 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZNMZKCH4X2hDPgh1RlwFDdFKrcU2X3-smJjypwd8DWLQZy--zpW1loZMO5_YCRGPJiw1tZCo-HWKjX15D8hvoaKECa_WijNI7-hLbZ-1YGd_mHYZFRPEjB3VbidUl2h8B0NRjkAMaXVm5EqQxq2AKHsPaUDnSinisyhfcT40KjGUM Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c7ccc53f02a44b67b1305282d2fcde52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c7ccc53f02a44b67b1305282d2fcde52", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c7ccc53f02a44b67b1305282d2fcde52 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5d8d533689ae40bcb0008c763673bdd1 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: exception: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5b295444-cbee-4cd4-8258-82fa9f6dd116'} Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 27 01:48:06.907383 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Returning 404 to user: Security group rule 5b295444-cbee-4cd4-8258-82fa9f6dd116 does not exist Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: Neutron server returns request_ids: ['req-d404393c-40d2-4d9c-b828-b4e42d6c51ca'] {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b9a6ce2-d207-4643-a58e-a239898cac13 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/5b295444-cbee-4cd4-8258-82fa9f6dd116" status: 404 len: 199 microversion: 2.1 time: 0.038225 Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2124/4220] 10.222.0.52 () {58 vars in 1287 bytes} [Tue Sep 27 01:48:06 2022] DELETE /compute/v2.1/os-security-group-rules/5b295444-cbee-4cd4-8258-82fa9f6dd116 => generated 199 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:06.917660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:06.924515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.925151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.927673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.927673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:06.927898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:06.928335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:06.949157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:07.071075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:07.079417 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf67e952-d106-436f-8f9e-b2ba45aafb0a tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1689 microversion: 2.1 time: 0.168450 Sep 27 01:48:07.079982 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2125/4221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:06 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:07.085423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e1ea228-3ceb-4fd1-bc21-c55dcbba1e6c tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d571aa60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:07.272429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e1ea228-3ceb-4fd1-bc21-c55dcbba1e6c tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/ad5b0955-175e-4f13-b273-7f8acf04c349" status: 202 len: 0 microversion: 2.1 time: 0.190574 Sep 27 01:48:07.273042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2126/4222] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:48:07 2022] DELETE /compute/v2.1/os-security-groups/ad5b0955-175e-4f13-b273-7f8acf04c349 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:07.280837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8066feb9-fe95-4bc0-ba86-d44c5a3f3938 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d5be2280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:07.476146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8066feb9-fe95-4bc0-ba86-d44c5a3f3938 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/768426da-6c29-4f2a-86af-a15c0f6c0843" status: 202 len: 0 microversion: 2.1 time: 0.198900 Sep 27 01:48:07.476981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2127/4223] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:48:07 2022] DELETE /compute/v2.1/os-security-groups/768426da-6c29-4f2a-86af-a15c0f6c0843 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:07.485510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-728678da-479f-42f7-aa0d-210e1aca0529 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d5688ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:07.669039 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-728678da-479f-42f7-aa0d-210e1aca0529 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/6de2b6e7-66a5-4b16-b246-f4f33e528e07" status: 202 len: 0 microversion: 2.1 time: 0.187962 Sep 27 01:48:07.670032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2128/4224] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:48:07 2022] DELETE /compute/v2.1/os-security-groups/6de2b6e7-66a5-4b16-b246-f4f33e528e07 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:07.675375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:07.676089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:07.685598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:07.686155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:07.687861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:07.689117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:07.689868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:07.690366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:07.824573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:07.833146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a5aa588-2bf5-4523-9fa4-5b468cac7718 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1502 microversion: 2.1 time: 0.161785 Sep 27 01:48:07.833838 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2129/4225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:07 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:07.838443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:07.839127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:07.845706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:07.846256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:07.846775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:07.847533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:07.848049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:07.848538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:07.977517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:07.986186 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da98da95-eea3-49d7-90e2-9d5cab817054 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.151249 Sep 27 01:48:07.986949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2130/4226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:07 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:08.000961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b99bca00-8245-44e7-a67c-77baad47ab31 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d56eddc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:08.181969 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b99bca00-8245-44e7-a67c-77baad47ab31 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/224295e3-f4e2-4274-bdc3-224932690eb7" status: 202 len: 0 microversion: 2.1 time: 0.193817 Sep 27 01:48:08.183239 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2131/4227] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:48:07 2022] DELETE /compute/v2.1/os-security-groups/224295e3-f4e2-4274-bdc3-224932690eb7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:08.189050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:08.189908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:08.196853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:08.197649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:08.198115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:08.198816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:08.199263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:08.199693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:08.333978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:08.344283 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afba09c3-089c-450a-a5b1-f8e7f0175865 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1689 microversion: 2.1 time: 0.157880 Sep 27 01:48:08.345001 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2132/4228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:08 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:08.350956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f2feb4d-3c1e-4025-ba29-d5d3ada89a52 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] Calling method '.version_select at 0x7f24d56edb80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:08.536183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f2feb4d-3c1e-4025-ba29-d5d3ada89a52 tempest-SecurityGroupRulesNegativeTestJSON-1551712795 tempest-SecurityGroupRulesNegativeTestJSON-1551712795-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/18639917-f16a-4abd-a4a2-3799ea6fb10a" status: 202 len: 0 microversion: 2.1 time: 0.189712 Sep 27 01:48:08.540536 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2133/4229] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:48:08 2022] DELETE /compute/v2.1/os-security-groups/18639917-f16a-4abd-a4a2-3799ea6fb10a => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:08.856324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:08.856850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:08.863820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:08.864304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:08.864733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:08.865513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:08.865968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:08.866387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:09.009793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:09.018172 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-338d24dc-17a3-4630-9ac1-2694a7b638cb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1502 microversion: 2.1 time: 0.165695 Sep 27 01:48:09.018911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2134/4230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:08 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:09.023474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:09.024157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:09.030809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:09.031301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:09.031789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:09.032488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:09.033008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:09.033523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:09.171351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:09.179639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a86ad747-e9ae-4302-b162-9f6394acda1d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.159869 Sep 27 01:48:09.193520 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2135/4231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:09 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:09.367450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:09.368061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:09.374449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:09.374993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:09.375426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:09.376113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:09.376567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:09.376994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:09.515851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:09.523665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-968a974e-5c22-48ae-a3d3-8acb9af643e2 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1689 microversion: 2.1 time: 0.160064 Sep 27 01:48:09.524243 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2136/4232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:09 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:10.042547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:10.043239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:10.049481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.051247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.051247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:10.051509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.066724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.067290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:10.244070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:10.257459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad36a1c5-9332-4f70-a0d5-de2e699042c1 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1502 microversion: 2.1 time: 0.216059 Sep 27 01:48:10.279904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2137/4233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:10 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:10.289041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:10.294414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:10.306625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.307126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.307644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:10.308370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.308844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.309277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:10.953915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:10.962939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-370ee2a8-d1ff-4a7b-aa1d-370415b8a5fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.681959 Sep 27 01:48:10.963495 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2138/4234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:10 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:10.970715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:10.971464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:10.981799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.982810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.983595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:10.987792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:10.988440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:10.988897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.298024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:11.318157 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e8eb62c-f5ea-4f74-9237-37d44ed225b3 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1689 microversion: 2.1 time: 0.352252 Sep 27 01:48:11.320256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2139/4235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:10 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1689 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:11.325280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:11.347988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:11.348841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:11.349521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.365029 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] Creating event network-changed:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:48:11.371048 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d5d918ad-8084-49b8-8044-dbb98818f2f6 req-c7cf7def-1e68-41e0-ad82-f59c9340e110 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049169 Sep 27 01:48:11.372582 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2140/4236] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:11.381876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:11.383180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:11.391136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:11.392079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:11.393395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.394457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:11.395134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:11.395773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.703797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:11.731106 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56a9e85b-61a3-408f-96fd-9cb60d92b177 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.354626 Sep 27 01:48:11.737127 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2141/4237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:11 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:11.774504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:11.776357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:11.784966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:11.787952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.neutron [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] re-assign floating IP 172.25.2.63 from instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 Sep 27 01:48:11.797910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:11.799122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.802156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:11.803332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:11.803812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:11.910315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Building network info cache for instance {{(pid=128779) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:12.114754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:12.146579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd950b65-5a2e-4394-980e-e15699e9084b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.389546 Sep 27 01:48:12.165373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2142/4238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:11 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:12.172482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:12.173477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:12.182478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.183328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.184127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:12.185178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.185928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.187720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:12.561580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:12.590538 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e2c35048-5b4f-42b5-aa41-748ef9ef3057 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.417491 Sep 27 01:48:12.591805 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2143/4239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:12 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:12.597350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:12.598096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: c50bc373-2dc3-49f3-bad9-4a1904711f46] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:12.604942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/c50bc373-2dc3-49f3-bad9-4a1904711f46/action HTTP/1.1 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: {"unpause": {}} Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'c50bc373-2dc3-49f3-bad9-4a1904711f46', 'body': {'unpause': {}}} Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:12.607194 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:12.613257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:12.613257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:12.613257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. Sep 27 01:48:12.613257 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:12.614846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance c50bc373-2dc3-49f3-bad9-4a1904711f46 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:12.615891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9eb133dc-e0ca-4a3e-840f-3e18d3e230a0 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/c50bc373-2dc3-49f3-bad9-4a1904711f46/action" status: 404 len: 111 microversion: 2.1 time: 0.022972 Sep 27 01:48:12.620291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2144/4240] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:12 2022] POST /compute/v2.1/servers/c50bc373-2dc3-49f3-bad9-4a1904711f46/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:12.627288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:12.628559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:12.638635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.639490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.639932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:12.640705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.641155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.641620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:12.770563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:12.781975 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9a5c0d1-99ca-490e-aeb3-ee24e7d67b87 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1621 microversion: 2.1 time: 0.159786 Sep 27 01:48:12.803448 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2145/4241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:12 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1621 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:12.826165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:12.829662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:12.838429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.839965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.840990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:12.842069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:12.842773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:12.843507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:13.257236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:13.266993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63328b61-6bf9-4db4-9eac-6dfe58ecc01f tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.459619 Sep 27 01:48:13.267597 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2146/4242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:12 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:13.294947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:13.295560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:13.307285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:13.308453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:13.310394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:13.311307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:13.313463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:13.314262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:13.683895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:13.705924 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95abe8da-fdeb-4fdf-9355-60e7d67204cd tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.411963 Sep 27 01:48:13.709922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2147/4243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:13 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:13.719906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:13.720532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:13.735535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:13.736527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:13.737213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:13.738184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:13.738868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:13.739628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:13.775157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Updating instance_info_cache with network_info: [{"id": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37", "address": "fa:16:3e:ad:67:23", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4bb9ae5c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:13.784674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Building network info cache for instance {{(pid=128779) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:13.937585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:13.941321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:13.951357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc67bd9b-e113-4548-be32-1e3c11235da0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.237613 Sep 27 01:48:13.956760 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2148/4244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:13 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:13.966348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5729ea-b3ad-45da-b543-5a954b998ab1", "tag": "79a13365-8e57-49a5-bd85-23dc60df97a9"}, {"server_uuid": "ed495a20-430a-4b48-86ba-5518488b5f1e", "name": "network-vif-deleted", "tag": "ae97b84f-5fe7-46ba-8847-2c549cd63734"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:13.996258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:13.997088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:13.997869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.013569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Creating event network-changed:79a13365-8e57-49a5-bd85-23dc60df97a9 for instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 on n-h1-859358-1 Sep 27 01:48:14.014301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] Creating event network-vif-deleted:ae97b84f-5fe7-46ba-8847-2c549cd63734 for instance ed495a20-430a-4b48-86ba-5518488b5f1e on n-h1-859358-1 Sep 27 01:48:14.024253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fc1c7336-c1a1-48e8-93ba-9f7726c45226 req-17f58e5d-61c6-48b2-ae5a-f1e437fce66f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066298 Sep 27 01:48:14.025125 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2149/4245] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:14.038431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:14.039624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:14.053510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.058546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.059235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.060244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.063046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.063671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.106838 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'unpause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 15 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: {"unpause": {}} Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: exception: Cannot 'unpause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'unpause': {}}} Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state active. Cannot unpause while the instance is in this state. Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:14.109790 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:14.115019 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:14.115019 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:14.115019 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:14.115019 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:14.115019 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:14.118814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'unpause' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:14.119638 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb219757-0ae1-4835-8793-c84ee6a3bd2b tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 145 microversion: 2.1 time: 0.093234 Sep 27 01:48:14.121147 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2150/4246] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:14 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 145 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:14.130438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:14.131631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:14.139130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.139975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.141388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.142791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.143973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.145235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.210014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.210757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.211391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.212015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'fault' on Instance uuid ed495a20-430a-4b48-86ba-5518488b5f1e {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:14.303998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:14.316940 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-533af518-3fde-417a-a6d9-ed88bdd11982 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 200 len: 1334 microversion: 2.1 time: 0.194169 Sep 27 01:48:14.319833 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2151/4247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:14 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:14.328957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:14.331245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:14.344547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.348687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.353245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.361911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.363128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.363754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.736629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:14.759554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e643f22c-60ef-408b-8f00-a22df129fe32 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.436432 Sep 27 01:48:14.763863 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2152/4248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:14 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:14.790932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:14.792534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:14.804265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.807086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.808343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:14.809426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:14.810127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:14.810977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:15.027849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:15.037083 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2922ca5-0ebb-4ef5-b884-5fefcc089c74 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.250611 Sep 27 01:48:15.049630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2153/4249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:14 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:15.049630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:15.049630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:15.058230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:15.222186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:15.230811 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-878fbea1-7290-420a-a0f4-989dfa893afe tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.190214 Sep 27 01:48:15.231407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2154/4250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:15 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:15.236373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:15.236982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: a41f34c6-fe04-4018-82fd-8ed7ae36d5ec] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:15.243035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/a41f34c6-fe04-4018-82fd-8ed7ae36d5ec/action HTTP/1.1 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 18 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: {"unshelve": null} Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a41f34c6-fe04-4018-82fd-8ed7ae36d5ec', 'body': {'unshelve': None}} Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:15.244582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:15.251917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance a41f34c6-fe04-4018-82fd-8ed7ae36d5ec could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:15.257202 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f7cc752-0716-4446-9c12-7c52fbe374fb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/a41f34c6-fe04-4018-82fd-8ed7ae36d5ec/action" status: 404 len: 111 microversion: 2.1 time: 0.013656 Sep 27 01:48:15.260889 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2155/4251] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:15 2022] POST /compute/v2.1/servers/a41f34c6-fe04-4018-82fd-8ed7ae36d5ec/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:15.267850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:15.268665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:15.276015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:15.280863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:15.281431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:15.282314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:15.285140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:15.285734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:15.530245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:15.555102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47d26a48-8eed-4e3e-8199-394321db7d42 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.292391 Sep 27 01:48:15.563614 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2156/4252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:15 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:16.047697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:16.048331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: ed495a20-430a-4b48-86ba-5518488b5f1e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.055140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.055854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.056491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.057463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.058100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.058511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.079139 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e HTTP/1.1 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ed495a20-430a-4b48-86ba-5518488b5f1e'} Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:16.080964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. Sep 27 01:48:16.085905 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.088584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 404 to user: Instance ed495a20-430a-4b48-86ba-5518488b5f1e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:16.090190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-193dccdf-c3c9-40d1-8905-bbf670efe2db tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e" status: 404 len: 111 microversion: 2.1 time: 0.524525 Sep 27 01:48:16.091510 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2157/4253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:15 2022] GET /compute/v2.1/servers/ed495a20-430a-4b48-86ba-5518488b5f1e => generated 111 bytes in 527 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:16.092275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Updating instance_info_cache with network_info: [{"id": "79a13365-8e57-49a5-bd85-23dc60df97a9", "address": "fa:16:3e:54:35:b1", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79a13365-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:16.101301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:16.102329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.114468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.115223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.116760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.118176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.119915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.120343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.122547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Releasing lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128779) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:48:16.128740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aec2caac-4287-4634-a9bb-fd256f9e8ccc tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1/action" status: 202 len: 0 microversion: 2.1 time: 9.597476 Sep 27 01:48:16.138191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2097/4254] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:06 2022] POST /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1/action => generated 0 bytes in 9612 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:48:16.143342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4812483f-339d-4a78-81d6-d534ce0e0451 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '.version_select at 0x7f24d685eb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:16.173730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4812483f-339d-4a78-81d6-d534ce0e0451 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695262552" status: 202 len: 0 microversion: 2.1 time: 0.034207 Sep 27 01:48:16.174348 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2098/4255] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 01:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695262552 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:16.179244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.63"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:16.379833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:16.392584 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68cff67f-342b-4d66-bbec-cfee45970348 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.298185 Sep 27 01:48:16.396254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2158/4256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:16 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:16.424289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:16.424680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.430022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.439530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.440161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.441438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.442778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.443460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.444205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.459000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.459492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.462728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.464069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.464544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.464980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.881789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:16.887363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] HTTP exception thrown: Floating IP 172.25.2.63 is not associated with instance b5dfd062-7c50-430b-ac4f-96a7d20426c1. Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Request method failure captured: Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action HTTP/1.1 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 48 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYXKqE8D6RZA9SPmCrcfgE0VydS_Xoo-JiIwWLp_mYQzk4L_3JxIDG26v2HF7O__sayXCZ_nKtY6F7yD560_8rsWmWtaT4b0uLJWMTx8w4eWmN7OWgRAw4GIBCqiGBQc5DR9eTWV92tGZrwoGP1EnIMspjC8K_ERM5ZhQQMX2-fGUY Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a83889d9e154610a95d9731581eaac7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5c30541b7e1c4f36aa873067f4d0d886 Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: {"removeFloatingIp": {"address": "172.25.2.63"}} Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: exception: Floating IP 172.25.2.63 is not associated with instance b5dfd062-7c50-430b-ac4f-96a7d20426c1. Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'b5dfd062-7c50-430b-ac4f-96a7d20426c1', 'body': {'removeFloatingIp': {'address': '172.25.2.63'}}} Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.63 is not associated with instance b5dfd062-7c50-430b-ac4f-96a7d20426c1. Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.63 is not associated with instance b5dfd062-7c50-430b-ac4f-96a7d20426c1. Sep 27 01:48:16.889095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.897501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Returning 409 to user: Floating IP 172.25.2.63 is not associated with instance b5dfd062-7c50-430b-ac4f-96a7d20426c1. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:16.897501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea5626f1-713b-457b-8309-d5ea64a16d51 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action" status: 409 len: 145 microversion: 2.1 time: 0.715111 Sep 27 01:48:16.897501 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2099/4257] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:16 2022] POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action => generated 145 bytes in 722 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:16.901694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:16.902375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.902851 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f42151a-25bb-486b-99ea-d4f7d8e9ec7e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.505306 Sep 27 01:48:16.909379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.909879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.910312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.911012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.911982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.912410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.924477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2159/4258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:16 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:16.929974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.63"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:16.953324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Cannot 'unshelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action HTTP/1.1 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 18 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: {"unshelve": null} Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: exception: Cannot 'unshelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'unshelve': None}} Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 in vm_state active. Cannot unshelve while the instance is in this state. Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 01:48:16.955224 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 409 to user: Cannot 'unshelve' instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 while it is in vm_state active {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebb59f86-2fb9-4aa4-b290-e6d20861e415 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action" status: 409 len: 146 microversion: 2.1 time: 0.058762 Sep 27 01:48:16.961267 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2100/4259] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:16 2022] POST /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6/action => generated 146 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:48:16.965300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:16.965951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:16.972775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.973842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.974278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:16.975176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:16.975628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:16.976497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.164309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:17.176004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de82dbf8-2e81-46e5-a300-9d6a78273787 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.214339 Sep 27 01:48:17.177320 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2101/4260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:16 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:17.199980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:17.200606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.207492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.208078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.208863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.209645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.210167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.210675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.281094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.292321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.294308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.295123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.297840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.298572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.299287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.475277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:17.477714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:17.485450 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17b01013-e1f4-4c98-a448-e92ee7516b0a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.289301 Sep 27 01:48:17.486711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2102/4261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:17 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:17.518640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1862331508_updated"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:17.521728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: f4bde61b-f685-4828-8c45-4f02c64631a9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.529853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/f4bde61b-f685-4828-8c45-4f02c64631a9 HTTP/1.1 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 81 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1862331508_updated"}} Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f4bde61b-f685-4828-8c45-4f02c64631a9', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1862331508_updated'}}} Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 27 01:48:17.532557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. Sep 27 01:48:17.538349 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:17.540902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance f4bde61b-f685-4828-8c45-4f02c64631a9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:17.541992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45a7dd45-01a2-49cf-bc84-3f85f05afccf tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "PUT /compute/v2.1/servers/f4bde61b-f685-4828-8c45-4f02c64631a9" status: 404 len: 111 microversion: 2.1 time: 0.028373 Sep 27 01:48:17.546147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2103/4262] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:48:17 2022] PUT /compute/v2.1/servers/f4bde61b-f685-4828-8c45-4f02c64631a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:17.552122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:17.552920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.562516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.563284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.563906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.564846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.565631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.566230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.735156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:17.745473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82f96e8e-2cf3-4c30-8cd9-cbe39305b656 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.197493 Sep 27 01:48:17.746134 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2104/4263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:17 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:17.771569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:17.772180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.778863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.779649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.780286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.781569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.782245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.782678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.852282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:48:17.852913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquired lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:48:17.929450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:17.938859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02595957-b8e1-445d-955f-e1d61c85d3bb tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.172350 Sep 27 01:48:17.952243 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2105/4264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:17 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:17.958340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:17.959090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:17.965318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.966018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.966552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:17.967376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:17.967840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:17.968846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.121429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:18.129947 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c934658-38e3-45f9-a2dc-34e83bbc0510 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.180587 Sep 27 01:48:18.130626 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2106/4265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:17 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:18.142624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5ab642d-c4e8-473b-bd95-9d609a29218d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5ab642d-c4e8-473b-bd95-9d609a29218d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 HTTP/1.1 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 280 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.147236 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5ab642d-c4e8-473b-bd95-9d609a29218d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5ab642d-c4e8-473b-bd95-9d609a29218d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 400 len: 619 microversion: 2.1 time: 0.016713 Sep 27 01:48:18.152002 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2107/4266] 10.222.0.52 () {60 vars in 1257 bytes} [Tue Sep 27 01:48:18 2022] PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:48:18.158581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:18.159230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:18.166920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.167609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.167835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.168539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.168996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.169480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.322538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:18.332330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-929a7b1e-0a87-40b8-ace7-7ec5f1a6df08 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.178153 Sep 27 01:48:18.333552 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2108/4267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:18.356315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:18.357178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:18.363713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.364473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.365108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.366390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.366948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.367452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.500035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:18.507862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93cbabd1-82ef-46aa-91d5-2379ec7260ae tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.155637 Sep 27 01:48:18.508430 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2109/4268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:18.530528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b821cbf-5559-44ea-bb3a-21d6f9387b63 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b821cbf-5559-44ea-bb3a-21d6f9387b63 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: request: PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 HTTP/1.1 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 24 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": ""}} Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6', 'body': {'server': {'name': ''}}} Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi '' Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:48:18.534212 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b821cbf-5559-44ea-bb3a-21d6f9387b63 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b821cbf-5559-44ea-bb3a-21d6f9387b63 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 400 len: 108 microversion: 2.1 time: 0.008868 Sep 27 01:48:18.540740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2110/4269] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:48:18 2022] PUT /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:48:18.545290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:18.546029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:18.553436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.554147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.554507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.555273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:18.555799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:18.556313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:18.698731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:18.712192 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d84e025-208c-401e-97fd-b7807bb81623 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1505 microversion: 2.1 time: 0.170975 Sep 27 01:48:18.713119 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2111/4270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:18 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:19.154489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:19.156982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:19.164818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:19.174861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:19.176249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:19.179061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:19.179709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:19.180343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:19.530556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:19.543810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bc56ef6-3767-47aa-b92c-b9f7c11ecee4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1512 microversion: 2.1 time: 0.394148 Sep 27 01:48:19.558382 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2112/4271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:19 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:19.708041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:19.716700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5729ea-b3ad-45da-b543-5a954b998ab1", "tag": "79a13365-8e57-49a5-bd85-23dc60df97a9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:19.749169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:19.754104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:19.754837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:19.779588 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] Creating event network-changed:79a13365-8e57-49a5-bd85-23dc60df97a9 for instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 on n-h1-859358-1 Sep 27 01:48:19.797098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-283cec13-a1a9-4ae3-96a5-88941dffa88d req-aa82da0a-be47-4a60-bc77-8ff50d8862ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083592 Sep 27 01:48:19.805749 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2113/4272] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:20.571742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:20.572521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:20.611346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:20.611865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:20.612309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:20.620700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:20.621285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:20.621761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:20.833022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Updating instance_info_cache with network_info: [{"id": "79a13365-8e57-49a5-bd85-23dc60df97a9", "address": "fa:16:3e:54:35:b1", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap79a13365-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:20.864608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Releasing lock "refresh_cache-3d5729ea-b3ad-45da-b543-5a954b998ab1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:48:20.865519 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25cb175c-d0a9-490b-bd9e-3a9fd83059ba tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1/action" status: 202 len: 0 microversion: 2.1 time: 3.939978 Sep 27 01:48:20.871592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2160/4273] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:16 2022] POST /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1/action => generated 0 bytes in 3946 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:48:20.883528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:20.884053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:20.909416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:20.910304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:20.910778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:20.922571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:20.923941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:20.936234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:21.040163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:21.183421 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87aac11a-8571-4fbc-9aff-82a3ce8c32fb tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 204 len: 0 microversion: 2.1 time: 0.310331 Sep 27 01:48:21.189577 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2161/4274] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:20 2022] DELETE /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:21.201884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.63"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:21.209856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:21.225851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:21.226448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:21.228089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:21.243800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:21.244326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:21.244785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:21.311185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:48:21.321772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquired lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:48:21.794152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:21.806946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0abaa16-abac-437e-bdeb-302d4070f1ef tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1489 microversion: 2.1 time: 1.239445 Sep 27 01:48:21.818732 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2114/4275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:20 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1489 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:21.832448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:21.835482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:21.854240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:21.857234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:21.869558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:21.870635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:21.871235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:21.871834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:22.433053 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43b775fc-4bf2-419f-83fa-e4d9496b0015 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 200 len: 116 microversion: 2.1 time: 0.605748 Sep 27 01:48:22.438936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2115/4276] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:21 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 116 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:22.445725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:22.446728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:22.474423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:22.476731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:22.478990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:22.479761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:22.480230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:22.480669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:22.920748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:22.943834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c02cfcc5-16c8-4d7f-8231-dc01305dc70e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.502744 Sep 27 01:48:22.967382 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2116/4277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:22.977378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:22.978414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:22.999131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:23.001713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:23.002931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:23.003691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:23.004156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:23.004589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:23.879485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:23.891675 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1d69e37-b59f-4666-9b82-046a1ead4e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.918295 Sep 27 01:48:23.897656 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2117/4278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:23.919437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:23.920772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:23.932549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:23.935339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:23.936444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:23.939123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:23.941262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:23.946420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:23.965672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:24.690133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:24.707142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86ac74ab-bd72-4280-aeaf-4ffa76d7e5c4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.791292 Sep 27 01:48:24.712133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2118/4279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:24.731882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:24.773521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:24.774263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:24.777748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:24.811710 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] Creating event network-changed:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:48:24.823620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-890bf68e-f4f0-498c-a725-f2b124a3a681 req-3fd7629e-6eff-4588-b884-ebaaa4e6fdd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107150 Sep 27 01:48:24.824819 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2119/4280] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:24.830835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:24.838050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:24.845606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:24.849405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:24.850107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:24.852812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:24.853548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:24.855709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:25.731697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:25.742262 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d2136a8-df02-42c7-83f8-1847c0f981a7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.914867 Sep 27 01:48:25.742262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2120/4281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:24 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:25.950253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-476580752", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "23594c01-9d6b-41da-b812-329d1c79b6da"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:26.049123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] validate_networks() for [('23594c01-9d6b-41da-b812-329d1c79b6da', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:48:27.351328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Updating instance_info_cache with network_info: [{"id": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37", "address": "fa:16:3e:ad:67:23", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4bb9ae5c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:27.366404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Releasing lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:48:27.370345 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-66a7f729-1185-4ca7-a599-e5d43995c632 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action" status: 202 len: 0 microversion: 2.1 time: 6.176045 Sep 27 01:48:27.371184 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2162/4282] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:21 2022] POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action => generated 0 bytes in 6181 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 27 01:48:27.393733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-405994e7-3c18-44f3-b31a-bb2f344cfc1d tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '.version_select at 0x7f24d5680ca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:27.822279 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-405994e7-3c18-44f3-b31a-bb2f344cfc1d tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/829621ab-d5b2-48f3-a634-87b9c0cb5528" status: 200 len: 184 microversion: 2.1 time: 0.445178 Sep 27 01:48:27.823584 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2163/4283] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Sep 27 01:48:27 2022] GET /compute/v2.1/os-floating-ips/829621ab-d5b2-48f3-a634-87b9c0cb5528 => generated 184 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:28.112215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5729ea-b3ad-45da-b543-5a954b998ab1", "name": "network-vif-deleted", "tag": "79a13365-8e57-49a5-bd85-23dc60df97a9"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:28.139230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.140287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.140731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.165532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] Creating event network-vif-deleted:79a13365-8e57-49a5-bd85-23dc60df97a9 for instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 on n-h1-859358-1 Sep 27 01:48:28.177166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f6e32dbc-81a1-4aba-b014-97a71955de29 req-6817b3d4-95cb-4f1a-ab86-1ffc732e1925 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350763 Sep 27 01:48:28.180988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2164/4284] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:28.193380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.63"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:28.515578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:48:28.516566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:48:28.517055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:48:28.517540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:48:28.517937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:48:28.537231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.537813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.539372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.539915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.541979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.542434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.588830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:48:28.598112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:28.600877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:48:28.605759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.606464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.607087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.609675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.618195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.618913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.635226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:48:28.646274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:48:28.740859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-925a89c9-524b-4f35-9b45-ed24f90a9e90 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.795815 Sep 27 01:48:28.748337 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2121/4285] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:48:28.775130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:28.775938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:28.784980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.785757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.786392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.788001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.788883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.789564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.805486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 HTTP/1.1 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48354f0c-9436-4e58-9c2b-ee3c7bc37022'} Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:28.807674 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:28.814273 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:28.816955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:28.818115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ead81ae2-2fd5-4beb-bf35-dc3efd92f812 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 404 len: 111 microversion: 2.1 time: 0.068794 Sep 27 01:48:28.818894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2122/4286] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:28 2022] DELETE /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:28.824749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b6e1dba-c8a2-4441-90b2-8043b8b6df2c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:28.825617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1b6e1dba-c8a2-4441-90b2-8043b8b6df2c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:28.949942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1b6e1dba-c8a2-4441-90b2-8043b8b6df2c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:28.960247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b6e1dba-c8a2-4441-90b2-8043b8b6df2c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1214 microversion: 2.1 time: 0.139935 Sep 27 01:48:28.961190 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2123/4287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:28 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:28.967250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:28.970366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 48354f0c-9436-4e58-9c2b-ee3c7bc37022] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:28.978718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.980597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.981455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:28.982430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:28.983126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:28.983959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.010122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 HTTP/1.1 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48354f0c-9436-4e58-9c2b-ee3c7bc37022'} Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:29.012095 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. Sep 27 01:48:29.017603 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:29.019785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 48354f0c-9436-4e58-9c2b-ee3c7bc37022 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:29.023248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14eed071-3edb-45de-b305-96bb9b27483c tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022" status: 404 len: 111 microversion: 2.1 time: 0.057843 Sep 27 01:48:29.025039 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2124/4288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:28 2022] GET /compute/v2.1/servers/48354f0c-9436-4e58-9c2b-ee3c7bc37022 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:29.036117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:29.040770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:29.054855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.056069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.056600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.059165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.059775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.061179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.119412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:29.265357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:29.358289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f5608be-411c-4339-8f76-ece2fe597de8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 204 len: 0 microversion: 2.1 time: 0.331664 Sep 27 01:48:29.360326 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2125/4289] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:29 2022] DELETE /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:29.368870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:29.377169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:29.388493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.389261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.390368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.391352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.397539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.398243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.468867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:29.668334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:29.719967 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7baea98f-f5b1-4e0d-8a4b-3e7aba49c92a tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 204 len: 0 microversion: 2.1 time: 0.357229 Sep 27 01:48:29.725786 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2126/4290] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:29 2022] DELETE /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:29.732469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:29.733961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:29.761040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.764097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.765945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.766709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:29.767171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:29.770388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:29.833055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 01:48:29.834208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquired lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 01:48:30.202768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:30.220297 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94e8492b-2291-46cf-951c-767dc8e6b659 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1507 microversion: 2.1 time: 0.485922 Sep 27 01:48:30.243581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2127/4291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:29 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:30.249648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:30.258253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:30.271192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:30.272012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:30.272616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:30.273591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:30.274345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:30.274991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:30.789776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:30.808257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4798832-e632-42cc-8964-576de359006e tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.563420 Sep 27 01:48:30.810043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2128/4292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:30 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:30.816958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:30.817601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:30.832904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:30.835995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:30.836741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:30.837733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:30.838380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:30.839007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:30.971636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:30.985486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d763ceae-ad9f-4920-8fae-2dc9b03524f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1218 microversion: 2.1 time: 0.174113 Sep 27 01:48:30.986159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2129/4293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:30 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:31.250731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:31.254094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:31.286695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:31.289039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:31.289905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:31.290699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:31.295900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:31.296781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:31.532609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:31.543355 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1507 microversion: 2.1 time: 0.297787 Sep 27 01:48:31.544499 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2130/4294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:31 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:31.546849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:31.547945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b38882c-642a-4933-9220-9180f34269eb tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001887 Sep 27 01:48:31.548712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2131/4295] 10.222.0.52 () {56 vars in 886 bytes} [Tue Sep 27 01:48:31 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 27 01:48:31.831669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:31.832996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:31.844795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:31.846022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:31.846481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:31.847269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:31.847729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:31.848161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:32.279170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:32.291540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa6cf8ec-2156-4aa2-989e-f8fbb748701d tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1511 microversion: 2.1 time: 0.464278 Sep 27 01:48:32.292146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2132/4296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:31 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1511 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:32.316159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:32.316797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:32.323292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:32.323795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:32.324242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:32.326157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:32.326737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:32.327917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:32.375208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Building network info cache for instance {{(pid=128778) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 27 01:48:32.616333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:32.630108 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3967762-dc02-452e-8aa3-9c0488f16f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1266 microversion: 2.1 time: 0.331134 Sep 27 01:48:32.632026 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2133/4297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:32 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:32.653751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:32.684992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:32.687158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:32.689763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:32.722284 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] Creating event network-changed:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:48:32.730895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b7b6be25-75ee-499f-a0db-09d2530a2b4d req-2a560db7-95d8-4430-a529-67c1ae998e2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097392 Sep 27 01:48:32.731500 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2134/4298] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:32.746760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:32.747753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:32.767276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:32.768032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:32.774229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:32.774924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:32.775648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:32.776256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:33.214438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:33.242575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b27f6582-d098-47a6-91df-257aa62dca90 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1507 microversion: 2.1 time: 0.508024 Sep 27 01:48:33.245913 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2135/4299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:32 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:33.321120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:33.322076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:33.333762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:33.335346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:33.337988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:33.339186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:33.340258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:33.342528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:33.871861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b585ddc3a2741d79a920bc96f5c21c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879eb61c6f94947921dd34a1e0931ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:33.885983 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf0e8d7c-b9f0-4764-b85b-198be114a973 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 200 len: 1469 microversion: 2.1 time: 0.567673 Sep 27 01:48:33.889220 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2136/4300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:33 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 1469 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:33.901778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:33.902874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:33.916771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:33.918006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:33.920266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:33.921294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:33.923093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:33.924668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.090598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:34.118648 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5465f8d0-9b6d-49bf-ae3a-242095ba8ac0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1272 microversion: 2.1 time: 0.223396 Sep 27 01:48:34.125097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2137/4301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:33 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:34.138275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49f1896-6732-4612-b2f2-b3f2f0a2f885", "name": "network-vif-deleted", "tag": "fc698b3d-a14a-4d8c-8c81-3a459deee631"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:34.166164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.170185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.172065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.223478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] Creating event network-vif-deleted:fc698b3d-a14a-4d8c-8c81-3a459deee631 for instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 on n-h2-859358-1 Sep 27 01:48:34.239960 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-31fb87a3-eebd-4410-b40b-2069a13f6763 req-5d587fae-5280-441e-8aee-8f26f9691012 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109803 Sep 27 01:48:34.241067 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2138/4302] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:34.274613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:34.275600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:34.292797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.297207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.299261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.300995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.302411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.303804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.448716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.456483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.464101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.466742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'fault' on Instance uuid f49f1896-6732-4612-b2f2-b3f2f0a2f885 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:34.806654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:34.820433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4d3f845-db2b-43b2-8f89-b9e840590124 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 200 len: 1311 microversion: 2.1 time: 0.550850 Sep 27 01:48:34.821726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2139/4303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:34 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 1311 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:34.839021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b97be9e-cb43-44a4-ac19-cf4eff1f61a6", "name": "network-vif-deleted", "tag": "5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:34.864193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.866578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.867323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.888228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] Creating event network-vif-deleted:5fe3a9c3-56a1-466a-bd7a-0dfcccdf330a for instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 on n-h1-859358-1 Sep 27 01:48:34.903860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f922248c-eb0a-413b-a72b-28a4ab95e71f req-159fd8d5-5402-4f7a-aadd-2cc1cace96ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076301 Sep 27 01:48:34.909536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2140/4304] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:34.915964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:34.920219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] [instance: 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:34.951025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.951827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.953288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.954419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:34.955572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:34.956242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:34.994823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] HTTP exception thrown: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Request method failure captured: Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 HTTP/1.1 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVv9TQ0-zkqKAbnY1IVvdTtY7ma3qexikVcByEKARnjJzUS3jxnYKp6FzcjdKHEX3j87MH7mNYBX1n0oAfKjvFYk1Rz16BmXJRqScp5HqWKaMty6ijuy63uQGD8E0pmTUWJaCWePP6cmxFF_50vktq2XSHjbzIXF-fSKHoIP7gBhbQ Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8879eb61c6f94947921dd34a1e0931ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8879eb61c6f94947921dd34a1e0931ea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8879eb61c6f94947921dd34a1e0931ea Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1350650862 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 2b585ddc3a2741d79a920bc96f5c21c4 Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-1350650862-project Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '7b97be9e-cb43-44a4-ac19-cf4eff1f61a6'} Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:34.996819 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. Sep 27 01:48:35.002109 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.004128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] Returning 404 to user: Instance 7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:35.005245 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb9ad194-3068-4b7d-a006-83da1620c605 tempest-ServersNegativeTestJSON-1350650862 tempest-ServersNegativeTestJSON-1350650862-project] 10.222.0.52 "GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6" status: 404 len: 111 microversion: 2.1 time: 0.093918 Sep 27 01:48:35.006429 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2141/4305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:34 2022] GET /compute/v2.1/servers/7b97be9e-cb43-44a4-ac19-cf4eff1f61a6 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:48:35.152227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Updating instance_info_cache with network_info: [{"id": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37", "address": "fa:16:3e:ad:67:23", "network": {"id": "e2de58ae-986d-4494-92ee-73fbfb5b9f8d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1370917977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3a83889d9e154610a95d9731581eaac7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4bb9ae5c-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128778) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:48:35.153485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:35.154131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:35.162557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.170439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.176836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.178277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.179006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.181579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:35.182312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.189627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Releasing lock "refresh_cache-b5dfd062-7c50-430b-ac4f-96a7d20426c1" {{(pid=128778) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 01:48:35.190829 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c710bdc7-83fa-4522-8f05-6d45d87c65ad tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action" status: 202 len: 0 microversion: 2.1 time: 7.008464 Sep 27 01:48:35.192006 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2165/4306] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:28 2022] POST /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1/action => generated 0 bytes in 7010 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 27 01:48:35.204001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:35.205032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:35.227427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.228238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.229040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.231329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.232076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.234415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.283437 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] HTTP exception thrown: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Request method failure captured: Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 HTTP/1.1 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlYXKqE8D6RZA9SPmCrcfgE0VydS_Xoo-JiIwWLp_mYQzk4L_3JxIDG26v2HF7O__sayXCZ_nKtY6F7yD560_8rsWmWtaT4b0uLJWMTx8w4eWmN7OWgRAw4GIBCqiGBQc5DR9eTWV92tGZrwoGP1EnIMspjC8K_ERM5ZhQQMX2-fGUY Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a83889d9e154610a95d9731581eaac7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5c30541b7e1c4f36aa873067f4d0d886 Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3d5729ea-b3ad-45da-b543-5a954b998ab1'} Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:35.291658 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.297979 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.300238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Returning 404 to user: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:35.301711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b5efe02-04b4-4a7c-a945-880848327df8 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 404 len: 111 microversion: 2.1 time: 0.104022 Sep 27 01:48:35.302941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2166/4307] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:35 2022] DELETE /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:48:35.382826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:35.386136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: 3d5729ea-b3ad-45da-b543-5a954b998ab1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:35.416316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.418216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.419504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.422105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.423855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.425639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.477959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] HTTP exception thrown: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Request method failure captured: Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 HTTP/1.1 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlYXKqE8D6RZA9SPmCrcfgE0VydS_Xoo-JiIwWLp_mYQzk4L_3JxIDG26v2HF7O__sayXCZ_nKtY6F7yD560_8rsWmWtaT4b0uLJWMTx8w4eWmN7OWgRAw4GIBCqiGBQc5DR9eTWV92tGZrwoGP1EnIMspjC8K_ERM5ZhQQMX2-fGUY Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a83889d9e154610a95d9731581eaac7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5c30541b7e1c4f36aa873067f4d0d886 Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3d5729ea-b3ad-45da-b543-5a954b998ab1'} Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.485603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. Sep 27 01:48:35.492478 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.502314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Returning 404 to user: Instance 3d5729ea-b3ad-45da-b543-5a954b998ab1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:35.502907 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad88042d-b227-498e-b8d7-d939a93d6104 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1" status: 404 len: 111 microversion: 2.1 time: 0.143961 Sep 27 01:48:35.505678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2167/4308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:35 2022] GET /compute/v2.1/servers/3d5729ea-b3ad-45da-b543-5a954b998ab1 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:35.518442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3916de7-aa16-4331-9f71-3200c10a9629 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '.version_select at 0x7f24d64e0a60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:35.913696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:35.924000 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ec6d810-5cb7-4200-806c-38121a9d5b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1272 microversion: 2.1 time: 0.774594 Sep 27 01:48:35.938389 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2142/4309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:35 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1272 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:35.946741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:35.947389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: f49f1896-6732-4612-b2f2-b3f2f0a2f885] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:35.955658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.956147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.956807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.958089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:35.958889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:35.959585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:35.989658 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 HTTP/1.1 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f49f1896-6732-4612-b2f2-b3f2f0a2f885'} Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:35.991513 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. Sep 27 01:48:35.997040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:36.000155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 404 to user: Instance f49f1896-6732-4612-b2f2-b3f2f0a2f885 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:36.001364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c0e1c82-90cd-4b6d-ac6f-98da9e19d210 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885" status: 404 len: 111 microversion: 2.1 time: 0.061784 Sep 27 01:48:36.002121 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2143/4310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:35 2022] GET /compute/v2.1/servers/f49f1896-6732-4612-b2f2-b3f2f0a2f885 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:36.012050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:36.012821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:36.034277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.035034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.035826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.036729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.037378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.037981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.100375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:36.117423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:36.265615 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed5a8131-f03c-4b3c-8b7a-80145a6e5343 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 204 len: 0 microversion: 2.1 time: 0.257147 Sep 27 01:48:36.267303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2144/4311] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:36 2022] DELETE /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:36.281579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:36.282771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:36.293635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.294901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.295968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.296989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.298265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.298886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.919597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:36.921510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3916de7-aa16-4331-9f71-3200c10a9629 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/829621ab-d5b2-48f3-a634-87b9c0cb5528" status: 202 len: 0 microversion: 2.1 time: 1.409862 Sep 27 01:48:36.926938 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2168/4312] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:48:35 2022] DELETE /compute/v2.1/os-floating-ips/829621ab-d5b2-48f3-a634-87b9c0cb5528 => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:48:36.931034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:36.931532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:36.936136 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc9e6d5b-7eef-4489-a599-82db8dfd2573 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.660460 Sep 27 01:48:36.937089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:36.954405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2145/4313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:36 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:36.962230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.962829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.963324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.964102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.964855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.965370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.971378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:36.974108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:36.985262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.987098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.987837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:36.988749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:36.989736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:36.990576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:37.002825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:37.100333 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-930da5ab-3bd7-4f91-b910-ebb4d247a185 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 204 len: 0 microversion: 2.1 time: 0.172708 Sep 27 01:48:37.101195 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2169/4314] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:36 2022] DELETE /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:48:37.112926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:37.113763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:37.121714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:37.122244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:37.122960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:37.124011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:37.124875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:37.125522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:37.367790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:37.382580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2153bb00-22d1-4853-be75-32add8626d6c tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1527 microversion: 2.1 time: 0.276126 Sep 27 01:48:37.390382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2170/4315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:37 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1527 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:37.565035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:37.574635 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64b0c184-79fe-4dd7-9c67-68b4179fc6b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.618248 Sep 27 01:48:37.586403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2146/4316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:36 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:37.964392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:37.965013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:37.984103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:37.984222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:37.985778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:37.986677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:37.987152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:37.987605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:38.414064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:38.414701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:38.438329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:38.438839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:38.439290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:38.444447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:38.445143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:38.445636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:38.461656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:38.475635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d0930ff2-5b37-404e-9efe-9b4293c1ed55 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.515015 Sep 27 01:48:38.476998 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2171/4317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:37 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:38.562148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:38.601245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:38.602475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:38.612945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:38.617673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:38.618495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:38.619428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:38.620490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:38.621103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:38.833248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:38.843705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9082b109-7d8f-4396-b9cf-3602820ab365 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1527 microversion: 2.1 time: 0.434048 Sep 27 01:48:38.844298 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2147/4318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:38 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:39.060974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:39.070173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49814365-0856-4f46-9ccd-f925f3b7fc0f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.473485 Sep 27 01:48:39.086495 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2172/4319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:38 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:39.500433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:39.501056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:39.509269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:39.512751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:39.513486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:39.514414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:39.515549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:39.516373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:39.516958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:39.869480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:39.871689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:39.932279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:39.932909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:39.933260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:39.934119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:39.934478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:39.938312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:40.218799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:40.232895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a6bf16a-c601-4744-af6e-3f3eb3786f99 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.736205 Sep 27 01:48:40.249266 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2148/4320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:39 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:40.254550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:40.255351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:40.262209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:40.263095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:40.263821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:40.265277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:40.265914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:40.266504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:40.523077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:40.533903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f673c9b-d9a6-416a-9b68-3cc132bf43f7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.294743 Sep 27 01:48:40.536975 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2149/4321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:40 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:40.689920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:40.704616 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04218969-1d86-4a60-b465-1ca469b909d3 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1527 microversion: 2.1 time: 0.840600 Sep 27 01:48:40.718446 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2173/4322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:39 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1527 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:41.014609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f12fea-0fc6-49a1-a5da-8797bf20488a", "tag": "235094f6-340c-4193-9c40-e3cb818fc4bf"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:41.075489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.076625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.078070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.103671 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] Creating event network-changed:235094f6-340c-4193-9c40-e3cb818fc4bf for instance 24f12fea-0fc6-49a1-a5da-8797bf20488a on n-h2-859358-1 Sep 27 01:48:41.123156 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6ef4c51a-5ed8-4fb0-a979-dd28053c2a99 req-986331dc-dcdd-44a5-82b6-d6a5c5a36164 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116996 Sep 27 01:48:41.124909 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2150/4323] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:41.256760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:41.257410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:41.271926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.272647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.273261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.274365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.286157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.286621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.559747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:41.561084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:41.572178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.576671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.578497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.585623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.586393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.587168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.936565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:41.954820 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aad44dd2-8a41-41b5-a28f-35509986a3d2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.399626 Sep 27 01:48:41.955791 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2151/4324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:41 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:41.969903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:41.970678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:41.984256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.984974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.985446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:41.986178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:41.986641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:41.987076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:42.002979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:42.010693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47b1c72e-8f94-4f3e-b38b-846b909fc119 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1523 microversion: 2.1 time: 0.757773 Sep 27 01:48:42.011295 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2174/4325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:41 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1523 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:42.020288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dfd062-7c50-430b-ac4f-96a7d20426c1", "name": "network-vif-deleted", "tag": "4bb9ae5c-ef5e-4915-9f1a-11b8969faa37"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:42.068357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:42.078320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:42.078781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:42.108174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] Creating event network-vif-deleted:4bb9ae5c-ef5e-4915-9f1a-11b8969faa37 for instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 on n-h2-859358-1 Sep 27 01:48:42.109787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:42.110287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:42.110727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:42.111194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lazy-loading 'fault' on Instance uuid b5dfd062-7c50-430b-ac4f-96a7d20426c1 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:42.133669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-635617fb-6543-4ec3-9aad-c72f2b6f952e req-ff5b550a-af86-4c84-b6e9-f66a52ed2f09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116793 Sep 27 01:48:42.134281 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2175/4326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:42.205825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c30541b7e1c4f36aa873067f4d0d886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a83889d9e154610a95d9731581eaac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:42.214607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc83e43e-e35c-404f-9034-070410685a06 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 200 len: 1314 microversion: 2.1 time: 0.257640 Sep 27 01:48:42.233445 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2152/4327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:41 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:42.980674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:42.981775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:42.999500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.000260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.000954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.023642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.024909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.025676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.035585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:43.036977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:43.050529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.058664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.059485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.066826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.071267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.072415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.548449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:43.565823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af634e08-0db3-4d86-8ea2-f73d14eed1e8 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1481 microversion: 2.1 time: 0.533388 Sep 27 01:48:43.570853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2153/4328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:43 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1481 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:43.592072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:43.593229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] [instance: b5dfd062-7c50-430b-ac4f-96a7d20426c1] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:43.602382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.603257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.604134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.605124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.605867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.607014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.629189 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] HTTP exception thrown: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Request method failure captured: Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 HTTP/1.1 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlYXKqE8D6RZA9SPmCrcfgE0VydS_Xoo-JiIwWLp_mYQzk4L_3JxIDG26v2HF7O__sayXCZ_nKtY6F7yD560_8rsWmWtaT4b0uLJWMTx8w4eWmN7OWgRAw4GIBCqiGBQc5DR9eTWV92tGZrwoGP1EnIMspjC8K_ERM5ZhQQMX2-fGUY Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3a83889d9e154610a95d9731581eaac7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3a83889d9e154610a95d9731581eaac7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 3a83889d9e154610a95d9731581eaac7 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2079473809 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5c30541b7e1c4f36aa873067f4d0d886 Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2079473809-project Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'b5dfd062-7c50-430b-ac4f-96a7d20426c1'} Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:43.631492 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. Sep 27 01:48:43.637330 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:43.639760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] Returning 404 to user: Instance b5dfd062-7c50-430b-ac4f-96a7d20426c1 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:43.640839 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-404bd3be-6749-4c4e-85bd-f018b4385510 tempest-FloatingIPsAssociationTestJSON-2079473809 tempest-FloatingIPsAssociationTestJSON-2079473809-project] 10.222.0.52 "GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1" status: 404 len: 111 microversion: 2.1 time: 0.067633 Sep 27 01:48:43.642017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2154/4329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:43 2022] GET /compute/v2.1/servers/b5dfd062-7c50-430b-ac4f-96a7d20426c1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:43.647183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0da0c08-6152-4018-8292-eecd8bddfbbf", "name": "network-vif-deleted", "tag": "354d4bd3-b837-4ed3-ad66-b02ae11c4fba"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:43.658522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:43.659333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:43.659937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:43.683590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] Creating event network-vif-deleted:354d4bd3-b837-4ed3-ad66-b02ae11c4fba for instance b0da0c08-6152-4018-8292-eecd8bddfbbf on n-h2-859358-1 Sep 27 01:48:43.694101 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7a0b4350-e4d8-4d3c-a2d5-3f8b161c793e req-71f026b0-0685-4069-a9cd-1f13a24314b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050577 Sep 27 01:48:43.694900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2155/4330] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:44.135171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:44.152699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b972aa2-4c41-4873-b605-1ab5d6ade042 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 1.175649 Sep 27 01:48:44.158602 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2176/4331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:42 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:44.599715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:44.600713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:44.635063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1251097122", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "c45b85e1-4c39-4d75-9463-874dec291445"}, {"uuid": "01e4314e-87ab-449a-8aaa-6f0823896f2b"}, {"uuid": "c45b85e1-4c39-4d75-9463-874dec291445"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:44.654102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:44.655194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:44.655610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:44.669943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:44.670495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:44.670944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:44.808170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] validate_networks() for [('c45b85e1-4c39-4d75-9463-874dec291445', None, None, None, None, None), ('01e4314e-87ab-449a-8aaa-6f0823896f2b', None, None, None, None, None), ('c45b85e1-4c39-4d75-9463-874dec291445', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:48:44.816136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:44.816628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:44.817062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:44.820112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lazy-loading 'fault' on Instance uuid b0da0c08-6152-4018-8292-eecd8bddfbbf {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:48:44.977685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cdaa103d9f4862baa7a76a2def10fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99af1ee801894ee689caadc33ccfd96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:45.008302 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-616ae992-1917-46f0-ae3d-a1534760fe60 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 200 len: 1312 microversion: 2.1 time: 0.413004 Sep 27 01:48:45.030751 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2156/4332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:44 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:45.183598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:45.184432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:45.199270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:45.200102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:45.200732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:45.201743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:45.208357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:45.209060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:45.659110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:45.672285 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d2a05a2-d9fe-43e7-96dc-a87709aace73 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.491016 Sep 27 01:48:45.674403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2157/4333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:45 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:46.037998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:46.039458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] [instance: b0da0c08-6152-4018-8292-eecd8bddfbbf] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:46.049725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:46.050238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:46.051624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:46.053747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:46.055384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:46.057466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:46.087993 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] HTTP exception thrown: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Request method failure captured: Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf HTTP/1.1 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlUy-eWMY2w_hej4hnn6yUhc756Sqlr8Qfk1b8_vv2JK1WoRYNVTeSuyp_7cOKHM_W9GK2B-xHdRoiSUN-qxM-c_kWLPaFNA-Z2QJsAOsGVeUS5UxPsJo4wNyMpgxikY-wf-PQc3nkxySjlEda_geKt0QReHwLGLrqGRQD8suLajT10 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/99af1ee801894ee689caadc33ccfd96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_99af1ee801894ee689caadc33ccfd96c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 99af1ee801894ee689caadc33ccfd96c Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1001297942 Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 82cdaa103d9f4862baa7a76a2def10fe Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1001297942-project Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'b0da0c08-6152-4018-8292-eecd8bddfbbf'} Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:46.093083 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. Sep 27 01:48:46.098954 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:46.101240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] Returning 404 to user: Instance b0da0c08-6152-4018-8292-eecd8bddfbbf could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:46.105850 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25c7d159-9fae-4b44-b704-ddbbd233eee9 tempest-ServerRescueNegativeTestJSON-1001297942 tempest-ServerRescueNegativeTestJSON-1001297942-project] 10.222.0.52 "GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf" status: 404 len: 111 microversion: 2.1 time: 0.071646 Sep 27 01:48:46.109212 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2158/4334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:46 2022] GET /compute/v2.1/servers/b0da0c08-6152-4018-8292-eecd8bddfbbf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:46.699037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:46.700504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:46.708570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:46.709558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:46.710246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:46.711198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:46.711888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:46.712542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:47.343990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:47.352640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f2660a3-8152-4fd7-9f78-25167947be56 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.657339 Sep 27 01:48:47.366601 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2159/4335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:46 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:48.022037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe542d68-d92d-4c4d-8612-e928dd901be3 tempest-ComputeTenantNetworksTest-1191922202 tempest-ComputeTenantNetworksTest-1191922202-project] Calling method '.version_select at 0x7f24da5b3670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:48.536280 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe542d68-d92d-4c4d-8612-e928dd901be3 tempest-ComputeTenantNetworksTest-1191922202 tempest-ComputeTenantNetworksTest-1191922202-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.794306 Sep 27 01:48:48.543428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2160/4336] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 01:48:47 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:48.548554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:48.549174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:48.567256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:48.568939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:48.569622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:48.570534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:48.571163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:48.571783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:48.886082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:48.916106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-569004f8-58c8-4afb-ae3b-338aba3f6ae9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.371415 Sep 27 01:48:48.917218 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2161/4337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:48 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:48.934922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a67dda13-7a7a-48ec-9036-50d30b8200c2 tempest-ComputeTenantNetworksTest-1191922202 tempest-ComputeTenantNetworksTest-1191922202-project] Calling method '.version_select at 0x7f24d5faddc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:49.183893 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a67dda13-7a7a-48ec-9036-50d30b8200c2 tempest-ComputeTenantNetworksTest-1191922202 tempest-ComputeTenantNetworksTest-1191922202-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/7eb1f9a7-f967-4ca6-a5c5-07a3ad1e534b" status: 200 len: 139 microversion: 2.1 time: 0.264739 Sep 27 01:48:49.192159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2162/4338] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:48:48 2022] GET /compute/v2.1/os-tenant-networks/7eb1f9a7-f967-4ca6-a5c5-07a3ad1e534b => generated 139 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:49.381242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:48:49.381860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:48:49.382532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:48:49.382668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:48:49.383053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:48:49.406666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.408423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.408870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.410901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.413164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.414122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.473697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Getting quotas for project 8485902fa9af48b59fe65ea59716e686. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:48:49.490061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Getting quotas for user a56ab078c9474e268df4d02248a064b2 and project 8485902fa9af48b59fe65ea59716e686. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:48:49.549981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:48:49.552495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:48:49.570791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:49.579433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:49.580240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Searching by: {'deleted': False, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:48:49.601706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.602206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.602631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.603378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.603848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.604278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.683569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:49.692848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:48:49.710460 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5802bebf-58e4-46a0-bad2-d09bee7849ea tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.082449 Sep 27 01:48:49.713057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2177/4339] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:48:49.725900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cf8155f-f017-45c0-b96b-ccbff563c029 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:49.736379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cf8155f-f017-45c0-b96b-ccbff563c029 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:49.770575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1962901f-c665-4b81-81d8-5ee1809a2470 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204970 Sep 27 01:48:49.771477 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2163/4340] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 01:48:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:48:49.786688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:49.807259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:49.810365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Searching by: {'deleted': False, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:48:49.824221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.826046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.827391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.828588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.829490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.830217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.896989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cf8155f-f017-45c0-b96b-ccbff563c029 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:49.898947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:48:49.910136 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cf8155f-f017-45c0-b96b-ccbff563c029 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1213 microversion: 2.1 time: 0.189724 Sep 27 01:48:49.911330 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2178/4341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:49 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:49.920466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f12fea-0fc6-49a1-a5da-8797bf20488a", "name": "network-vif-plugged", "status": "completed", "tag": "235094f6-340c-4193-9c40-e3cb818fc4bf"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:49.946787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:49.949317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:49.949977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:49.984704 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] Creating event network-vif-plugged:235094f6-340c-4193-9c40-e3cb818fc4bf for instance 24f12fea-0fc6-49a1-a5da-8797bf20488a on n-h2-859358-1 Sep 27 01:48:49.995054 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d9f29255-6aca-411c-b2dd-e6185b4b0329 req-633e57a7-dbb2-49c1-9d8b-ecc76e2642a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082135 Sep 27 01:48:49.997127 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2179/4342] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:50.011049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:50.017134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:50.018158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:50.039448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:50.040001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:50.040728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:50.041167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:50.043023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:50.043392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:50.043955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:50.045107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:50.045831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:50.503851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:50.517405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-925e3e8d-e36d-4134-869f-7787f7468301 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 0.518523 Sep 27 01:48:50.534770 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2180/4343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:49 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:50.676023 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bd75a38-a24a-43b0-b1a2-c80fc25b7ae9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.894159 Sep 27 01:48:50.677739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2164/4344] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:48:49 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:50.700860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd8f23d9-3106-4761-acc8-b4dce1bc9431 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:50.709095 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd8f23d9-3106-4761-acc8-b4dce1bc9431 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012017 Sep 27 01:48:50.714558 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2181/4345] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:48:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:50.935136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:50.936215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:50.950390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:50.950955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:50.951325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:50.952756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:50.954339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:50.954864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.023667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:51.026017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:51.047135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.050034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.052069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.054117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.056769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.057420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.060387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:51.079194 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b56532ab-324b-4dcc-a42d-cecaf6606e9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1217 microversion: 2.1 time: 0.146866 Sep 27 01:48:51.079947 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2165/4346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:50 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:51.110348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:48:51.321809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b16797e-bd79-4347-923e-6cc41b7fd10a tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 204 len: 0 microversion: 2.1 time: 0.299031 Sep 27 01:48:51.322445 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2182/4347] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:48:51 2022] DELETE /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:48:51.339131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:51.341302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:51.359394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.359828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.363999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.367958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.372223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.375335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.881459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:51.890650 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9912b30e-1ec0-47e8-a017-ab4fb42d4fb0 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1608 microversion: 2.1 time: 0.562801 Sep 27 01:48:51.897681 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2166/4348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:51 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1608 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:51.902782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:51.905819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:51.923803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.931198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.931884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:51.932985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:51.935018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:51.937425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:52.001422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0576863-556b-4126-b657-139e26e84285 tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Action: 'create', calling method: .version_select at 0x7f24d5636f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-444190191", "metadata": {"Type": "work"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:52.783082 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0576863-556b-4126-b657-139e26e84285 tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.344964 Sep 27 01:48:52.783859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2183/4349] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 27 01:48:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1347 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 27 01:48:52.799719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:52.799719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:52.806895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:52.807785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:52.819027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:52.820240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:52.821930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:52.823843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:53.005496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:53.016961 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bfc9da0-3b04-45af-9f06-f8ff191b78da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1314 microversion: 2.1 time: 1.117619 Sep 27 01:48:53.030814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2167/4350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:51 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1314 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:53.031197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:53.031651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87ee7f83-9c27-4679-a575-7d833f661d27 tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d55b01f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:53.031997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1ee60b1-555c-4e5d-b5b8-b4b0a662117f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1283 microversion: 2.1 time: 0.237978 Sep 27 01:48:53.056703 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2184/4351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:52 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:53.071254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:53.077020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:53.098017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:53.100957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:53.101903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:53.106020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:53.106748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:53.109902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:53.147912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87ee7f83-9c27-4679-a575-7d833f661d27 tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 352 microversion: 2.1 time: 0.128408 Sep 27 01:48:53.148562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2168/4352] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:53 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:53.585903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:53.595744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5c49789-b684-4a66-8886-4d1e96a371da tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1608 microversion: 2.1 time: 0.537795 Sep 27 01:48:53.605499 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2185/4353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:53 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1608 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:54.045900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.046589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:54.060016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.061657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:54.071138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.075418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.076316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.077590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.078527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.079302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.080342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.082546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.083657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.084484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.085187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.102199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.108328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:54.339029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:54.349955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1acd581c-d637-47ca-a708-b190a9654bd5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1271 microversion: 2.1 time: 0.291629 Sep 27 01:48:54.351973 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2186/4354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:54.371656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f81a113-eeb1-4a31-b954-1609dd0fef6a tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d56a1ee0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.452257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f81a113-eeb1-4a31-b954-1609dd0fef6a tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 353 microversion: 2.1 time: 0.098012 Sep 27 01:48:54.471556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:54.474214 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2187/4355] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:54.487362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0104798-fd22-4b29-812f-546058966ec6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1502 microversion: 2.1 time: 0.444381 Sep 27 01:48:54.489083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2169/4356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1502 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:54.494429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c31093ad-1c1b-42bc-9c5b-59aa8bf3326c tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d56a1430>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.516220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:54.520507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:54.534600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.535482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.537493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.538527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.539001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.544576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.584163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c31093ad-1c1b-42bc-9c5b-59aa8bf3326c tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 353 microversion: 2.1 time: 0.100492 Sep 27 01:48:54.585009 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2188/4357] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:54.599095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4539d13-e396-416b-8764-58748d86c08d tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d5652820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.649111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b39b474d-884f-4a24-8dcb-435beb9f65e9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.137553 Sep 27 01:48:54.650239 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2170/4358] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:54 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:48:54.656104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.656829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:54.669611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:54.675138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.676328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.677066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.679064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:54.680238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:54.682596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:54.735722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4539d13-e396-416b-8764-58748d86c08d tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 202 len: 0 microversion: 2.1 time: 0.141315 Sep 27 01:48:54.736300 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2189/4359] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:48:54 2022] DELETE /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:48:54.744167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-453d2022-8996-47d5-880b-2d7de338d9ca tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d56a1c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:54.869572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-453d2022-8996-47d5-880b-2d7de338d9ca tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 352 microversion: 2.1 time: 0.126668 Sep 27 01:48:54.869572 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2190/4360] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:55.183486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:55.192470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db02fbdc-df8a-4d91-b6c3-366283a29499 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1608 microversion: 2.1 time: 0.541101 Sep 27 01:48:55.196855 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2171/4361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:54 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1608 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:55.373967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:55.374574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:55.383192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:55.383675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:55.384111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:55.384812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:55.385263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:55.385717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:55.663733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:55.666100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:55.688371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:55.688868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:55.689568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:55.690987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:55.691627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:55.692279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:55.770587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58d70a65-46fb-4d82-af23-055c6da485e1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.110873 Sep 27 01:48:55.771487 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2172/4362] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:55 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:48:55.882327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af9a37da-dbbf-4b56-a7cd-24d16f04ec9b tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d6bc3310>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:56.030655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:56.042447 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af9a37da-dbbf-4b56-a7cd-24d16f04ec9b tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 352 microversion: 2.1 time: 0.164896 Sep 27 01:48:56.045840 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2173/4363] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:55 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:48:56.050707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0b7136-86dd-496f-8080-3e5cfc02ea29", "name": "network-vif-deleted", "tag": "3055f70b-2034-44ee-ae98-2d81e453f68a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:56.057890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-73be1d9a-2375-4fc8-b06b-6fd9758e88eb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1313 microversion: 2.1 time: 0.688391 Sep 27 01:48:56.064502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2191/4364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:55 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:56.097763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:56.099695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:56.100167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:56.131656 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] Creating event network-vif-deleted:3055f70b-2034-44ee-ae98-2d81e453f68a for instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 on n-h1-859358-1 Sep 27 01:48:56.144216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-12f8696e-ff43-4b5c-ab2b-a4ef3b5d18cb req-7d102c72-be4b-4edb-a9ec-ba5b4a772301 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096866 Sep 27 01:48:56.148194 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2174/4365] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:56.216629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:56.217724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:56.229957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:56.236691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:56.237613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:56.238556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:56.241770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:56.244686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:56.692570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:56.705467 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05e6f9c3-7305-42e9-9111-4c7131cea3a9 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.493564 Sep 27 01:48:56.709398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2192/4366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:56 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:56.785514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:56.789893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:56.802126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:56.802882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:56.803517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:56.805045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:56.805933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:56.807552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:56.877440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33be0563-48ae-4e79-b371-37051f875663 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.097996 Sep 27 01:48:56.878148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2175/4367] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:56 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:48:57.056758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de7f1509-1176-4444-b1c3-9aa83809b81e tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d56a1c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:57.091328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:57.092099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:57.109845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:57.110346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:57.110794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:57.111528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:57.111979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:57.112406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:57.177891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de7f1509-1176-4444-b1c3-9aa83809b81e tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 352 microversion: 2.1 time: 0.125350 Sep 27 01:48:57.178500 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2193/4368] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:57 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:57.732693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:57.734416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:57.746455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:57.747260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:57.749897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:57.750935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:57.752455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:57.753054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:57.994545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:58.001776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:58.012203 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-811e849e-1be7-4bc7-8a7a-24aba893787d tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.284636 Sep 27 01:48:58.013109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2194/4369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:57 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:48:58.016888 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-113be8ec-eb48-446c-b3b9-73260a628786 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1334 microversion: 2.1 time: 0.927284 Sep 27 01:48:58.037484 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2176/4370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:57 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1334 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:58.192509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5bd643d-58b2-48d3-8966-df2070df489c tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24da5b3700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:58.363214 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5bd643d-58b2-48d3-8966-df2070df489c tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 200 len: 352 microversion: 2.1 time: 0.174470 Sep 27 01:48:58.363896 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2177/4371] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:58 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:58.594012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:58.599372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:58.626641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:58.631003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:58.631584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:58.634741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:58.637913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:58.638468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:58.819403 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fba7af14-e7a0-46bb-91e6-f690520420a9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.801054 Sep 27 01:48:58.820040 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2195/4372] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:58 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:48:59.038894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:59.040237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:59.051354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:59.052228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:59.061877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.063115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.063866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.064918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.065783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.066784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.094269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.120937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.121953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.124802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.126809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.127264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.298078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:59.307325 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b8441a7-1f87-499f-8c9f-3f105212f286 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.275312 Sep 27 01:48:59.329083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2178/4373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:59 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:59.377691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb1a7b12-6f4a-4db1-b52f-23745626accf tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Calling method '.version_select at 0x7f24d5555d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:59.437420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:59.478522 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-eb1a7b12-6f4a-4db1-b52f-23745626accf tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] HTTP exception thrown: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb1a7b12-6f4a-4db1-b52f-23745626accf tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Request method failure captured: Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea HTTP/1.1 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlaDM2_4uBUiUlm0C4i2QVHHoaiTK_UoReTe0825JrnS9I74T2wOaONGtvVYmoIhAGMItLogQwTVPvrePWtgfTGjvN-kaD-th-0NmuS-u1IlDWPoq7qtybkD9HaK2XlbwZ59UD6qQJcVpzn5BmRSNpbqvfcjMXeX4AjQSvDBNYQbDlA Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 45c4ca606cb14865a4527e538a192e17 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesGetTestJSON-440455733 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/45c4ca606cb14865a4527e538a192e17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/45c4ca606cb14865a4527e538a192e17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/45c4ca606cb14865a4527e538a192e17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_45c4ca606cb14865a4527e538a192e17", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesGetTestJSON-440455733 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 45c4ca606cb14865a4527e538a192e17 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesGetTestJSON-440455733 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesGetTestJSON-440455733-project Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 76a74b718b324d90bfc9553117bc6928 Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesGetTestJSON-440455733-project Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: exception: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '61b41610-188b-41db-a969-c107556e84ea'} Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. (HTTP 404) (Request-ID: req-e5765658-ddd2-4092-b9c9-85a12408b5a5) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:48:59.480858 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. Sep 27 01:48:59.485984 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:48:59.493362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb1a7b12-6f4a-4db1-b52f-23745626accf tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] Returning 404 to user: Volume 61b41610-188b-41db-a969-c107556e84ea could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:48:59.494209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb1a7b12-6f4a-4db1-b52f-23745626accf tempest-VolumesGetTestJSON-440455733 tempest-VolumesGetTestJSON-440455733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea" status: 404 len: 109 microversion: 2.1 time: 0.120390 Sep 27 01:48:59.495243 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2179/4374] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:48:59 2022] GET /compute/v2.1/os-volumes/61b41610-188b-41db-a969-c107556e84ea => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:48:59.718359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:48:59.730864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3f7c8c1-83b2-4386-8cfc-eb7e82fd6b42 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.685177 Sep 27 01:48:59.737606 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2196/4375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:48:59 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:48:59.835496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:48:59.838488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:48:59.853493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07a4be37-5ecb-4eaa-9c23-c10b29eff804 tempest-ExtensionsTest-877113579 tempest-ExtensionsTest-877113579-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:59.853924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.855290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.855649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07a4be37-5ecb-4eaa-9c23-c10b29eff804 tempest-ExtensionsTest-877113579 tempest-ExtensionsTest-877113579-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.279438 Sep 27 01:48:59.856310 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2180/4376] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 01:48:59 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:48:59.858108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.862752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:48:59.873919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:48:59.875038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:48:59.878958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b27cf7c-2cfd-48ab-9fcd-682412c14a60 tempest-ExtensionsTest-877113579 tempest-ExtensionsTest-877113579-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:48:59.880100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:48:59.885903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b27cf7c-2cfd-48ab-9fcd-682412c14a60 tempest-ExtensionsTest-877113579 tempest-ExtensionsTest-877113579-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.023556 Sep 27 01:48:59.891186 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2181/4377] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 27 01:48:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:48:59.958653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:00.002017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-092f028f-4429-478a-b355-5870422db081 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.172419 Sep 27 01:49:00.006478 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2197/4378] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:48:59 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:49:00.338951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:00.346006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:00.346917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:00.369447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:00.369864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:00.370307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:00.378660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:00.379179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:00.379629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:00.689378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:00.707567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-016d5016-6912-4bb2-a9bb-ca6616b75395 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.369198 Sep 27 01:49:00.710635 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2182/4379] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:00 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:00.760034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:00.761004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:00.812699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:00.814964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:00.820023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:00.822879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:00.825758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:00.827015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:01.016789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:01.019562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:01.030906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:01.032952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:01.033834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:01.040986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:01.041725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:01.042334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:01.128084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-997be8b0-458b-41e3-8526-e1c9ce05c42d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.114938 Sep 27 01:49:01.129164 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2183/4380] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:01 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:49:01.539064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:01.547428 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c397959-7d46-4527-b302-3d7b9e6c0274 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.792342 Sep 27 01:49:01.562107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2198/4381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:00 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:01.733095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:01.733991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:01.757175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:01.757698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:01.758143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:01.758866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:01.759640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:01.759742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:02.008492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "tag": "d201f932-fcf3-432c-99da-16501f2ebcb6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:02.040383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:02.040868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:02.041305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:02.074184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] Creating event network-changed:d201f932-fcf3-432c-99da-16501f2ebcb6 for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:02.082594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-be63f637-a7aa-4165-9f48-9b1736e254b3 req-5f373262-ea8f-4054-944b-26506a3bb799 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077785 Sep 27 01:49:02.086042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2199/4382] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:02.132038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:02.140547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:02.144258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:02.146825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5716c3f-c499-4b9f-8b43-1d0dff516a24 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.417786 Sep 27 01:49:02.161795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:02.164479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:02.166773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2184/4383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:01 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:02.167126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:02.167909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:02.168385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:02.168815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:02.314119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-32e3bc21-6da7-4415-a01b-8b963c315b83 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.177543 Sep 27 01:49:02.314779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2200/4384] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:02 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:49:02.577159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:02.578071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:02.592986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:02.593793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:02.595321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:02.597438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:02.600015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:02.600800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:03.103446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:03.117115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e1c7b6b-3ed3-4b28-aa44-0fb014cb37c6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.546883 Sep 27 01:49:03.118090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2185/4385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:02 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:03.176439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:03.177166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:03.193000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:03.193514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:03.197901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:03.199021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:03.202049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:03.202682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:03.328475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:03.331707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:03.358241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:03.359096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:03.359904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:03.362414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:03.363134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:03.363850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:03.468114 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ec1659f-e44a-4a91-94ed-021c57305046 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.144062 Sep 27 01:49:03.472587 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2186/4386] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:03 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:49:03.547299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:03.562895 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca933500-9f32-4cb6-bc0f-42a3df5d51c5 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.392098 Sep 27 01:49:03.583459 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2201/4387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:03 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:04.145555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:04.147216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:04.166552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.166741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.167131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.175883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.176434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.182599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.260164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:04.320905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "tag": "fb0c5055-2904-468b-9bf1-7801f50b5dcf"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:04.346973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.347312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.355893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.416482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] Creating event network-changed:fb0c5055-2904-468b-9bf1-7801f50b5dcf for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:04.431741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-27b53130-6ea2-4cba-9fee-c71cf9b0bb48 req-19486b53-46a1-4923-8484-7b4edb328672 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114527 Sep 27 01:49:04.437132 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2202/4388] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:04.480515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:04.483012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:04.507312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.507980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.508438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.509189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.509689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.510115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.633141 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f968261-7a50-420e-9554-8265659849a6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 14 microversion: 2.1 time: 0.157148 Sep 27 01:49:04.636972 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2203/4389] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:04 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:49:04.643720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:04.644436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:04.658276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.662916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.665381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.666349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:04.666972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:04.668345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:04.964757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:04.976735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a988024c-3d41-46f9-8cd6-ec4720134048 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.838502 Sep 27 01:49:04.978240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2187/4390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:04 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:05.027771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ca1ec526fc44b69f52626ce3731ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46aa42ec88e4ecfaf7f3b8c3729d87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:05.040449 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22e9c948-b89a-4683-8dcf-cf1578a8365f tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 200 len: 1252 microversion: 2.1 time: 0.401749 Sep 27 01:49:05.061416 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2204/4391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:04 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 1252 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:05.647384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:05.650463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:05.660597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:05.661633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:05.662287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:05.663526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:05.664235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:05.664820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:05.815168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6fbf5b8-84db-44e9-8ebd-64d51a785ea3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action" status: 200 len: 8207 microversion: 2.1 time: 0.174079 Sep 27 01:49:05.815903 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2188/4392] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:05 2022] POST /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a/action => generated 8207 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:05.831097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:05.831708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:05.853464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:05.853975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:05.854429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:05.866976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:05.869518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:05.870004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:06.002223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:06.003320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:06.056513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:06.065695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:06.069239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:06.075745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:06.079234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:06.081264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:06.875687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:06.888294 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80280f91-f69e-4e4a-90d8-1ad84e9bb35a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.891629 Sep 27 01:49:06.889636 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2189/4393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:05 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:06.912593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:06.919073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] [instance: 0c0b7136-86dd-496f-8080-3e5cfc02ea29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:06.951681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:06.953015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:06.953679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:06.954924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:06.956855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:06.959049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:06.960131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:06.973085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-755b23e1-6bd3-45f9-8706-30a22afb9539 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 1.149001 Sep 27 01:49:06.981147 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2205/4394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:05 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:06.996846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] HTTP exception thrown: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Request method failure captured: Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 HTTP/1.1 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlX-fcbDojDLJfMiCGPSdLgtBpv2SIPvsQ-SDYEI_QwKiOEPzuC1QUwwAIEIanY8Oc5mKZHIgEEi-fO4pYO4_zBHtBcu8rxsV_ClvmGotkYQaLdi6AK737BaE1X0tuZIZ_K1p0tVZ-CFpEvTsEiDdjsPGR7YlTrDjowisz8xS1879U0 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: f46aa42ec88e4ecfaf7f3b8c3729d87c Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestBootFromVolume-1271804137 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f46aa42ec88e4ecfaf7f3b8c3729d87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f46aa42ec88e4ecfaf7f3b8c3729d87c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f46aa42ec88e4ecfaf7f3b8c3729d87c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f46aa42ec88e4ecfaf7f3b8c3729d87c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestBootFromVolume-1271804137 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: f46aa42ec88e4ecfaf7f3b8c3729d87c Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1271804137 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestBootFromVolume-1271804137-project Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 02ca1ec526fc44b69f52626ce3731ac6 Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestBootFromVolume-1271804137-project Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0c0b7136-86dd-496f-8080-3e5cfc02ea29'} Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:06.998905 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. Sep 27 01:49:07.003849 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:07.007707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:07.008341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:07.008640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Returning 404 to user: Instance 0c0b7136-86dd-496f-8080-3e5cfc02ea29 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:49:07.009729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4329d886-e080-4593-abfa-d601599cf9e1 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29" status: 404 len: 111 microversion: 2.1 time: 0.113433 Sep 27 01:49:07.013548 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2190/4395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:06 2022] GET /compute/v2.1/servers/0c0b7136-86dd-496f-8080-3e5cfc02ea29 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:49:07.015783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:07.023407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f3d4824-419f-4c19-9a7c-2f65fda06793 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] Calling method '.version_select at 0x7f24da53fa60>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:07.034648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:07.035154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:07.048748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:07.051159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:07.051866 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f3d4824-419f-4c19-9a7c-2f65fda06793 tempest-ServersTestBootFromVolume-1271804137 tempest-ServersTestBootFromVolume-1271804137-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124612091" status: 202 len: 0 microversion: 2.1 time: 0.033153 Sep 27 01:49:07.053034 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2191/4396] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124612091 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:49:07.053664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:07.054422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:07.915574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:07.916437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:07.939213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:07.940619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:07.942514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:07.943576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:07.946126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:07.947555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:08.141262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:08.150836 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6735c479-8dee-467a-9631-dbf6551e17ec tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 1.147138 Sep 27 01:49:08.176010 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2206/4397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:07 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:08.187673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:08.188308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:08.211396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:08.211895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:08.212338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:08.213054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:08.213571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:08.214017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:08.549432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:08.558492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5ac27a7-a5cb-4ddf-8a07-b5c041212051 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.649734 Sep 27 01:49:08.575210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2192/4398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:07 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:08.705918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "tag": "0046e0cd-cb58-49ce-92a0-25857004034e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:08.722905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:08.724818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:08.728084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:08.750537 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] Creating event network-changed:0046e0cd-cb58-49ce-92a0-25857004034e for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:08.767262 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-187609e1-1de1-4625-bd7b-d3e91b0a0fde req-6005158d-d9a7-417b-bfa7-8a3a8fdc0333 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064831 Sep 27 01:49:08.769037 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2193/4399] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:08.987129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:09.000761 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ed9c362-8b02-4afe-a2be-d57083affe77 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.823754 Sep 27 01:49:09.001376 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2207/4400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:08 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:09.028172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:09.030173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:09.036594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.037365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.037973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.039111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.039902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.040544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.558827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:09.576660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27b65c7e-8f5f-41a1-a081-9c0c01b3f9bb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.551037 Sep 27 01:49:09.581718 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2194/4401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:09 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:09.602188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:09.603412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:09.606563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:09.608489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:09.612868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.613381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.619905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.621324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.621777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.623413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.624088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.627686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.628185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.628638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.634349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.639401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.751947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Locking {{(pid=128779) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 27 01:49:09.888750 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0a209d7-2762-430e-b880-fff43d2add95 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.286839 Sep 27 01:49:09.890095 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2195/4402] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:09 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:49:09.898382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:09.899231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:09.916474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.917951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.919050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:09.922153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:09.924499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:09.926568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:10.430251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:10.438246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e693da9a-1367-49a4-b936-4ece426b3342 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.544128 Sep 27 01:49:10.444336 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2196/4403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:09 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:10.463431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:10.475847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:10.477806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:10.479584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:10.533728 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action HTTP/1.1 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 15 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: {"os-stop": {}} Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f957b2c4-cf5f-454f-b71a-66d7bdc01340', 'body': {'os-stop': {}}} Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked Sep 27 01:49:10.535340 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 409 to user: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 is locked {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07038dfa-e93f-40f5-9d8e-9af42df3b52c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 409 len: 107 microversion: 2.1 time: 0.077460 Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2197/4404] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:10 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 107 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:10.627823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:10.689450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Unlocking {{(pid=128779) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 27 01:49:10.771113 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30daa135-9585-440d-b719-4a1e22e24e01 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.228632 Sep 27 01:49:10.774712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2198/4405] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:10 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:49:10.781263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:10.790522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:10.791733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:10.793441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:10.867119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:49:11.018173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-031e2212-3e2f-4a7e-b956-1a6462fa6c78 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.233332 Sep 27 01:49:11.022116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2199/4406] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:10 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:49:11.044601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:11.046341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:11.062478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:11.063101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:11.065979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:11.070365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:11.078366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:11.084000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:11.315644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:11.325617 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd5b7719-f0cb-4ae3-8fe1-b58676dc1726 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 1.730610 Sep 27 01:49:11.356184 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2208/4407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:09 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:11.846628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:11.855680 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d36ee6b3-e1e2-4ca8-829d-adc10148543b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.827404 Sep 27 01:49:11.860606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2200/4408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:12.026252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2cbe7a2b-ba04-4ef4-aece-efe6a01d483a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: .version_select at 0x7f24d56a1ca0>, body: {"keypair": {"name": "tempest-keypair-1332228549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSAjamOlcg0ejO0RM8hlXEeqGxIf/GdPZIBGBGBS4TD8L0zCOT2tuSzDXf4/L7bGt84JHamLKoe3JeEH7lbXJaBCnaJZXV8qLaGLBMLw6gYHeI/RlD3oQnlSYGJAQSs8g=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:12.088761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2cbe7a2b-ba04-4ef4-aece-efe6a01d483a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for project 9042d8e2cb974e91b397874370b74c88. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:12.110555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-2cbe7a2b-ba04-4ef4-aece-efe6a01d483a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for user 305ea2953dde435d9e74bb0bc0da89b4 and project 9042d8e2cb974e91b397874370b74c88. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:12.223407 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2cbe7a2b-ba04-4ef4-aece-efe6a01d483a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.865985 Sep 27 01:49:12.229424 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2209/4409] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:49:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 868 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:49:12.360157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:12.360782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:12.380077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:12.380571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:12.381008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:12.383811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:12.385372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:12.386987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:12.512461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:12.890310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:12.890946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:12.903709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:12.905292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:12.907122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:12.907930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:12.909914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:12.914189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:13.446074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:13.460636 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3586fba6-0535-44f2-b377-62d5870cfc41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 1.104184 Sep 27 01:49:13.463449 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2201/4410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:12 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:14.843282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:14.856683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a97200c9-9201-411e-9819-f370973f2383 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 1.972373 Sep 27 01:49:14.862555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2210/4411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:12 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:14.876719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:14.885527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:14.914740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:14.915468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:14.916070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:14.916947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:14.918458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:14.921496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:14.955807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:15.180741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e68eb5d5-ad63-4371-8c44-fe73ef876b8e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Action: 'create', calling method: .version_select at 0x7f24da5ad8b0>, body: {"keypair": {"name": "tempest-keypair-1962591888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv1+lWVhdMthZu9OXgEDAaP0sOAOsy3hFzT6CHgPliP2fhp/4dxaoky/TfloxYzwJjK0BFBaSCgy3r1voSS93XaoFxc9D0vrI55e4JsKi4cOhta+LHyGwemyesIwNe91Q=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:15.264581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e68eb5d5-ad63-4371-8c44-fe73ef876b8e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Getting quotas for project 18d643da90cc4b949f303ce36ec308ee. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:15.289575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e68eb5d5-ad63-4371-8c44-fe73ef876b8e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Getting quotas for user fa4a10ecba334d04a1c69d7dea924fc9 and project 18d643da90cc4b949f303ce36ec308ee. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:15.392725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e68eb5d5-ad63-4371-8c44-fe73ef876b8e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.910707 Sep 27 01:49:15.400674 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2202/4412] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:15.557029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:15.567781 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f36cf94-b5a8-4453-971d-25bb5e1cb3da tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.703564 Sep 27 01:49:15.568368 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2211/4413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:14 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:15.897707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:15.898594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:15.919316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:15.923876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:15.928667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:15.931630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:15.932284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:15.933015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:16.592404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:16.593020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:16.618700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:16.618700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:16.618700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:16.619331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:16.620739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:16.621170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:16.786742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:16.797659 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2592f6a9-01ec-4c30-9f2f-e17175c1d21b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.914259 Sep 27 01:49:16.810745 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2203/4414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:15 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:17.283530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:17.299896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f75fdec5-8749-4ce3-b967-d5e22f9f70bb tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.711812 Sep 27 01:49:17.302143 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2212/4415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:16 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:17.841002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:17.842940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:17.857320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:17.859611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:17.861746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:17.862730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:17.864943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:17.867692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:18.328703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:18.329389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:18.338523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:18.339179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:18.339934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:18.340659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:18.341400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:18.341994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:18.675316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:18.690396 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0c9c804-af19-4d13-bb65-999c53bb6d15 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.366113 Sep 27 01:49:18.708063 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2213/4416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:18 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:18.773742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:18.799611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2365e8a9-dbfd-4967-8eba-484ef06900f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.961332 Sep 27 01:49:18.803139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2204/4417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:17 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:19.327710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1763300845", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71d6a3e4-a275-48e8-8eeb-b9cde3a71612"}], "security_groups": [{"name": "tempest-securitygroup--937189061"}], "key_name": "tempest-keypair-1332228549", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:19.619680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] validate_networks() for [('71d6a3e4-a275-48e8-8eeb-b9cde3a71612', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:49:19.715743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:19.716998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:19.735175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:19.739067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:19.740553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:19.741673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:19.744016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:19.749860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:20.511066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:20.520860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fe3f757-4e00-419c-8726-ebdd8b07ecec tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.809031 Sep 27 01:49:20.524678 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2205/4418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:19 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:20.532424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:20.533278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:20.552147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:20.555052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:20.558322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:20.561319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:20.562088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:20.563689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:20.999092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:21.018121 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1103312b-f4df-4c19-9a84-8e42620a4efc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.491354 Sep 27 01:49:21.019081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2206/4419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:20 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:21.150445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e0a7c492-8f1d-4989-ae79-f5614d4f01ce"}], "security_groups": [{"name": "tempest-securitygroup--1702413663"}], "key_name": "tempest-keypair-1962591888", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:21.355394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:49:21.355885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:49:21.356722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:49:21.357945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:49:21.358509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:49:21.377637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] validate_networks() for [('e0a7c492-8f1d-4989-ae79-f5614d4f01ce', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:49:21.379115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:21.379764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:21.380348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:21.381235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:21.381878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:21.387631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:21.446590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for project 9042d8e2cb974e91b397874370b74c88. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:21.486713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for user 305ea2953dde435d9e74bb0bc0da89b4 and project 9042d8e2cb974e91b397874370b74c88. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:21.515943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:49:21.525691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:49:21.650190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7cba44d9-0713-4688-845e-5e4ad85cb9a3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.328522 Sep 27 01:49:21.657798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2214/4420] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:49:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:49:21.664470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:21.664957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:21.674454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:21.675162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:21.675804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:21.677225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:21.678793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:21.681417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.109504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.120323 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-203f8f73-42e8-471e-a223-07a6ba51eec4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.461328 Sep 27 01:49:22.120913 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2215/4421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:21 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:22.143185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:22.147503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:22.280058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.304901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.310003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.313714 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74066361-4736-420b-b7ce-d6d7eb07b516 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1282 microversion: 2.20 time: 0.186473 Sep 27 01:49:22.314532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2216/4422] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:22 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:22.329678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:22.330481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:22.340177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.342835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.343623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.346169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.347877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.349895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.527759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:49:22.529630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:49:22.530114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:49:22.530798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:49:22.531320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:49:22.545200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.545737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.546169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.546904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.547438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.547875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.596789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Getting quotas for project 18d643da90cc4b949f303ce36ec308ee. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:22.606042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.609650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Getting quotas for user fa4a10ecba334d04a1c69d7dea924fc9 and project 18d643da90cc4b949f303ce36ec308ee. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:22.616200 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4a3e62c-41f2-48c6-8d3e-d2cb141aacaa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1656 microversion: 2.1 time: 0.300463 Sep 27 01:49:22.617004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2217/4423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1656 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:22.643680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:22.652175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:49:22.656868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.657265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:49:22.657857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.658491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.691867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Going to try to start instance {{(pid=128778) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 01:49:22.752420 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bb65d2fc-36f0-4e4b-aa10-e4bcdef88cf3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.112611 Sep 27 01:49:22.753853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2218/4424] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:22 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:49:22.774461 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c713072-2a1f-4a18-8b82-adfcff07ed86 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.625800 Sep 27 01:49:22.777758 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2207/4425] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:49:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:49:22.778843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:22.780166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:22.791253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.792139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.793170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.795705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:22.796573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:22.797596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:22.799362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a9e0c2d-1219-4404-aeb9-8c56e4265f98 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:22.813317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a9e0c2d-1219-4404-aeb9-8c56e4265f98 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:22.941597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a9e0c2d-1219-4404-aeb9-8c56e4265f98 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:22.952126 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a9e0c2d-1219-4404-aeb9-8c56e4265f98 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1226 microversion: 2.1 time: 0.159521 Sep 27 01:49:22.952726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2208/4426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:22 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:23.148709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:23.149745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:23.164321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:23.165030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:23.168690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:23.170464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:23.171518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:23.173375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:23.495594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:23.503705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a5d7a34-87a2-4f34-89e1-4d4b75663298 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.359735 Sep 27 01:49:23.512442 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2209/4427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:23 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:23.517597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:23.527619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:23.552890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:23.553395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:23.553849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:23.554569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:23.555126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:23.555446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:23.714607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:23.715785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:23.722565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:23.731173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a816a347-acbd-42a1-a28b-531c2de7360a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1665 microversion: 2.1 time: 0.969926 Sep 27 01:49:23.740531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:23.744385 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c027619-7e0c-4fa3-81e5-f2a12b1895be tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1342 microversion: 2.20 time: 0.229019 Sep 27 01:49:23.745776 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2219/4428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1665 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:23.746729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2210/4429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:23 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:23.976321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:23.977753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:23.993784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:23.994303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:23.994758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:23.995504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.003909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.004380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:24.147606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-plugged", "status": "completed", "tag": "d201f932-fcf3-432c-99da-16501f2ebcb6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:24.177941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:24.192044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:24.195272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3e4c537-0479-4c28-85b8-2472fbac15b0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1222 microversion: 2.1 time: 0.221757 Sep 27 01:49:24.201116 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2220/4430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:23 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:24.205100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.206720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.207402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:24.242985 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] Creating event network-vif-plugged:d201f932-fcf3-432c-99da-16501f2ebcb6 for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:24.258058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3f321bc2-53fb-4bd7-833b-2e47c6e7f88f req-ee3cb036-a8f4-4c1f-8a23-878bd10a3f57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114937 Sep 27 01:49:24.262597 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2211/4431] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:24.532631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:24.533235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:24.551500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.552001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.555436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:24.557272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.560588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.561039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:24.761292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:24.764107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:24.778642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.780656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.781279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:24.783700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:24.784441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:24.797972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:25.063258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.071741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e7649db-dc70-48b2-aa8c-b38f630a22a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.543838 Sep 27 01:49:25.076465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2221/4432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:24 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:25.083551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:25.087643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:25.100147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:25.100649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:25.101085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:25.101817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:25.102469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:25.102905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:25.267537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.283759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32cbb794-f68c-4c83-b25e-cfe51e08b641 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1665 microversion: 2.1 time: 0.527151 Sep 27 01:49:25.284669 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2212/4433] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:24 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1665 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:25.302480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:25.303339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:25.317756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:25.318306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:25.319668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.320987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:25.323703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:25.324265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:25.324720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:25.343013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.344560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.355381 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49b72ee7-b062-49d0-aba9-4f1c91f81d9c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.266886 Sep 27 01:49:25.357088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2222/4434] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:25 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:25.515153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:25.530070 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-305b4d06-2bda-41a3-9704-26453972339e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1284 microversion: 2.1 time: 0.242759 Sep 27 01:49:25.532325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2213/4435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:25 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:26.100524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:26.101165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:26.112600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.113313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.113918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.114788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.115686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.116330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.288174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-plugged", "status": "completed", "tag": "fb0c5055-2904-468b-9bf1-7801f50b5dcf"}, {"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-plugged", "status": "completed", "tag": "0046e0cd-cb58-49ce-92a0-25857004034e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:26.302253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.303029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.303664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.324016 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Creating event network-vif-plugged:fb0c5055-2904-468b-9bf1-7801f50b5dcf for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:26.329644 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] Creating event network-vif-plugged:0046e0cd-cb58-49ce-92a0-25857004034e for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:26.338665 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4b297568-fdab-4871-a9c5-efd2823cba91 req-3cf5f21b-4c53-424f-83d0-29faa8d5c87f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059933 Sep 27 01:49:26.341450 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2214/4436] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:26.361849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:26.362574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:26.371478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.376265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.376807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.377592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.378054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.378817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.521979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:26.532883 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34b5afe8-f826-4faa-8d7c-69cef123f924 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.437169 Sep 27 01:49:26.549466 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2223/4437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:26 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:26.554714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:26.555335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:26.561708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.562224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.562890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.563938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.564570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.570982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.709108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:26.725775 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8eb2e0b7-33b7-46e5-8917-3ab5492add1f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.381241 Sep 27 01:49:26.726737 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2215/4438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:26 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:26.735468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:26.736447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:26.744161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.745209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.748926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:26.751360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:26.752488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:26.753755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.013078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.021035 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-133a6b82-3683-4bf8-b84f-9ad35e4d2fbe tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.292722 Sep 27 01:49:27.021884 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2216/4439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:26 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:27.026695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:27.027544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:27.034598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.035345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.036052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.036989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.037787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.038225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.085952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.094141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.095573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.096861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-245eb1b8-1b61-489f-b4c8-3b9372147c78 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.546338 Sep 27 01:49:27.113742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2224/4440] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:26 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:27.120469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:27.133677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.134568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.135423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.148194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] Creating event network-changed:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:49:27.155010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ab8ccc8d-273c-490d-8067-2c9ccfefd32a req-ee3b60ca-71c0-446f-b431-74962c8aca31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038692 Sep 27 01:49:27.156285 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2225/4441] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:27.376113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.384993 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f173f7e0-f5ae-4abd-b2bb-b56bbecb04b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.361827 Sep 27 01:49:27.385912 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2217/4442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:27 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:27.416390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:27.417022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:27.440842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.442025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.442646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.443573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.444268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.444926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.525382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Unlocking {{(pid=128778) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 27 01:49:27.565075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:27.568339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:27.585698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.586169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.586902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.588967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.590014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.592959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.602001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:27.620801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1c13f71-9f04-46a1-b378-48b68e929dc6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.209285 Sep 27 01:49:27.622214 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2226/4443] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:27 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:49:27.635810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:27.636770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:27.657109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.657703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.658178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.659483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:27.659944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:27.660375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:27.793441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:27.804224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50e89bc9-8972-437c-8372-df954116e3c5 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1355 microversion: 2.1 time: 0.251282 Sep 27 01:49:27.813458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2218/4444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:27 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:28.012145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:28.029240 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28fc2501-66e0-44f6-ad5b-6127d1e603df tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.399785 Sep 27 01:49:28.032622 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2227/4445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:27 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:28.045772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:28.046727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:28.063778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:28.064624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:28.069221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.069779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.070248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.071017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.088487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.088487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.088487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.088487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.088487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.089232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.089727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.098616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.473522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:28.483692 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d764f76-d043-4b52-8bb6-54b2b5f97a46 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.426144 Sep 27 01:49:28.484282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2228/4446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:28 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:28.552703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:28.554722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:28.582007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.586582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.588633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.591513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:28.594907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:28.596513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:28.973828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:28.982316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94ce8d68-c5a4-473c-97c2-d7a844398591 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.941042 Sep 27 01:49:28.993700 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2219/4447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:28 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:28.999267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:29.000065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:29.010938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.011445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.012096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.019610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.020439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.021035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.231651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:29.248227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:29.253551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:29.255011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c41d064-84f1-42b0-8da5-f6a104a52b74 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.744519 Sep 27 01:49:29.256174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2229/4448] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:28 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:29.267525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef77cd4-294f-4398-b437-0f0a803facda", "tag": "8e8f9563-2a5b-41c8-b0b8-3294ccef818f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:29.288846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.290783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.291412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.320150 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] Creating event network-changed:8e8f9563-2a5b-41c8-b0b8-3294ccef818f for instance 0ef77cd4-294f-4398-b437-0f0a803facda on n-h2-859358-1 Sep 27 01:49:29.331208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f7c5794f-4e37-4bd7-8312-a9e2c8c518d9 req-e2fd2183-245b-472c-8283-5a07245347b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073577 Sep 27 01:49:29.334870 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2230/4449] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:29.345208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:29.345960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:29.356132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.357075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.357976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.358983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.371240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.371606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.761860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:29.775981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7824c586-bed4-403f-9efd-5a8aeb7164b5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.780483 Sep 27 01:49:29.789362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2220/4450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:28 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:29.789724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:29.791031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36382981-6ab3-4b2c-8e19-5b557a5db42f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1805 microversion: 2.1 time: 0.454743 Sep 27 01:49:29.795963 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2231/4451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:29 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1805 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:29.803953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:29.805586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:29.813271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.814028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.814612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.815779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.816425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.817598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.822841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:29.823539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:29.834794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.835647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.837829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.838897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.841113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.841813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.860413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:29.877285 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a62a113-629a-4b7e-aabd-d659a0985017 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6/ips" status: 200 len: 218 microversion: 2.1 time: 0.058223 Sep 27 01:49:29.878562 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2232/4452] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:49:29 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6/ips => generated 218 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:29.892792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:29.893327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:29.906342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.906848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.908102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.908978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:29.909654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:29.910359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:29.960499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:49:29.967012 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aaa75ee3-c0cd-4ba3-9d51-d2284b355111 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.167311 Sep 27 01:49:29.974308 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2221/4453] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:29 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:49:29.986845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:29.988087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:30.007655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.008423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.011538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.014352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.015807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.016750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.096039 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac2ec72a-2858-418f-99b7-d7fd4151d5b8 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 204 len: 0 microversion: 2.1 time: 0.207909 Sep 27 01:49:30.103723 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2233/4454] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:49:29 2022] DELETE /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:49:30.115334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:30.116149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:30.123501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.124723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.125929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.127016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.127603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.128202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.344770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.364278 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5a836b0-20b8-4b00-a551-41b9a1b240d2 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.255754 Sep 27 01:49:30.365940 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2234/4455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:30 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:30.373835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:30.374844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:30.382831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.383325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.383759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.384896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.385375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.385811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.434478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.463527 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9149edb7-580c-4794-a458-d6211d88f828 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1674 microversion: 2.1 time: 0.483637 Sep 27 01:49:30.464990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2222/4456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:29 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1674 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:30.498916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:30.499808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:30.521454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.522177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.522780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.524151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:30.524897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:30.527182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:30.739686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.769011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aeb8cf73-e198-4a71-9519-ec57e91f6df4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1811 microversion: 2.1 time: 0.399215 Sep 27 01:49:30.774109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2235/4457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:30 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1811 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:30.951424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.962252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.963785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:30.967129 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f03b95e2-cfbc-44f6-ad65-553c6f188ce0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.486827 Sep 27 01:49:30.971593 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2223/4458] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:30 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:31.392494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:31.393868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:31.401226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.402070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.402705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.404241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.404901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.405678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.438245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:31.495223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:31.496530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:31.511079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.514100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.514782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.515664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.516325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.517000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.613789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:31.624155 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f147b665-49e9-4698-b8b1-92f4e02b4f9e tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.236088 Sep 27 01:49:31.625178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2236/4459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:31 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:31.798580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:31.799317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:31.813398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.813909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.814351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.815074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.815534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.815967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.869151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:31.881822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91ad5683-1a0b-45d6-98d4-1b176478afee tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1654 microversion: 2.1 time: 0.391628 Sep 27 01:49:31.882611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2224/4460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:31 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1654 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:31.912229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:31.912916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:31.924748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.925247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.925730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:31.926445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:31.926911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:31.927325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.007054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.016461 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6991878-a9ec-472d-8a54-f4d456218fed tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1811 microversion: 2.1 time: 0.222036 Sep 27 01:49:32.018009 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2237/4461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:31 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1811 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:32.036599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:32.037558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:32.047827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.048704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.049515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.052741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.053618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.054363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.095876 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07b5a2d4-6090-4ed7-9801-f353c2dec929 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.189479 Sep 27 01:49:32.100652 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2225/4462] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:49:31 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:49:32.108441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:32.120995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:32.134790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.135349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.135783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.144360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.145135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.146450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.284883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:32.344546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.358693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.360235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.362772 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c95eecef-991f-4b7f-b840-e1b46b3b4b25 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.343490 Sep 27 01:49:32.363762 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2238/4463] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:32 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:32.577589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:32.592862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.610767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccc691d1-c7d9-443c-bb84-b12b9dcb2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1661 microversion: 2.1 time: 0.508643 Sep 27 01:49:32.612779 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2226/4464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:32 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1661 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:32.649710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:32.650465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:32.653801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:32.666595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.668616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.671867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.673610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:32.674090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:32.677934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:32.880049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:32.889659 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3b9bf09-2494-41e8-bbb4-9736b11eb523 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.244918 Sep 27 01:49:32.890236 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2239/4465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:32 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:33.045625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:33.046598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:33.048634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:33.066581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.069733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.070213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.070935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.071396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.071830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.359626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:33.373853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-296a3bb2-9961-474f-878e-a2db1289f061 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1811 microversion: 2.1 time: 0.331960 Sep 27 01:49:33.374782 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2227/4466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:33 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1811 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:33.392858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:33.393789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:33.402947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.404286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.404941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.406314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.406978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.407556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.638306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:33.639199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:33.667725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.669462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.669925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.675030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.675535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.675985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.785649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:33.802284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:33.806767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:33.808553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a8c2b25-5c08-44ca-a376-ceb482355a4b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.420249 Sep 27 01:49:33.810784 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2240/4467] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:33 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:33.913328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:33.914332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:33.932825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.935637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.936192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.938967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:33.942475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:33.942757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:33.944020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:33.953157 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eda432de-4785-4d98-9449-1ef965f0dc96 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.319759 Sep 27 01:49:33.954847 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2228/4468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:33 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:33.982094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:33.990663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:34.009861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.010358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.010786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:34.011492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.011940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.012362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:34.587572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:34.597804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87ef8acf-7f72-46b3-9c7b-38239b975e4e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.620214 Sep 27 01:49:34.598860 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2229/4469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:33 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:34.603882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:34.606071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:34.621121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.621646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.622127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:34.622833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.623287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.623707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:34.759755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:34.770874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c398931e-c3fa-4ca7-abc8-51c5e4e68143 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.862397 Sep 27 01:49:34.775201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2241/4470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:33 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:34.782375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:34.783365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:34.814822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.816870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.818377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:34.819555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:34.820198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:34.820834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.100186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.142966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-691ecb9f-00f9-4ad2-bd9d-a96650072bc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1811 microversion: 2.1 time: 0.542832 Sep 27 01:49:35.146427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2230/4471] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:34 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1811 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:35.154859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:35.162020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:35.172217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.173388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.174546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.176130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.177133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.180270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.266651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.270147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:35.275331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b576f00-e240-4b70-be79-59d6b59a6951 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.498881 Sep 27 01:49:35.289742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2242/4472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:34 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:35.305093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:35.305750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:35.313021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.314380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.314842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.315571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.316029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.316622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.698953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.723001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.723607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.725010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:35.730466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e8b1dd0-0e69-415a-90df-9ec58bd72af2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.582004 Sep 27 01:49:35.732769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2231/4473] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:35 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:35.745975 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd565c03-b371-46bc-96ff-be79fd4dada1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.451627 Sep 27 01:49:35.747317 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2243/4474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:35 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:35.782589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:35.789843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:35.800468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:35.801064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:35.825669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.826207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.826827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.828358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.828798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.829375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.830334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.832042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.832686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:35.833876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:35.834332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:35.836249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.435798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:36.438814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:36.448253 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-497a25ca-6963-4677-9b10-a1707a0cb64c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.677231 Sep 27 01:49:36.454595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2232/4475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:35 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:36.475160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39285498-c14f-469b-a430-413f4c1f4f18 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.680767 Sep 27 01:49:36.476150 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2244/4476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:35 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:36.490251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "name": "network-vif-plugged", "status": "completed", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:36.507709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:36.511111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:36.516866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.517802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.518945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.527288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.527797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.528787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.529554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.535681 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] Creating event network-vif-plugged:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:49:36.539631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.541968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dbaeb9e0-53c7-47ff-a99d-7a43e4671b06 req-57069bc8-4dcf-42e0-9166-5d53db6c2a53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085623 Sep 27 01:49:36.544531 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2233/4477] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:36.546851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.550459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-deleted", "tag": "fb0c5055-2904-468b-9bf1-7801f50b5dcf"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:36.562116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.562963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.564506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.579306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] Creating event network-vif-deleted:fb0c5055-2904-468b-9bf1-7801f50b5dcf for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:36.587031 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8f87c9bb-5e12-4742-b950-f7eb1c496850 req-ce81f1ea-a508-4e11-a147-6e16b8fe68e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039803 Sep 27 01:49:36.588121 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2234/4478] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:36.595716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:36.596670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:36.603706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.605120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.605717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:36.606612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:36.607379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:36.607692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:37.015729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:37.029721 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c39c26ce-4d3b-4d05-9319-5d422b859fae tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.439515 Sep 27 01:49:37.031063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2235/4479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:36 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:37.427952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:37.437996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c4b7fa6-92d8-46d5-9c17-3dfb71eeb979 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1790 microversion: 2.1 time: 0.954602 Sep 27 01:49:37.453373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2245/4480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:36 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1790 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:37.458833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:37.459537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:37.492833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:37.493329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:37.499407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:37.500238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:37.500761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:37.501192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:37.550600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1219279572", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "fabc1b28-ae34-4705-b968-a8b23cc08169"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:37.667201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] validate_networks() for [('fabc1b28-ae34-4705-b968-a8b23cc08169', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:49:37.805436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:37.816515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:37.818231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:37.823154 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a7937c8-11bd-4930-83d3-88f71fd6ab99 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1407 microversion: 2.20 time: 0.382439 Sep 27 01:49:37.838592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2246/4481] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:37 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:37.847464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:37.848092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:37.864839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:37.865440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:37.865818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:37.866532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:37.867008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:37.867453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.146147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:38.160838 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5aa9449c-f2ce-43f0-9bdd-06420683988c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.321059 Sep 27 01:49:38.165156 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2247/4482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:37 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:38.284864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:49:38.285299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:49:38.285813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:49:38.286224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:49:38.286641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:49:38.308421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.308919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.309438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.310335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.311640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.314086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.342900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Getting quotas for project dd6d1455b0ed4c2ca0c06d8ee12626dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:38.348763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Getting quotas for user 4c0869509ac34cfd9e01dec9ea4f5d2a and project dd6d1455b0ed4c2ca0c06d8ee12626dd. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:38.367001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:49:38.369700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:49:38.448806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80605039-3ceb-4653-9bac-da02fe076dc3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.416403 Sep 27 01:49:38.452056 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2236/4483] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:49:38.464120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:38.465383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:38.490662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:38.501117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:38.516569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.524375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.527423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.528417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.533173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.534139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.630655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:38.651428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:38.653324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:38.658778 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d1a85aa-5a8c-45b0-9362-9edb77c55c00 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1262 microversion: 2.26 time: 0.199383 Sep 27 01:49:38.680079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2248/4484] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:38 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1262 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:38.696118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:38.710466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f1e7fc0-0be3-41da-b9c1-25b756522c3a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 200 len: 1568 microversion: 2.1 time: 0.242421 Sep 27 01:49:38.713078 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2237/4485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:38 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:38.788205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef77cd4-294f-4398-b437-0f0a803facda", "name": "network-vif-plugged", "status": "completed", "tag": "8e8f9563-2a5b-41c8-b0b8-3294ccef818f"}, {"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-unplugged", "status": "completed", "tag": "0046e0cd-cb58-49ce-92a0-25857004034e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:38.836368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.836877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.837297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.854343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:38.855398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:38.863708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.865710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.866314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.867210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.867818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.868405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.878663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Creating event network-vif-plugged:8e8f9563-2a5b-41c8-b0b8-3294ccef818f for instance 0ef77cd4-294f-4398-b437-0f0a803facda on n-h2-859358-1 Sep 27 01:49:38.879214 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] Creating event network-vif-unplugged:0046e0cd-cb58-49ce-92a0-25857004034e for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:38.892063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:38.897206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-195efe95-87d5-48cf-91cb-ea56d885071b req-4f0b8b79-1907-4ff7-a90a-d5c58b63bb61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.113771 Sep 27 01:49:38.899632 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2249/4486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:38.919393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-deleted", "tag": "d201f932-fcf3-432c-99da-16501f2ebcb6"}, {"server_uuid": "dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6", "name": "network-vif-deleted", "tag": "0046e0cd-cb58-49ce-92a0-25857004034e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:38.940977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:38.942917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:38.943519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:38.961281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Creating event network-vif-deleted:d201f932-fcf3-432c-99da-16501f2ebcb6 for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:38.961833 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] Creating event network-vif-deleted:0046e0cd-cb58-49ce-92a0-25857004034e for instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 on n-h2-859358-1 Sep 27 01:49:38.977316 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0ae67262-f7ab-4e54-a9be-c3f21ad6f259 req-55640261-537c-4379-8c4f-8b8572c9f57b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062809 Sep 27 01:49:38.979294 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2250/4487] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:39.145958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.160660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.171166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.175528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-457f02e6-faaf-4f7d-86f4-91f27148e37d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1598 microversion: 2.20 time: 0.327161 Sep 27 01:49:39.177757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2238/4488] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:38 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1598 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:39.205102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:39.206106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:39.208609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:39.210421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:39.214586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.219053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.220572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.220572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.220903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.221326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.221660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.222078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.222204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.223930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.224667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.226628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.354605 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a8a6f0f-5e64-4cb1-8277-bbc9a1b5efd8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152197 Sep 27 01:49:39.355809 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2239/4489] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:49:39 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:49:39.571699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.581633 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05b55a09-0334-4926-82ef-0ae6c7e7b1ea tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 0.383954 Sep 27 01:49:39.584818 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2251/4490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:39 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:39.701215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:39.702239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:39.714022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.714790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.715405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.718123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.721123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.722125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.744226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:39.745040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:39.763080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.766738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.768473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.776355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:39.776857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:39.777306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:39.846356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 HTTP/1.1 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6'} Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:49:39.848452 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:49:39.851909 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:49:39.857054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:49:39.858602 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee57c131-8434-4913-866c-d134c1499012 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 404 len: 111 microversion: 2.1 time: 0.125554 Sep 27 01:49:39.859493 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2252/4491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:39 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:49:39.909669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.920918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.922897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:39.927034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2d0b678-32bc-46f6-bac7-49a84f6f29bc tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1258 microversion: 2.26 time: 0.235063 Sep 27 01:49:39.943454 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2240/4492] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:39 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:40.611167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:40.612226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:40.634279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:40.636007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:40.636007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:40.636007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:40.640947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:40.641438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.113730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:41.114163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:41.130900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.133567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.134048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.136911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.138589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.139055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.217525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:49:41.456776 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-597f1de8-cd64-4a6d-b410-cb7fe0a20de4 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 204 len: 0 microversion: 2.32 time: 1.257872 Sep 27 01:49:41.457378 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2253/4493] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:49:40 2022] DELETE /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 0 bytes in 1259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:49:41.462670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:41.471827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:41.500879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.503959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.504504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.505279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.508174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.508793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.669782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:41.688059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:41.691894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:41.693045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b310675-d153-45c7-b8e1-7dd605932965 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1320 microversion: 2.26 time: 0.234398 Sep 27 01:49:41.697629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2254/4494] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:41 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:41.715047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:41.715244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:41.716771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:41.728420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60654f3a-08ab-4b20-b139-92d9b8cdaae5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1352 microversion: 2.1 time: 1.120851 Sep 27 01:49:41.732590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.734482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.735678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.738600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:41.739880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:41.741548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:41.746468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2241/4495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:40 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1352 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:42.217990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:42.242483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:42.246995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:42.260988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb2650b2-40f2-4cb7-b58a-664551370d82 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2947 microversion: 2.32 time: 0.561935 Sep 27 01:49:42.264264 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2255/4496] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:41 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2947 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:42.649479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:42.676191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:42.676726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:42.677222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:42.701312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] Creating event network-changed:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:49:42.716696 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4bc10910-9b87-4052-af0a-7eb11c6fb28f req-7548d244-1d5e-48f2-a632-7aa7e4546f4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070944 Sep 27 01:49:42.720913 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2242/4497] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:42.726146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:42.727644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:42.740304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:42.742086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:42.743237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:42.744949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:42.746415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:42.747839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:42.762768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:42.763762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:42.779297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:42.780842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:42.787145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:42.788734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:42.789533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:42.790185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:43.010638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:43.021794 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac73ce9b-b6f2-4232-ab4d-58d6cf5dde9a tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1541 microversion: 2.1 time: 0.261814 Sep 27 01:49:43.023902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2243/4498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:42 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1541 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:43.049720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:43.052014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:43.067566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:43.068064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:43.068788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:43.069204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:43.073534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:43.074356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:43.237182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-606c0d2a-cd55-4bb9-ad42-f4ea25fea83c tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193360 Sep 27 01:49:43.238274 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2244/4499] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:49:43 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:43.253832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:43.271151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:43.277028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:43.280605 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b7b698e-8101-454d-8d1c-12d9962789ad tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.558599 Sep 27 01:49:43.282221 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2256/4500] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:42 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:43.305627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:43.306511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:43.317057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:43.318250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:43.318833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:43.319856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:43.320456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:43.321077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:43.979692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:43.995825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:44.000296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:44.002988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd9bc999-0737-42e7-95cb-f134a82a8bec tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2947 microversion: 2.32 time: 0.703307 Sep 27 01:49:44.006438 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2245/4501] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:43 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2947 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:44.310958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:44.311589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:44.318481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:44.319201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:44.319799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:44.320678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:44.321416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:44.322013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:44.615842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:44.629707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:44.633000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:44.638632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f6e69c1-196d-4483-ae0a-02d452ae0298 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.329959 Sep 27 01:49:44.655125 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2257/4502] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:44 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:45.037955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:45.038833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:45.048565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:45.049054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:45.049720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:45.051464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:45.051933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:45.052363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:45.569911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:45.580948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:45.582412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:45.584210 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-138e6365-14b2-47cf-83e4-dbbbdd0173fc tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2947 microversion: 2.32 time: 0.550104 Sep 27 01:49:45.584789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2246/4503] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:45 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2947 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:45.670033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:45.671225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:45.683658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:45.686551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:45.687189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:45.688523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:45.696443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:45.696898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:45.995782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:46.004435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:46.008006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:46.013436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-696ba528-aa5a-4bab-81db-aa7739c65c71 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.347788 Sep 27 01:49:46.016590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2258/4504] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:45 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:46.143636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef77cd4-294f-4398-b437-0f0a803facda", "tag": "8e8f9563-2a5b-41c8-b0b8-3294ccef818f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:46.169744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:46.173765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:46.174966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:46.229376 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] Creating event network-changed:8e8f9563-2a5b-41c8-b0b8-3294ccef818f for instance 0ef77cd4-294f-4398-b437-0f0a803facda on n-h2-859358-1 Sep 27 01:49:46.242709 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-685a5d0d-3443-4b82-b4ad-1587b09181b8 req-a325885f-ab98-4f00-842b-68307026838a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103363 Sep 27 01:49:46.247362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2247/4505] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:46.615901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:46.616524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:46.630276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:46.631430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:46.631870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:46.632605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:46.633068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:46.633530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:47.047071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:47.048013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:47.058359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:47.070570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:47.076146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:47.077081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:47.077583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:47.078222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:47.237024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.259424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.271680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.273042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f6b43fe7-f1a8-48bd-8e8c-8c5c73ceb021 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2926 microversion: 2.32 time: 0.662468 Sep 27 01:49:47.279945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2259/4506] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:46 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2926 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:47.551128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.561670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.566276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:47.567492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-049bab51-69f0-473a-b836-ee507f2aa8b4 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.526209 Sep 27 01:49:47.585832 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2248/4507] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:47 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:48.213773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-unplugged", "status": "completed", "tag": "f614e123-3043-4e23-911c-17972ccd15fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:48.233970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.234981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.238285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.263320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] Creating event network-vif-unplugged:f614e123-3043-4e23-911c-17972ccd15fd for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:48.275657 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2f2f004f-a385-444e-a783-a5f0385a903b req-f5042260-dbd4-4263-8256-4f93b76edaa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065184 Sep 27 01:49:48.283248 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2260/4508] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:48.306551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:48.307979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:48.327100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.329524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.330509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.331706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.332736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.341822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.343462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:48.377321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:48.598185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:48.598898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:48.606533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.607431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.608150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.609073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.609809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.610566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.639196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:48.640239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:48.696665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:48.716059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:48.722037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:48.726665 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64401666-38a1-44ef-9ed7-52d59389a72e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2905 microversion: 2.32 time: 0.424681 Sep 27 01:49:48.728519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2249/4509] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:48 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2905 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:48.734475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959a8e6c-7eb6-4895-9ee4-933369cfd497", "tag": "20dc902f-ee7f-42a4-9fb2-a876796705cc"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:48.745744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:48.746469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:48.747566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:48.768827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] Creating event network-changed:20dc902f-ee7f-42a4-9fb2-a876796705cc for instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 on n-h1-859358-1 Sep 27 01:49:48.779426 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-10782adc-feec-4b77-8718-dd11782b7511 req-d780a41e-14b8-4bf5-9203-1912e45babb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047681 Sep 27 01:49:48.780603 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2250/4510] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:49.032955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:49.055761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:49.057931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:49.059920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6a0a1e2-0653-474b-ac78-250d56c9e605 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.466027 Sep 27 01:49:49.062315 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2261/4511] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:48 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:49.491933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1836671437", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "af52517e-090e-47e7-8baa-dcf3a32b2ed6"}, {"uuid": "8e936e4b-b0b5-41fb-9408-cd873de32c0f"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:49.586579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] validate_networks() for [('af52517e-090e-47e7-8baa-dcf3a32b2ed6', None, None, None, None, None), ('8e936e4b-b0b5-41fb-9408-cd873de32c0f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:49:49.743920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-deleted", "tag": "8e78f337-4d92-4245-a3bb-b449d93a8ff3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:49.779415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:49.782745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:49.785326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:49.824192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] Creating event network-vif-deleted:8e78f337-4d92-4245-a3bb-b449d93a8ff3 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:49.841294 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-83b19884-a0fb-46e7-aaf8-7af9f604fe0b req-0043060c-e584-4b1f-a295-2b1700b9dd1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105170 Sep 27 01:49:49.844496 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2262/4512] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:49.895197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:49.899541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:49.921320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:49.923968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:49.925261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:49.926988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:49.929259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:49.932748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:50.649616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:50.664984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:50.666483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:50.677807 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a65853a-0f61-44d9-8d54-ab57b1a5d4d5 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2745 microversion: 2.32 time: 0.828231 Sep 27 01:49:50.679456 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2263/4513] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:49 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2745 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:50.688184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:50.688913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:50.696668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:50.697575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:50.698229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:50.699134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:50.699882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:50.700960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.179848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:49:51.180349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:49:51.180767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:49:51.181704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:49:51.182304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:49:51.198993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:51.202108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:51.204258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.208075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:51.208736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:51.209488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.267433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Getting quotas for project 8485902fa9af48b59fe65ea59716e686. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:49:51.277053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:51.287263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Getting quotas for user a56ab078c9474e268df4d02248a064b2 and project 8485902fa9af48b59fe65ea59716e686. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:49:51.332698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:49:51.341402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:49:51.465920 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6aa1f6ed-8b0b-4233-ad00-77aa78e28fb2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980030 Sep 27 01:49:51.480091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2251/4514] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:49:51.485122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ff3212d-e1ec-465b-ad65-471fe445567b"}, {"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-unplugged", "status": "completed", "tag": "2f06025e-abb7-45cf-8f89-9f6dac7a80f9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:51.529463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:51.532018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:51.533437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.556662 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Creating event network-vif-unplugged:2ff3212d-e1ec-465b-ad65-471fe445567b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:51.563035 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] Creating event network-vif-unplugged:2f06025e-abb7-45cf-8f89-9f6dac7a80f9 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:51.575551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-26e21b38-e9d2-4407-b991-6698ec69a1c0 req-0f4fcbdf-d431-4a88-bb5d-54f73c0f4a5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.093479 Sep 27 01:49:51.582250 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2252/4515] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:51.590867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77ab5ae6-1784-49ff-b2bc-9c29f8e4fcc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:51.592726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77ab5ae6-1784-49ff-b2bc-9c29f8e4fcc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:51.749207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77ab5ae6-1784-49ff-b2bc-9c29f8e4fcc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:51.756916 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77ab5ae6-1784-49ff-b2bc-9c29f8e4fcc4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1213 microversion: 2.1 time: 0.172944 Sep 27 01:49:51.778039 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2253/4516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:51 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:51.786885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:51.787505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:51.812108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:51.822824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:51.823487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.824484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:51.824983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:51.825448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:51.928583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:51.943889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:51.946529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:51.948538 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3fd1e1f0-6a67-4cf3-884c-bad38755674e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 1.267331 Sep 27 01:49:51.952252 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2264/4517] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:50 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:51.981862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-deleted", "tag": "f614e123-3043-4e23-911c-17972ccd15fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:52.013857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:52.016046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:52.017625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:52.091881 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] Creating event network-vif-deleted:f614e123-3043-4e23-911c-17972ccd15fd for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:52.098066 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-99e0f9fc-51d0-4b4a-b6c3-a8bc6fd9c023 req-3e04d4f8-cf1e-466f-8128-f221d82e9e3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122379 Sep 27 01:49:52.099252 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2265/4518] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:52.233964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:52.247882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:52.249435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:52.250671 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a182d8d8-44b1-4b7f-8e20-9a0750a43b8e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2699 microversion: 2.32 time: 0.471559 Sep 27 01:49:52.251253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2254/4519] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:51 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2699 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:52.792782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:52.793590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:52.807601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:52.808099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:52.809995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:52.810724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:52.811190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:52.811631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:52.981552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:52.982159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:52.992437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:52.993004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:52.994270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:52.995183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:52.995786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:52.997047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:53.135040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.147515 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53a21015-be01-47df-b6b0-50129afc1d47 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1265 microversion: 2.1 time: 0.358036 Sep 27 01:49:53.148255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2266/4520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:52 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:53.224535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.238016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.240527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.243180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf8b9efc-3059-4f7f-a5af-8ec7d202f50d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.265554 Sep 27 01:49:53.243957 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2255/4521] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:52 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:53.284225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:53.285102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:53.293916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:53.294800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:53.295609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:53.296553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:53.297248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:53.298587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:53.623893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-unplugged", "status": "completed", "tag": "b3bb06e2-fbe1-490a-b20e-57de6d615186"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:53.651478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:53.656079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:53.656513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:53.690005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] Creating event network-vif-unplugged:b3bb06e2-fbe1-490a-b20e-57de6d615186 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:53.704080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c649ce2d-6199-43cc-9302-597d0fd69e93 req-acb0a179-5f50-4982-82a2-542968337cec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083870 Sep 27 01:49:53.704921 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2256/4522] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:53.718758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.740276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.759194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:53.761714 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7030c8e-4d1c-4661-8fef-116f6e151686 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2539 microversion: 2.32 time: 0.482464 Sep 27 01:49:53.770968 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2267/4523] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:53 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2539 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:54.169988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-deleted", "tag": "b3bb06e2-fbe1-490a-b20e-57de6d615186"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:54.177506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:54.178393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:54.192172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.194845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.197684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.216141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.216576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.219410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.223419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.225128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.226357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.228736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] Creating event network-vif-deleted:b3bb06e2-fbe1-490a-b20e-57de6d615186 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:54.242686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-99d1fd55-2ece-4db2-9aee-614478bb89d5 req-28152f67-fe4c-487c-8285-5b038651b4f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080486 Sep 27 01:49:54.244295 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2257/4524] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:54.270861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:54.271778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:54.293948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.296197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.296937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.299596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.302167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.313171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.525606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:54.535340 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b28bcf43-035b-4b76-9311-51376e668388 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1271 microversion: 2.1 time: 0.366854 Sep 27 01:49:54.536966 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2268/4525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:54 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1271 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:54.652301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:54.665573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:54.669527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:54.711362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5693354d-f9f1-4169-a077-911f42d316fd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.442471 Sep 27 01:49:54.714038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2258/4526] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:54 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:54.795141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:54.796007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:54.807989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.821802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.826847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:54.826847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:54.826847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:54.826847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:55.260474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:55.280050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:55.283328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:55.284602 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3be3bd01-c92c-49a3-a1b1-dc1887ccb43b tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2208 microversion: 2.32 time: 0.494079 Sep 27 01:49:55.285168 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2269/4527] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:54 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2208 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:55.569292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:55.570003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:55.580672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:55.583940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:55.584401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:55.596811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:55.597612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:55.598222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:55.737533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:55.741324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:55.750004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:55.750502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:55.750946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:55.755969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:55.756458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:55.756909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:56.010673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.039924 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24c22aa7-e70e-4700-818d-93cd0c9eac08 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1313 microversion: 2.1 time: 0.474392 Sep 27 01:49:56.040560 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2259/4528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:55 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:56.056276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959a8e6c-7eb6-4895-9ee4-933369cfd497", "name": "network-vif-plugged", "status": "completed", "tag": "20dc902f-ee7f-42a4-9fb2-a876796705cc"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:56.092944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:56.093513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:56.093949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:56.125825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] Creating event network-vif-plugged:20dc902f-ee7f-42a4-9fb2-a876796705cc for instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 on n-h1-859358-1 Sep 27 01:49:56.134371 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e44f4a8d-e450-4986-bd0a-ae357109323d req-5f1dc7d1-af67-4e3d-b6f8-cc1eb7142980 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081589 Sep 27 01:49:56.134998 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2260/4529] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:56.173384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.197767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.201667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.203320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55f0f9b6-0774-4fb1-935c-f45519c788e2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.469532 Sep 27 01:49:56.204616 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2270/4530] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:55 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:56.287254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-deleted", "tag": "2f06025e-abb7-45cf-8f89-9f6dac7a80f9"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:56.316325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:56.316950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:56.333383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:56.333872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:56.334304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:56.337175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:56.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:56.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:56.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:56.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:56.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:56.378387 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] Creating event network-vif-deleted:2f06025e-abb7-45cf-8f89-9f6dac7a80f9 for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:56.395241 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e3096fba-d869-477e-910f-6331235644ab req-885fda61-719e-4ed7-82d8-b68b716eeef9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113837 Sep 27 01:49:56.410607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2261/4531] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:49:56.534440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.544956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.554778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:56.556214 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1428d763-df6c-465e-aa78-f94f81aa4dad tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 2141 microversion: 2.32 time: 0.244465 Sep 27 01:49:56.575661 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2271/4532] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:56 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 2141 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:57.065678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:57.066799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:57.081130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.083300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.083905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.111772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.112281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.112731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.233871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:57.234871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:57.273173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.274301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.277006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.278534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.281161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.282649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.552653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.564056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:57.569921 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-737678b6-faad-4e42-8abf-b5fc608b9611 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.507658 Sep 27 01:49:57.571083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2262/4533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:57 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:57.595128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:57.596828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:57.606110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.606774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.607364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.608547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:57.609157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:57.609931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:57.739737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.761156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.764355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.769449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40712120-69c1-48ce-9dc4-0a8af6797edf tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.179237 Sep 27 01:49:57.782369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2263/4534] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:57 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:57.920820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.938775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.942416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:57.945307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd460acf-fdde-4293-ad93-6091240ca658 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1362 microversion: 2.26 time: 0.716431 Sep 27 01:49:57.946224 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2272/4535] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:57 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:58.484502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9a195-a58c-4860-8890-3726ef36cc2f", "name": "network-vif-deleted", "tag": "2ff3212d-e1ec-465b-ad65-471fe445567b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:49:58.525599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:58.526873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:58.528979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:58.546422 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] Creating event network-vif-deleted:2ff3212d-e1ec-465b-ad65-471fe445567b for instance 83c9a195-a58c-4860-8890-3726ef36cc2f on n-h1-859358-1 Sep 27 01:49:58.555215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aaf8fedb-b89b-462a-bbc5-aa0b7a711b67 req-9c67b0c3-0cce-4fcb-aa4f-ded04dbe13af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075137 Sep 27 01:49:58.557215 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2264/4536] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:49:58.594052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:58.594671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:58.601810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:58.602295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:58.602730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:58.603423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:58.603874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:58.604298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:58.799957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:58.800921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:58.815528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:58.822588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:58.826417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:58.827410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:58.828171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:58.828788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:58.960424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:58.972985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:58.982126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:58.984396 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fd20fbc-bcbf-498f-93c6-a6e0239c636f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.188762 Sep 27 01:49:58.994440 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2265/4537] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:58 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:49:59.012658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.013534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:59.021400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.034129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.034700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.035569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.036203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.036760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.160962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:59.175175 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-897e1b0f-f4e9-4077-8939-1954c18406f4 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.585573 Sep 27 01:49:59.179787 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2273/4538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:49:58 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:49:59.284225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:59.298412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:59.300982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:49:59.302975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1604e3d8-9daa-4cc2-bab2-e813fa2672c0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1545 microversion: 2.26 time: 0.307035 Sep 27 01:49:59.304153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2266/4539] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:49:58 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1545 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:49:59.337407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d56c9dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.348238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.349020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.349682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.350314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:59.358114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.358885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.359541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.360552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.361156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.361754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.421617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.422474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.423143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.439797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.440582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.441503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.487928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:49:59.516316 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a147a14-b16d-46ab-8022-f0a744f90aa2 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1463902356" status: 201 len: 0 microversion: 2.26 time: 0.184022 Sep 27 01:49:59.521772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2274/4540] 10.222.0.52 () {62 vars in 1380 bytes} [Tue Sep 27 01:49:59 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1463902356 => generated 0 bytes in 185 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 27 01:49:59.534647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b198931d-f293-4d8d-8b74-9f0b00213356 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d5523ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.549657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b198931d-f293-4d8d-8b74-9f0b00213356 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.550419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b198931d-f293-4d8d-8b74-9f0b00213356 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.551035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b198931d-f293-4d8d-8b74-9f0b00213356 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.571389 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b198931d-f293-4d8d-8b74-9f0b00213356 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1463902356" status: 204 len: 0 microversion: 2.26 time: 0.048311 Sep 27 01:49:59.575562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2267/4541] 10.222.0.52 () {60 vars in 1361 bytes} [Tue Sep 27 01:49:59 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1463902356 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:49:59.581065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24da524040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.593707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.594131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.594572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.598074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:59.614582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.618249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.618757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.620911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.621476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.621922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.687416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.687954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.688716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.706654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:49:59.734090 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-37be8aa9-69ed-4bce-8dc7-5168372c29f0 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 204 len: 0 microversion: 2.26 time: 0.157073 Sep 27 01:49:59.736618 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2275/4542] 10.222.0.52 () {60 vars in 1295 bytes} [Tue Sep 27 01:49:59 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:49:59.748109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08ce1bac-c8d6-489c-b7e7-b3f12e84e7f3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d5523ca0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.762875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08ce1bac-c8d6-489c-b7e7-b3f12e84e7f3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.778513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08ce1bac-c8d6-489c-b7e7-b3f12e84e7f3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.781083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08ce1bac-c8d6-489c-b7e7-b3f12e84e7f3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.824018 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08ce1bac-c8d6-489c-b7e7-b3f12e84e7f3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 12 microversion: 2.26 time: 0.080485 Sep 27 01:49:59.828984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2268/4543] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:49:59 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:49:59.846412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d5688160>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:49:59.860936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.861724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.862676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.864438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:49:59.876446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.877077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.877662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.878547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.879480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.880471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.916846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.917381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.918036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.927240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:49:59.927925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:49:59.928449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:49:59.931650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:49:59.956465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:49:59.976570 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-778fc991-327d-4049-97c9-15237fcf5f83 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-958067701" status: 201 len: 0 microversion: 2.26 time: 0.142227 Sep 27 01:49:59.977425 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2276/4544] 10.222.0.52 () {62 vars in 1377 bytes} [Tue Sep 27 01:49:59 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-958067701 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 27 01:49:59.987546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd5bf456-905b-4c03-b9d6-400e89508447 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d554cdc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.001167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd5bf456-905b-4c03-b9d6-400e89508447 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.001769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd5bf456-905b-4c03-b9d6-400e89508447 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.002276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd5bf456-905b-4c03-b9d6-400e89508447 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.019569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd5bf456-905b-4c03-b9d6-400e89508447 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 35 microversion: 2.26 time: 0.036067 Sep 27 01:50:00.020796 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2269/4545] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:49:59 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 35 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:00.031877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.032401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d548cdc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.033106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.040687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.041536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.042180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.043649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.044558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.045192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.049317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.049834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.050445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.050918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.057495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.058179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.059334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.060355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.060970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.061573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.089419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.089664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.090333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.122919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:00.147213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5650cb5b-70a5-42a4-9dc2-cd5793d31f41 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-958067701" status: 204 len: 0 microversion: 2.26 time: 0.119864 Sep 27 01:50:00.148124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2270/4546] 10.222.0.52 () {60 vars in 1361 bytes} [Tue Sep 27 01:50:00 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-958067701 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:00.157431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-919dbe27-44c1-4149-8ae1-55cbb152550e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d54ea550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.166583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:00.183315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-919dbe27-44c1-4149-8ae1-55cbb152550e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.184660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:00.186240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-919dbe27-44c1-4149-8ae1-55cbb152550e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.187511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-919dbe27-44c1-4149-8ae1-55cbb152550e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.190041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:00.193752 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6d05aa2-3a23-445e-b7a3-b3870ff3361c tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.164511 Sep 27 01:50:00.197380 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2277/4547] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:00 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:00.205290 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-919dbe27-44c1-4149-8ae1-55cbb152550e tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 12 microversion: 2.26 time: 0.052531 Sep 27 01:50:00.210730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.211529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.220444 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2271/4548] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:50:00 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:00.220615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.225366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.226817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.228390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d548cb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.229123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.229922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.231681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.247814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.253474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.253857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.254344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.264756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.265288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.265746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.266432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.266871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.267292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.309513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.309998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.310536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.323308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:00.339434 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2b368d6-4f0a-4551-8ec7-b6a9cf10b9c3 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 204 len: 0 microversion: 2.26 time: 0.117579 Sep 27 01:50:00.347092 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2272/4549] 10.222.0.52 () {60 vars in 1295 bytes} [Tue Sep 27 01:50:00 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:00.352225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d54eadc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.364196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.364753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.365296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.366018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.373207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.373806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.374252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.374994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.375444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.375909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.404670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.405164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.405626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.425674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.426257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.426848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.483757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:00.504620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-872b05a8-a95b-442e-b58c-ece1424d7994 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-2098619927" status: 201 len: 0 microversion: 2.26 time: 0.156299 Sep 27 01:50:00.509550 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2273/4550] 10.222.0.52 () {62 vars in 1380 bytes} [Tue Sep 27 01:50:00 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-2098619927 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 27 01:50:00.516045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24da5508b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.527060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.528075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.528552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.529694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.535628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.536180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.536569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.537267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.537819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.538307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.547271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:00.557589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0261ef58-a8d8-47bd-9373-79b2a08dd064 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.350681 Sep 27 01:50:00.560742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2278/4551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:00 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:00.570324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.570945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.571422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.589373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.589871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "tag": "331454a6-0423-4639-bc0e-05b02890f8dc"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:00.591068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.591730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.613176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.615170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.615636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.639324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:00.649310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] Creating event network-changed:331454a6-0423-4639-bc0e-05b02890f8dc for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:00.664140 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90f8f918-5933-4445-baaf-39dd9391f890 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1087863852" status: 201 len: 0 microversion: 2.26 time: 0.151771 Sep 27 01:50:00.667855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-33b23ea3-37ec-4a82-873c-d2c3009c83d2 req-1912398a-aadb-4c95-89a6-c87354b8f20f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081673 Sep 27 01:50:00.670138 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2279/4553] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:00.670274 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2274/4553] 10.222.0.52 () {62 vars in 1380 bytes} [Tue Sep 27 01:50:00 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1087863852 => generated 0 bytes in 159 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 27 01:50:00.678089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d5490670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.686772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.687258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.687696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.688246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.694390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.694873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.695299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.696145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.696645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.697090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.752791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.753292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.757941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.807882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:00.845987 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f944ac04-98fa-4894-b630-67281c91e696 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 204 len: 0 microversion: 2.26 time: 0.174072 Sep 27 01:50:00.847475 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2275/4554] 10.222.0.52 () {60 vars in 1295 bytes} [Tue Sep 27 01:50:00 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:00.857982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-355ed406-88d1-465b-a61b-cf15c554f4c1 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24da658310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.874991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355ed406-88d1-465b-a61b-cf15c554f4c1 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.875481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355ed406-88d1-465b-a61b-cf15c554f4c1 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.880310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355ed406-88d1-465b-a61b-cf15c554f4c1 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.909701 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-355ed406-88d1-465b-a61b-cf15c554f4c1 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 12 microversion: 2.26 time: 0.054315 Sep 27 01:50:00.910388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2280/4555] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:50:00 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:00.921970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d54d55e0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:00.943223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.945916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.946962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.947719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:00.955451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.956313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.956917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.958680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.959903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.960614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:00.980009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:00.995021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:00.995887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:00.996637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.021397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:01.043772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43b9f32a-c4b0-42d6-88ea-5b828efa4587 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 204 len: 0 microversion: 2.26 time: 0.126297 Sep 27 01:50:01.045068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2276/4556] 10.222.0.52 () {60 vars in 1295 bytes} [Tue Sep 27 01:50:00 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:01.054694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d622b310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.070533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.071193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.071639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.077575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.086774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:01.094425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.096668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.098924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.100049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.100708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.101899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.187089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.193219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.194647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.222226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.223593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.223808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.224136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.224520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.237572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.239650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.240696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.242017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.243811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.244198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.246179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:01.269057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:01.293598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36b35fe2-00ea-47ac-b3b7-aa4caa75d7cd tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-649005350" status: 201 len: 0 microversion: 2.26 time: 0.242206 Sep 27 01:50:01.300739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2281/4557] 10.222.0.52 () {62 vars in 1377 bytes} [Tue Sep 27 01:50:01 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-649005350 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 27 01:50:01.306579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d56c9c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.322411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.323351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.325330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.326051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.334708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.335607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.336273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.337422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.338304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.338800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.372496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.373054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.373745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.395614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.396238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.397382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.438581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:01.458515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:01.459776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:01.463971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:01.466913 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fa08266-2a5b-451d-b5e4-fe22a51ca77e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.247260 Sep 27 01:50:01.478031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2277/4558] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:01 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:01.493259 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-51799ba6-4178-430b-a88d-6baca9608d96 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1344889925" status: 201 len: 0 microversion: 2.26 time: 0.190724 Sep 27 01:50:01.494028 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2282/4559] 10.222.0.52 () {62 vars in 1380 bytes} [Tue Sep 27 01:50:01 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags/tempest-tag-1344889925 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 27 01:50:01.512503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Action: 'update_all', calling method: .version_select at 0x7f24d548c280>, body: {"tags": ["tempest-tag-178769764", "tempest-tag-1620966569"]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:01.541039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.545718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.546366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.546984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.555048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.555785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.556367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.557382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.557987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.558827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.588653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.589542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.603214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.603800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.607827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.608495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.609113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.615971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.624432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.625203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.627483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.640897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:01.686425 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c1766da-9077-4393-9ba3-e7db40836379 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 61 microversion: 2.26 time: 0.185875 Sep 27 01:50:01.696133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2278/4560] 10.222.0.52 () {62 vars in 1312 bytes} [Tue Sep 27 01:50:01 2022] PUT /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 61 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:01.702104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4387ada-e976-44a2-aaa1-4550fdd5fc80 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d54900d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.717130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4387ada-e976-44a2-aaa1-4550fdd5fc80 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.717751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4387ada-e976-44a2-aaa1-4550fdd5fc80 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.718321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4387ada-e976-44a2-aaa1-4550fdd5fc80 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.728805 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4387ada-e976-44a2-aaa1-4550fdd5fc80 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 200 len: 61 microversion: 2.26 time: 0.031330 Sep 27 01:50:01.729442 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2279/4561] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Sep 27 01:50:01 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 61 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:01.741650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '.version_select at 0x7f24d54bc9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.752342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.752847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.753329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.754158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.760782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:01.767058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.767864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.768512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.769558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.770196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.770850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.804517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.805094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.806812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.830214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'flavor' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:01.849717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcca2339-5ef9-44a2-b12f-5eb41146ae6d tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags" status: 204 len: 0 microversion: 2.26 time: 0.113979 Sep 27 01:50:01.850862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2280/4562] 10.222.0.52 () {60 vars in 1295 bytes} [Tue Sep 27 01:50:01 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497/tags => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:50:01.860031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:01.860803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:01.867618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.869072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.869728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.870842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:01.872302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:01.873171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:01.934007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:01.947720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-499d7293-8582-4d6f-a709-011b56e2dd9a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.363813 Sep 27 01:50:01.948530 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2283/4563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:01 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:01.960588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:50:02.165561 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a4c77ae-0a1c-41d4-890f-91861de06799 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 204 len: 0 microversion: 2.26 time: 0.309162 Sep 27 01:50:02.166454 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2281/4564] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:50:01 2022] DELETE /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:02.175424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:02.176049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:02.188081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.188691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.189005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.189746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.190205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.190632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.495175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.500034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:02.500749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:02.506574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.509994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.512574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.513059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.513406 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fee785f-601a-4288-94ae-b5425395d9f7 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1551 microversion: 2.26 time: 0.341781 Sep 27 01:50:02.513530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.514235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.514766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.515107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.515567 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2284/4565] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:02 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1551 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:02.618779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.630654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.632893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:02.634445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-314dd2d7-1e25-4065-9e4f-bd23c63b94c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.138757 Sep 27 01:50:02.635545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2282/4566] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:02 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:02.768180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "tag": "70bf6fc0-9bbb-4230-80a4-a9706d0d468e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:02.776235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.776720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.777152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.792516 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] Creating event network-changed:70bf6fc0-9bbb-4230-80a4-a9706d0d468e for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:02.796085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-44258d33-6b67-43aa-8c5a-887e67541409 req-53ad1e19-da0c-4437-8abf-7ea547acaf67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033582 Sep 27 01:50:02.797002 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2285/4567] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:02.978782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:02.979318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:02.987858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.988358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.988950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:02.989715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:02.990875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:02.991322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:03.204955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.212747 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d3a77508-34b1-4c51-a4e8-c01c27e4b401 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.240071 Sep 27 01:50:03.213611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2283/4568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:02 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:03.541659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:03.542490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:03.556915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:03.559895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:03.560343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:03.561067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:03.561581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:03.563616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:03.662855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:03.663470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:03.676027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:03.676521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:03.676963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:03.677721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:03.678347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:03.678923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:03.745188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.759740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.763404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.766991 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d4915e7-86aa-4646-8436-cf681c891d74 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.107384 Sep 27 01:50:03.768904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2284/4569] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:03 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:03.922768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.932874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.935056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:03.936764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-92584d1d-1eaa-4fdc-a344-6fd22793fd2f tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1551 microversion: 2.26 time: 0.400448 Sep 27 01:50:03.949714 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2286/4570] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:03 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1551 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:04.255088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:04.257828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:04.269377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:04.299552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.301158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.301792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.305775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.306426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.306968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.542385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:04.550501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30bb154e-3a84-4698-8d2f-c0148e673355 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.317558 Sep 27 01:50:04.552369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2285/4571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:04 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:04.795229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:04.796253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:04.804211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.804713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.805164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.805983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.806451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.806895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.817641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959a8e6c-7eb6-4895-9ee4-933369cfd497", "name": "network-vif-deleted", "tag": "20dc902f-ee7f-42a4-9fb2-a876796705cc"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:04.831141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.831843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.832534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.845295 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] Creating event network-vif-deleted:20dc902f-ee7f-42a4-9fb2-a876796705cc for instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 on n-h1-859358-1 Sep 27 01:50:04.851650 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-64bbca3f-838f-4978-8e75-274f85f1e760 req-78bc9eeb-134f-4ef6-b12d-26f33fa388fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039125 Sep 27 01:50:04.852989 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2286/4572] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:04.916163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:04.929384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:04.931927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:04.934209 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-65f17fe1-0265-4b17-b21c-823b3760d604 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.142768 Sep 27 01:50:04.935457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2287/4573] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:04 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:04.964051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:04.965322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:04.972393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.973192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.973831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:04.974723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:04.975560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:04.976127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:05.051452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:05.052225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:05.052836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:05.053298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lazy-loading 'fault' on Instance uuid 959a8e6c-7eb6-4895-9ee4-933369cfd497 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:05.103732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:05.113645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:05.115478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c0869509ac34cfd9e01dec9ea4f5d2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6d1455b0ed4c2ca0c06d8ee12626dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:05.116930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71a970c1-a4a2-4d6e-96a0-e51fc8510148 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 200 len: 1352 microversion: 2.26 time: 0.157194 Sep 27 01:50:05.127076 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2287/4574] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:04 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 1352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:05.577978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:05.578530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:05.585786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:05.586267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:05.586700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:05.587381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:05.588013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:05.588627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:05.849144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:05.864084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-518dc77c-8f96-4ffc-ac57-66950cf8a011 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.290094 Sep 27 01:50:05.865249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2288/4575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:05 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:05.962790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:05.963671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:05.971397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:05.971893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:05.972332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:05.976351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:05.976834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:05.978521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:06.071651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:06.083811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:06.086227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:06.087584 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab982e39-b40a-4737-9150-fd0f5e587f5f tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.128853 Sep 27 01:50:06.088924 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2288/4576] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:05 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:06.146523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:06.148367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] [instance: 959a8e6c-7eb6-4895-9ee4-933369cfd497] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:06.164007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:06.166810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:06.167262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:06.168177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:06.168635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:06.169063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:06.212631 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] HTTP exception thrown: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Request method failure captured: Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 HTTP/1.1 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlawtJS7VA15aNFORBJVi6QjfrWRR1aaTncFrToDs_poLuMxzr96_EKgxPo3MLNDAMdZvHNO9p4rb9fKcmd1FFsxSA8HqsmR-Uv5o7TGXF6i_CzYeIx6yjkIwXQy1IYqQYr2r-nhnJ4uOaFZo8zOwhLREULQI1r-UPpLsRGyBDeuCvQ Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.26 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: dd6d1455b0ed4c2ca0c06d8ee12626dd Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerTagsTestJSON-805786337 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd6d1455b0ed4c2ca0c06d8ee12626dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dd6d1455b0ed4c2ca0c06d8ee12626dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dd6d1455b0ed4c2ca0c06d8ee12626dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dd6d1455b0ed4c2ca0c06d8ee12626dd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerTagsTestJSON-805786337 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: dd6d1455b0ed4c2ca0c06d8ee12626dd Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerTagsTestJSON-805786337 Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerTagsTestJSON-805786337-project Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4c0869509ac34cfd9e01dec9ea4f5d2a Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerTagsTestJSON-805786337-project Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '959a8e6c-7eb6-4895-9ee4-933369cfd497'} Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:06.216741 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] Returning 404 to user: Instance 959a8e6c-7eb6-4895-9ee4-933369cfd497 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0c07ae9-358e-428c-8233-1ffae64f8792 tempest-ServerTagsTestJSON-805786337 tempest-ServerTagsTestJSON-805786337-project] 10.222.0.52 "GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497" status: 404 len: 111 microversion: 2.26 time: 0.078572 Sep 27 01:50:06.220463 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2289/4577] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:06 2022] GET /compute/v2.1/servers/959a8e6c-7eb6-4895-9ee4-933369cfd497 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:50:06.889865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:06.890971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:06.902387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:06.902881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:06.903314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:06.904076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:06.904587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:06.905186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.113503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:07.114765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:07.122323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:07.123140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:07.123781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.124690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:07.125369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:07.126009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.193044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:07.208490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-626e5068-6b01-4407-9a96-59bca668e2b1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.323240 Sep 27 01:50:07.224379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2289/4578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:06 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:07.247968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:07.253490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:07.264519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:07.272060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:07.273407 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97d9ecb5-ead6-47eb-a639-b7aaf39b7350 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.163748 Sep 27 01:50:07.274202 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2290/4579] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:07 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:07.408675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Calling method '.version_select at 0x7f24d5445ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:07.410578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:07.411207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:07.411646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.416086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=3,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:07.454665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:07.457641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:07.458298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.487677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:07.491922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:07.492607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:07.508228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38f93620-1395-4979-bdf7-52958e72e1f4 tempest-PortsAdminExtendedAttrsTestJSON-66101641 tempest-PortsAdminExtendedAttrsTestJSON-66101641-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.254913 Sep 27 01:50:07.510383 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2290/4580] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:50:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:08.232314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:08.232941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:08.250028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:08.250969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:08.251602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:08.252594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:08.253207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:08.254175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:08.301605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:08.302245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:08.309109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:08.309622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:08.310052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:08.310743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:08.321834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:08.322392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:08.473114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:08.483592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:08.494131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:08.495615 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06210b38-0ffc-4075-a9b0-103286db14eb tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.198372 Sep 27 01:50:08.520192 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2291/4581] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:08 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:08.575686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:08.589293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2928c1f-a024-4283-a0cf-af023d467184 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.360885 Sep 27 01:50:08.593524 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2291/4582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:08 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:09.528786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:09.529875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:09.558760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:09.561151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:09.564139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.564313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.570397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.573506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.575852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.576746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.579265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.594027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.594756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.595665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.596279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.598581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.762581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68f9cbab-c6d0-4dc3-ac87-2fe6b3378a18 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.207268 Sep 27 01:50:09.779342 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2292/4583] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:50:09 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:50:09.795949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:09.796848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:09.797070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:09.804616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.805358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.806148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.807617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.809096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.809370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:09.809907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.810979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:09.812543 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f78d71d-4622-415a-a379-536036a6ad03 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.289409 Sep 27 01:50:09.813910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2292/4584] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:09 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:09.818696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:09.819504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:09.826096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.826800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.827440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:09.828322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:09.828962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:09.829614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:10.108410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:10.118247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09aec202-15c3-4576-8e96-30de27f8d675 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1671 microversion: 2.1 time: 0.302764 Sep 27 01:50:10.119051 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2293/4585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:09 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1671 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:10.298115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:10.307702 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-049f395f-cd46-40f1-9270-4d7536f1ea9b tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.526079 Sep 27 01:50:10.317864 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2293/4586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:09 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:10.840334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:10.841036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:10.855397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:10.856289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:10.856733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:10.857482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:10.861291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:10.861804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:10.967938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:10.980782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:10.982553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:10.984031 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c42aa7e-b840-467c-a1cc-0aecdd1b5400 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.149180 Sep 27 01:50:11.010403 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2294/4587] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:10 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:11.142652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:11.143857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:11.165405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:11.165995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:11.166308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:11.167009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:11.167463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:11.168407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:11.331501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:11.334554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:11.350972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:11.352954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:11.354565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:11.356328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:11.358469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:11.359553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:11.403354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:11.422015 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a82e65c5-a7f2-4d6b-a132-b0aff81298bc tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1671 microversion: 2.1 time: 0.283091 Sep 27 01:50:11.428869 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2294/4588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1671 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:11.935339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "name": "network-vif-plugged", "status": "completed", "tag": "70bf6fc0-9bbb-4230-80a4-a9706d0d468e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:11.961460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:11.962011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:11.962644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:11.985945 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] Creating event network-vif-plugged:70bf6fc0-9bbb-4230-80a4-a9706d0d468e for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:12.002109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b28e48dc-80b2-46e6-9f76-f01a959f5269 req-fe770287-bf09-4df1-b63e-95f120a52d12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081371 Sep 27 01:50:12.021066 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2295/4589] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:12.037777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:12.039974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:12.058046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:12.060089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:12.062975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:12.064041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:12.064733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:12.067377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:12.306504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:12.318432 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c47c65b0-9574-45ac-969e-db8f7394a854 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.990732 Sep 27 01:50:12.320785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2295/4590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:11 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:12.450369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:12.451002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:12.461117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:12.467843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:12.468638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:12.469220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:12.469725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:12.470158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:12.488163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:12.507582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:12.510590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:12.513058 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fcbc69d6-dabd-4612-88cd-36827bc97409 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.489092 Sep 27 01:50:12.514301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2296/4591] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:12 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:12.675190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:12.685548 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bfa7aad-d9ba-4e4b-8806-91e5da02a816 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.239708 Sep 27 01:50:12.701591 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2296/4592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:12 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:13.345158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:13.345905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:13.355662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:13.356550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:13.357296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:13.358542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:13.360070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:13.360814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:13.541067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:13.542055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:13.552641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:13.553583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:13.554209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:13.555104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:13.555875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:13.556439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:13.597190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:13.610076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31e4d76d-2ac6-4278-b96f-adf466f84f0a tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.268684 Sep 27 01:50:13.610908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2297/4593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:13 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:13.648306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:13.662544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:13.664774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a30d026a1d4f96b6526604d185ddf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2017bbe6d24c0ea3f62e8aa2792293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:13.666212 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-853dc412-c646-4403-a119-3e047927f40e tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 200 len: 1602 microversion: 2.32 time: 0.130135 Sep 27 01:50:13.666777 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2297/4594] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:13 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 1602 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:13.954071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-17161315", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:14.030327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:50:14.030753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:50:14.031393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:50:14.031978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:50:14.032657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:50:14.034835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "name": "network-vif-plugged", "status": "completed", "tag": "331454a6-0423-4639-bc0e-05b02890f8dc"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:14.042717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.043276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.043729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.044465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.044918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.045374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.054779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.055272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.055816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.065663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Getting quotas for project 63b81c20da7f42fca4e2fe29aedb34db. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:50:14.069270 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] Creating event network-vif-plugged:331454a6-0423-4639-bc0e-05b02890f8dc for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:14.071184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Getting quotas for user 689a952c02554dd1bf556b4172e8ed53 and project 63b81c20da7f42fca4e2fe29aedb34db. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:50:14.076920 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-de81b747-d818-43f8-a1e6-d131422ff8f6 req-f102dff1-139d-4362-a72f-50be88c6a94c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046951 Sep 27 01:50:14.077794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2298/4595] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:50:14.085143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:50:14.087518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:50:14.148744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-062b942c-802a-4308-9a87-35be31c976f2 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.354863 Sep 27 01:50:14.151018 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2298/4596] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:50:14.162325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:14.163038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:14.253842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:14.265980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:14.267690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:14.271937 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-295aadce-48b9-4fa7-b1e4-c37875a4d575 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1276 microversion: 2.57 time: 0.113891 Sep 27 01:50:14.273293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2299/4597] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:14 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:14.634094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:14.635363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:14.647799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.648298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.649056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.650708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.651827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.652468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.692337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:14.693158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:14.704805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.705316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.705813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.706557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:14.707011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:14.707434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:14.724297 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] HTTP exception thrown: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Request method failure captured: Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f HTTP/1.1 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVKeafPt4kUHouiwpDhC4JooUCizpFU4NWS6OOhfsDM9bN_9RpccmQw_ff5l0RdyMURUt8haBJ_MRELVxAYLMo_3Tdn8ibiijFBKQVJl399YJQEUwTJjnW7Le_bXD2wmRaL3-Tw6kPr8CmfqWlgpDwl43iK-iEtTpPjKQGi0YwkuLU Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.32 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe2017bbe6d24c0ea3f62e8aa2792293", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 42a30d026a1d4f96b6526604d185ddf7 Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '83c9a195-a58c-4860-8890-3726ef36cc2f'} Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:14.726731 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:14.731209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Returning 404 to user: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:14.732054 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0379d349-ef5d-4d02-b73a-ab8c73e18792 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 404 len: 111 microversion: 2.32 time: 0.041612 Sep 27 01:50:14.732954 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2300/4598] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:14 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:50:14.741879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9bea50c9-fa94-4b26-afb6-dee26c6c36c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '.version_select at 0x7f24d54ea430>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:14.766166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9bea50c9-fa94-4b26-afb6-dee26c6c36c6 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414622618" status: 204 len: 0 microversion: 2.32 time: 0.028444 Sep 27 01:50:14.771020 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2301/4599] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414622618 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:14.874980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:14.884519 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24c721b8-b473-45ad-8b28-3dc0b07c7a7e tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.255804 Sep 27 01:50:14.901077 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2299/4600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:14 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:15.302485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:15.303026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:15.311024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:15.311956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:15.312907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:15.314086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:15.314752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:15.315581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:15.631503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:15.640292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:15.641787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:15.642949 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a390a022-8b6b-46e9-bdf5-36705d7359f9 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1328 microversion: 2.57 time: 0.345388 Sep 27 01:50:15.643513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2302/4601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:15 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1328 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:15.913395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:15.915468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:15.922722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:15.923281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:15.923940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:15.924883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:15.925785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:15.926288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:16.120136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:16.138291 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd9f394b-c044-4734-ae47-4eab983a6c0f tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1334 microversion: 2.1 time: 0.232887 Sep 27 01:50:16.139260 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2300/4602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:15 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1334 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:16.671028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:16.671806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:16.679063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:16.679673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:16.680209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:16.681024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:16.681610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:16.682105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:16.755574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:16.764106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:16.765601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:16.766777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ded3672d-3419-426d-b152-d66c56b1ec19 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1334 microversion: 2.57 time: 0.100229 Sep 27 01:50:16.767341 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2303/4603] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:16 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:17.091484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.092045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.098861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.099564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.100159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.101017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.101703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.102271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.130369 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec9196d1-71ff-4d32-880b-39f7e00f1ed7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/ips" status: 200 len: 151 microversion: 2.20 time: 0.043319 Sep 27 01:50:17.131489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2301/4604] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Sep 27 01:50:17 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:50:17.175192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.175941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.186754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.187439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.187748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.188416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.189216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.189475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.433958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:17.444117 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9e7fdef-e432-4a6c-ada6-79982f296d98 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1670 microversion: 2.1 time: 0.274582 Sep 27 01:50:17.444756 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2304/4605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:17 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:17.470440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.471202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.484923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.485516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.486220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.487002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.487464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.487930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.540546 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69fd472e-78dc-4541-88b6-94569fceddd9 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440/ips" status: 200 len: 180 microversion: 2.1 time: 0.074022 Sep 27 01:50:17.541484 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2302/4606] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:50:17 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440/ips => generated 180 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:17.566617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.567686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.584015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.584562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.584949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.585892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.586367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.586896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.723822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:50:17.796002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.796813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.807648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.813620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.819024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.819908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:17.822940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:17.822940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:17.963733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-edd7c0dc-a2fe-4792-8ca7-80cf8b65ca41 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "DELETE /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 204 len: 0 microversion: 2.1 time: 0.413945 Sep 27 01:50:17.965011 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2305/4607] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:50:17 2022] DELETE /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:50:17.981420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:17.984738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:17.986700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.003166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.003766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.006487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.007099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.007941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a2e41c6-02a0-4161-892f-bd07a9c989e3 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1355 microversion: 2.57 time: 0.216814 Sep 27 01:50:18.008662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.009467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.009941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2303/4608] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:17 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1355 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:18.012842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.013563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.041687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:18.046546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:18.076538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.078344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.079019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.081787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.084069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.085290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.224587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:50:18.225630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:50:18.225630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:50:18.225939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:50:18.226953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:50:18.303280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.316953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-146aaa0a-69e6-44b1-83a7-4977ac333545 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1676 microversion: 2.1 time: 0.346041 Sep 27 01:50:18.328377 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2306/4609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:17 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1676 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:18.380746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:18.391833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.392336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.392775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.393533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.393990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.394586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.433668 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc5fb7aa-8eee-4bb0-9713-965b71232394 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "POST /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e/action" status: 202 len: 1136 microversion: 2.57 time: 0.396670 Sep 27 01:50:18.435291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2304/4610] 10.222.0.52 () {62 vars in 1320 bytes} [Tue Sep 27 01:50:18 2022] POST /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e/action => generated 1136 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 27 01:50:18.457896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:18.458520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:18.466444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.467145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.467759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.469304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:18.470618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:18.471121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:18.548316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.559134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.561193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:18.563034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7358ea27-21af-4919-bd9c-479a6cabbe09 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.109571 Sep 27 01:50:18.577539 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2307/4611] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:18 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:19.343150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:19.343767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:19.351644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.352102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.352747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.353646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.354260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.354701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.452327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:19.454288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:19.462005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.462865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.463519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.465066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.465774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.466412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.487380 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] HTTP exception thrown: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Request method failure captured: Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f HTTP/1.1 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVKeafPt4kUHouiwpDhC4JooUCizpFU4NWS6OOhfsDM9bN_9RpccmQw_ff5l0RdyMURUt8haBJ_MRELVxAYLMo_3Tdn8ibiijFBKQVJl399YJQEUwTJjnW7Le_bXD2wmRaL3-Tw6kPr8CmfqWlgpDwl43iK-iEtTpPjKQGi0YwkuLU Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.32 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe2017bbe6d24c0ea3f62e8aa2792293", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 42a30d026a1d4f96b6526604d185ddf7 Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '83c9a195-a58c-4860-8890-3726ef36cc2f'} Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:19.489191 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Returning 404 to user: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-739f3ca8-62f9-4eb3-a77b-ae5d9e6910d9 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 404 len: 111 microversion: 2.32 time: 0.044999 Sep 27 01:50:19.493324 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2308/4612] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:50:19 2022] DELETE /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:50:19.500159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:19.500774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] [instance: 83c9a195-a58c-4860-8890-3726ef36cc2f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:19.508577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.509066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.509554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.510271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.510729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.511705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.517611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:19.531845 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] HTTP exception thrown: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Request method failure captured: Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f HTTP/1.1 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVKeafPt4kUHouiwpDhC4JooUCizpFU4NWS6OOhfsDM9bN_9RpccmQw_ff5l0RdyMURUt8haBJ_MRELVxAYLMo_3Tdn8ibiijFBKQVJl399YJQEUwTJjnW7Le_bXD2wmRaL3-Tw6kPr8CmfqWlgpDwl43iK-iEtTpPjKQGi0YwkuLU Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.32 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe2017bbe6d24c0ea3f62e8aa2792293"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe2017bbe6d24c0ea3f62e8aa2792293", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: fe2017bbe6d24c0ea3f62e8aa2792293 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest-538976733 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 42a30d026a1d4f96b6526604d185ddf7 Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest-538976733-project Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '83c9a195-a58c-4860-8890-3726ef36cc2f'} Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:19.533706 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] Returning 404 to user: Instance 83c9a195-a58c-4860-8890-3726ef36cc2f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ee37d8e-94f9-4c95-b2e5-c147098335f2 tempest-TaggedBootDevicesTest-538976733 tempest-TaggedBootDevicesTest-538976733-project] 10.222.0.52 "GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f" status: 404 len: 111 microversion: 2.32 time: 0.039591 Sep 27 01:50:19.541133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2309/4613] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:19 2022] GET /compute/v2.1/servers/83c9a195-a58c-4860-8890-3726ef36cc2f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:50:19.555797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:19.565042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e84c564-a649-4e41-8df1-893766ab6271 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1676 microversion: 2.1 time: 0.226045 Sep 27 01:50:19.565621 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2305/4614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:19 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:19.592912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:19.593619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:19.603191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.603696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.604135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.604872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:19.605330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:19.606041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:19.701095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:19.716390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:19.717907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:19.719090 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4602a19-f4c3-4f0e-9d32-bbfd5332fced tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.133132 Sep 27 01:50:19.719987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2310/4615] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:19 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:20.330342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "name": "network-vif-deleted", "tag": "70bf6fc0-9bbb-4230-80a4-a9706d0d468e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:20.353731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.356052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.358344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.395160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] Creating event network-vif-deleted:70bf6fc0-9bbb-4230-80a4-a9706d0d468e for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:20.405796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bc1776b5-da6f-423b-a936-f1fd1d040b73 req-e990c512-55a9-4728-9d94-531b0bbd141c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078898 Sep 27 01:50:20.410568 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2306/4616] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:20.441324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:20.442216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:20.449567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.450323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.450922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.451785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.452609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.460390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.521864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lazy-loading 'flavor' on Instance uuid 02eb52cb-8186-4531-b89b-680215671893 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:20.591936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:20.592621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:20.601730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.602523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.603046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.603843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.604381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.605523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.612169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:20.846095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2647014-1a3f-480c-9e5f-17a9bee77168 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/action" status: 202 len: 0 microversion: 2.20 time: 0.408194 Sep 27 01:50:20.846712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2311/4617] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:50:20 2022] POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:50:20.856855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:20.870502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:20.877768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.878363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.878727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.879529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:20.880123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:20.880444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:20.997399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.012171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.013642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.014858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d173a8a6-bebd-4c70-baeb-16db6c873b13 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.166866 Sep 27 01:50:21.018639 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2312/4618] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:20 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:21.030172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:21.031119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:21.042858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:21.045665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:21.046281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:21.047933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:21.049588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:21.049819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56ab078c9474e268df4d02248a064b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8485902fa9af48b59fe65ea59716e686', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.052402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:21.060018 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d8f2702-6b41-4df4-aee0-476b9f4660a2 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 200 len: 1496 microversion: 2.1 time: 0.474289 Sep 27 01:50:21.062969 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2307/4619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:20 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 1496 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:21.329181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.340369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.341862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:21.343067 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8161c61-f436-4083-bcd4-f0594767ce66 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.323240 Sep 27 01:50:21.343638 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2313/4620] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:21 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:22.044946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:22.045617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:22.054075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.054938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.055378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.056278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.056866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.057293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.087977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:22.088598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:22.109198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.109953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.110591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.111321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.111947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.112483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.126832 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 HTTP/1.1 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '275afb5b-6f4e-4b03-ba5b-f18188829440'} Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:22.129112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:22.132768 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:22.133741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.134796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:22.135859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4026721b-1d3d-42ae-bed0-99a97e92e1f6 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 404 len: 111 microversion: 2.1 time: 0.051739 Sep 27 01:50:22.137019 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2314/4621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:22 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:50:22.145627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.147210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.148992 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8edf40c-f890-4cbb-9b7f-fdbae86bfa5f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.109298 Sep 27 01:50:22.149895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2308/4622] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:22 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:22.368543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:22.369547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:22.379102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.380232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.382277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.383014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.383485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.383921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.455653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "275afb5b-6f4e-4b03-ba5b-f18188829440", "name": "network-vif-deleted", "tag": "331454a6-0423-4639-bc0e-05b02890f8dc"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:22.472516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:22.473190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:22.473918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:22.540243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] Creating event network-vif-deleted:331454a6-0423-4639-bc0e-05b02890f8dc for instance 275afb5b-6f4e-4b03-ba5b-f18188829440 on n-h2-859358-1 Sep 27 01:50:22.546017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ee7dac10-5e98-4f74-9c43-8fd7c6345429 req-4db71650-09e6-4547-964f-3e4920ed2113 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096864 Sep 27 01:50:22.548028 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2309/4623] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:50:22.598710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.616253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.619201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:22.621168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9243bb77-5ff0-4fe7-9c0c-da1eb8d044cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.256606 Sep 27 01:50:22.622129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2315/4624] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:22 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:23.177620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:23.178343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:23.197073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:23.198479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:23.199410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:23.199667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:23.200127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:23.202709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:23.357842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.368440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.374725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.376282 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03b8fe18-7c1c-4d02-a6d1-584ac46d2e2e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.204077 Sep 27 01:50:23.377794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2310/4625] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:23 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:23.660486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:23.661353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:23.675922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:23.677306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:23.677306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:23.677784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:23.678415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:23.678848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:23.975359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.985632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.987508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:23.993312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba86bde2-5959-44bb-b11a-9e9b9683c3e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.345765 Sep 27 01:50:24.015883 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2316/4626] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:23 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:24.408197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:24.408824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:24.433453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:24.439918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:24.480072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.480803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.485676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.490408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.493847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.500366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.618175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:24.638750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:24.659808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:24.663257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb2ff005-d804-4082-9186-1a7b2d136b9d tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.260128 Sep 27 01:50:24.687264 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2311/4627] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:24 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:24.810819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:24.811482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:24.815463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:24.826019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.829568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.830131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.831108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.832404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.834710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.858586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 HTTP/1.1 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '275afb5b-6f4e-4b03-ba5b-f18188829440'} Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:24.860618 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.864752 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.866934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:24.868014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-172d9782-94f7-46f4-b289-94c411012a84 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "DELETE /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 404 len: 111 microversion: 2.1 time: 0.062564 Sep 27 01:50:24.869174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2317/4628] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:50:24 2022] DELETE /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:50:24.880718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:24.882286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: 275afb5b-6f4e-4b03-ba5b-f18188829440] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:24.891318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.892160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.894182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.896183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.896738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.897795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.918958 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 HTTP/1.1 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '275afb5b-6f4e-4b03-ba5b-f18188829440'} Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.920760 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. Sep 27 01:50:24.925317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.926409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance 275afb5b-6f4e-4b03-ba5b-f18188829440 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:24.927415 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1042a69-3e12-480f-a149-4e568a50c5c1 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440" status: 404 len: 111 microversion: 2.1 time: 0.053428 Sep 27 01:50:24.928473 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2312/4629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:24 2022] GET /compute/v2.1/servers/275afb5b-6f4e-4b03-ba5b-f18188829440 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:50:24.939435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:24.939990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:24.946834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.947632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.948306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.949389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.949923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.950413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.965079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 HTTP/1.1 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6'} Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:24.966994 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:24.970525 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6f0aad9-14ef-4ef4-b2c3-c1ad1b1aae25 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 404 len: 111 microversion: 2.1 time: 0.034188 Sep 27 01:50:24.972217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2318/4630] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:50:24 2022] DELETE /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:50:24.979040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:24.980750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] [instance: dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:24.988258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.988760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.989210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:24.989975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:24.990435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:24.991397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:25.010196 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] HTTP exception thrown: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Request method failure captured: Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 HTTP/1.1 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlZ4qzlaTpRyzAIoMC9jHnhJ8jVP_e9xwwYRTWnRtr5BWzsXThFLInV3BCW_a9wtaelbTw38ZfUBXT5E5KanmPmELIhpTph1Yy7xkEQWPYtIUcPnm3WbzPIv6YfieNeICDo1tEABgZ_6qq9weFTDblRvMn9mIMjC8qpCiZyel33b_Cg Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8485902fa9af48b59fe65ea59716e686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8485902fa9af48b59fe65ea59716e686", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8485902fa9af48b59fe65ea59716e686 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestMultiNic-2145579066 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: a56ab078c9474e268df4d02248a064b2 Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestMultiNic-2145579066-project Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6'} Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:25.012076 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. Sep 27 01:50:25.018672 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:25.020139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] Returning 404 to user: Instance dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:25.021386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e6de739-74db-439b-bbae-3e4869bb1190 tempest-ServersTestMultiNic-2145579066 tempest-ServersTestMultiNic-2145579066-project] 10.222.0.52 "GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6" status: 404 len: 111 microversion: 2.1 time: 0.047155 Sep 27 01:50:25.022257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2313/4631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:24 2022] GET /compute/v2.1/servers/dfcc0f0a-3db7-4717-9d45-4f9a6fdd2df6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:50:25.025168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:25.025820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:25.035308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:25.036197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:25.036744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:25.037738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:25.038303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:25.039093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:25.329514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.338492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.340371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.341813 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecf20e35-e377-42d2-9c4c-ada390e94cdc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.321901 Sep 27 01:50:25.353857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2319/4632] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:25 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:25.703083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:25.704964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:25.716549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:25.717865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:25.719052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:25.720561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:25.721251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:25.723264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:25.811761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.823162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.826636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:25.828422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a16abfd-7057-4f16-9f84-91a1ed0bc62a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.131791 Sep 27 01:50:25.831469 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2314/4633] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:25 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:26.367839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:26.369243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:26.382806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:26.383477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:26.384072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:26.385286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:26.386666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:26.387272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:26.691967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:26.707940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:26.710078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:26.711640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10408e93-4c22-45e6-ad62-f925ad2c9b37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.348160 Sep 27 01:50:26.713032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2320/4634] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:26 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:26.856225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:26.857548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:26.866977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:26.867851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:26.868897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:26.870103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:26.871370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:26.872038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:27.015537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:27.034359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:27.036016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:27.037393 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6df292c-6b69-4415-afa8-143c623194ef tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.186932 Sep 27 01:50:27.038818 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2315/4635] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:26 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:27.738603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:27.739935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:27.752197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:27.759556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:27.768894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:27.770274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:27.770909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:27.771504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:28.064884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:28.065515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:28.092444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:28.093364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:28.093976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:28.094873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:28.095500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:28.096098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:28.192196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.203105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.204793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.219699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4ccf902d-d9d4-443b-add3-63d2880922da tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.159156 Sep 27 01:50:28.221169 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2316/4636] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:28 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:28.223714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.254301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.263717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:28.272226 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-551e8341-fdcc-4100-96a0-2527a96b014a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.530411 Sep 27 01:50:28.287545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2321/4637] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:27 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:29.272098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:29.272728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:29.291153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:29.292041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:29.292694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:29.293846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:29.294516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:29.295459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:29.305598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:29.306933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:29.320511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:29.320511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:29.320511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:29.320511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:29.320837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:29.325165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:29.497748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.514435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.519618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.527293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b240db2-47fa-4afd-9a86-fd0a41979c4e tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.277280 Sep 27 01:50:29.529887 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2317/4638] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:29 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:29.744713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.763941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.765426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:29.766639 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f73ecaa7-f179-49df-b61e-86e4754f64cc tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.465000 Sep 27 01:50:29.767212 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2322/4639] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:29 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:30.565041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:30.565041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:30.572353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:30.572853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:30.573937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:30.574660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:30.590806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:30.592112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:30.702215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:30.715753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:30.717564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:30.718960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a034257-eb35-4f0d-8d8a-1d55834bd379 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.166501 Sep 27 01:50:30.721180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2318/4640] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:30 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:30.792263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:30.792995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:30.807608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:30.808462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:30.809101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:30.810055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:30.810738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:30.811366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:31.246956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.261803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.267483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.272260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18ee4a03-004a-4c08-ad73-8ca1cf8e3150 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.484531 Sep 27 01:50:31.274439 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2323/4641] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:30 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:31.748273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:31.749923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:31.760145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:31.763288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:31.765112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:31.766574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:31.767738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:31.768729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:31.769766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:31.934763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.947781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.949304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:31.950539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46b46acb-9c72-43b5-abd8-c0341d623f9a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.208609 Sep 27 01:50:31.954082 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2319/4642] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:31 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:32.314425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:32.315140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:32.336360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:32.336967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:32.337543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:32.338410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:32.339878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:32.340435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:32.886765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:32.902517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:32.906162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:32.908209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38ae16f7-33eb-4cab-9c3e-415f5e3fd4c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.601840 Sep 27 01:50:32.911714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2324/4643] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:32 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:32.980576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:32.981184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:32.998920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:32.999427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:33.000321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:33.001060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:33.001706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:33.002415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:33.169661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:33.181107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:33.185552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:33.197921 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9fad542f-a2b3-425a-a25f-60dd0059c380 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.219985 Sep 27 01:50:33.199382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2320/4644] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:32 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:33.940501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:33.941812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:33.954660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:33.955322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:33.956465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:33.958924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:33.959483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:33.961694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:34.231699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:34.232335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:34.261380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:34.262239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:34.262706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:34.263537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:34.263911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:34.264345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:34.388542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.405366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.407685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.409098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7610dad6-a210-4a07-b738-585d1636448d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.473812 Sep 27 01:50:34.410427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2325/4645] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:33 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:34.459306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.474203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.476200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:34.480031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3fb61dba-1427-4473-a2dc-267eb26a9930 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.255028 Sep 27 01:50:34.483311 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2321/4646] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:34 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:35.444603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:35.445369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:35.451207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:35.470906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:35.471614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:35.472286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:35.473191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:35.473878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:35.476132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:35.512500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:35.513772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:35.532532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:35.537958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:35.538851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:35.539780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:35.540770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:35.546214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:35.546719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:35.692650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.706827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.717195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.719544 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0aa1558-ada3-4403-b426-a8b55e6d1a16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.211074 Sep 27 01:50:35.720375 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2322/4647] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:35 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:35.906264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.920676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.922400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:35.927470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3420822-3508-4f9e-b38e-7b75151c99d4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 0.495369 Sep 27 01:50:35.928423 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2326/4648] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:35 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:36.752368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:36.753197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:36.761485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:36.762024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:36.762417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:36.763581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:36.764396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:36.765379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:36.872457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:36.883076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:36.894320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:36.895690 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3969d8a0-fe15-4d25-86de-889b3e5d714a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.152189 Sep 27 01:50:36.896868 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2323/4649] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:36 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:36.961167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:36.962326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:36.978159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:36.978844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:36.980278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:36.981859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:36.982453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:36.982979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:37.362466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:37.375445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:37.382729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:37.390402 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4488515b-0709-4257-bab7-f990a63b236d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1744 microversion: 2.20 time: 0.430156 Sep 27 01:50:37.416590 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2327/4650] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:36 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1744 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:37.929709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:37.930329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:37.945441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:37.946583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:37.948784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:37.952499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:37.960207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:37.960751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:38.122996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:38.136271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:38.143650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:38.146231 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-925bc833-aba7-45ca-9987-aae4b7df8ee4 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.224933 Sep 27 01:50:38.151975 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2324/4651] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:37 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:38.420478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:38.421651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:38.435261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:38.436109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:38.437888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:38.443078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:38.443931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:38.444540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:39.064601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.078946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.082901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.084411 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fb27920-7838-469a-a825-306d28ba4f86 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1744 microversion: 2.20 time: 0.668292 Sep 27 01:50:39.113284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2328/4652] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:38 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1744 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:39.177609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:39.178324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:39.188707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:39.197749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:39.198877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:39.199716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:39.201084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:39.203597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:39.384540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.389385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:39.406918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.410218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:39.414336 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-223b31e2-1c21-4b93-bcb3-baabd8caae4c tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.240237 Sep 27 01:50:39.417107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2325/4653] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:39 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:40.078716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "name": "network-vif-plugged", "status": "completed", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:40.124364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:40.125591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:40.134876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:40.140088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:40.144900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:40.147706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:40.157223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:40.164670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:40.194460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:40.196830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:40.197299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:40.247538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] Creating event network-vif-plugged:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:50:40.263269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f3a22e31-e96c-40a6-8092-7e97f745361a req-6a2856e2-6a0f-4923-8766-502a1a7aef77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183352 Sep 27 01:50:40.267838 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2329/4654] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:50:40.450132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:40.450851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:40.475728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:40.482231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:40.483796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:40.484570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:40.485051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:40.492845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:40.510154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.525255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.531786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.533384 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-263e9a19-327d-4bf8-b258-a10ad6ac3965 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.422086 Sep 27 01:50:40.535073 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2326/4655] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:40 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:40.842099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.851593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.856152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:40.858679 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-431bfb8c-2b2b-4e26-9899-8fbfb53f2b17 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.415321 Sep 27 01:50:40.886168 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2330/4656] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:40 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:41.561021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:41.561667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:41.571999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:41.574502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:41.577561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:41.578482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:41.581714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:41.582353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:41.899733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:41.901592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:41.916395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:41.923917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:41.926629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:41.927150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:41.930698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:41.931514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:41.931713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:41.937600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:41.946401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:41.950480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48953534-d5f7-4f73-9ae9-b18989d8b592 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.394001 Sep 27 01:50:41.951589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2327/4657] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:41 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:42.444912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:42.476483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:42.482007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:42.489700 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92cfb6ae-502f-45bf-b0b7-b80e868103bf tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.592294 Sep 27 01:50:42.492263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2331/4658] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:41 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:42.981682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:42.982304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:42.996055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:42.996572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:42.997020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:42.997797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:42.998267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:42.998690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:43.518514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:43.519496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:43.543423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:43.543935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:43.546593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:43.551113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:43.554430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:43.554945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:43.868262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:43.881068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:43.882784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:43.884183 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0cd5a927-a725-4b14-8884-2d50264f8421 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.371325 Sep 27 01:50:43.884936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2332/4659] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:43 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:43.983399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:44.004463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:44.012775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:44.015902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a286f9a9-23f2-4e54-a3f8-2d3776b80332 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.038425 Sep 27 01:50:44.017913 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2328/4660] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:42 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:44.911799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:44.913091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:44.924800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:44.925303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:44.925778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:44.926499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:44.926963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:44.927397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:45.047076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:45.047703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:45.064252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:45.064749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:45.065188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:45.075534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:45.078149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:45.078620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:45.331365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:45.340381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:45.350833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:45.352743 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dc2247b-d401-41a6-ac11-4f1e67306685 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.444951 Sep 27 01:50:45.378773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2333/4661] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:44 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:45.754905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:45.755793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:45.768378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:45.774057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:45.778166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:45.786419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:45.792961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:45.797368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:46.536348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:46.556299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:46.559331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:46.560791 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-304f37b6-6c62-43d3-a7a4-b872033d233c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.519254 Sep 27 01:50:46.582093 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2329/4662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:45 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:46.590487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:46.606600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:46.618253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:46.627044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:46.628629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:46.631462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:46.633945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:46.634750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.058706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:47.070112 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5db4991-e1da-4b9c-a328-2720cf56fde5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 1.319453 Sep 27 01:50:47.081370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2334/4663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:45 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:47.108226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:47.109520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:47.119688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.120138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.120573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.124031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:47.126080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.127105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.127623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.133178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:47.139935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:47.141183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8a6545b-0a52-4419-8ef8-b33af6bb7cca tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.554694 Sep 27 01:50:47.141786 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2330/4664] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:46 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:47.598957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:47.602292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:47.625172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.626732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.627362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.628315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.632190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.632878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.703521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:47.713625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-945a9bd0-db85-43b6-81d9-4a21ab136b2e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.615035 Sep 27 01:50:47.724000 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2335/4665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:50:47.747386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:47.748120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:47.785565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.786075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.786517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:47.787232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:47.788461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:47.789825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:48.295220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:48.303646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bbdb823-2850-4d23-a45e-b1ed8ca1c43e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.566654 Sep 27 01:50:48.304251 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2336/4666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:48.776446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:48.808207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:48.813675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:48.823170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f866b82b-0894-4c7b-b4da-4320758c480f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.223140 Sep 27 01:50:48.824245 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2331/4667] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:47 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:48.844582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:48.845257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:48.876148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:48.876701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:48.882369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:48.889587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:48.890092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:48.890542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:49.116381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-91456733", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a218e540-9d3e-4d7d-a232-312276a7b705"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:49.133147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:49.153928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:49.156100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:49.165046 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6417b138-14fe-4ac8-9d77-8a13a0ee552a tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1364 microversion: 2.57 time: 0.338702 Sep 27 01:50:49.165699 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2332/4668] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:48 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:49.181429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:49.190823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:49.209309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:49.210984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:49.211443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:49.212176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:49.212642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:49.213615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:49.264676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] validate_networks() for [('a218e540-9d3e-4d7d-a232-312276a7b705', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:50:49.834326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:49.854002 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4330e21c-d080-4eb4-8c0c-a0a6c8dc0604 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.681762 Sep 27 01:50:49.874275 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2333/4669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:49 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:49.939473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:49.942167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:49.953141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:49.953141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:49.953141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:49.954150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:49.955108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:49.955597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:50.578874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.590768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.598171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.602377 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0890545-d5ac-4ad4-a9d3-9b5d4029f1c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.679175 Sep 27 01:50:50.626459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:50:50.627615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:50:50.628296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:50:50.628872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:50:50.629466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:50:50.637223 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2334/4670] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:49 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:50.647745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:50.650205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:50.653401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:50.654245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:50.654861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:50.657655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:50.668078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:50.668788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:50.680021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:50.680773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:50.681599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:50.682519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:50.683124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:50.683704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:50.730162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Getting quotas for project 261a36bc119848f5a7977ad136c1aa55. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:50:50.748318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Getting quotas for user 737e331b40674bd1afb795dccb1e26df and project 261a36bc119848f5a7977ad136c1aa55. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:50:50.778174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:50:50.781040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:50:50.921329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.928977 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b88d0c9-5f81-4ef4-813e-36539c8560f3 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.620362 Sep 27 01:50:50.929672 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2337/4671] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:50:50.934378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.939059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:50.943803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbde6d9c-2f69-4433-a071-c509ea5a0967 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1370 microversion: 2.57 time: 0.303993 Sep 27 01:50:50.945388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2335/4672] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:50 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:50.960188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:50.962119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:50.979807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-492858659", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "23594c01-9d6b-41da-b812-329d1c79b6da"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:50:51.089281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] validate_networks() for [('23594c01-9d6b-41da-b812-329d1c79b6da', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:50:51.248763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:51.305023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:51.309682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:51.314299 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0766ab9-1dfc-43d6-8a3a-99011f4d32b7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1257 microversion: 2.21 time: 0.365580 Sep 27 01:50:51.330835 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2336/4673] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:50 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1257 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:51.633837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:51.634431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:51.646918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:51.654452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:51.659670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:51.661886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:51.665450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:51.666235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:52.705047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:52.723818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:52.743406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:52.745193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-94228adc-ba04-49e2-93e9-e641c96a3661 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.115497 Sep 27 01:50:52.745799 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2337/4674] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:51 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:52.768485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:52.779299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:52.789749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:52.790873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:52.791848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:52.793601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:52.794234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:52.795654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:52.831944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:50:53.013059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:50:53.013565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:50:53.014327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:50:53.015069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:50:53.015902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:50:53.041800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.044937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.046165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.048047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f021e442-01e6-4887-85f3-912cbe56a928 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 204 len: 0 microversion: 2.1 time: 0.298362 Sep 27 01:50:53.048937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.049292 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2338/4675] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:50:52 2022] DELETE /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:50:53.051197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.052343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.066907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.067694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.086841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.087343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.087786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.088546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.089000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.089446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.098561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:50:53.118004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:50:53.155990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:50:53.161299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:50:53.239756 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b19bb4e2-221b-408b-a511-debdccce2e80 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.308675 Sep 27 01:50:53.240834 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2338/4676] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:50:53.247474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.248582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.256249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.256986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.257698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.258863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.259653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.260306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.341943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.352685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.355517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.357589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-30d1e9e6-2d94-485a-8ab0-a21f7a57bc4b tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1355 microversion: 2.57 time: 0.305382 Sep 27 01:50:53.358518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2339/4677] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:53 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1355 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:53.389887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.391709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.398824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.399640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.400250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.402152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.402842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.403422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.642227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.661406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.664686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.665905 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2042764d-c7f7-44b8-a87f-9c3c395c6f31 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1309 microversion: 2.21 time: 0.423860 Sep 27 01:50:53.668695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2339/4678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:53 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:53.696511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb741f79-c625-401f-b6bd-1d352c5d3dcf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.697093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb741f79-c625-401f-b6bd-1d352c5d3dcf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.874276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bb741f79-c625-401f-b6bd-1d352c5d3dcf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.882809 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb741f79-c625-401f-b6bd-1d352c5d3dcf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1214 microversion: 2.1 time: 0.209014 Sep 27 01:50:53.883305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:53.896425 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a2bc70b2-00fd-4941-96ab-9c069373ac47 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1666 microversion: 2.1 time: 0.523141 Sep 27 01:50:53.897018 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2340/4679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:53 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1666 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:53.901690 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2340/4680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:53 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:53.911804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.912283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.912648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:53.913367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:53.927497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.929316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.929893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.930745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.931281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.931771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.948628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.950711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.952203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:53.953004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:53.953513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:53.953959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.028587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:50:54.047288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:54.229357 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0bc8d4eb-edbb-4c74-8a94-7bd1f6a5f631 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "DELETE /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 204 len: 0 microversion: 2.57 time: 0.324528 Sep 27 01:50:54.231042 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2341/4681] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:50:53 2022] DELETE /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:50:54.240346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:54.250548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:54.260990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.268739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.271133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.272122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.273737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.274297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.440831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.480726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.483471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.492807 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b6c0e05-9621-4619-b05e-48a2dd6ea8e5 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1361 microversion: 2.57 time: 0.256803 Sep 27 01:50:54.496492 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2342/4682] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:54 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:54.697120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:54.698827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:54.707538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.707538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.707538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.721214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.722456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.723104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.805690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.816388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.823413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.827395 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e4f410e-9fcc-41b7-b625-3cd58554cb01 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.924581 Sep 27 01:50:54.828177 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2341/4683] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:53 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:54.905834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:54.906815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:54.915689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.921400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.924341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.925379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.927537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.928600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.931415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.942205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.944441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:54.946344 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f527c3e4-82fd-400c-b648-b0d81281d560 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1309 microversion: 2.21 time: 0.252702 Sep 27 01:50:54.948261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2343/4684] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:54 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:54.955726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:54.956868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:54.965500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.966298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.966967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:54.968539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:54.969398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:54.970957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:55.125585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:55.135223 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca724990-2443-4232-b8fe-852e7698255f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1210 microversion: 2.1 time: 0.233172 Sep 27 01:50:55.135815 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2342/4685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:54 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:55.300537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:55.315042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-acebc649-6301-4f08-bdde-ee3aeaeed0a3 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1666 microversion: 2.1 time: 0.364957 Sep 27 01:50:55.330775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2344/4686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:54 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1666 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:55.529726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:55.529726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:55.536440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:55.536931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:55.537385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:55.553696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:55.554318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:55.554773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:55.745420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:55.754264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:55.761783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:55.765028 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-33cb99f7-04e4-48f6-9cad-81f93e2fc57f tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1361 microversion: 2.57 time: 0.241573 Sep 27 01:50:55.787977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2343/4687] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:55 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:55.857161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:55.860432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:55.867603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:55.868322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:55.870532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:55.871436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:55.872112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:55.872698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:55.981460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:55.983402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:56.008279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.011472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.013817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.014861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.018845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.019614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.179400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:56.192276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:56.196948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:56.198528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72ffc637-752a-4735-af56-26199ff0ba80 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1315 microversion: 2.21 time: 0.226012 Sep 27 01:50:56.203902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2344/4688] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:55 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:56.209034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:56.215088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:56.224083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.228108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.229255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.232609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.233195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.233768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.380250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:56.393173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6277fb93-80e2-4fe7-89b4-cadb1a0d95d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1266 microversion: 2.1 time: 0.185533 Sep 27 01:50:56.394051 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2345/4689] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:56 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:56.454327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:56.459529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:56.477736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.478247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.482500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.483934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.484593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.485047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.543213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:50:56.761927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:56.770823 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-419bbb8e-4fec-4e26-9c86-fd9b18ed7ff0 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1666 microversion: 2.1 time: 0.373803 Sep 27 01:50:56.787726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2346/4690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:56 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1666 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:56.812676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:56.816305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:56.829068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.829933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.830833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.831919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.832790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.833499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.892645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:56.893683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:56.894385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:56.895129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lazy-loading 'fault' on Instance uuid 248f86a4-9f63-4377-a12e-81f1c175796e {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:50:57.083346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.096340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.098125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '689a952c02554dd1bf556b4172e8ed53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b81c20da7f42fca4e2fe29aedb34db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.105456 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96a3dc55-cfe5-4278-acb1-4f820d0b0680 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 200 len: 1366 microversion: 2.57 time: 0.299881 Sep 27 01:50:57.106270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2347/4691] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:56 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:57.223735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.229983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:57.230952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:57.232773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.237670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.240434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.241240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.241978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:57.242965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.244848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.245701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:57.246743 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ee90d4a2-f08e-4046-963a-61983081928b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.395138 Sep 27 01:50:57.247361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2345/4692] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:55 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:57.397291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.407587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.417210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.419004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f85597ee-ebfe-4cf0-b824-85c0b0d35326 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1315 microversion: 2.21 time: 0.194790 Sep 27 01:50:57.429433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2348/4693] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:57 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:50:57.429621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:57.429621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:57.440071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.440071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.443022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:57.443880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.445086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.446116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:57.667998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:57.676825 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2228ec49-6aa8-49f9-8f39-55a671764ff5 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1272 microversion: 2.1 time: 0.260069 Sep 27 01:50:57.685111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2346/4694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:57 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:57.795449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:57.796074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:57.807291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.807795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.808239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:57.808962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:57.809488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:57.809938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.132292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:58.133216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] [instance: 248f86a4-9f63-4377-a12e-81f1c175796e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:58.142169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.143165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.143858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.145600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.146344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.147732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.183519 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] HTTP exception thrown: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Request method failure captured: Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e HTTP/1.1 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlbVjuG2JJemhKyi61yYBQuPXQYCxsvgdkODoFfKmkHQS99EugCtOE1DlcJKk_QMYG4c4X6r3ucwDfoqbOX1vHupKf6qEde4xIRv0NsjRMaFpEzkG1FyNXrIyL74wVG7n78-l2ND-YiYfz2FyTcXYToOxyJxDvg7g39hrTeAnzXhntU Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.57 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 63b81c20da7f42fca4e2fe29aedb34db Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerShowV257Test-339609058 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63b81c20da7f42fca4e2fe29aedb34db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/63b81c20da7f42fca4e2fe29aedb34db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63b81c20da7f42fca4e2fe29aedb34db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_63b81c20da7f42fca4e2fe29aedb34db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerShowV257Test-339609058 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 63b81c20da7f42fca4e2fe29aedb34db Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerShowV257Test-339609058 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerShowV257Test-339609058-project Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 689a952c02554dd1bf556b4172e8ed53 Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerShowV257Test-339609058-project Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '248f86a4-9f63-4377-a12e-81f1c175796e'} Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:50:58.186752 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. Sep 27 01:50:58.190525 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:50:58.194419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] Returning 404 to user: Instance 248f86a4-9f63-4377-a12e-81f1c175796e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:50:58.196817 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a4e166a-2596-4a1b-b428-b8fa8ea79d16 tempest-ServerShowV257Test-339609058 tempest-ServerShowV257Test-339609058-project] 10.222.0.52 "GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e" status: 404 len: 111 microversion: 2.57 time: 0.067785 Sep 27 01:50:58.208998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:58.214975 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2347/4695] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:58 2022] GET /compute/v2.1/servers/248f86a4-9f63-4377-a12e-81f1c175796e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 27 01:50:58.222503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6508542e-f78b-42a9-896d-c3a2774e57e4 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1666 microversion: 2.1 time: 0.431441 Sep 27 01:50:58.234862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2349/4696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:57 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1666 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:58.274109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:58.276067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:58.301457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.302230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.307898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.309011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.311540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.313994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.471054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:58.474402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:58.514295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.520807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.523279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.530340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.532213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.533844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.713164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:58.722549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:58.723909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:58.734406 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea83f887-baeb-430b-b2f6-1a4f4ab0c5a0 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1315 microversion: 2.21 time: 0.281605 Sep 27 01:50:58.755697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2350/4697] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:58 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:50:58.764392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:58.767707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:58.791387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.791994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.792446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:58.793203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:58.793701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:58.794133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:59.421481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:59.431241 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd8a289f-6252-4542-a551-214f88510bf8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1272 microversion: 2.1 time: 0.674167 Sep 27 01:50:59.435127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2351/4698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:58 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1272 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:59.452703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:59.453320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:59.467514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:59.468008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:59.468445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:59.469160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:59.469634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:59.473481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:59.603256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:59.618235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe3dcfce-fe26-4527-b2fa-9158954b1f81 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1598 microversion: 2.1 time: 0.181819 Sep 27 01:50:59.625941 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2352/4699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:50:59 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:50:59.763163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:50:59.764262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:50:59.774918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:59.777605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:59.778242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:59.779690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:50:59.783068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:50:59.784085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:50:59.969532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:59.978603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:59.992208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:50:59.993694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-765fcdd3-a361-4f1d-a42e-8c8e57f6941a tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1315 microversion: 2.21 time: 0.235449 Sep 27 01:51:00.010677 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2353/4700] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:59 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:00.201010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:00.210350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:00.219311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:00.220774 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46ca634c-f0ba-4e55-94d6-1ac92475d22a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.952253 Sep 27 01:51:00.221539 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2348/4701] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:50:58 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:00.461550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:00.462953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:00.475528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:00.476265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:00.477911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:00.481677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:00.482410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:00.483006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:00.645785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:00.647264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:00.664011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:00.664652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:00.665142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:00.666497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:00.666944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:00.667549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:00.955682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:00.996286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-675b41fe-e954-4d13-8c98-a7ec07546461 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1598 microversion: 2.1 time: 0.353885 Sep 27 01:51:01.012750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2349/4702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:00 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1598 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:01.035635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:01.036697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:01.049721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:01.052285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:01.053269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:01.054823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:01.055614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:01.056190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:01.126814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.136020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-213fcc55-df6a-4430-ae49-1326c1124c88 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.678400 Sep 27 01:51:01.139950 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2354/4703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:00 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:01.251950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:01.252787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:01.286064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:01.301776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:01.304177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:01.305173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:01.307762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:01.314297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:01.315559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:01.583223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.591905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.593396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.594565 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26f2b11c-3f31-4027-901d-f1cf1618067d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.347277 Sep 27 01:51:01.606275 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2355/4704] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:01 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:01.850674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.868666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.870957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:01.877845 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f26ad2d-8617-4294-96d5-97e09444fc2e tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.855960 Sep 27 01:51:01.890441 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2350/4705] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:01 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:02.020257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:02.021452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:02.028822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.030134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.030912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:02.032023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.032718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.033478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:02.147489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:02.157879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b6428fa-0024-4616-a408-fba796b8a12f tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1598 microversion: 2.1 time: 0.141506 Sep 27 01:51:02.174418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:02.174418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:02.175270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2356/4706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:02 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:02.175393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:02.176977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.177768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.178502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:02.179656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.180129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.180560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:02.631863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:02.632677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:02.667506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.671602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.673380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:02.676715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:02.679366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:02.682312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.078254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:03.463838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:03.479245 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8de2a0d1-7abb-4e87-ae14-c63b43e54065 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 1.315282 Sep 27 01:51:03.500561 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2351/4707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:02 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:03.518482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef77cd4-294f-4398-b437-0f0a803facda", "name": "network-vif-deleted", "tag": "8e8f9563-2a5b-41c8-b0b8-3294ccef818f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:03.571692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.573094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.573572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.582674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:03.601600 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] Creating event network-vif-deleted:8e8f9563-2a5b-41c8-b0b8-3294ccef818f for instance 0ef77cd4-294f-4398-b437-0f0a803facda on n-h2-859358-1 Sep 27 01:51:03.618297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:03.620312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:03.621787 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01a2fdb1-daa7-48b2-9ebb-d23a820db6c1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.000864 Sep 27 01:51:03.624910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2357/4708] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:02 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:03.634085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:03.636882 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fa2ec719-5be9-4891-ae58-d66bb3340eaa req-c3a5e17b-7a1e-4389-a93f-57e562802a3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132157 Sep 27 01:51:03.636882 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2352/4709] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:03.642913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:03.650846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:03.659615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:03.673080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.673617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.678533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.679578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.681008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.682486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.713165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.719399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.719998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.720775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.721262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.723433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.828315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:03.837145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:03.837727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:03.838290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lazy-loading 'fault' on Instance uuid 0ef77cd4-294f-4398-b437-0f0a803facda {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:51:03.882429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:04.067022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4a10ecba334d04a1c69d7dea924fc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d643da90cc4b949f303ce36ec308ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:04.082514 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b676cb1e-8a75-40f7-b575-0873ac6e49b5 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 200 len: 1316 microversion: 2.1 time: 0.444787 Sep 27 01:51:04.083123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2353/4710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:03 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:04.513247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:04.515391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:04.536314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:04.537915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:04.539133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:04.539825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:04.540830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:04.542488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:04.543500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:04.547481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:04.549071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:04.550111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d787dd89-ec55-497b-b211-876a416e3ad7 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.923968 Sep 27 01:51:04.550675 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2358/4711] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:03 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:04.652877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:04.653533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:04.664707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:04.678489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:04.679253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:04.680484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:04.681236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:04.682488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:05.151460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:05.173669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:05.180608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:05.183156 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83e30878-eaac-4d2b-adeb-2e588f560444 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 0.534687 Sep 27 01:51:05.185799 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2359/4712] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:04 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:05.197468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:05.200046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] [instance: 0ef77cd4-294f-4398-b437-0f0a803facda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:05.206974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:05.211931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:05.220614 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a49a60e8-f072-4fb6-802e-443939762fd8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.714311 Sep 27 01:51:05.227529 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2354/4713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:04 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:05.232779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:05.234312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:05.242641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:05.244453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:05.245159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:05.245912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:05.276813 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] HTTP exception thrown: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Request method failure captured: Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda HTTP/1.1 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlaa1CCUckYFP5Bo6Y8r3_CR2nMt7BAQ8M6ordk2ThN5XfeBH94_V7nFXTMa26hf0UiDhH4VYsYPZtpiPWMI4mZvcwMvPkA90aeXMLkSh0cmdk8J4mVRAk_p-wtjJlEJ3B1q4x9_qYGuG_VytKLxfnkFzVusbvfoCCrSbqBUogwWTiY Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 18d643da90cc4b949f303ce36ec308ee Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestFqdnHostnames-1636740318 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18d643da90cc4b949f303ce36ec308ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18d643da90cc4b949f303ce36ec308ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18d643da90cc4b949f303ce36ec308ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18d643da90cc4b949f303ce36ec308ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestFqdnHostnames-1636740318 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 18d643da90cc4b949f303ce36ec308ee Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1636740318 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestFqdnHostnames-1636740318-project Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: fa4a10ecba334d04a1c69d7dea924fc9 Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestFqdnHostnames-1636740318-project Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '0ef77cd4-294f-4398-b437-0f0a803facda'} Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:05.281442 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. Sep 27 01:51:05.285102 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:51:05.289434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Returning 404 to user: Instance 0ef77cd4-294f-4398-b437-0f0a803facda could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:51:05.292515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36ba2f8f-419f-442a-bf5b-8f96aef06768 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda" status: 404 len: 111 microversion: 2.1 time: 0.104603 Sep 27 01:51:05.303735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-137c7bf0-5df1-4b56-b724-4494ef698469 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] Calling method '.version_select at 0x7f24d59b23a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:05.312485 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2360/4714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:05 2022] GET /compute/v2.1/servers/0ef77cd4-294f-4398-b437-0f0a803facda => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:51:05.358661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-137c7bf0-5df1-4b56-b724-4494ef698469 tempest-ServersTestFqdnHostnames-1636740318 tempest-ServersTestFqdnHostnames-1636740318-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962591888" status: 202 len: 0 microversion: 2.1 time: 0.060700 Sep 27 01:51:05.359705 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2355/4715] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962591888 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:51:05.662356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:05.663101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:05.682910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:05.683411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:05.683851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:05.684568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:05.695230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:05.699881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.074411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:06.089612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:06.090383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:06.091437 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8c8b228-620c-40bb-9888-f72c02a975e8 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.433212 Sep 27 01:51:06.096575 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2361/4716] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:05 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:06.214124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:06.215249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:06.229967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:06.230670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:06.235158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.236075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:06.236728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:06.237311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.250713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:06.251604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:06.266723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:06.267405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:06.268159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.269019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:06.276687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:06.279006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.886321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:06.898759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e235536b-0db4-410a-8ac6-b8174b719c9f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.651775 Sep 27 01:51:06.899447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2362/4717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:06 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:06.924860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b53d38-6e09-409d-b4d3-9cd1d15814c8", "tag": "4b8c009b-74d1-475a-a45f-7d32bfb5662f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:06.938745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:06.946321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:06.949230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:06.954663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:06.966528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] Creating event network-changed:4b8c009b-74d1-475a-a45f-7d32bfb5662f for instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 on n-h1-859358-1 Sep 27 01:51:06.973189 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d68bc1c2-664c-4a40-95c9-bc87fbbd086f req-9677bdd5-2049-4f35-bf30-3aeea75be91a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054256 Sep 27 01:51:06.974554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2363/4718] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:07.116714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:07.117450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:07.125098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:07.125853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:07.126522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:07.127459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:07.128130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:07.128789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:07.266359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:07.276396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:07.278024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:07.279509 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50a0f9e0-b0d1-42f6-9bed-4a0c7314961b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1739 microversion: 2.20 time: 1.071139 Sep 27 01:51:07.294189 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2356/4719] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:06 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1739 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:07.926237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:07.927611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:07.935514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:07.936432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:07.937093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:07.938535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:07.939488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:07.940144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:08.001667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:08.021238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:08.026128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:08.027997 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cb3fb95-ef66-44f7-861f-f113318fd6c5 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.915606 Sep 27 01:51:08.029270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2364/4720] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:07 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:08.319165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:08.322306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:08.363632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:08.369228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:08.371238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:08.377483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:08.380174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:08.380920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:08.466490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:08.477553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f6dfe36-cd26-4b05-ab03-78005655fe5b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.555247 Sep 27 01:51:08.478536 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2357/4721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:07 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:09.055238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:09.059099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.062722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:09.075793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:09.076289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:09.076957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:09.077852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:09.078311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.078986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:09.080921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.081650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:09.085573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79996da2-c732-4c92-bf4d-bb2827f26a9f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1721 microversion: 2.20 time: 0.781507 Sep 27 01:51:09.089874 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2365/4722] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:08 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1721 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:09.192467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9c9a29-921c-43f2-92a6-6248241f3b7f", "tag": "db603948-5cba-4cdb-a1fd-9db89d276a2e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:09.203698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:09.204239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:09.204883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:09.241556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] Creating event network-changed:db603948-5cba-4cdb-a1fd-9db89d276a2e for instance ee9c9a29-921c-43f2-92a6-6248241f3b7f on n-h2-859358-1 Sep 27 01:51:09.271215 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-158d6426-43bc-4c17-a50f-1c93ac67dfec req-4a416e17-92d0-4f4d-b09b-648e91a233bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083123 Sep 27 01:51:09.271801 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2366/4723] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:51:09.389570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.393778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:09.400447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.402413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:09.403788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db2e995f-f441-498e-b969-8ef84686563c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.353327 Sep 27 01:51:09.417865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2358/4724] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:09 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:09.500708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:09.501448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:09.507718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:09.508464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:09.509052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:09.509974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:09.510571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:09.511136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.113602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:10.115723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:10.127080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:10.131670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:10.132368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.136098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:10.136838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:10.137645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.423170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:10.442455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c862b7b-6630-466b-8e5d-b537aa9b2d70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.945854 Sep 27 01:51:10.444926 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2367/4725] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:09 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:10.464369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:10.474450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "name": "network-vif-unplugged", "status": "completed", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:10.476967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:10.479322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:10.481250 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f549696c-2581-4e3d-b5d3-a5347c2e2c40 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1721 microversion: 2.20 time: 0.372949 Sep 27 01:51:10.495284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:10.496363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:10.497175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.497989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2359/4726] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:10 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1721 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:10.506106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:10.507064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:10.514336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:10.515228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:10.515868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.516780 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] Creating event network-vif-unplugged:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:51:10.517127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:10.517968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:10.518629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:10.522269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-773fef9f-bc3c-4e63-a169-8dbc06c7ce2d req-413a4638-21b7-4631-b2bf-cdd2a3c0d0db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074268 Sep 27 01:51:10.523437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2368/4727] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:11.076669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:11.096249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:11.098869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:11.102404 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4a16108-4685-4f80-bb5c-a1255b1ee077 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.601362 Sep 27 01:51:11.109664 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2360/4728] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:10 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:11.470736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:11.471538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:11.485721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:11.487818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:11.489442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:11.491023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:11.495410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:11.495875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:11.512006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:11.512920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:11.530450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:11.536918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:11.537642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:11.538603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:11.539551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:11.540526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:12.179552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.188093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09792f80-8d5e-4fcc-a2ec-eeed8dc7caeb tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.724197 Sep 27 01:51:12.201374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2369/4729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:11 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:12.202329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.214322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:12.217149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:12.224029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.232279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.237296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0dca7ad8-14da-4d57-bed6-36dfafcdbfad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1664 microversion: 2.20 time: 0.728383 Sep 27 01:51:12.239605 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2361/4730] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:11 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1664 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:12.240450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:12.241133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:12.247384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:12.253066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:12.253801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:12.254470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:12.265548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3142e31-5671-4155-b187-6776c8e12848"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:12.268477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:12.287533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:12.292004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:12.292653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:12.293570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:12.295434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:12.296667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:12.829185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.842388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.843872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:12.845068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10ac028c-2f33-42e2-990a-e2306a28d711 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.649287 Sep 27 01:51:12.857763 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2370/4731] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:12 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:13.047761 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-abf186d3-aca3-4ff6-aa9f-2e4b2b794a41 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.786553 Sep 27 01:51:13.051201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2362/4732] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Sep 27 01:51:12 2022] POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 188 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:51:13.216508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:13.217057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:13.229483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.229979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.230598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.231492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.233164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.236658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.316076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:13.316716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:13.338910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.339675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.340277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.341152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.347711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.348405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.419511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128778) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 01:51:13.559158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1db0abae-447e-4623-98cc-665a20741c81 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/action" status: 202 len: 0 microversion: 2.20 time: 0.247431 Sep 27 01:51:13.567346 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2363/4733] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:51:13 2022] POST /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 27 01:51:13.584881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:13.588309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:13.600718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.601418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.601936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.603625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.604157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.604665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.672917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:13.687952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac5ada3c-e67c-47a6-b3d7-e02b09b36718 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.474919 Sep 27 01:51:13.688563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2371/4734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:13 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:13.874281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:13.874950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:13.884760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.889635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.890156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:13.890922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:13.891405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:13.901436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:14.639701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.667384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.673608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.681938 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-365d280a-20ba-43fb-ae94-f15dac7a636b tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.810367 Sep 27 01:51:14.684762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2372/4735] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:13 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:14.694364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b53d38-6e09-409d-b4d3-9cd1d15814c8", "name": "network-vif-plugged", "status": "completed", "tag": "4b8c009b-74d1-475a-a45f-7d32bfb5662f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:14.714607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:14.715486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:14.716513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:14.749459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] Creating event network-vif-plugged:4b8c009b-74d1-475a-a45f-7d32bfb5662f for instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 on n-h1-859358-1 Sep 27 01:51:14.757544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-942fdc06-cf20-4dde-ab84-0fa6fa85c351 req-5c25419d-253a-4fa9-92be-67c607f4575b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070322 Sep 27 01:51:14.758956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2373/4736] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:14.766222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:14.767721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:14.820921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:14.823222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:14.824827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:14.826992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:14.827935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.834415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:14.837552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:14.841585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.857528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:14.858990 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38f7e489-30a0-4c6e-ad87-724a97a37c11 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1750 microversion: 2.20 time: 1.290482 Sep 27 01:51:14.862370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2364/4737] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:13 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1750 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:15.297181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:15.314724 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca966fba-3ea8-410f-8066-083a7bf95783 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1314 microversion: 2.1 time: 0.553338 Sep 27 01:51:15.323014 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2374/4738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:14 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:15.710075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:15.710695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:15.724972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:15.725508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:15.725950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:15.726669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:15.727127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:15.727559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:15.889081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:15.889770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:15.909782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:15.910839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:15.911573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:15.913581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:15.914941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:15.916429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.338235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.355080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.360199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.368590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41ec7bb2-c1e9-43a5-8034-6bebf4bad623 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1750 microversion: 2.20 time: 0.478717 Sep 27 01:51:16.374227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2375/4739] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:15 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1750 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:16.382437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:16.383340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:16.390748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:16.391449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:16.392052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.393388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:16.393994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:16.394628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.395873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.404944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.406645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.407958 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84fca7bf-3ec6-4477-b69e-97d54dd96b7c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.702296 Sep 27 01:51:16.422512 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2365/4740] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:15 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:16.743305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:16.758110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e5ae626-a88f-428d-838c-4917e92fd11d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1501 microversion: 2.1 time: 0.382403 Sep 27 01:51:16.761035 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2376/4741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:16 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:16.787500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:16.788129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:16.800574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:16.801104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:16.801574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.802281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:16.810758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9c9a29-921c-43f2-92a6-6248241f3b7f", "name": "network-vif-plugged", "status": "completed", "tag": "db603948-5cba-4cdb-a1fd-9db89d276a2e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:16.819189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:16.819720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.830126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:16.830612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:16.831060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:16.896414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] Creating event network-vif-plugged:db603948-5cba-4cdb-a1fd-9db89d276a2e for instance ee9c9a29-921c-43f2-92a6-6248241f3b7f on n-h2-859358-1 Sep 27 01:51:16.919158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7341f35e-2cda-4ca1-ba60-ba6ca6ced562 req-2cbb761b-9cfe-49f7-9dbd-bca62073d6c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112223 Sep 27 01:51:16.936553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2377/4742] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:51:17.400862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:17.401892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:17.411737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:17.413296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:17.417242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:17.418402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:17.419955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:17.421424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:17.438298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Removing security group 3abc135f-2520-41b2-b298-a46f6ed1251a from port 4b8c009b-74d1-475a-a45f-7d32bfb5662f Sep 27 01:51:18.176900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.247232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.247232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.250041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-796cd78b-a5c1-40b6-86e3-8e5153ed1e03 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1752 microversion: 2.20 time: 0.853174 Sep 27 01:51:18.275909 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2378/4743] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:17 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1752 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:18.291653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:18.292570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:18.310708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:18.311487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:18.313438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:18.314324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:18.317199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:18.317851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:18.940300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.959821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.961640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:18.963096 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c21051f4-56b9-478f-a040-06e2b2e9d327 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1357 microversion: 2.21 time: 0.685525 Sep 27 01:51:18.964533 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2379/4744] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:18 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1357 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:19.291908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:19.292542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:19.308119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:19.308823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:19.309467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:19.310353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:19.310965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:19.311583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:19.624625 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d78a0459-9102-4fac-a0c8-29684db526ad tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8/action" status: 202 len: 0 microversion: 2.1 time: 2.840729 Sep 27 01:51:19.627229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2366/4745] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:51:16 2022] POST /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8/action => generated 0 bytes in 2845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:51:19.638057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b53d38-6e09-409d-b4d3-9cd1d15814c8", "tag": "4b8c009b-74d1-475a-a45f-7d32bfb5662f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:19.678129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:19.681555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:19.683679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:19.738040 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] Creating event network-changed:4b8c009b-74d1-475a-a45f-7d32bfb5662f for instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 on n-h1-859358-1 Sep 27 01:51:19.756574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-acbbcd94-b91d-4845-9a15-1489606751d1 req-08d4b904-c25a-4193-a890-f07c6182a090 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124691 Sep 27 01:51:19.762264 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2367/4746] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:51:19.776386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:19.782069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:19.809921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:19.810621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:19.812100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:19.813157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:19.819108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:19.820615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:20.046932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.065512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.068466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.076985 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be24891c-e92c-4b4f-9ec3-b2e15a5f2fab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1752 microversion: 2.20 time: 0.789218 Sep 27 01:51:20.094329 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2380/4747] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:19 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1752 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:20.113493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:20.114400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:20.128928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:20.131714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:20.132544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:20.134244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:20.139883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:20.140499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:20.465442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.474891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9d7752a-3c0e-4f5e-bbd1-7243fbba9544 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1459 microversion: 2.1 time: 0.710909 Sep 27 01:51:20.503068 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2368/4748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:19 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1459 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:20.829876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-560864265", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "b8cc7cbc-d775-4770-b7eb-18cbc189d093"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:20.927688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.950146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] validate_networks() for [('b8cc7cbc-d775-4770-b7eb-18cbc189d093', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:51:20.958259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.965165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:20.968660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3103b631-3c5a-4154-bc7a-e31a030b64fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1549 microversion: 2.21 time: 0.872872 Sep 27 01:51:20.973621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2381/4749] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:20 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1549 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:20.986521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:20.987161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:21.003178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:21.004435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:21.004889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:21.005789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:21.006254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:21.009405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:21.856786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:21.874963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81a0f4d1-3280-4a8a-a15a-dff64881584b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.899469 Sep 27 01:51:21.885368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2382/4750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:20 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:21.885368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:21.885368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:21.898696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:21.899942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:21.901896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:21.902816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:21.905639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:21.906295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:21.954927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:21.971605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:51:22.197651 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e41eb0a4-6d3c-4cea-b736-3f981c893489 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 204 len: 0 microversion: 2.21 time: 0.319958 Sep 27 01:51:22.198538 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2383/4751] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:51:21 2022] DELETE /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:51:22.204827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:22.207281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:22.222544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.225845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.228178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.231186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.231928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.235218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.372815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:51:22.374092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:51:22.374915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:51:22.375545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:51:22.376296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:51:22.392687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.394851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.395593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.396578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.401492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.403136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.462766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Getting quotas for project 97a659798c5548ba9a4f229dd082ffdc. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:51:22.481696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Getting quotas for user 410e27823fed45ef99d0c352f54e653f and project 97a659798c5548ba9a4f229dd082ffdc. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:51:22.500056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:51:22.515968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:51:22.648794 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf887503-f512-462a-9761-a2a8d63691b6 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144333 Sep 27 01:51:22.669493 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2369/4752] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:51:22.680405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:22.684354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:22.700617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.705113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.705919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.710344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.711153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.711859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.879468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:22.900016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:22.909287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:22.914524 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f411a1dd-c612-4d71-b121-67386d9ace39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1752 microversion: 2.20 time: 0.710975 Sep 27 01:51:22.917312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2384/4753] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:22 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1752 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:22.936993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:22.939157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:22.964419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.964926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.965407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:22.972521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:22.972993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:22.973502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.098429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.115097 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a588d47b-002f-4089-9782-215501ab1af8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.442326 Sep 27 01:51:23.134190 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2370/4754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:22 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:23.155731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b8cd8a0-e1a0-4721-a53c-f1a55f0ef892 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:23.157836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b8cd8a0-e1a0-4721-a53c-f1a55f0ef892 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:23.264558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b8cd8a0-e1a0-4721-a53c-f1a55f0ef892 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.271717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b8cd8a0-e1a0-4721-a53c-f1a55f0ef892 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1216 microversion: 2.1 time: 0.149635 Sep 27 01:51:23.273308 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2371/4755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:23 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:23.298012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:23.299984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:23.312462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.313307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.313976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.314988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.315645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.316266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.546232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.557025 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eeceb2ad-d4d3-4332-9274-581d546c9e67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.269233 Sep 27 01:51:23.557965 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2372/4756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:23.592571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:23.593225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:23.606338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.608719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.610834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.614563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.618346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.619737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.886100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.912396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.925112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:23.926797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0bb04b4-2f3b-4b32-961a-df49d81eae50 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1555 microversion: 2.21 time: 1.007300 Sep 27 01:51:23.932262 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2385/4757] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:22 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1555 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:23.960619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:23.964912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:23.986614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.987112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.987558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:23.988288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:23.988750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:23.989188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:24.818299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:24.848070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:24.850061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:24.855732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-654955d3-21b9-480f-88e3-89dec62c1caa tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1752 microversion: 2.20 time: 0.912687 Sep 27 01:51:24.856340 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2386/4758] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:23 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1752 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:24.881927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:24.882815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:24.921056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:24.922068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:24.925678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:24.927604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:24.928087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:24.928591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:25.159092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:25.176398 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4986c764-3c2e-46b6-9773-51ef11f20f0e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1268 microversion: 2.1 time: 0.310985 Sep 27 01:51:25.177643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2387/4759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:24 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1268 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:25.190368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:25.196592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:25.212393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:25.213260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:25.215495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:25.216444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:25.217887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:25.220512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:25.233315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:25.242092 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e586da7c-470e-49ef-96d9-8b5dcb3f6173 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 1.662966 Sep 27 01:51:25.246541 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2373/4760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:23 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:25.660987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1359806533", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "23594c01-9d6b-41da-b812-329d1c79b6da"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:25.779076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] validate_networks() for [('23594c01-9d6b-41da-b812-329d1c79b6da', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:51:26.590653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:26.606133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:26.611315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737e331b40674bd1afb795dccb1e26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a36bc119848f5a7977ad136c1aa55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:26.612934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d825cfaf-637b-4e61-8c18-c29edf3e8d4c tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 200 len: 1555 microversion: 2.21 time: 1.431528 Sep 27 01:51:26.617712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2388/4761] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:25 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 1555 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:26.627984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:26.628864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:26.641466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:26.648281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:26.650460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:26.651661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:26.652945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:26.653582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:27.502788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:51:27.504238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:51:27.506144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:51:27.506935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:51:27.507569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:51:27.518774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:27.520191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:27.520793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:27.521794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:27.522692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:27.523287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:27.578093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:51:27.592877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Getting quotas for user 9fecdf5face2426cb4fc1c97b6632e76 and project 7334a772e20e4fa6ac6bc5ee87a4c050. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:51:27.612838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:51:27.616686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:51:27.756930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9aa6f2a8-56b9-496d-ae09-a78d11c5af27 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.100170 Sep 27 01:51:27.768151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2374/4762] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:51:27.776919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:27.780024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:27.800655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:27.801955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:27.803752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:27.804776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:27.805677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:27.807218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:27.812650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:27.911281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:27.922879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6980b95c-b826-406a-a6cc-6c2cf819be9e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1274 microversion: 2.1 time: 0.153156 Sep 27 01:51:27.923477 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2375/4763] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:27 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:27.937079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9c9a29-921c-43f2-92a6-6248241f3b7f", "name": "network-vif-deleted", "tag": "db603948-5cba-4cdb-a1fd-9db89d276a2e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:27.960986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:27.962463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:27.962463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.021162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] Creating event network-vif-deleted:db603948-5cba-4cdb-a1fd-9db89d276a2e for instance ee9c9a29-921c-43f2-92a6-6248241f3b7f on n-h2-859358-1 Sep 27 01:51:28.054632 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a9b69ab2-4a30-4ac8-89cb-4b06abf6d577 req-06abd6c6-d119-44a5-bb51-68cf11e6cfb7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110815 Sep 27 01:51:28.055718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2376/4764] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:28.066611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.067321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.094499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.101089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.101760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.105066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.109772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.110378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.137628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:28.156977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:28.163093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:28.164481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] HTTP exception thrown: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Request method failure captured: Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f HTTP/1.1 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlb3vygJ8ZnoKAqTgeJpIODq3LtqsyEmA8bWu5vHKNWyTx0PVaurDltn79hLOJJphvJwNiaPWH6rtss80Bprx-Dkg1cb7yWD-DKTnO1NUMtkbiIh8xe4XZvNb3vR6rBwVw7VhtL5e2EAKRV0ZFIXAj-bCB9ieJ-pzBuug1eV9jQMMZw Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.21 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_261a36bc119848f5a7977ad136c1aa55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 737e331b40674bd1afb795dccb1e26df Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ee9c9a29-921c-43f2-92a6-6248241f3b7f'} Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.172344 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.177066 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.177982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a1315ed-01c9-4f29-9971-67782140ffd1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1752 microversion: 2.20 time: 1.552728 Sep 27 01:51:28.178616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Returning 404 to user: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:51:28.188987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4fc46af-08bb-4f8a-b96e-d31e712d6d25 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 404 len: 111 microversion: 2.21 time: 0.131963 Sep 27 01:51:28.190667 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2389/4765] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:26 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1752 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:28.196351 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2377/4766] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:28 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:51:28.200828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d231116f-5d20-4772-a5eb-757432aa1125 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.206015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d231116f-5d20-4772-a5eb-757432aa1125 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.217277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '.version_select at 0x7f24d59f3280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.219817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.240704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.246048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.253937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.254969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.256593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.257682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.471302 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-587888ce-40da-4575-a2fb-9f5bf66353fc tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.272015 Sep 27 01:51:28.471900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2378/4767] 10.222.0.52 () {60 vars in 1337 bytes} [Tue Sep 27 01:51:28 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f/os-instance-actions => generated 611 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:51:28.497458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.498090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.512203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.513878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.515821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.516904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.519337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.521027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.571566 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] HTTP exception thrown: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Request method failure captured: Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f HTTP/1.1 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlb3vygJ8ZnoKAqTgeJpIODq3LtqsyEmA8bWu5vHKNWyTx0PVaurDltn79hLOJJphvJwNiaPWH6rtss80Bprx-Dkg1cb7yWD-DKTnO1NUMtkbiIh8xe4XZvNb3vR6rBwVw7VhtL5e2EAKRV0ZFIXAj-bCB9ieJ-pzBuug1eV9jQMMZw Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.21 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_261a36bc119848f5a7977ad136c1aa55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 737e331b40674bd1afb795dccb1e26df Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ee9c9a29-921c-43f2-92a6-6248241f3b7f'} Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:51:28.576901 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.581156 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.590297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Returning 404 to user: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:51:28.596343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d231116f-5d20-4772-a5eb-757432aa1125 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:28.602244 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9be3952-7af7-4134-bacd-45b00e534aae tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 404 len: 111 microversion: 2.21 time: 0.118284 Sep 27 01:51:28.607365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2379/4768] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:51:28 2022] DELETE /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:51:28.607617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d231116f-5d20-4772-a5eb-757432aa1125 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1215 microversion: 2.1 time: 0.411932 Sep 27 01:51:28.623036 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2390/4769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:28 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:28.641930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.642784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] [instance: ee9c9a29-921c-43f2-92a6-6248241f3b7f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.667777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.669597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.671233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.673963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.676909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.677742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.706086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] HTTP exception thrown: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Request method failure captured: Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f HTTP/1.1 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlb3vygJ8ZnoKAqTgeJpIODq3LtqsyEmA8bWu5vHKNWyTx0PVaurDltn79hLOJJphvJwNiaPWH6rtss80Bprx-Dkg1cb7yWD-DKTnO1NUMtkbiIh8xe4XZvNb3vR6rBwVw7VhtL5e2EAKRV0ZFIXAj-bCB9ieJ-pzBuug1eV9jQMMZw Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.21 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/261a36bc119848f5a7977ad136c1aa55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_261a36bc119848f5a7977ad136c1aa55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 261a36bc119848f5a7977ad136c1aa55 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-618355223 Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 737e331b40674bd1afb795dccb1e26df Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsV221TestJSON-618355223-project Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ee9c9a29-921c-43f2-92a6-6248241f3b7f'} Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.716012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. Sep 27 01:51:28.719768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:28.724652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] Returning 404 to user: Instance ee9c9a29-921c-43f2-92a6-6248241f3b7f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:51:28.725811 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35717d90-a393-4507-84ee-e50020782f23 tempest-InstanceActionsV221TestJSON-618355223 tempest-InstanceActionsV221TestJSON-618355223-project] 10.222.0.52 "GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f" status: 404 len: 111 microversion: 2.21 time: 0.101683 Sep 27 01:51:28.730919 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2380/4770] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:28 2022] GET /compute/v2.1/servers/ee9c9a29-921c-43f2-92a6-6248241f3b7f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:51:28.959273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:28.960078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:28.975865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.976494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.978402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:28.980380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:28.981097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:28.983488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:29.206964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:29.209376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:29.215937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:29.235914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:29.238165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:29.238657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:29.241365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:29.242662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:29.244423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:29.751845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:29.763359 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dc233d8-b465-48d2-8366-b10c849eb866 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.817568 Sep 27 01:51:29.764097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2391/4771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:28 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:29.768488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:29.769105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:29.789061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:29.789607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:29.790117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:29.790847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:29.803403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:29.804082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:29.946435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:29.962248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f13ca7ef-fc84-4a7a-a145-11a173ced219 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1267 microversion: 2.1 time: 0.196844 Sep 27 01:51:29.964497 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2392/4772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:29 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:30.106227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:30.129540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:30.133668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:30.138472 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa68fb99-bef9-404c-b6ed-ed7805b278f3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.935430 Sep 27 01:51:30.142365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2381/4773] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:29 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:30.787145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:30.787774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:30.796017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:30.796515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:30.796948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:30.797698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:30.798148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:30.798750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:30.987644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:30.988571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:30.996911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:30.997766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:30.998407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:30.999430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:31.000047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:31.000676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:31.167838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:31.181131 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ab7d66a-5dd3-4ef9-89e3-20ca602fc54b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1273 microversion: 2.1 time: 0.196731 Sep 27 01:51:31.182663 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2382/4774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:30 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:31.207159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:31.208382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:31.217731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:31.218753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:31.219521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:31.221177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:31.222214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:31.223063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:31.423716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:31.447340 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86e57777-5d26-4cba-8d98-ec2e6e7ced66 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.664237 Sep 27 01:51:31.451395 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2393/4775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:30 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:31.812811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:31.821951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:31.835247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:31.837444 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b98c166-d9f3-49cb-b83d-dd3034052b91 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.653100 Sep 27 01:51:31.838200 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2383/4776] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:31 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:32.207518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:32.210217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:32.234734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.239506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.240153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.240998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.243207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.243870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.360273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93352e3d-591b-45b4-b628-9126a27d48e8", "tag": "4a9709bf-d415-45be-a2d2-c82f871dcd9c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:32.388756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.389554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.390575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.419172 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] Creating event network-changed:4a9709bf-d415-45be-a2d2-c82f871dcd9c for instance 93352e3d-591b-45b4-b628-9126a27d48e8 on n-h1-859358-1 Sep 27 01:51:32.433168 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2dda3295-e185-4580-a1fc-a8dc1bfb7615 req-62a04153-398c-4572-bb9c-4e181764b99f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076246 Sep 27 01:51:32.434484 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2384/4777] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:32.475102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:32.476068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:32.498644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.499951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.501697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.502972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.504276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.506067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.702219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:32.716055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5356dd1c-0f3c-450d-ad70-70a3baf5b118 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1273 microversion: 2.1 time: 0.511731 Sep 27 01:51:32.717138 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2394/4778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:32 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1273 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:32.867531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:32.869083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:32.881926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.882699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.884827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:32.885806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:32.888245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:32.888876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:34.429219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:34.448333 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dccdf5dd-f712-401e-a898-63fbb2f606a9 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 1.977363 Sep 27 01:51:34.452413 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2385/4779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:32 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:34.466735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:34.467800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:34.496658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:34.497168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:34.505832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:34.516045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:34.517754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:34.519041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:35.286440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:35.299110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e5ab7d3-99ab-4e35-8b2b-7db8a9eefbc9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 0.845484 Sep 27 01:51:35.303977 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2386/4780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:34 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:35.432155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:35.470405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:35.478520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:35.478894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:35.479970 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-55212d05-e8ee-461c-85d7-215b445d17d1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 2.616243 Sep 27 01:51:35.480578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2395/4781] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:32 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 2618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:35.481009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:35.498365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:35.499051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:35.500937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:35.505090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:35.505816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:35.507141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:36.329318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:36.329991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:36.353700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:36.359317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:36.359824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:36.360310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:36.361032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:36.361546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:36.361976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:36.929405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:36.943438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35c0bb6e-32eb-4171-963b-bb196132d2a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 0.617942 Sep 27 01:51:36.945376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2396/4782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:36 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:36.977975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:36.978586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:36.985125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:36.985647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:36.986302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:36.987466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:36.988085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:36.988722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:37.021898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:37.036053 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b67f6cc2-74b0-4355-a24d-926f07bff4cc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 1.562598 Sep 27 01:51:37.065845 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2387/4783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:35 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:37.329573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:37.346428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:37.349272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:37.352297 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f08a21f-c44e-4630-b5e0-4f6300f84854 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.381015 Sep 27 01:51:37.353907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2397/4784] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:36 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:37.469840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c91e3c8-fd78-493f-ac29-2322c2c8e9ce", "tag": "6c414df6-df54-488c-a1ab-3d91107d6123"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:37.487639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:37.488827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:37.489558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:37.516623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] Creating event network-changed:6c414df6-df54-488c-a1ab-3d91107d6123 for instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce on n-h2-859358-1 Sep 27 01:51:37.533259 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b73c869a-e684-480a-aee4-66c5cfd8196c req-fe7b3b98-a918-4b27-b239-cd6468a2e5b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071778 Sep 27 01:51:37.534409 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2388/4785] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:37.972091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:37.973298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:37.984451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:37.985436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:37.986208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:37.987190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:37.988771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:37.996809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:38.074455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:38.075670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:38.080327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:38.082242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:38.106066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:38.110527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:38.111307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:38.112170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:38.112763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:38.122067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:38.600411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:38.901754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:38.923695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a9f9e05-36f2-48ee-a0ff-2fffaabe412c tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.847585 Sep 27 01:51:38.926587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2389/4786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:38 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:38.942130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:38.949083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:38.966632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:38.971034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:38.971753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:38.975249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:38.977802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:38.978555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:39.295403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:39.308290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:39.311061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:39.313256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7abb8ee6-8601-4b11-a3ad-1fc3b2721518 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.382111 Sep 27 01:51:39.327949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2390/4787] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:38 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:39.592265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:39.604634 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c26e7d2d-f264-414c-b9c4-925e24d425da tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 1.636329 Sep 27 01:51:39.627881 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2398/4788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:37 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:39.949322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:39.950036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:39.971435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:39.972026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:39.975713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:39.976584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:39.977190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:39.978374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:40.253706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:40.270935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7fa9d33-35cd-48c0-bf11-c2de2a82cc76 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.325062 Sep 27 01:51:40.273291 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2391/4789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:39 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:40.350117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:40.350827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:40.371363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:40.371868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:40.372410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:40.375833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:40.377216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:40.377710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:40.448472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:40.647491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:40.648989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:40.665022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:40.668224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:40.670069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:40.674167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:40.675288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:40.675901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:41.027404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:41.042710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e028f3f9-b8a3-48b1-a379-40fa7be1754e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 0.412911 Sep 27 01:51:41.064015 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2392/4790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:40 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:41.300226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:41.301292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:41.325122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:41.325649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:41.326131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:41.326830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:41.331913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:41.333947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:41.408103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:41.443017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:41.444659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:41.457945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-721bd3ee-8a75-421a-918a-ec8722885207 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 1.103151 Sep 27 01:51:41.460263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2399/4791] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:40 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:41.772323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:41.805614 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ce2f801-0472-4bd2-845d-9f1e13a753aa tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.509281 Sep 27 01:51:41.815522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2393/4792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:41 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:42.069914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:42.071386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:42.080975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:42.083627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:42.085291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:42.087095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:42.090471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:42.093455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:42.490604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:42.492177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:42.512396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:42.513220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:42.516203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:42.519351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:42.521538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:42.522462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:43.100423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:43.115332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:43.123115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:43.129649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6e36fa7-e157-4a0a-8036-0cbfcef4fce1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.644316 Sep 27 01:51:43.135289 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2394/4793] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:42 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:43.151318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:43.156954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:43.177322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:43.179637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:43.181857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:43.183124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:43.185546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:43.186665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:43.641581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:43.667487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19f5b837-f620-46eb-b0b0-4cd876b4820a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 1.598817 Sep 27 01:51:43.684633 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2400/4794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:42 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:43.725149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93352e3d-591b-45b4-b628-9126a27d48e8", "name": "network-vif-plugged", "status": "completed", "tag": "4a9709bf-d415-45be-a2d2-c82f871dcd9c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:43.759016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:43.762218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:43.764219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:43.825004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] Creating event network-vif-plugged:4a9709bf-d415-45be-a2d2-c82f871dcd9c for instance 93352e3d-591b-45b4-b628-9126a27d48e8 on n-h1-859358-1 Sep 27 01:51:43.844968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2e9c1fb2-1845-452f-bbd4-74e859fb0e19 req-4d34fea4-4db7-4f32-a31c-fa3ab379dfd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155220 Sep 27 01:51:43.848414 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2401/4795] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:43.989984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:43.998402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:44.007052 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b11f7e74-9527-4712-8247-742ae3083a93 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.857736 Sep 27 01:51:44.009438 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2395/4796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:43 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:44.167615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:44.168732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:44.177485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:44.178397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:44.181139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:44.181518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:44.182703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:44.184368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:44.694797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:44.695412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:44.723159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:44.730416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:44.731329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:44.731989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:44.732788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:44.733533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:44.772410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:44.852822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:44.860329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:44.862391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66e5c6d9-d92c-49c9-8af8-dd98382e7ce3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.703243 Sep 27 01:51:44.863695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2402/4797] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:44 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:45.042306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:45.043718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:45.056868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:45.057926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:45.058604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:45.059743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:45.060492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:45.061590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:45.643771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:45.665186 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1042d2f5-317e-4f8d-9128-8a72ddfc7230 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1316 microversion: 2.1 time: 0.631296 Sep 27 01:51:45.676095 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2403/4798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:45 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:45.878297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c91e3c8-fd78-493f-ac29-2322c2c8e9ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c414df6-df54-488c-a1ab-3d91107d6123"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:45.902357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:45.903302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:45.904670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:45.932510 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] Creating event network-vif-plugged:6c414df6-df54-488c-a1ab-3d91107d6123 for instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce on n-h2-859358-1 Sep 27 01:51:45.943040 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-78ee2cb6-ca32-4373-ab54-d77f1345672b req-39a4c90e-8d30-47b6-ac0b-4d41d080d977 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067612 Sep 27 01:51:45.944589 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2404/4799] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:45.954376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:45.955512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:45.965854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:45.967364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:45.968067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:45.969754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:45.970471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:45.971455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:46.378628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:46.393147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:46.398185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:46.406566 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ac67c66-a3fe-484c-b838-a926e1fa349c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.460340 Sep 27 01:51:46.409123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2405/4800] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:45 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:46.665396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:46.700280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:46.700908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:46.701041 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31e2e0e3-ba6c-4a0e-a868-c5b2211985be tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 2.011316 Sep 27 01:51:46.707685 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2396/4801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:44 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:46.735197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:46.735697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:46.736138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:46.736850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:46.737309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:46.737761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:46.981148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:46.990365 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd099390-2103-4dea-9364-9ee42b0881f3 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1505 microversion: 2.1 time: 0.295187 Sep 27 01:51:46.991590 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2406/4802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:46 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:51:47.019433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:47.020016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:47.029039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.029858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.030651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.031868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.032431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.033080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.069547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:47.076921 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2d460e3-c240-44d3-8c53-4219038be526 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/os-instance-actions/req-cf887503-f512-462a-9761-a2a8d63691b6" status: 200 len: 313 microversion: 2.1 time: 0.062865 Sep 27 01:51:47.077950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2397/4803] 10.222.0.52 () {58 vars in 1419 bytes} [Tue Sep 27 01:51:47 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/os-instance-actions/req-cf887503-f512-462a-9761-a2a8d63691b6 => generated 313 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:51:47.093082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:47.095936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:47.108658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.109470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.110150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.111096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.111771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.113297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.279222 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a7da81b-25b9-4fa1-af34-5e2485d7b0dc tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "POST /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/action" status: 202 len: 0 microversion: 2.1 time: 0.190253 Sep 27 01:51:47.282967 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2407/4804] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:51:47 2022] POST /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:51:47.288260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:47.289666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:47.304242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.305560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.306387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.307276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.309568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.310378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.442894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:47.443767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:47.465175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.465798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.466594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.467332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.469778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.470275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.804427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:47.819308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f5fe447-8066-4cac-b0a9-886e210fe3be tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1507 microversion: 2.1 time: 0.534906 Sep 27 01:51:47.832454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2398/4805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:47 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:47.840122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:47.840956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:47.848310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.848890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.849441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.850237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:47.850770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:47.851405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:47.889177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:47.900612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:47.906562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:47.908048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84dd8bb6-3f37-4bb1-bfd9-0690ef3a6d06 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.475498 Sep 27 01:51:47.909905 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2408/4806] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:47 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:48.599580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:48.636399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d281ab02-ffce-46fb-94ad-2c6a9e5ac8d1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1315 microversion: 2.1 time: 0.801042 Sep 27 01:51:48.647231 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2399/4807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:47 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:48.845601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:48.846259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:48.860252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:48.860750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:48.861199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:48.870902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:48.871751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:48.872670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:48.939068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:48.940426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:48.955442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:48.955942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:48.956378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:48.963607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:48.964572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:48.967661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.448356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:49.459581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3839f24d-35b3-4629-8939-c2bbda5ff3a4 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1505 microversion: 2.1 time: 0.619550 Sep 27 01:51:49.464341 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2409/4808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:48 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:49.495677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '.version_select at 0x7f24d5fad160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:49.496453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:49.504840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.505732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.506249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.507120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.507738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.508318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.544623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef33f7d2-995f-441a-8ce3-e683456dea78 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.056014 Sep 27 01:51:49.545853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2410/4809] 10.222.0.52 () {58 vars in 1296 bytes} [Tue Sep 27 01:51:49 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8/os-instance-actions => generated 611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:51:49.564848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:49.565598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:49.570448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:49.580975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:49.589146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.589887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:49.591385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.593578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.593920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-202b8997-082b-49e2-a2d8-bd3f21c8ae97 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.658928 Sep 27 01:51:49.602089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2400/4810] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:48 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:49.606315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.606975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.607579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.666347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:49.667072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:49.675638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.676137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.676896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.677809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.678465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.679104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.681052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:51:49.849992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29916577-3bab-4d07-aba6-45d28cbdb197 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "DELETE /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 204 len: 0 microversion: 2.1 time: 0.291505 Sep 27 01:51:49.852784 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2411/4811] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:51:49 2022] DELETE /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:51:49.864183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:49.866068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:49.881621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.884258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.885132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.886340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:49.888448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:49.889208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:49.950727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:49.964172 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce4646e1-a226-4d39-82d4-24814f80d287 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1502 microversion: 2.1 time: 0.302657 Sep 27 01:51:49.968969 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2401/4812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:49 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:49.999301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:50.000217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:50.013746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.018928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.020215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:50.024503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.025217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.025885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:50.299995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5a82429-21cf-41b9-8a14-7ab5eb138d4b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.310588 Sep 27 01:51:50.304073 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2402/4813] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:51:49 2022] POST /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:51:50.316489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:50.317619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:50.327397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.328243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.328931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:50.329910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.330611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.331962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:50.346221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:50.377958 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4914608-d0b4-4ac5-9e03-afa04948748f tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1511 microversion: 2.1 time: 0.520530 Sep 27 01:51:50.384305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2412/4814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:49 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1511 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:50.624546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:50.626214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:50.637927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.641974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.654411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:50.658936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:50.660742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:50.661380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:51.083094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:51.096032 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb60aa03-44bb-47a9-8e5a-794ace456050 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1507 microversion: 2.1 time: 0.788621 Sep 27 01:51:51.118925 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2403/4815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:50 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:51.396191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:51.411507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:51.415361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:51.416962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:51.419093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:51.420366 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-20abdbc6-26a5-493f-864f-9afc4b6e6787 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.800697 Sep 27 01:51:51.424826 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2413/4816] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:50 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:51:51.426020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:51.426515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:51.430477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:51.431224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:51.431693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:51.436424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:51.950474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:51.960323 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3af6a8d-ce3e-4b1d-b662-9e9868722172 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1511 microversion: 2.1 time: 0.554034 Sep 27 01:51:51.978969 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2404/4817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:51 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:52.119677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:52.120301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:52.127295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.127824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.128233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.128949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.129759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.132974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.203630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:51:52.453943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:52.455431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:52.465121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.466070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.467611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.468632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.469458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.470402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.758800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:52.770048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb4fad62-c27a-4403-adb2-3d25fcebab21 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1487 microversion: 2.1 time: 0.654331 Sep 27 01:51:52.771426 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2414/4818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:52 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1487 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:52.801246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:52.801832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:52.819003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.820099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.821997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.823059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:52.823871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:52.824511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:52.869314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lazy-loading 'flavor' on Instance uuid 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:51:53.382919 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14f5f601-4c0e-486b-9b8f-75937d6fa64d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.586197 Sep 27 01:51:53.383683 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2415/4819] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:51:52 2022] POST /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:51:53.397834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:53.409166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:53.434946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:53.435459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:53.437854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:53.438689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:53.440435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:53.440884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:53.674275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:53.691843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:53.694651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:53.697396 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-949eb8f3-c889-4d0b-a8a0-2f2d1dffd5af tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 1.248913 Sep 27 01:51:53.698467 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2405/4820] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:52 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:53.708947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:53.711333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:53.731451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:53.739624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:53.742523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:53.753360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:53.754208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:53.754822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:53.869509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410e27823fed45ef99d0c352f54e653f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a659798c5548ba9a4f229dd082ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:53.892693 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5af05528-7c99-476f-b4d9-b9882efeff39 tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 200 len: 1469 microversion: 2.1 time: 0.503275 Sep 27 01:51:53.897546 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2416/4821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:53 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 1469 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:53.911136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93352e3d-591b-45b4-b628-9126a27d48e8", "name": "network-vif-deleted", "tag": "4a9709bf-d415-45be-a2d2-c82f871dcd9c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:51:53.943061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:53.943547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:53.948199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:53.978492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] Creating event network-vif-deleted:4a9709bf-d415-45be-a2d2-c82f871dcd9c for instance 93352e3d-591b-45b4-b628-9126a27d48e8 on n-h1-859358-1 Sep 27 01:51:53.993873 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-cc961936-03fb-49dd-b4cc-ed2c7377da87 req-8871ce22-2454-4b8c-a9e5-de0047555486 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089751 Sep 27 01:51:53.996140 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2417/4822] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:51:54.240529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:54.276137 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4770e824-7758-45a6-ac69-65745e9ee06e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1493 microversion: 2.1 time: 0.570747 Sep 27 01:51:54.285757 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2406/4823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:53 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1493 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:54.726192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:54.727709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:54.747611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:54.752332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:54.752928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:54.753781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:54.754316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:54.754825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:54.921381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:54.922013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] [instance: 93352e3d-591b-45b4-b628-9126a27d48e8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:54.943498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:54.946373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:54.948206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:54.952277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:54.953372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:54.954466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:54.983722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] HTTP exception thrown: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Request method failure captured: Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 HTTP/1.1 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlcXPiroLhWRDaAsibZZITyUlClgEg3wXv6LE-pSaOerJlhnCX4NQUSe0bIO_eHBr-709euofgFVxIq9fdDEfw7HPLlFh2-fpdMzQ8XaQlrUkHDCIaxiqG6MPVmNiN5bRRuFMhWLmMGPGLY792IPwNheyR43XvVuplt3AYOCxikpHl0 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 97a659798c5548ba9a4f229dd082ffdc Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-InstanceActionsTestJSON-2050602610 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97a659798c5548ba9a4f229dd082ffdc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97a659798c5548ba9a4f229dd082ffdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97a659798c5548ba9a4f229dd082ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97a659798c5548ba9a4f229dd082ffdc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-InstanceActionsTestJSON-2050602610 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 97a659798c5548ba9a4f229dd082ffdc Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2050602610 Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-InstanceActionsTestJSON-2050602610-project Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 410e27823fed45ef99d0c352f54e653f Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-InstanceActionsTestJSON-2050602610-project Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '93352e3d-591b-45b4-b628-9126a27d48e8'} Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:51:54.990417 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] Returning 404 to user: Instance 93352e3d-591b-45b4-b628-9126a27d48e8 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:51:54.994789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9d08c45-039c-40f5-902a-7229d12e292e tempest-InstanceActionsTestJSON-2050602610 tempest-InstanceActionsTestJSON-2050602610-project] 10.222.0.52 "GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8" status: 404 len: 111 microversion: 2.1 time: 0.075640 Sep 27 01:51:55.000532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2407/4824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:54 2022] GET /compute/v2.1/servers/93352e3d-591b-45b4-b628-9126a27d48e8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:51:55.307274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:55.307901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:55.319767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:55.320810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:55.321253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:55.325720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:55.327132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:55.327954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:56.170071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:56.196950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:56.204072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:56.206846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c982e82-a883-44e3-82f9-72ed81187426 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 1.485213 Sep 27 01:51:56.231332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2418/4825] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:54 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:57.198882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:57.209990 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-096151ca-38fa-4981-98a5-a154510ed6dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1514 microversion: 2.1 time: 1.908231 Sep 27 01:51:57.211753 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2408/4826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:55 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1514 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:57.238046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:57.239224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:57.252818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:57.258520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:57.260077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:57.261228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:57.262410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:57.262868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:58.185978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:58.208935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:58.211628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:58.213601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e715cee0-6682-41fd-bb9c-f33ff210b60b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 0.980887 Sep 27 01:51:58.215878 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2419/4827] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:57 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:51:58.243745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:58.245022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:58.252408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:58.253242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:58.253924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:58.254844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:58.255506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:58.256160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:58.951049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:51:58.962541 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-095b8dee-c83b-4c46-b582-7cee472e4fd6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1514 microversion: 2.1 time: 0.719860 Sep 27 01:51:58.973444 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2409/4828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:58 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1514 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:51:59.245217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:59.245951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:51:59.268208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:59.274787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:59.275772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:59.278705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:51:59.280518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:51:59.281597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:51:59.989174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:51:59.991131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:00.012889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=57 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:00.024611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:00.025597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:00.031453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:00.032508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:00.036343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:00.037151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:00.756888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:00.807593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:00.829130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:00.833878 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-511b637c-234a-49d3-8808-37e1bf74506a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 1.590416 Sep 27 01:52:00.835228 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2420/4829] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:51:59 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:01.118031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "name": "network-vif-plugged", "status": "completed", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:01.145584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:01.146117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:01.146562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:01.184682 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] Creating event network-vif-plugged:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:52:01.216182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c1996a13-b449-40ef-9511-70b8c740fa7e req-9311d57e-1cc5-43eb-b8e7-59d43798f2a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102229 Sep 27 01:52:01.222360 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2421/4830] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:01.864973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:01.865832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:01.892714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:01.893616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:01.894314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:01.895377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:01.896145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:01.896840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:01.928932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:01.946050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8cd73d79-783e-4c17-8db1-ed4af7911871 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 1.961464 Sep 27 01:52:01.948620 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2410/4831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:51:59 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:02.980437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:02.983189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:03.012269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:03.015873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:03.021991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:03.025516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:03.026230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:03.026849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:03.509540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:03.518290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-398d5a62-7e08-4a56-be48-081226596f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.545380 Sep 27 01:52:03.528079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2411/4832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:02 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:03.547715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c91e3c8-fd78-493f-ac29-2322c2c8e9ce", "name": "network-vif-plugged", "status": "completed", "tag": "6c414df6-df54-488c-a1ab-3d91107d6123"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:03.563287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:03.568334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:03.569006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:03.581058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:03.604809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] Creating event network-vif-plugged:6c414df6-df54-488c-a1ab-3d91107d6123 for instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce on n-h2-859358-1 Sep 27 01:52:03.616339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a1c8fe54-42e5-4df9-bf24-b589d3df3cea req-44a620fa-38d7-4ad2-99d7-52c29aa1a1b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086787 Sep 27 01:52:03.619412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2412/4833] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:03.863186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:03.888208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:03.889961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:03.899005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ebba3158-9880-44a8-af99-2b1b7234002d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 2.039079 Sep 27 01:52:03.901082 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2422/4834] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:01 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:04.552932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:04.553822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:04.593114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:04.593763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:04.597196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:04.599033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:04.601622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:04.608660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:04.931700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:04.933466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:04.961713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:04.965881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:04.967197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:04.968241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:04.971100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:04.973167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:05.417377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:05.426222 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-baeb94a9-c07e-4a1d-ab4e-9af6136c238f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.879376 Sep 27 01:52:05.431707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2413/4835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:04 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:06.459613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:06.460230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:06.473554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:06.474367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:06.475823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:06.477822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:06.478298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:06.478736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:06.972914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:06.988678 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3daeff0-73ef-4361-bdf2-ea6cbb49c1a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.532303 Sep 27 01:52:06.990682 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2414/4836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:06 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:07.326599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:07.336380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:07.351577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:07.353001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60a43f5f-87e3-4a5e-9005-39cfc95ecd39 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1808 microversion: 2.20 time: 2.426732 Sep 27 01:52:07.353633 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2423/4837] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:04 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1808 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:08.017200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:08.017929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:08.039411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:08.040263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:08.043061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:08.045156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:08.047009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:08.048403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:08.388385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:08.389146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:08.401301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:08.423369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:08.424165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:08.425030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:08.428534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:08.429815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:08.433139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:08.811904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:08.828246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:08.836310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:08.842473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f45e6193-57a0-4239-b760-7e57b0ebdcd9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1795 microversion: 2.20 time: 0.462684 Sep 27 01:52:08.844503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2424/4838] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:08 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1795 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:09.315305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:09.330510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55b90bf2-b2b5-4608-8281-61294b4caba0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 1.316179 Sep 27 01:52:09.333735 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2415/4839] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:08 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:10.355973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:10.357523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:10.372555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:10.376742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:10.385301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:10.386680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:10.389596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:10.390558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:10.758493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: .version_select at 0x7f24d67c9670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1316163446", "policies": ["affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:10.837456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:10.846933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.012790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:11.026850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.062278 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0cb75346-c290-47fe-ad49-3247f75a68cc tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.029707 Sep 27 01:52:11.063560 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2425/4840] 10.222.0.52 () {60 vars in 1174 bytes} [Tue Sep 27 01:52:10 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:11.075847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:11.079488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: .version_select at 0x7f24d5fad940>, body: {"server_group": {"name": "tempest-server-group-790146034", "policies": ["affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:11.097125 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8beddda3-7960-4421-95e2-5507b8646f34 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.743005 Sep 27 01:52:11.097803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2416/4841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:10 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:11.122223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:11.134930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.296432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:11.313894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.377936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63c36aaf-087f-4039-8ba7-e83e7521b46e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.299880 Sep 27 01:52:11.381970 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2426/4842] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 01:52:11 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:11.393567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: .version_select at 0x7f24d56125e0>, body: {"server_group": {"name": "tempest-server-group-790146034", "policies": ["affinity"]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:11.474724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:11.498879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.616470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:11.627664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:11.703098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f998bf26-0613-4df8-a75d-68c72ee0f48a tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.301990 Sep 27 01:52:11.708194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2417/4843] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 01:52:11 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:11.720543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44a10f41-1c66-42ce-8064-c4fc3d6a2307 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:11.827304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44a10f41-1c66-42ce-8064-c4fc3d6a2307 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/be8b207f-fba1-4040-9206-ad7ee4ae0353" status: 204 len: 0 microversion: 2.1 time: 0.109950 Sep 27 01:52:11.828329 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2427/4844] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:11 2022] DELETE /compute/v2.1/os-server-groups/be8b207f-fba1-4040-9206-ad7ee4ae0353 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:11.838186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-42a39a6d-72cf-448e-9397-5dbb56e75bc7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:11.867766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-42a39a6d-72cf-448e-9397-5dbb56e75bc7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.034893 Sep 27 01:52:11.881847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2418/4845] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:52:11 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:11.886627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cfb5e8f-2f95-46b5-99f0-732da9ad9536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:11.998427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cfb5e8f-2f95-46b5-99f0-732da9ad9536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/887ddf84-fcd1-4bf2-8e05-a2d326ac46ad" status: 204 len: 0 microversion: 2.1 time: 0.116346 Sep 27 01:52:12.000924 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2428/4846] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:11 2022] DELETE /compute/v2.1/os-server-groups/887ddf84-fcd1-4bf2-8e05-a2d326ac46ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:12.010834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f6370fa-9553-42ef-a156-6628a15fbc39 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.041280 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f6370fa-9553-42ef-a156-6628a15fbc39 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036405 Sep 27 01:52:12.052637 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2419/4847] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:52:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:12.058905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: .version_select at 0x7f24da54a0d0>, body: {"server_group": {"name": "tempest-server-group-909138132", "policies": ["affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:12.112436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:12.131829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:12.133231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.134287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:12.148953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:12.150032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:12.152183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:12.153684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:12.155398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:12.156533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:12.283208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:12.299321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:12.337541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcf7f01d-7ba4-489d-8c62-d490a2522792 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.284283 Sep 27 01:52:12.350031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2429/4848] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 01:52:12 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:12.357722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-212962bd-1739-43b5-9789-0d62ca570b0b tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.382036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:12.467548 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-212962bd-1739-43b5-9789-0d62ca570b0b tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f9a0b71d-e428-4344-9af0-7205f32cf008" status: 204 len: 0 microversion: 2.1 time: 0.116315 Sep 27 01:52:12.468518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2430/4849] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:12 2022] DELETE /compute/v2.1/os-server-groups/f9a0b71d-e428-4344-9af0-7205f32cf008 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:12.493772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcd49983-860a-42a1-ad39-2e5fb443763e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.565487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcd49983-860a-42a1-ad39-2e5fb443763e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.091056 Sep 27 01:52:12.573600 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2431/4850] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:52:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:12.587254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: .version_select at 0x7f24d6bc3dc0>, body: {"server_group": {"name": "tempest-server-group-1155914538", "policies": ["anti-affinity"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:12.617919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:12.624553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:12.715524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:12.717166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:12.726908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-beb1f779-f732-4ec4-8a1a-5c4dc2435af7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.610460 Sep 27 01:52:12.727505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2420/4851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:12 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:12.746922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_groups'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:12.785754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-307cba77-6fc4-4460-9729-0516535d7b53 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.202384 Sep 27 01:52:12.790127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2432/4852] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 01:52:12 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:12.806419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb4bfa60-9796-49f4-883d-7b2c0a77b0b3 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.895152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb4bfa60-9796-49f4-883d-7b2c0a77b0b3 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/63052a48-2b10-49d1-908b-ca6c5799f90f" status: 204 len: 0 microversion: 2.1 time: 0.095931 Sep 27 01:52:12.896410 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2421/4853] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:12 2022] DELETE /compute/v2.1/os-server-groups/63052a48-2b10-49d1-908b-ca6c5799f90f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:12.905868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b4177f1-6ccd-4131-866d-c3d46c44bc05 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:12.929996 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b4177f1-6ccd-4131-866d-c3d46c44bc05 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027118 Sep 27 01:52:12.932442 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2433/4854] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:52:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:13.518806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-149588243", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a57a773f-3b49-4613-a22c-4519ab1fd8d8"}]}, "os:scheduler_hints": {"group": "f02659b8-fdc5-4ffe-8f10-55e83c39717c"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:13.644093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] validate_networks() for [('a57a773f-3b49-4613-a22c-4519ab1fd8d8', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:52:13.758252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:13.759215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:13.779226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:13.781145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:13.783008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:13.784313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:13.788678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:13.789756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:14.618400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:14.653173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98e5476a-aafc-43f1-ac9c-02dd31a0c01c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.884567 Sep 27 01:52:14.655610 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2434/4855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:13 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:14.778171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:52:14.779282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:52:14.779963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:52:14.780601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:52:14.781200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:52:14.828615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:14.830658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:14.831361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:14.832577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:14.835074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:14.838008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:14.910789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:14.930815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:14.972022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:52:14.980527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:52:15.067659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128778) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 27 01:52:15.114046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_group_members'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:15.123972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_group_members'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:15.187291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-806242995", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:15.226695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_group_members'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:15.241451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Getting quotas for user 498d54a6920440cfba9426179abce98f and project 47d8c7c2ac61435ab5940dee10a402d9. Resources: {'server_group_members'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:15.328883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:52:15.329462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:52:15.330056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:52:15.330634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:52:15.331151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:52:15.358205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5225fc29-0689-4f5d-bfa2-36203784dbbe tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845628 Sep 27 01:52:15.358817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:15.359617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:15.367361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2422/4856] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:52:15.368484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:15.370259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:15.375715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:15.376358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:15.377625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62a28a0e-e080-4312-bb6a-63f6b1fcb526 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:15.378283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-62a28a0e-e080-4312-bb6a-63f6b1fcb526 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:15.389502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:15.426071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Getting quotas for project 038abb8189224e54af56c154932ee41f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:15.438317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Getting quotas for user 688088e6b90046fcbaa0508403dea8d0 and project 038abb8189224e54af56c154932ee41f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:15.490418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:52:15.496200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:52:15.556185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62a28a0e-e080-4312-bb6a-63f6b1fcb526 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:15.571126 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62a28a0e-e080-4312-bb6a-63f6b1fcb526 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1212 microversion: 2.1 time: 0.200041 Sep 27 01:52:15.583754 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2423/4857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:15 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1212 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:15.642316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b512b3c7-9a33-49c0-9a86-ec1212ed080e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.833543 Sep 27 01:52:15.657814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2435/4858] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:52:15.661010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:15.662893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:15.695473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:15.696335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:15.724165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:15.724505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:15.724961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:15.725774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:15.726260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:15.726639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:15.887556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:15.896540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:15.911199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:15.912510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e026119a-feb2-4e08-8125-f9120594d0be tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 200 len: 1277 microversion: 2.47 time: 0.261397 Sep 27 01:52:15.913683 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2424/4859] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:15 2022] GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:16.598052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a309d49-6d46-4f44-931e-793dd2498d1d tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:16.598746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a309d49-6d46-4f44-931e-793dd2498d1d tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:16.926991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:16.941109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-729db289-ba98-4307-a615-5c26826436b7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 1.255330 Sep 27 01:52:16.947492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2436/4860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:15 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:16.967312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-943060935", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:17.047294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a309d49-6d46-4f44-931e-793dd2498d1d tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:17.064650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a309d49-6d46-4f44-931e-793dd2498d1d tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1212 microversion: 2.1 time: 0.470946 Sep 27 01:52:17.070022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2425/4861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:16 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1212 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:17.970248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:17.970978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:17.996548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:18.008987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:18.009870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:18.011334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:18.026655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:18.029645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:18.987418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:19.014267 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3177cdef-d0a3-4173-b5c6-67b1125078dd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 1.048326 Sep 27 01:52:19.023362 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2426/4862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:17 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:19.052536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:19.053210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:19.092788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:19.103346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:19.105009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:19.105009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:19.125666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:19.129300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:19.773315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:19.786506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8bd28196-b007-468f-89ef-83383f1dbcf4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1282 microversion: 2.1 time: 0.761758 Sep 27 01:52:19.796247 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2427/4863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:19 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1282 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:20.059718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:20.061379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:20.077962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:20.092675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:20.102002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:20.106557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:20.107219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:20.107829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:21.331609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:21.340148 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f213bec6-a8bf-49e1-8e5e-e2b07408cd6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 1.287913 Sep 27 01:52:21.351157 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2428/4864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:20 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:21.365018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:21.366569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:21.391240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:21.400475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:21.401099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:21.401950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:21.402628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:21.403246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:22.031984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:22.051100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83129ed0-3b28-485d-a7c8-b3421f0443b4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.698641 Sep 27 01:52:22.064593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2429/4865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:21 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:22.368002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:22.369005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:22.380181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:22.382654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:22.383133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:22.383856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:22.384313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:22.387190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:23.210207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:23.225201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08bcec7e-038b-4ebf-891e-b8c11163c32e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.859774 Sep 27 01:52:23.227959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2430/4866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:22 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:23.247756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:23.253509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:23.272011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:23.275139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:23.275781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:23.278459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:23.279153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:23.280442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:23.622838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:23.641286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dec40d15-f9e6-4bf7-9730-b6d5b8c1336e tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.404305 Sep 27 01:52:23.642431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2431/4867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:23 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:24.253741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:24.254372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:24.276363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:24.279101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:24.279569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:24.280374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:24.280848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:24.281286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:24.733593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:24.746325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-47d0fc82-5203-4f00-b2d9-e69f074b1c3f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.494563 Sep 27 01:52:24.748220 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2432/4868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:24 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:24.773298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478ea125-7709-4f90-a0ae-8f79b5b21874", "tag": "8f0bed31-fab7-4be9-b033-9620636eb882"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:24.796912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:24.798717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:24.799170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:24.837434 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] Creating event network-changed:8f0bed31-fab7-4be9-b033-9620636eb882 for instance 478ea125-7709-4f90-a0ae-8f79b5b21874 on n-h1-859358-1 Sep 27 01:52:24.853553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3e8c4d51-7df6-4a8d-a29f-f378c167ad21 req-dc328553-fe40-423e-96cc-e26f35e64e42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101715 Sep 27 01:52:24.855344 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2433/4869] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:24.868626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:24.870146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:24.889618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:24.891579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:24.892083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:24.892528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:24.894807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:24.897871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:24.904621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:25.392502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:25.478780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:26.326678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:26.338957 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-502ac542-c8b3-4c0d-9ed7-543bb6fe0a76 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 1.481654 Sep 27 01:52:26.340209 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2434/4870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:24 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:26.347405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:26.348318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:26.375639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:26.376460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:26.377241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:26.378535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:26.379360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:26.380076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:26.827585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:26.838072 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d5372d2-c4f6-4825-ac97-4746fa4d734c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.496459 Sep 27 01:52:26.866920 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2435/4871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:26 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:26.936793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:27.018181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:27.363147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=28 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:27.378536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:27.383058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:27.414296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:27.415981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:27.416918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:27.419953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:27.420769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:27.422122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:28.564020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:28.589513 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-737423df-67a7-46c1-b5c6-e9c300aa80d2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 1.226945 Sep 27 01:52:28.612266 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2436/4872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:27 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:28.625406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:28.628541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:28.638939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:28.640309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:28.641139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:28.642067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:28.642689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:28.651202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:29.254211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:29.259055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:29.273594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03d55405-c638-4969-bbf8-9b837746ec6d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.656117 Sep 27 01:52:29.277080 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2437/4873] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:28 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:29.621249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:29.623950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:29.635572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:29.636658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:29.637268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:29.638197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:29.639184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:29.639765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:30.020676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:30.052335 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e582eca9-02ba-4dde-868b-3a5342fece7f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.438148 Sep 27 01:52:30.063359 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2438/4874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:29 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:30.312110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:30.315908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:30.326878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:30.328261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:30.329005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:30.330923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:30.331714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:30.335322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:30.586448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:30.596074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-592f0afe-16c7-4c75-91ff-5b65d1e22bc3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.299557 Sep 27 01:52:30.608165 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2439/4875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:30 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:31.080685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:31.081392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:31.098664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:31.099163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:31.099597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:31.111400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:31.112137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:31.112613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:31.516271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:31.561517 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-66c74f1c-84e9-4a0f-b280-9e37bb9efbc9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.484526 Sep 27 01:52:31.563496 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2440/4876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:31 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:31.624121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:31.624848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:31.637900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:31.644399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:31.647087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:31.647877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:31.655759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:31.658116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:32.171106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:32.197560 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7c1e7b6f-04bb-4c1e-8b8e-8770411f13a8 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.573006 Sep 27 01:52:32.202518 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2441/4877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:31 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:32.412362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:52:32.412914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:52:32.414484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:52:32.414484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:52:32.414816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:52:32.435708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:32.436203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:32.436641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:32.437401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:32.448136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:32.448136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:32.483848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Getting quotas for project 038abb8189224e54af56c154932ee41f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:52:32.499124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Getting quotas for user 688088e6b90046fcbaa0508403dea8d0 and project 038abb8189224e54af56c154932ee41f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:52:32.525017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:52:32.527281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:52:32.589547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:32.590266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:32.607045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:32.607045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:32.607045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:32.607709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:32.608099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:32.608665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:32.630163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4934806f-d4ec-467e-af43-2fbc1d54695a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 15.680671 Sep 27 01:52:32.630828 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2437/4878] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 15683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:52:32.642886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-efde407b-4100-417e-902e-55f238c1a89e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:32.645259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-efde407b-4100-417e-902e-55f238c1a89e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:32.746382 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-efde407b-4100-417e-902e-55f238c1a89e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "PUT /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 991 microversion: 2.47 time: 0.107412 Sep 27 01:52:32.747316 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2438/4879] 10.222.0.52 () {62 vars in 1297 bytes} [Tue Sep 27 01:52:32 2022] PUT /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:32.771897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:32.772523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:33.082387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:33.091387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:33.096394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:33.100953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbd685ea-09ca-4ce6-976b-3bd4294752b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1277 microversion: 2.47 time: 0.333021 Sep 27 01:52:33.104975 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2439/4880] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:32 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1277 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:33.223537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:33.227565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:33.242745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:33.248789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:33.249284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:33.251913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:33.252598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:33.253871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:33.283281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:33.298802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-550927e0-a18f-4d31-8336-dfa401132fc2 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.714360 Sep 27 01:52:33.299399 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2442/4881] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:32 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:33.691690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:33.710539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b27881a6-96e1-4b95-9de7-b51c5f515f6a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1506 microversion: 2.1 time: 0.488235 Sep 27 01:52:33.713695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2440/4882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:33 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:34.136392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:34.138199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:34.160283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.161621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.162950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.166915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.167543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.168156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.326000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:34.326604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:34.347251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.351298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.352081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.353646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.355589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.356164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.388360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:34.413498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:34.415857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:34.417281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-edfe8477-3d1e-4d47-a4d3-20097b682d3d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1273 microversion: 2.47 time: 0.286907 Sep 27 01:52:34.418075 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2443/4883] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:34 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:34.495905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478ea125-7709-4f90-a0ae-8f79b5b21874", "name": "network-vif-plugged", "status": "completed", "tag": "8f0bed31-fab7-4be9-b033-9620636eb882"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:34.509634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.510492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.511186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.552342 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] Creating event network-vif-plugged:8f0bed31-fab7-4be9-b033-9620636eb882 for instance 478ea125-7709-4f90-a0ae-8f79b5b21874 on n-h1-859358-1 Sep 27 01:52:34.567434 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b91460ea-fdc0-4497-9298-e3c125d5730e req-a03f1559-af82-4f68-b5ba-0f6ae00e132f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076421 Sep 27 01:52:34.568967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2444/4884] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:52:34.737072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:34.737837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:34.753208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.753751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.754286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.754887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:34.755347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:34.755769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:34.944215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:34.960081 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c115459-dab4-40fd-b7e5-76bb0f25a7a1 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.638288 Sep 27 01:52:34.992063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2441/4885] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:34 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:35.335842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:35.358681 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b3b8918-aaa5-4a7a-9a11-67a492aa5c6e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1506 microversion: 2.1 time: 0.625997 Sep 27 01:52:35.359888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2445/4886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:34 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:35.448114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:35.449646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:35.470744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:35.477516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:35.480004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:35.480872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:35.481461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:35.482246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:35.647714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:35.676425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:35.683660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:35.687222 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b372c0e4-ed41-4b14-8075-08a8187a32db tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1335 microversion: 2.47 time: 0.243532 Sep 27 01:52:35.688165 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2442/4887] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:35 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:35.996771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:35.997420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:36.004221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.004720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.005159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.014922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.015427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.015939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.386549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:36.387915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:36.400687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.410049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.413171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.416882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.417872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.418543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.783773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:36.795163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7320e7a-ac01-449e-963c-71714aab29d7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1506 microversion: 2.1 time: 0.412497 Sep 27 01:52:36.801753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2443/4888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:36 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:36.809578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:36.810814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:36.819949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.820922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.822352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.824051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:36.825211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:36.826016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:36.867522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:36.888882 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b89edaba-c5c7-4285-968b-0d8261b03536 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1312 microversion: 2.1 time: 0.896018 Sep 27 01:52:36.894069 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2446/4889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:35 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1312 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:37.012265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:37.040213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:37.048774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:37.050514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a261d1bd-e3e0-447e-b7c3-a8f980733f46 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1335 microversion: 2.47 time: 0.247157 Sep 27 01:52:37.051579 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2444/4890] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:36 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1335 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:37.309391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c91e3c8-fd78-493f-ac29-2322c2c8e9ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6c414df6-df54-488c-a1ab-3d91107d6123"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:37.337687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:37.338330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:37.338861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:37.367937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] Creating event network-vif-unplugged:6c414df6-df54-488c-a1ab-3d91107d6123 for instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce on n-h2-859358-1 Sep 27 01:52:37.375080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-34a07a4f-ce70-4c24-a049-ba65f7fa5094 req-0c24b903-4969-4d5e-b7ff-bd083c89f5c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070589 Sep 27 01:52:37.379288 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2447/4891] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:52:37.828617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:37.829329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:37.840823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:37.841317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:37.848678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:37.852468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:37.853025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:37.854008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:37.920525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:37.921938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:37.941500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:37.949690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:37.950175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:37.950929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:37.951489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:37.951815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.345977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:38.369228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2280896f-aced-43d9-a994-3f0ac9b7a15f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1506 microversion: 2.1 time: 0.544832 Sep 27 01:52:38.370384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2445/4892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:37 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:38.376009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:38.376820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:38.385788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.386583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.389741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.391754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.394272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.397524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.599165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:38.600168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:38.607385 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88ccfc7d-9dc8-4465-aac3-bc06c36586d5 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1498 microversion: 2.1 time: 0.691291 Sep 27 01:52:38.613974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:38.618458 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2448/4893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:37 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1498 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:38.618694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:38.620750 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9aa2abc4-cf56-4a77-a65f-c3d2d39106b0 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1335 microversion: 2.47 time: 0.249267 Sep 27 01:52:38.641296 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2446/4894] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:38 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1335 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:38.653745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:38.707263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.server_groups [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Querying cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) for 1 instances {{(pid=128778) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 27 01:52:38.708013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.708497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.708940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.790953 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80cda27e-bf80-4b02-bb36-cc46afa470c7 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c" status: 200 len: 222 microversion: 2.1 time: 0.144308 Sep 27 01:52:38.792259 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2449/4895] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:52:38 2022] GET /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c => generated 222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:38.803970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:38.804486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:38.821020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.821549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.831459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:38.834295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:38.837560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.838510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.839149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.839446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.850485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.853159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.855006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.857903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:38.858349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:38.859070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:38.912997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9f53fcf-8576-4da9-a5c8-37cfb43f3046 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments/e3142e31-5671-4155-b187-6776c8e12848" status: 200 len: 194 microversion: 2.20 time: 0.084879 Sep 27 01:52:38.915168 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2450/4896] 10.222.0.52 () {60 vars in 1454 bytes} [Tue Sep 27 01:52:38 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments/e3142e31-5671-4155-b187-6776c8e12848 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:52:38.936332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:52:39.066390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:39.067557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:39.080543 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b517d6ec-cf89-45ce-85a9-a56306f26f90 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 204 len: 0 microversion: 2.1 time: 0.277955 Sep 27 01:52:39.085753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2447/4897] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:52:38 2022] DELETE /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:39.087263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.088842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.089580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.090747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.099029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.101086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.110644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:39.112057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:39.130992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.132677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.133938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.136390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.152551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.154260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.314798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lazy-loading 'services' on Instance uuid 02eb52cb-8186-4531-b89b-680215671893 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:52:39.436212 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-093e52cf-f0c8-43a3-b8f2-29ae205e635a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments/e3142e31-5671-4155-b187-6776c8e12848" status: 202 len: 0 microversion: 2.20 time: 0.386721 Sep 27 01:52:39.436814 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2451/4898] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Sep 27 01:52:39 2022] DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments/e3142e31-5671-4155-b187-6776c8e12848 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:39.450267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:39.451295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:39.480973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.481517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.482123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.483231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.484582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.485048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.722840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:39.744747 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f45cf9cc-bedb-4df0-b1cb-6ceaf5b4604f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 200 len: 1509 microversion: 2.1 time: 0.301486 Sep 27 01:52:39.745379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2452/4899] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:39 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:39.755653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:39.758625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:39.768401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.769373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.771156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.771994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.772583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.776295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.819094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-436e2561-aef1-4e4c-9611-51b245b45b79 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070446 Sep 27 01:52:39.825672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2453/4900] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:39 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:39.834816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:39.836855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:39.851414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.852045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.852497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.853315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:39.853882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:39.854372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:39.956918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:39.978904 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85009467-630f-43c8-a4c2-78e16d9e943f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1504 microversion: 2.1 time: 0.885957 Sep 27 01:52:39.988239 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2448/4901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:39 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:40.006821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:40.009120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:40.043619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.048653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.049522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.050023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.054846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.055276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.068331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:40.104155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:40.112966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:40.116642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-403f3bfb-cd64-4869-9dda-f68f65ead89a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1335 microversion: 2.47 time: 0.289840 Sep 27 01:52:40.117510 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2454/4902] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:39 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1335 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:40.548423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:40.564360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67bf0b21-2de2-4965-9277-9101bc6fd8d6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.567662 Sep 27 01:52:40.565254 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2449/4903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:39 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:40.597403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:40.598466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:40.606132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.606870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.607547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.608464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.609128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.609767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.630780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:40.832678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:40.836309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:40.854093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.858115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.862127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.864448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:40.865153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:40.867500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:40.962761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bb6580c8-c2e1-4ca5-a1d2-9255ef02db6b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134508 Sep 27 01:52:40.964805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2450/4904] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:40 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:52:41.013215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:41.014173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:41.024115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.024809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.025466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.027215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.031073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.031699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.322664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:41.334622 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7311d1f4-3bd4-4beb-aa4e-6ab756c8f17b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.741152 Sep 27 01:52:41.335461 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2455/4905] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:40 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:41.352869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:41.353974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:41.376851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.377669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.379284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.382032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.383129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.383889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.532855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:41.551458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:41.561653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:41.569256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3217342f-b043-4e5f-aa15-8a37b9196901 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1356 microversion: 2.47 time: 0.228219 Sep 27 01:52:41.584803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2456/4906] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:41 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:41.598961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:41.601599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:41.619489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.624778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.625483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.626379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.626997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.627605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.817855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:41.828010 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47bef2ee-951b-4881-8d50-aed1ef28d10f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1504 microversion: 2.1 time: 0.819277 Sep 27 01:52:41.833471 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2451/4907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:41 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1504 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:41.858045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:41.860973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:41.870508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.872302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.873133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:41.876153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:41.876942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:41.878047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.044619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:52:42.047162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:52:42.047964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:52:42.048617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:52:42.049551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:52:42.191217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:42.220942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.224134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.225095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.226129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.227627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.228385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.234666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:42.316004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3b0f6c0-e9f0-4a29-9082-caac9d239deb tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "POST /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48/action" status: 202 len: 1078 microversion: 2.47 time: 0.472514 Sep 27 01:52:42.316643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2452/4908] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:52:41 2022] POST /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48/action => generated 1078 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 27 01:52:42.334302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:42.336600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:42.358452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.358955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.359398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.360119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.360579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.361011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.389765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:42.399616 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cac2c1d4-3e8d-44dc-aad0-bbfd8cb5c8f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.813267 Sep 27 01:52:42.423356 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2457/4909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:41 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:42.452119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:42.452119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:42.462296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:42.465809 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bc3c83a-9621-4713-b41f-1f00707155d8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148075 Sep 27 01:52:42.466402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.466896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.468138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.471163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.473878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.475585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.479510 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2453/4910] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:42 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:42.487241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:42.488046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:42.515904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.516381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.516866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.517591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.518047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.518477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.689938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:42.710363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:42.716956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:42.721693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4744fdd5-6bdc-4dde-ac57-eaaa0fcf800d tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.289724 Sep 27 01:52:42.744118 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2458/4911] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:42 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:42.868528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:42.870622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:42.895898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.896699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.900365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:42.903181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:42.904578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:42.906353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.031587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:43.050686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89d7759a-c843-4da6-8718-cb6b9bc2601d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.566097 Sep 27 01:52:43.052011 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2454/4912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:42 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:43.078099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:43.100266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:43.111404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.112143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.115775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.188305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498d54a6920440cfba9426179abce98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d8c7c2ac61435ab5940dee10a402d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:43.193521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:52:43.207680 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dab994fb-9ac4-4b6f-a7a9-6c64caab165c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 200 len: 1462 microversion: 2.1 time: 0.350411 Sep 27 01:52:43.210048 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2459/4913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:42 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 1462 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:43.216849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478ea125-7709-4f90-a0ae-8f79b5b21874", "name": "network-vif-deleted", "tag": "8f0bed31-fab7-4be9-b033-9620636eb882"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:43.235191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.237441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.238128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.280138 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] Creating event network-vif-deleted:8f0bed31-fab7-4be9-b033-9620636eb882 for instance 478ea125-7709-4f90-a0ae-8f79b5b21874 on n-h1-859358-1 Sep 27 01:52:43.308105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-65c1d455-e66c-4501-b3d5-193d79b7a7c6 req-ca25bbcc-2e76-4349-b448-5996d341bb19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095989 Sep 27 01:52:43.311364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2460/4914] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:43.362501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3b0efd7-6a27-4a99-96e7-eff3b46f81ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.287546 Sep 27 01:52:43.363134 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2455/4915] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:52:43 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:52:43.375167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:43.377105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:43.394093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.396348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.397901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.416577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.417089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.420895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.481984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:43.485013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:43.505589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.506760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.514254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.515510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.528527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.529385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.620904 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-319a9229-f5f1-4940-9721-2062bfcfe7ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146245 Sep 27 01:52:43.626363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2456/4916] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:43 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 01:52:43.662474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:43.679107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cbfbd1c-b739-41cc-bdcc-f4861854d6a4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.308071 Sep 27 01:52:43.707531 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2461/4917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:43 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:43.757992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:43.758725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:43.771101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.774484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.775520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:43.776468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:43.778186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:43.780493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.020762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:44.036840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:44.041636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:44.048954 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4775cc97-5e83-49ea-bdcd-ed99681145b1 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.296680 Sep 27 01:52:44.053184 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2457/4918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:43 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:44.232554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.233181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:44.246295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.248639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.249267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.251378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.254671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.255297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.305669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 HTTP/1.1 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '478ea125-7709-4f90-a0ae-8f79b5b21874'} Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.310548 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.319709 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a87fe084-a66b-45db-a22e-7f8dd2643fcd tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 404 len: 111 microversion: 2.1 time: 0.083743 Sep 27 01:52:44.330128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.338211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2462/4919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:52:44.384562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_groups [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Querying cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) for 1 instances {{(pid=128779) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 27 01:52:44.387352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.392949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.394059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.423222 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5db7f9e8-79e0-4d24-9300-abd461994054 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.102910 Sep 27 01:52:44.426006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2458/4920] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:44.440858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.473712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.server_groups [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Querying cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) for 1 instances {{(pid=128778) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 27 01:52:44.475250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.475955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.476558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.491288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd50fb96-97f5-44c0-af68-419e75a5bf4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c" status: 200 len: 184 microversion: 2.1 time: 0.055752 Sep 27 01:52:44.492742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2463/4921] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c => generated 184 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:44.506656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.508674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:44.518944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.519558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.520014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.520909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.522618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.523269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.543801 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 HTTP/1.1 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '478ea125-7709-4f90-a0ae-8f79b5b21874'} Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.546282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.551020 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.553570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.554811 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27347ded-56b7-4562-81fd-b5ffb1fff881 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 404 len: 111 microversion: 2.1 time: 0.053714 Sep 27 01:52:44.555988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2459/4922] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:52:44.566669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.568682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] [instance: 478ea125-7709-4f90-a0ae-8f79b5b21874] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:44.580212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.580709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.582039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.586881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.586881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.586881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.606019 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 HTTP/1.1 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '478ea125-7709-4f90-a0ae-8f79b5b21874'} Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.608851 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. Sep 27 01:52:44.613294 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.615701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance 478ea125-7709-4f90-a0ae-8f79b5b21874 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.616814 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eace9f3e-a3ed-4546-a150-aeafbfc755b9 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874" status: 404 len: 111 microversion: 2.1 time: 0.056996 Sep 27 01:52:44.617928 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2464/4923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/servers/478ea125-7709-4f90-a0ae-8f79b5b21874 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:52:44.627384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb963b01-75a7-4451-964e-d13a01e91fd4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.637513 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-fb963b01-75a7-4451-964e-d13a01e91fd4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb963b01-75a7-4451-964e-d13a01e91fd4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-server-groups/63052a48-2b10-49d1-908b-ca6c5799f90f HTTP/1.1 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '63052a48-2b10-49d1-908b-ca6c5799f90f'} Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.642784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. Sep 27 01:52:44.648076 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.652609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.654920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb963b01-75a7-4451-964e-d13a01e91fd4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance group 63052a48-2b10-49d1-908b-ca6c5799f90f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.656294 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb963b01-75a7-4451-964e-d13a01e91fd4 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/63052a48-2b10-49d1-908b-ca6c5799f90f" status: 404 len: 117 microversion: 2.1 time: 0.034369 Sep 27 01:52:44.657086 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2460/4924] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/os-server-groups/63052a48-2b10-49d1-908b-ca6c5799f90f => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:52:44.658887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:44.674660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48b8e9db-c360-4e0d-b624-8ad134332395 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.679070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.679562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.682658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.687352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.687352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.687352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.700071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-48b8e9db-c360-4e0d-b624-8ad134332395 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48b8e9db-c360-4e0d-b624-8ad134332395 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-server-groups/f9a0b71d-e428-4344-9af0-7205f32cf008 HTTP/1.1 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f9a0b71d-e428-4344-9af0-7205f32cf008'} Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.704493 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.708784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48b8e9db-c360-4e0d-b624-8ad134332395 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance group f9a0b71d-e428-4344-9af0-7205f32cf008 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.710814 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48b8e9db-c360-4e0d-b624-8ad134332395 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f9a0b71d-e428-4344-9af0-7205f32cf008" status: 404 len: 117 microversion: 2.1 time: 0.047693 Sep 27 01:52:44.717162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2461/4925] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/os-server-groups/f9a0b71d-e428-4344-9af0-7205f32cf008 => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:52:44.728634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.729256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:44.758095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.762385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.763730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.766847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:44.767590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:44.768194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:44.800559 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af73f805-ae99-4a89-997d-4e2dccb945b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165725 Sep 27 01:52:44.803897 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2465/4926] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:44.819069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be45de93-3a34-43c3-b97d-1aa9b3186cc6 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.836880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-be45de93-3a34-43c3-b97d-1aa9b3186cc6 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be45de93-3a34-43c3-b97d-1aa9b3186cc6 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-server-groups/887ddf84-fcd1-4bf2-8e05-a2d326ac46ad HTTP/1.1 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '887ddf84-fcd1-4bf2-8e05-a2d326ac46ad'} Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.843723 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. Sep 27 01:52:44.852423 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.855033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be45de93-3a34-43c3-b97d-1aa9b3186cc6 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance group 887ddf84-fcd1-4bf2-8e05-a2d326ac46ad could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.856081 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-be45de93-3a34-43c3-b97d-1aa9b3186cc6 tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/887ddf84-fcd1-4bf2-8e05-a2d326ac46ad" status: 404 len: 117 microversion: 2.1 time: 0.049738 Sep 27 01:52:44.858100 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2466/4927] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/os-server-groups/887ddf84-fcd1-4bf2-8e05-a2d326ac46ad => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:52:44.869039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89f96d41-0ff3-4779-b779-f56b364b5d4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.879635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-89f96d41-0ff3-4779-b779-f56b364b5d4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] HTTP exception thrown: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89f96d41-0ff3-4779-b779-f56b364b5d4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Request method failure captured: Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-server-groups/be8b207f-fba1-4040-9206-ad7ee4ae0353 HTTP/1.1 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMldJIAGnpWb2ywBW7dGaJuavUQxTZkLb8RHZ-bPVCE9Ni8nODl6VwMkrWsPVQbXoCrJIz-elUSfDOsTYuSY38KhACH8ftcVUOslXtp-qjnPqA9ptlcPOUZ-c_A27297TbPRC_NszNWL4Y5D9l9NpkUOC3IKnvgAe30CyNubhKjwXD34 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/47d8c7c2ac61435ab5940dee10a402d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_47d8c7c2ac61435ab5940dee10a402d9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 47d8c7c2ac61435ab5940dee10a402d9 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953449070 Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 498d54a6920440cfba9426179abce98f Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerGroupTestJSON-1953449070-project Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'be8b207f-fba1-4040-9206-ad7ee4ae0353'} Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.882629 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89f96d41-0ff3-4779-b779-f56b364b5d4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Returning 404 to user: Instance group be8b207f-fba1-4040-9206-ad7ee4ae0353 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89f96d41-0ff3-4779-b779-f56b364b5d4c tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/be8b207f-fba1-4040-9206-ad7ee4ae0353" status: 404 len: 117 microversion: 2.1 time: 0.021866 Sep 27 01:52:44.886379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2467/4928] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/os-server-groups/be8b207f-fba1-4040-9206-ad7ee4ae0353 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:52:44.896164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a5b3755-0a01-4cf9-b9a3-6e7fa896fc0f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:44.906739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:44.965933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a5b3755-0a01-4cf9-b9a3-6e7fa896fc0f tempest-ServerGroupTestJSON-1953449070 tempest-ServerGroupTestJSON-1953449070-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c" status: 204 len: 0 microversion: 2.1 time: 0.076556 Sep 27 01:52:44.968183 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2468/4929] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 01:52:44 2022] DELETE /compute/v2.1/os-server-groups/f02659b8-fdc5-4ffe-8f10-55e83c39717c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:52:45.076531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:45.077193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:45.092486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:45.092486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:45.092486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:45.094437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:45.095689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:45.096131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:45.249816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:45.259004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bd793a22-a505-484b-b231-ba70caa4e651 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.541692 Sep 27 01:52:45.267283 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2462/4930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:44 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:45.370683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:45.393134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:45.393391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:45.394612 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93b7ade4-3094-41a0-aee4-b385a142d5c8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.322745 Sep 27 01:52:45.395255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2469/4931] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:45 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:45.819238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:45.823205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:45.841529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:45.842317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:45.845881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:45.846763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:45.848436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:45.850315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:45.977773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-576d60d9-c619-45fb-b32a-7e5a495a63c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165517 Sep 27 01:52:45.980606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2463/4932] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:45 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:46.294947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:46.295744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:46.308697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:46.314521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:46.315223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:46.318159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:46.320973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:46.322196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:46.426322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:46.427345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:46.444256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:46.447477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:46.449117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:46.451039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:46.451973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:46.453247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:46.596247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:46.609776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:46.613800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:46.619754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10ef463d-d0fb-46d0-a02f-efa69d2c1e07 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.197364 Sep 27 01:52:46.621750 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2464/4933] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:46 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:46.636604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:46.694466 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98e55cb4-eb4e-49b3-baef-d15be12119f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.400637 Sep 27 01:52:46.709393 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2470/4934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:46 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:46.999254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:47.008312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:47.029706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.030421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.031767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.033781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.036166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.038946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.158438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f20ba49b-852b-49f3-a76c-8547ccc4b51d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170041 Sep 27 01:52:47.159410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2465/4935] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:46 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:47.655701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:47.665096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:47.689085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.690263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.691581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.693512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.694747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.695884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.723535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:47.726383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:47.739253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.740485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.741406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.742706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:47.743419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:47.744062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:47.799028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:47.821285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:47.825526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:47.828075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85f70fdf-4b53-45e0-b2bd-4b2fb9a0dc23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.179820 Sep 27 01:52:47.842997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2471/4936] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:47 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:48.174205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:48.182967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:48.202589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:48.209635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:48.211984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:48.214719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:48.216987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:48.221447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:48.222272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:48.225953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45365950-a4a7-4823-8360-1e2b941f7ac7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.507796 Sep 27 01:52:48.238562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2466/4937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:48.280927 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46ef1443-4d94-4ea4-9bde-21704902c9ad tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111820 Sep 27 01:52:48.282229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2472/4938] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:48 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:48.860859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:48.861583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:48.872729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:48.874774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:48.875244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:48.875995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:48.876467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:48.876906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:49.065075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:49.090432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:49.094627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:49.101864 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d93d8b4-9e98-4008-bb60-ea9cd4eb0f53 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.245607 Sep 27 01:52:49.103948 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2467/4939] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:48 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:49.259743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:49.261158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:49.270200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:49.272458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:49.272918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:49.273670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:49.274140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:49.274568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:49.296583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:49.298835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:49.324321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:49.325770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:49.326234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:49.328679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:49.329169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:49.330214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:49.398883 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35669e6d-ec92-42fa-b518-1c2aa2648e62 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108091 Sep 27 01:52:49.402836 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2468/4940] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:49 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:52:50.131931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:50.132649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:50.157698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.158278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.158728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.159473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.159935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.160360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.195553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:50.237451 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31ac7cb6-fd95-4b61-a9e0-5a539b5e2913 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.981472 Sep 27 01:52:50.242798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2473/4941] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:49 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:50.375559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:50.390532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:50.392286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:50.393944 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d946db75-7692-434d-995a-594d88ce0c9a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.269594 Sep 27 01:52:50.394857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2469/4942] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:50 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:50.415897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:50.420112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:50.447287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.447776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.453978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.454868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.455481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.455958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.528951 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01d87ec2-9772-450e-a4ce-c43a74c96a68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118780 Sep 27 01:52:50.533950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2474/4943] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:52:50 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:50.667174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:50.667813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:50.695447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:50.700174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.705010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.708457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.709840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:50.715219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:50.715752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:50.803277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:52:50.881117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:51.065828 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-30cac352-cd72-4d05-b224-676e00596183 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 204 len: 0 microversion: 2.20 time: 0.407404 Sep 27 01:52:51.067149 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2470/4944] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:52:50 2022] DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:52:51.077230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:51.078080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:51.097851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.098584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.125152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:51.128710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.134047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.134517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:51.267518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:51.268291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:51.282524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.283031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.283486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:51.284213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.284670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.287890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:51.657815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:51.676970 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-55d27d47-be5f-44b8-a4fa-36a23b2596f1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.414849 Sep 27 01:52:51.679217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2471/4945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:51 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:51.685302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:51.685962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:51.709116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.709651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.710310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:51.711336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:51.711806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:51.712277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:52.441040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.489501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.497872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.499782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34bed801-143a-4cc6-854d-f9178d20b0ef tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.819096 Sep 27 01:52:52.501722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2472/4946] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:51 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:52.706640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:52.707631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:52.719548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:52.722458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:52.725299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:52.726113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:52.727937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:52.728867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:52.752498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.780936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.786063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:52.789890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8429a1f-fed7-4fd6-8c72-a30831522be1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 1.717982 Sep 27 01:52:52.791274 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2475/4947] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:51 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:52:53.209180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:53.223724 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77b2aa13-2b21-4258-ae27-bd0fe978715e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1679 microversion: 2.1 time: 0.523405 Sep 27 01:52:53.246180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2473/4948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:52 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1679 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:53.543934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:53.544547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:53.575133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:53.576540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:53.577905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:53.582868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:53.584229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:53.584962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:53.822383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:53.823222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:53.841391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:53.842085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:53.842965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:53.845476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:53.847365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:53.849560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:54.174352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.195915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.199998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.205893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86df182c-b8f6-4a64-a305-8d043aefa2f7 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.665815 Sep 27 01:52:54.208839 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2476/4949] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:53 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:54.259144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:54.260094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:54.277976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:54.278807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:54.280639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:54.281663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:54.285203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:54.285910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:54.948713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.961927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.966566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:54.968946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-387a8132-234a-4869-990b-df26c392754e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1723 microversion: 2.20 time: 1.151577 Sep 27 01:52:54.972234 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2474/4950] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:53 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1723 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:54.994024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:55.001785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:52:55.004393 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a3b662e-8fb7-4834-9b5e-a9a1a4e79973 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1656 microversion: 2.1 time: 0.755962 Sep 27 01:52:55.005710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2477/4951] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:54 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1656 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:55.029995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:55.045951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.047121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.049794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.180522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Going to try to start instance {{(pid=128779) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 01:52:55.246058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:55.247985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:55.256038 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8260def3-78ff-4d4f-9d3c-19a5a48f4684 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.230560 Sep 27 01:52:55.257813 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2475/4952] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:52:55 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:52:55.273844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:55.275852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:55.280323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.281217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.282587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.284231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.284891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.290245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.292851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.307155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.309655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.312938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.314074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.318743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.488274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:55.513260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:55.515322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:55.517717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-398c1beb-8f67-4897-ab91-9f270e82fdbd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.288221 Sep 27 01:52:55.533482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2478/4953] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:55 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:55.899847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02eb52cb-8186-4531-b89b-680215671893", "name": "network-vif-deleted", "tag": "4e900802-81d8-4d0a-ad68-9434c75c85aa"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:52:55.937435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:55.938670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:55.952716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:55.975051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] Creating event network-vif-deleted:4e900802-81d8-4d0a-ad68-9434c75c85aa for instance 02eb52cb-8186-4531-b89b-680215671893 on n-h1-859358-1 Sep 27 01:52:55.977945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:55.981479 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ca9cde7c-22c0-486b-bd68-cbb2858b552f req-d78f0d10-7a74-4e7a-9919-d41a92bea1f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085585 Sep 27 01:52:55.982774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2479/4954] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:55.987092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a400878e-a894-40ba-b096-6be74d696ed1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1665 microversion: 2.1 time: 0.724646 Sep 27 01:52:56.001570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2476/4955] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:55 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1665 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:52:56.007382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:56.008554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:56.021759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:56.029456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:56.030958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:56.031956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:56.032612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:56.033277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:56.089055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:56.090142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:56.090671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:56.091564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lazy-loading 'fault' on Instance uuid 02eb52cb-8186-4531-b89b-680215671893 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:52:56.156045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:56.170188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:56.171831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:56.173395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53b29a0f-c235-48c9-a01f-33520844c3d2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 200 len: 1372 microversion: 2.20 time: 0.173514 Sep 27 01:52:56.181397 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2480/4956] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:55 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:56.546394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:56.547022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:56.558134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:56.558631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:56.559069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:56.559792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:56.560251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:56.560683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:57.011894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.013044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:57.022839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:57.033299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:57.033959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:57.035013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:57.035648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:57.036238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:57.172272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:57.182258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:57.185052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:57.186566 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2374a0dd-8bb3-4369-bc41-7e1d9520391a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.644553 Sep 27 01:52:57.197814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2477/4957] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:56 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:57.415640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-426622b7-daab-453a-a02d-eead2e176824 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] Calling method '.version_select at 0x7f24d6ce2280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.450531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:57.468697 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87e16e88-eedf-4a52-ba0b-56eb6e823f67 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1665 microversion: 2.1 time: 0.459172 Sep 27 01:52:57.470738 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2481/4958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1665 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:52:57.488158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.488814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:57.502268 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-426622b7-daab-453a-a02d-eead2e176824 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba/defaults" status: 200 len: 371 microversion: 2.1 time: 0.302279 Sep 27 01:52:57.504251 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2478/4959] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba/defaults => generated 371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:57.509483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:57.509986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:57.510424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:57.511138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:57.511591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:57.512207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:57.517960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-768ed8b2-18a5-4c0a-80a9-032e08f05b17 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] Calling method '.version_select at 0x7f24d667eb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.541694 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 HTTP/1.1 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '02eb52cb-8186-4531-b89b-680215671893'} Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:57.544144 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:52:57.549590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:52:57.554220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41892d62-c27c-4506-bc99-9b8ecd74b876 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 404 len: 111 microversion: 2.20 time: 0.082275 Sep 27 01:52:57.555032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2482/4960] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:52:57.563903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acced5d2-4af9-4d60-af71-e5f754162a1c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '.version_select at 0x7f24d55d8f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.587644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-acced5d2-4af9-4d60-af71-e5f754162a1c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332228549" status: 204 len: 0 microversion: 2.20 time: 0.027912 Sep 27 01:52:57.592428 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2483/4961] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Sep 27 01:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332228549 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:52:57.638766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-768ed8b2-18a5-4c0a-80a9-032e08f05b17 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba" status: 200 len: 371 microversion: 2.1 time: 0.125015 Sep 27 01:52:57.640054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2479/4962] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:52:57.654661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8d2b4a4b-859a-4850-90d7-12ed6f4f622c tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] Calling method '.version_select at 0x7f24d65111f0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.760109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8d2b4a4b-859a-4850-90d7-12ed6f4f622c tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba/defaults" status: 200 len: 371 microversion: 2.1 time: 0.109253 Sep 27 01:52:57.761941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2484/4963] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba/defaults => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:57.776161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afd7ba74-2fc1-466b-97f8-cdf20c19856f tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] Calling method '.version_select at 0x7f24d6853ee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.913547 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afd7ba74-2fc1-466b-97f8-cdf20c19856f tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba" status: 200 len: 371 microversion: 2.1 time: 0.141498 Sep 27 01:52:57.934759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf068336-3d79-4296-9203-0def1bc2efc7 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] Calling method '.version_select at 0x7f24d6786dc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:57.942047 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2480/4964] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:58.085695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf068336-3d79-4296-9203-0def1bc2efc7 tempest-QuotasTestJSON-2032578464 tempest-QuotasTestJSON-2032578464-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba?user_id=d06fc04dd72c4237b73f3aafd46a7c59" status: 200 len: 371 microversion: 2.1 time: 0.155115 Sep 27 01:52:58.089685 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2485/4965] 10.222.0.52 () {58 vars in 1323 bytes} [Tue Sep 27 01:52:57 2022] GET /compute/v2.1/os-quota-sets/aac685d613134a4da204254d9feb1fba?user_id=d06fc04dd72c4237b73f3aafd46a7c59 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:52:58.218512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:58.219539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:58.231994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:58.232502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:58.234306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:58.236603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:58.238074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:58.238570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:58.500058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:58.500773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:58.522585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:58.525074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:58.525626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:58.528507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:58.530669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:58.532169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:58.587620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:58.597671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:58.605016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:58.606586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a462174-9768-4e41-a978-9e9a71ea213a tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.392762 Sep 27 01:52:58.609331 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2481/4966] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:58 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:59.634772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:52:59.636150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:52:59.643085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:59.643838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:59.645083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:59.646566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:52:59.647208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:52:59.647801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:52:59.837703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:59.872116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:59.875823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:59.876389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:52:59.877942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4eeb1478-2d8c-4cca-b90c-eb3eb2bc1af8 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.247034 Sep 27 01:52:59.879091 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2482/4967] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:52:59 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:52:59.888047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3b17696f-281e-473f-8903-b6f04c893ddd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1665 microversion: 2.1 time: 1.396060 Sep 27 01:52:59.888749 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2486/4968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:52:58 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1665 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:00.277985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bd37601-de33-40d0-90eb-0e4eab11c4b4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: .version_select at 0x7f24d6adf550>, body: {"keypair": {"name": "tempest-keypair-287588850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3IURHVRtsAXI30pylNlOxOLs0E+lEo8pY/fyYgM8xyijbWHJTX7qwmHfPLYH8YniAL+KPghr/JPI+PJrMl5ZigAlDmqbZphDN2bZOO87Uayw1z7M5nluxZ0AYD5yiROA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:00.327095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5bd37601-de33-40d0-90eb-0e4eab11c4b4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for project 9042d8e2cb974e91b397874370b74c88. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:53:00.334955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5bd37601-de33-40d0-90eb-0e4eab11c4b4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for user 305ea2953dde435d9e74bb0bc0da89b4 and project 9042d8e2cb974e91b397874370b74c88. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:53:00.379190 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bd37601-de33-40d0-90eb-0e4eab11c4b4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.105801 Sep 27 01:53:00.380110 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2483/4969] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:53:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 01:53:00.905058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:00.905695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:00.914067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:00.914867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:00.922381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:00.922943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:00.923915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:00.928309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:00.928884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:00.929444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:00.934389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:00.934972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:00.935432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:00.936182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:00.936645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:00.937073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:01.078707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:01.102094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:01.103848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:01.107980 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9973682b-6360-40cb-bebf-c7067209db2f tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.206419 Sep 27 01:53:01.109372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2487/4970] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:00 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:01.850967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:01.867406 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85bc7c4a-3c42-4bf0-a587-d6eaf8907a8d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.958718 Sep 27 01:53:01.868523 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2484/4971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:00 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:01.893406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:01.894359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:01.909386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:01.910570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:01.911029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:01.912382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:01.912850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:01.916013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:02.147884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:02.151586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:02.170034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:02.171030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:02.171809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:02.173214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:02.173909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:02.174481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:02.323457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:02.339102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:02.340698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:02.341963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24367a64-6dd7-4eed-b3fc-4b25a45fce9c tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.201997 Sep 27 01:53:02.342552 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2485/4972] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:02 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:02.551291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:02.562143 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed77f01b-c34f-4e3b-9d86-ee3a5e4a0597 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.672968 Sep 27 01:53:02.569203 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2488/4973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:01 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:02.603390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:02.604677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:02.618994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:02.619679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:02.622692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:02.623638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:02.627968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:02.629142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:03.370149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:03.370749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:03.377998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:03.381018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:03.381744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:03.382973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:03.383763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:03.384413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:03.496103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:03.510568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:03.512375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:03.514141 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc5b8d03-00d0-4f0c-916c-775170238557 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.147832 Sep 27 01:53:03.515257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2489/4974] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:03 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:03.554068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:03.584506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d96684c0-404f-4c58-a047-55f60073f18d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.984062 Sep 27 01:53:03.589493 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2486/4975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:02 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:03.611875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:03.614016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:03.628420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:03.631310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:03.631938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:03.637551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:03.639555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:03.641129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:04.160637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:04.180394 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb7a0427-b2cf-4a80-8f9b-482c0434f8ce tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.572982 Sep 27 01:53:04.180917 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2490/4976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:03 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:04.204239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:04.204347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:04.212445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:04.213713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:04.214327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:04.215230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:04.216163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:04.216764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:04.546062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:04.546673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:04.561238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:04.562761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:04.566230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:04.576708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:04.577539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:04.578789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:04.799623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:04.815078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:04.819177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:04.824258 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-871b05cf-dfd1-4269-8aaf-f94fe22cdc98 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.280392 Sep 27 01:53:04.828771 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2491/4977] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:04 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:05.077541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:05.102673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8a22d21-6016-4a3d-bc43-1b57a9816fe6 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.903368 Sep 27 01:53:05.103786 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2487/4978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:04 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:05.125660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:05.126217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:05.141650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.142664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.143853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:05.144596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.145062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.145534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:05.215499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lazy-loading 'flavor' on Instance uuid f957b2c4-cf5f-454f-b71a-66d7bdc01340 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:05.371736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50107705-cc1e-48ad-81fe-c3d81d47193e tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.250224 Sep 27 01:53:05.374593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2492/4979] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:53:05 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:53:05.391154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:05.401280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:05.422079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.422964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.423616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:05.424593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.425259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.426685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:05.857196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:05.857962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:05.876564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.877766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.881174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:05.884960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:05.886307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:05.887596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:06.044269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:06.067702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:06.069297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:06.073123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c10d4a3-2312-4207-bda3-d6805777c424 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.221797 Sep 27 01:53:06.076542 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2493/4980] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:05 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:06.200756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:06.215244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50a049b1-6e9f-4e12-b10a-c033dfa0239d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1677 microversion: 2.1 time: 0.832595 Sep 27 01:53:06.217784 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2488/4981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:05 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1677 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:07.110304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:07.110942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:07.128297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.129612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.130778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.131691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.132326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.133138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.249519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:07.250354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:07.250922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:07.260541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.262140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.262945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.263074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:07.264842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:07.266187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.266733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5293d06-42d9-4c90-8e93-da65d826ca23 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.163248 Sep 27 01:53:07.266876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.267105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.268111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2494/4982] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:07 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:07.275747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1784757690", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71d6a3e4-a275-48e8-8eeb-b9cde3a71612"}], "security_groups": [{"name": "tempest-securitygroup--762985041"}], "key_name": "tempest-keypair-287588850", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:07.343117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:07.472843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] validate_networks() for [('71d6a3e4-a275-48e8-8eeb-b9cde3a71612', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:53:07.668158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:07.678095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c71b199-42d9-4bd2-9a69-d7f562e65bb1 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1660 microversion: 2.1 time: 0.434439 Sep 27 01:53:07.681722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2489/4983] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:07 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1660 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:07.701731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:07.702555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:07.710417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.711266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.711935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.712883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.713836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.714495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.888904 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23200299-457b-44e8-984a-d464aef5ed60 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action" status: 202 len: 0 microversion: 2.1 time: 0.190403 Sep 27 01:53:07.897131 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2490/4984] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:53:07 2022] POST /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:53:07.907913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:07.908644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:07.929394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.933638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.934531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:07.935721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:07.936480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:07.937805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:08.080001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:08.250231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:53:08.251335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:53:08.252478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:53:08.253080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:53:08.253730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:53:08.273028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:08.276722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:08.277557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:08.278588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:08.280039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:08.281603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:08.324352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for project 9042d8e2cb974e91b397874370b74c88. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:53:08.335519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Getting quotas for user 305ea2953dde435d9e74bb0bc0da89b4 and project 9042d8e2cb974e91b397874370b74c88. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:53:08.367989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:53:08.372380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:53:08.486509 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ac579a5-0bc5-4ddc-ad6d-fd410bfad74e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.216627 Sep 27 01:53:08.487550 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2495/4985] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 01:53:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:53:08.498320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:08.500998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:08.514038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:08.514816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:08.515586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:08.517856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:08.517856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:08.518460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:08.748876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:08.763160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:08.769529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:08.772583 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84108d71-2bd8-489a-8715-0b485d31ddfd tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1365 microversion: 2.47 time: 0.283300 Sep 27 01:53:08.776533 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2496/4986] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:08 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:08.796244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:08.797058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:08.806091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:08.815261 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a05f5068-2873-43fc-a8d5-8329b689126f tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1666 microversion: 2.1 time: 0.916752 Sep 27 01:53:08.823919 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2491/4987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:07 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1666 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:09.017958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:09.027645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:09.030365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:09.034738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bdcc3edd-c5ca-4f8d-a0ba-1fb14c1c704d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1281 microversion: 2.20 time: 0.255974 Sep 27 01:53:09.037943 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2497/4988] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:08 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:09.063541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54b64ef4-c903-4e6c-b96b-f718b30718fb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Action: 'create', calling method: .version_select at 0x7f24d6bc3310>, body: {"keypair": {"name": "tempest-keypair-201855387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiLe5V6DDkfNpemZFZYaQeJTjehZN1HtOI6DrMUjVtLMIpCTdmQjG9pFzCyVzBj5D6gunMULlBbN7m/JZC+5usv3kbI/iPMzrnQvZCkpYX9jiZDjisNJkLDlyGQnmPEhQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:09.104585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54b64ef4-c903-4e6c-b96b-f718b30718fb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Getting quotas for project 4f67d35052374bdbbbd97d406009ba76. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:53:09.121227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54b64ef4-c903-4e6c-b96b-f718b30718fb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Getting quotas for user 1c59bb9619964ae89c641404d974ed49 and project 4f67d35052374bdbbbd97d406009ba76. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:53:09.189538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54b64ef4-c903-4e6c-b96b-f718b30718fb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.131595 Sep 27 01:53:09.191867 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2492/4989] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Sep 27 01:53:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 27 01:53:09.803827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:09.804431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:09.821879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:09.822928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:09.825807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:09.826718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:09.827347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:09.828694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:09.847817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:09.848435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:09.855721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:09.856480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:09.857084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:09.857989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:09.858598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:09.859181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:09.869069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:10.026077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.047878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.054223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.058982 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecdd29c0-e69a-48d3-a49e-2a361e8f79c3 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1371 microversion: 2.47 time: 0.259720 Sep 27 01:53:10.089630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2498/4990] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:09 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:10.097706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:10.098686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:10.106688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:10.107586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:10.108241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:10.109202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:10.110252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:10.110955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:10.207214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.225077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.232509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.238563 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-447aab9a-dd6c-47ed-ab91-5fa191ecf93a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1333 microversion: 2.20 time: 0.144984 Sep 27 01:53:10.240105 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2499/4991] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:10 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:10.362429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:10.372978 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d8115960-05d2-4582-9d9c-21f02521cb87 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1666 microversion: 2.1 time: 0.529798 Sep 27 01:53:10.374551 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2493/4992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:09 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1666 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:11.094795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:11.096261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:11.105999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.106792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.107379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.108236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.109611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.110290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.272881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.273688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:11.274923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:11.281258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.282732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.283949 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4ba3362d-cc90-4c08-94b1-8b0cf97a8ee4 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1371 microversion: 2.47 time: 0.197346 Sep 27 01:53:11.286911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.287617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.288061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.289087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.293571 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2500/4993] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:11 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:11.294313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.294927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.401231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:11.401884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:11.417156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.417696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.418134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.418823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:11.419277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:11.419699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:11.437732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.449581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.451034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.459875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-339b2533-a02e-42c8-92ca-b1f9d53df21e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1339 microversion: 2.20 time: 0.194864 Sep 27 01:53:11.462636 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2494/4994] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:11 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:11.957784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:11.968959 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c395831-c5be-4c62-9635-eaa6c299cca0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.571710 Sep 27 01:53:11.971898 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2501/4995] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:11.997964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:11.999051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:12.009038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.012571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.013124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.013991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.014687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.017544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.311147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:12.312602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:12.319356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:12.325672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.329515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.333497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.334478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.335134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.338565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.628718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.641595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.643035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.644213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f975b32-2773-48c0-a68f-6a47896c0792 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1371 microversion: 2.47 time: 0.337303 Sep 27 01:53:12.649535 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2502/4996] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:12 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:12.654247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:12.655115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:12.677703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.678213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.679185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.679914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.680372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.680798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.705253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.713947 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f744aacd-adb4-4df5-be87-40e4241b5286 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1669 microversion: 2.1 time: 0.719860 Sep 27 01:53:12.732330 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2495/4997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:11 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1669 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:12.746928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:12.747619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:12.766451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.769703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.770456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.773812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:12.775867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:12.777092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:12.850040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.863367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:12.864217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.866080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:12.867391 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74955453-ab5a-4122-bb6a-b52d5ee897ae tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1339 microversion: 2.20 time: 0.216859 Sep 27 01:53:12.870396 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2503/4998] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:12 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:12.901314 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.compute.api [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Working on deleting snapshot d9fd65ec-fe1d-4409-97c7-191aedc85b11 from shelved instance... Sep 27 01:53:13.676068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:13.677833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:13.688108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:13.689904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:13.691507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:13.693289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:13.693938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:13.694799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:13.916620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:13.928831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:13.937216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:13.947973 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34b84fb8-a600-48fe-8892-9aeb222a383b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1356 microversion: 2.47 time: 0.277270 Sep 27 01:53:13.951255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2504/4999] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:13 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1356 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:13.960384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:13.974411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:13.982499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:13.983516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:13.984123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:13.986313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:13.987057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:13.987705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:14.481768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Doing local delete in cell c7fdefa2-21d6-4f51-989f-549d04e7ccc8(cell1) {{(pid=128779) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 27 01:53:14.483136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:14.483864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:14.484467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:14.485055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.compute.api [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 27 01:53:14.490012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] deallocate_for_instance() {{(pid=128779) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 27 01:53:14.745028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:14.773697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:14.785010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:14.795792 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecb89cb8-1f2c-4a57-9e5a-0936a8574bb0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.836996 Sep 27 01:53:14.800179 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2505/5000] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:13 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:14.825311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:14.840045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:14.842739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Searching by: {'deleted': False, 'project_id': '038abb8189224e54af56c154932ee41f'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 01:53:14.861654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:14.863693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:14.866940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:14.883224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:14.886655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:14.888082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:15.163045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 01:53:15.349440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:15.359199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:15.359759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:15.360208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:15.374070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:15.375925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:15.915908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c42fb499-c126-41d7-90e3-4c2f0464ef03 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.111684 Sep 27 01:53:15.918087 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2506/5001] 10.222.0.52 () {60 vars in 1187 bytes} [Tue Sep 27 01:53:14 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:15.923487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-14070004", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6e92d040-8958-40b9-b3a2-f7191b947b86"}, {"port": "c1b74e3f-ff04-4311-849d-af8536d9d1ed", "tag": "port-1"}, {"port": "5953da3c-c32e-4866-9b77-afd7b6c69d89", "tag": "port-2"}, {"uuid": "f082a273-d019-4426-a608-646b4cdf608f", "tag": "net-1"}, {"uuid": "f082a273-d019-4426-a608-646b4cdf608f"}, {"uuid": "c5b353fc-77f6-4a30-99b0-69d6a3002fb7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c5b353fc-77f6-4a30-99b0-69d6a3002fb7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "dc485fcf-7e58-48ba-9cb2-c827c010bc46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e275b470-f5a8-4b23-a379-380c12f6ad76", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1f3874d4-1d8e-42bb-a068-31ca5ff2a381", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1859770306"}], "key_name": "tempest-keypair-201855387", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:16.195715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] validate_networks() for [('6e92d040-8958-40b9-b3a2-f7191b947b86', None, None, None, None, None), (None, None, 'c1b74e3f-ff04-4311-849d-af8536d9d1ed', None, None, None), (None, None, '5953da3c-c32e-4866-9b77-afd7b6c69d89', None, None, None), ('f082a273-d019-4426-a608-646b4cdf608f', None, None, None, None, None), ('f082a273-d019-4426-a608-646b4cdf608f', None, None, None, None, None), ('c5b353fc-77f6-4a30-99b0-69d6a3002fb7', '10.2.2.100', None, None, None, None), ('c5b353fc-77f6-4a30-99b0-69d6a3002fb7', '10.2.2.200', None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:53:16.516680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Updating instance_info_cache with network_info: [] {{(pid=128779) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 27 01:53:17.099176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a86f4ab-6ac3-4850-bc23-63fbdc8d92bd tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 204 len: 0 microversion: 2.1 time: 4.361563 Sep 27 01:53:17.099767 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2496/5002] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:53:12 2022] DELETE /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 0 bytes in 4363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:53:17.112475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:17.118379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:17.129203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:17.131610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:17.132234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:17.134304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:17.135124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:17.137010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:17.649914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:17.666772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:17.668218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:17.669364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ceebb1a-e6ba-4fb9-8dd2-d89ae942904e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.566011 Sep 27 01:53:17.669940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2497/5003] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:17 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:17.687031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:17.687769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:17.695121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:17.698700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:17.699602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:17.702670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:17.703305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:17.703895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:17.764705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:17.840413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:17.935605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:17.956071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-526f2525-2a8c-433c-ad75-764e5ac9cb19 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 204 len: 0 microversion: 2.47 time: 0.273302 Sep 27 01:53:17.957169 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2498/5004] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:53:17 2022] DELETE /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:53:18.241797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c91e3c8-fd78-493f-ac29-2322c2c8e9ce", "name": "network-vif-deleted", "tag": "6c414df6-df54-488c-a1ab-3d91107d6123"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:18.252758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.253770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.254665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.275988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.server_external_events [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] Unable to find a host for instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce. Dropping event network-vif-deleted {{(pid=128779) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 27 01:53:18.276910 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1545c305-49cc-4eb2-891b-0b4fc1ee07a4 req-26a6549f-3eb5-4759-bf40-2bb4d26bcc09 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.317579 Sep 27 01:53:18.278247 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2499/5005] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 320 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 27 01:53:18.283783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:18.298286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.299154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.299808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.350055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] Creating event network-changed:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:53:18.361514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-af36b298-3a94-45e0-855b-c5486477a720 req-98ddbb03-4b1b-4aca-afed-1a7688d6bdd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081611 Sep 27 01:53:18.362524 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2500/5006] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:18.369353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:18.370335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:18.388919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.405323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.410167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.411762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.417275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.418272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.456655 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce HTTP/1.1 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2c91e3c8-fd78-493f-ac29-2322c2c8e9ce'} Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:18.461754 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. Sep 27 01:53:18.466622 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:18.468114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 404 to user: Instance 2c91e3c8-fd78-493f-ac29-2322c2c8e9ce could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:18.469149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28519f28-22db-4144-97a9-d992772aed42 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce" status: 404 len: 111 microversion: 2.1 time: 0.105314 Sep 27 01:53:18.470127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2501/5007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:18 2022] GET /compute/v2.1/servers/2c91e3c8-fd78-493f-ac29-2322c2c8e9ce => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:53:18.479956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:18.481106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:18.488606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.490007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.490454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.491171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.491631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.492061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.639383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:18.655564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:18.657066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:18.659818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a340d457-752d-4e97-8d35-a84ad8e44aaa tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1362 microversion: 2.47 time: 0.183791 Sep 27 01:53:18.662339 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2502/5008] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:18 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:18.668640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:18.669816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:18.680267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.681017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.686184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.686967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:18.687444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:18.687890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:18.754921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:18.985205 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dda55bcf-6f2a-43da-a3ac-404f4cb3009c tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 204 len: 0 microversion: 2.1 time: 0.320880 Sep 27 01:53:18.986655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2503/5009] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:53:18 2022] DELETE /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:53:18.994578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:18.995643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:19.003825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.004806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.005575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.006684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.007614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.008199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.144847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:19.446039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.454890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.456453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.458267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97d95768-322a-4182-90e2-e2ecc0c8adc1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.469455 Sep 27 01:53:19.458899 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2504/5010] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:18 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:19.463475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:19.464162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:19.470421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.470948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.471470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.472234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.472887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.473451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.607513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.622452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbdd1715-181f-4d97-8e5c-7f434c2cdba4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1465 microversion: 2.1 time: 0.162415 Sep 27 01:53:19.623977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2505/5011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:19 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:19.690590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:19.694782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:19.703248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.704139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.705013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.706650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:19.707378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:19.708277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:19.820810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.830034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.832061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:19.833654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c422a014-0c92-4773-850b-436dde02bc7b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1362 microversion: 2.47 time: 0.147052 Sep 27 01:53:19.837697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2506/5012] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:19 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:20.490201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:20.490974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:20.507675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:20.508686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:20.509500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:20.510474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:20.511213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:20.511939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:20.825977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:20.842604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:20.844907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:20.846141 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97eca355-6b3e-414a-9f44-267c6073052f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.360291 Sep 27 01:53:20.849203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2507/5013] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:20 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:20.873539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:20.874470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:20.884548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:20.885372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:20.886055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:20.887029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:20.887864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:20.890198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:21.113259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:21.130015 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-215ad23d-d34d-495c-bbfb-195d2e033716 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1465 microversion: 2.1 time: 0.275242 Sep 27 01:53:21.154853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2508/5014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:20 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1465 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:21.174611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:21.179427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:21.195403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:21.196395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:21.197065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:21.198417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:21.199567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:21.202272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:21.253243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:21.254464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:21.255635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:21.256542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lazy-loading 'fault' on Instance uuid 9844ee46-844e-44aa-a1d3-abafddabbb48 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:21.424388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:21.432879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:21.434682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:21.436132 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c17345bb-92f6-4a95-ac97-2bff47a55086 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 200 len: 1367 microversion: 2.47 time: 0.279269 Sep 27 01:53:21.436938 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2509/5015] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:21 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:21.876137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:21.877968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:21.891722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.340615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:22.350674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:22.352370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:22.356163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9c4c1f9-593c-4239-ab2f-f5300473b219 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.482661 Sep 27 01:53:22.356163 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2510/5016] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:21 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:22.361420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:22.362412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:22.370273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.370940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.371555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.372931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.374429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.375510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.574826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:22.588433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc07945d-30a6-45c6-b4d0-076cb03626b4 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1465 microversion: 2.1 time: 0.228737 Sep 27 01:53:22.589466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2511/5017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:22 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1465 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:22.614694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:22.615643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 9844ee46-844e-44aa-a1d3-abafddabbb48] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:22.623154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.625314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.626047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.627032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.627737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.628380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.645327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] HTTP exception thrown: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Request method failure captured: Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 HTTP/1.1 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMldO7T3kj76k7HvdFw8tpSUREt1T1mfW4R4ks37FAP66firJIJaHOMVLLv9a1Otm0Thq01KEzQpk0Y4tBG9J3H1ijunS4TTNxsL-qbm3kAmXw6PmT7kSSDb4gEGbEUrynlpEPLUwUvfYkOAjvoy4RdHcyTRnniBteHr5Vc_WgJOw9dU Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.47 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 038abb8189224e54af56c154932ee41f Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/038abb8189224e54af56c154932ee41f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/038abb8189224e54af56c154932ee41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/038abb8189224e54af56c154932ee41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_038abb8189224e54af56c154932ee41f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 038abb8189224e54af56c154932ee41f Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerShowV247Test-1471728738-project Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 688088e6b90046fcbaa0508403dea8d0 Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerShowV247Test-1471728738-project Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '9844ee46-844e-44aa-a1d3-abafddabbb48'} Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:22.647458 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. Sep 27 01:53:22.651378 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:22.654634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Returning 404 to user: Instance 9844ee46-844e-44aa-a1d3-abafddabbb48 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:22.656108 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3371e1fb-6fb3-45e6-a2b4-4d3eedbcde11 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48" status: 404 len: 111 microversion: 2.47 time: 0.052352 Sep 27 01:53:22.657256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2512/5018] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:22 2022] GET /compute/v2.1/servers/9844ee46-844e-44aa-a1d3-abafddabbb48 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:53:22.666869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:22.674125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:22.705135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.705519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.705962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.706760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.707143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.708089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.762613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:22.842577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:22.881795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2e102df-11dc-47e7-8fec-51a262204865 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 204 len: 0 microversion: 2.47 time: 0.218025 Sep 27 01:53:22.884468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2513/5019] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:53:22 2022] DELETE /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:53:22.893289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:22.902623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:22.917451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.918330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.919140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:22.920287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:22.921164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:22.922591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.144892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.159760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.164455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.170906 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a218ab81-2517-4809-a6b8-9ea990e27905 tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 200 len: 1362 microversion: 2.47 time: 0.282369 Sep 27 01:53:23.172067 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2514/5020] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:22 2022] GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:23.189557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b53d38-6e09-409d-b4d3-9cd1d15814c8", "name": "network-vif-deleted", "tag": "4b8c009b-74d1-475a-a45f-7d32bfb5662f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:23.221393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.222484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.225958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.259858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] Creating event network-vif-deleted:4b8c009b-74d1-475a-a45f-7d32bfb5662f for instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 on n-h1-859358-1 Sep 27 01:53:23.278134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-eecb2c46-b686-4c98-9547-1d09521a26b0 req-22e6fffe-af55-4023-aac3-b0568424e0c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104261 Sep 27 01:53:23.289154 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2515/5021] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:23.386616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:23.387363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:23.400954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.401484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.401927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.402658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.405961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.406492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.658557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.672192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.676091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.678554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-412cdbeb-b72e-419b-93a5-c40367336e71 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.296234 Sep 27 01:53:23.679814 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2516/5022] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:23 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:23.688234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:23.695126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:23.704966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.705624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.706164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.706987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.707562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.708118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.753065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:23.753404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:23.753844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:23.754943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lazy-loading 'fault' on Instance uuid 07b53d38-6e09-409d-b4d3-9cd1d15814c8 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:23.815191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:23.834613 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e392ce0-9404-4bbb-abf6-269105a6029b tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 200 len: 1304 microversion: 2.1 time: 0.143941 Sep 27 01:53:23.835394 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2517/5023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:23 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:24.070867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:53:24.072632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:53:24.073323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:53:24.073770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:53:24.074191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:53:24.087191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.087933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.092211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:24.093584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.094370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.095111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:24.128916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Getting quotas for project 4f67d35052374bdbbbd97d406009ba76. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:53:24.136094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Getting quotas for user 1c59bb9619964ae89c641404d974ed49 and project 4f67d35052374bdbbbd97d406009ba76. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:53:24.202166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:24.202780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:24.212250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.212744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.213181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:24.218121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.218656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.220572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:24.381824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:24.391750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:24.395892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:24.396741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:53:24.397129 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8550aec-0a40-4dbf-b6fc-700309c6a11e tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 200 len: 1362 microversion: 2.47 time: 0.199402 Sep 27 01:53:24.400729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='dc485fcf-7e58-48ba-9cb2-c827c010bc46',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e275b470-f5a8-4b23-a379-380c12f6ad76',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f3874d4-1d8e-42bb-a068-31ca5ff2a381',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:53:24.413118 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2518/5024] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:24 2022] GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:24.709319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:24.710066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:24.722359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.725918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.726740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:24.728477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:24.731348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:24.732067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.026339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a00aac17-6528-4dba-b56c-c41f43f1f126 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.105623 Sep 27 01:53:25.029695 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2507/5025] 10.222.0.52 () {62 vars in 1189 bytes} [Tue Sep 27 01:53:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 9111 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 01:53:25.042537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:25.043832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 07b53d38-6e09-409d-b4d3-9cd1d15814c8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:25.059269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.062600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.063394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.064491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.065879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.067074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.109627 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 HTTP/1.1 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '07b53d38-6e09-409d-b4d3-9cd1d15814c8'} Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:25.114492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. Sep 27 01:53:25.119062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:53:25.121634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 404 to user: Instance 07b53d38-6e09-409d-b4d3-9cd1d15814c8 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:25.122536 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3696948d-5d28-4ade-95af-716d2a57b27d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8" status: 404 len: 111 microversion: 2.1 time: 0.091337 Sep 27 01:53:25.123095 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2508/5026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:25 2022] GET /compute/v2.1/servers/07b53d38-6e09-409d-b4d3-9cd1d15814c8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:53:25.261168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.270940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.273667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.274889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-047721f1-8c32-4362-89da-5cf001baaeab tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.570045 Sep 27 01:53:25.275459 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2519/5027] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:24 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:25.294268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:25.295069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:25.401863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.412135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.421980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.424089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-269af9d1-0d48-4bfb-a47c-49f621edbe08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1283 microversion: 2.42 time: 0.137014 Sep 27 01:53:25.427149 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2520/5028] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:25 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:25.431858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "name": "network-vif-plugged", "status": "completed", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:25.440886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:25.444134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:25.452564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.453274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.453919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.472744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.479159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.479974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.483235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.483892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.485892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.493079 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] Creating event network-vif-plugged:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:53:25.505891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9f57fdf4-dd31-4e75-a6b5-2516786a0233 req-2d2febdc-1804-4a8b-a700-473544ee0fef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378703 Sep 27 01:53:25.510308 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2509/5029] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:25.515920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:25.526390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:25.543448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.544274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.544904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.545643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.546094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.546530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.556845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:25.613020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.613555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.614063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.614499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lazy-loading 'fault' on Instance uuid 8df1ead3-d42b-480d-b297-f0eb20d4fa8a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:25.691420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68ad5c6d-04e4-46a1-92a4-162349fa7cc7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 204 len: 0 microversion: 2.1 time: 0.260248 Sep 27 01:53:25.693363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2521/5030] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:53:25 2022] DELETE /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:53:25.705223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:25.705994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:25.718761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.719259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.719691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.720397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:25.720873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:25.721303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:25.777270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.785359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.800735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '688088e6b90046fcbaa0508403dea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038abb8189224e54af56c154932ee41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:25.802732 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1197b557-1db7-4878-b2f1-095e6ba0469b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 200 len: 1367 microversion: 2.47 time: 0.291121 Sep 27 01:53:25.803452 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2510/5031] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:25 2022] GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:26.169808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.185490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4e06fee-51fb-4acb-96d5-ee97aedaf6fa tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1508 microversion: 2.1 time: 0.487979 Sep 27 01:53:26.186200 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2522/5032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:25 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:26.303699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:26.304318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:26.313692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.314134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.315040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.315393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.316143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.316576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.452222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:26.453380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:26.461448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.462197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.462788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.463643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.464243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.464811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.554774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.565003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.566768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.568696 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-708a599a-5cfa-4a38-ab3c-42e5b85ac1f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1525 microversion: 2.42 time: 0.120574 Sep 27 01:53:26.587719 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2523/5033] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:26 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1525 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:26.751269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.785483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.791665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:26.793107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-43896841-8eec-4589-abd4-04a3166d299f tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1406 microversion: 2.20 time: 0.494554 Sep 27 01:53:26.795958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2511/5034] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:26 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:26.845399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:26.847675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] [instance: 8df1ead3-d42b-480d-b297-f0eb20d4fa8a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:26.866583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.867940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.868551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.869488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:26.870160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:26.871559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:26.910334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] HTTP exception thrown: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Request method failure captured: Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a HTTP/1.1 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMldO7T3kj76k7HvdFw8tpSUREt1T1mfW4R4ks37FAP66firJIJaHOMVLLv9a1Otm0Thq01KEzQpk0Y4tBG9J3H1ijunS4TTNxsL-qbm3kAmXw6PmT7kSSDb4gEGbEUrynlpEPLUwUvfYkOAjvoy4RdHcyTRnniBteHr5Vc_WgJOw9dU Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.47 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 038abb8189224e54af56c154932ee41f Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/038abb8189224e54af56c154932ee41f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/038abb8189224e54af56c154932ee41f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/038abb8189224e54af56c154932ee41f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_038abb8189224e54af56c154932ee41f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 038abb8189224e54af56c154932ee41f Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerShowV247Test-1471728738 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerShowV247Test-1471728738-project Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 688088e6b90046fcbaa0508403dea8d0 Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerShowV247Test-1471728738-project Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8df1ead3-d42b-480d-b297-f0eb20d4fa8a'} Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:26.914362 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. Sep 27 01:53:26.919884 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:26.921488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] Returning 404 to user: Instance 8df1ead3-d42b-480d-b297-f0eb20d4fa8a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:26.922551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d47e529-e8ca-47c9-8d18-7722830e4a1b tempest-ServerShowV247Test-1471728738 tempest-ServerShowV247Test-1471728738-project] 10.222.0.52 "GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a" status: 404 len: 111 microversion: 2.47 time: 0.091576 Sep 27 01:53:26.932667 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2524/5035] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:26 2022] GET /compute/v2.1/servers/8df1ead3-d42b-480d-b297-f0eb20d4fa8a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:53:27.208776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:27.209414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:27.223574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.226100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.226717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:27.229105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.229907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.234443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:27.595092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:27.596288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:27.611796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.612504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.613211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:27.617548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.618318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.618778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:27.735959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:27.757875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:27.759788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:27.761440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d03eab6-f16d-4747-a711-9b89f27c6608 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1573 microversion: 2.42 time: 0.170577 Sep 27 01:53:27.762830 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2525/5036] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:27 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:27.823250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:27.823934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:27.831357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.831912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.832405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:27.833119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:27.833598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:27.834032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:28.279042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.287911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.289855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.291034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed03b251-7e15-4528-88c3-980578e96ab7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1597 microversion: 2.20 time: 0.473158 Sep 27 01:53:28.306240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2526/5037] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:27 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1597 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:28.317881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:28.318361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:28.324660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:28.325763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:28.326204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:28.326909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:28.327361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:28.327782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:28.479086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-918b23e4-4281-43d3-a785-ba58d09ea5f8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165263 Sep 27 01:53:28.479711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2527/5038] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:53:28 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:53:28.795619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:28.797872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:28.807198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:28.812478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:28.813774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:28.815751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:28.817644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:28.819646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:28.856209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.866228 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-14ba7a12-dfaa-4d00-9029-bf04220bb4af tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1508 microversion: 2.1 time: 1.661837 Sep 27 01:53:28.870407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2512/5039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:27 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1508 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:28.955984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.973947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.978717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:28.981439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63dd8f70-690d-40a8-9137-24550fdb84f9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1591 microversion: 2.42 time: 0.193629 Sep 27 01:53:28.993320 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2528/5040] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:28 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1591 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:29.896278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:29.897420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:29.914174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:29.914686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:29.915126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:29.915851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:29.916308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:29.916738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:30.014012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:30.014704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:30.031744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:30.039283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:30.040579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:30.044055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:30.044715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:30.045363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:30.137478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:30.146411 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d451ba61-5ecd-4290-8663-0b8f234ffd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1466 microversion: 2.1 time: 0.256087 Sep 27 01:53:30.149618 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2513/5041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:29 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1466 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:30.579502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f12fea-0fc6-49a1-a5da-8797bf20488a", "name": "network-vif-deleted", "tag": "235094f6-340c-4193-9c40-e3cb818fc4bf"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:30.580897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:30.597364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:30.599802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:30.601253 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ae8b185-cb96-4d56-9db1-81040172b1ce tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1591 microversion: 2.42 time: 0.593744 Sep 27 01:53:30.614160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:30.614160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:30.614160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:30.615731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2529/5042] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:30 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1591 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:30.662716 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] Creating event network-vif-deleted:235094f6-340c-4193-9c40-e3cb818fc4bf for instance 24f12fea-0fc6-49a1-a5da-8797bf20488a on n-h2-859358-1 Sep 27 01:53:30.678771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-86d5c653-f15a-40fa-891b-a49e59ee4185 req-bc5ffcf6-4bc9-4ec6-861e-53baabd32d85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318837 Sep 27 01:53:30.680498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2514/5043] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:31.177461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:31.178085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:31.197209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:31.197821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:31.198205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:31.198953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:31.199408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:31.199845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:31.324140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:31.324651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:31.326280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:31.326759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lazy-loading 'fault' on Instance uuid 24f12fea-0fc6-49a1-a5da-8797bf20488a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:31.632556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:31.633326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:31.644343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:31.645722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:31.646171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:31.647565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:31.648196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:31.648635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:31.872840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:31.876796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:31.887732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f3463ac1-baca-4b09-a3c4-210191ef1010 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 200 len: 1304 microversion: 2.1 time: 0.714845 Sep 27 01:53:31.916754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:31.917321 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2530/5044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:31 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 1304 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:31.930831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:31.932624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:31.935230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ff4693a-7c7d-4e82-b51c-c72b05bd9a31 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1591 microversion: 2.42 time: 0.308017 Sep 27 01:53:31.950566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2515/5045] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:31 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1591 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:32.911513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:32.912128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 24f12fea-0fc6-49a1-a5da-8797bf20488a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:32.931585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:32.932321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:32.933028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:32.933935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:32.934735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:32.935351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:32.965421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:32.968136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:32.975470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a HTTP/1.1 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '24f12fea-0fc6-49a1-a5da-8797bf20488a'} Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:32.977030 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 404 to user: Instance 24f12fea-0fc6-49a1-a5da-8797bf20488a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:32.982024 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3873b1b1-7956-461e-8c13-4a4b013ed23d tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a" status: 404 len: 111 microversion: 2.1 time: 0.070982 Sep 27 01:53:32.986328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:32.986818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:32.987257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:32.987962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:32.988549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:32.988980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:32.997245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2531/5046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:32 2022] GET /compute/v2.1/servers/24f12fea-0fc6-49a1-a5da-8797bf20488a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:53:33.002101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:33.002597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:33.019118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:33.026063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:33.026510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:33.027260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:33.027713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:33.028139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:33.067347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:33.275247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:33.297682 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8b0d4d2-9d63-486f-a6b8-1259a587e674 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 204 len: 0 microversion: 2.1 time: 0.299007 Sep 27 01:53:33.298281 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2532/5047] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:53:32 2022] DELETE /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:53:33.307607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:33.311979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:33.325105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:33.325834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:33.328165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:33.329085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:33.329751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:33.334385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:34.107700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:34.145382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=16 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:34.175969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:34.195912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b913b82-ac14-4987-b2be-5d3d6526bd70 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1495 microversion: 2.1 time: 0.889644 Sep 27 01:53:34.209322 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2533/5048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:33 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1495 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:34.216954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:34.237325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:34.239430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:34.240970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:34.280499 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] Creating event network-changed:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:53:34.295440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-264957bb-aa1e-4975-b81a-fd650e0319cc req-2badfc85-c89f-4d9f-a892-7e0534c844fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094115 Sep 27 01:53:34.297420 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2534/5049] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:34.774969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:34.782837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:34.793229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:34.815237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:34.823203 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2e17f00-afc0-41cc-b04c-dedbdf5547f0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1659 microversion: 2.42 time: 1.858020 Sep 27 01:53:34.825178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2516/5050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:32 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1659 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:35.227698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:35.228477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:35.242949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:35.243454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:35.245384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:35.248873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:35.249937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:35.250394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:35.406900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:35.855085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:35.856383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:35.868753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:35.870408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:35.871043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:35.875085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:35.875831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:35.876535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:36.063864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:36.076709 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be4e01a7-5c5b-4ac4-9bea-3d46c823e9d9 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1495 microversion: 2.1 time: 0.856125 Sep 27 01:53:36.099134 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2535/5051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:35 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1495 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:36.742071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a39c788-af69-4e40-b24a-8fda7795f9ac", "name": "network-vif-deleted", "tag": "21e02012-d309-409f-b774-340ceefa8373"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:36.765098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:36.812546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:36.813028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:36.880713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] Creating event network-vif-deleted:21e02012-d309-409f-b774-340ceefa8373 for instance 3a39c788-af69-4e40-b24a-8fda7795f9ac on n-h2-859358-1 Sep 27 01:53:36.909546 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0d1e1002-7ee5-44de-8ce5-73c834b03846 req-725f5ba5-de0b-460d-ae93-a078a7accc61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167921 Sep 27 01:53:36.912300 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2536/5052] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:53:37.101053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:37.101798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:37.140590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:37.141089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:37.145010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:37.146112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:37.146814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:37.147476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:37.227575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:37.229522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:37.231627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:37.232403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lazy-loading 'fault' on Instance uuid 3a39c788-af69-4e40-b24a-8fda7795f9ac {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:53:37.603617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:37.623856 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b804b58-a174-4076-9746-a2b5ead59331 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 200 len: 1305 microversion: 2.1 time: 0.525000 Sep 27 01:53:37.628000 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2537/5053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:37 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 1305 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:37.712929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:37.743057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:37.744683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:37.746082 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e9128a11-d4a2-4a0f-b29a-e32f86ccedff tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1706 microversion: 2.42 time: 1.894820 Sep 27 01:53:37.746993 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2517/5054] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:35 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1706 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:38.651860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:38.653125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: 3a39c788-af69-4e40-b24a-8fda7795f9ac] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:38.669003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.669833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.674028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.675072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.675826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.676699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.712515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac HTTP/1.1 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3a39c788-af69-4e40-b24a-8fda7795f9ac'} Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:38.718221 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. Sep 27 01:53:38.725479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:38.728848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 404 to user: Instance 3a39c788-af69-4e40-b24a-8fda7795f9ac could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:38.733161 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b760bb7-1734-466b-9257-fcb9517973b3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac" status: 404 len: 111 microversion: 2.1 time: 0.086344 Sep 27 01:53:38.734000 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2538/5055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:38 2022] GET /compute/v2.1/servers/3a39c788-af69-4e40-b24a-8fda7795f9ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:53:38.742676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:38.743259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:38.756590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.758418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.758989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.762630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.763270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.763905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.781700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:38.782681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:38.795257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.798002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.798946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.799857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:38.802453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:38.803981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:38.851610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:53:39.086371 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2473f3d3-ff6b-4c2f-ab1c-726fbea1c2f2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 204 len: 0 microversion: 2.1 time: 0.347082 Sep 27 01:53:39.087455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2518/5056] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:53:38 2022] DELETE /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:53:39.095987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:39.101593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:39.123525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:39.125312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:39.131661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:39.133568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:39.136485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:39.137145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:39.567884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:39.580754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:39.587209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:39.591394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09fd0d3d-abc8-48f0-84e3-c5bbfbffd859 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1706 microversion: 2.42 time: 0.814496 Sep 27 01:53:39.594162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2539/5057] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:38 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1706 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:40.412936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:40.428678 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2dd1ec48-1d12-4d82-b9f0-d3b8db169bb7 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1675 microversion: 2.1 time: 1.336751 Sep 27 01:53:40.432154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2519/5058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:39 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1675 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:40.627560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:40.629659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:40.642148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:40.642944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:40.649541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:40.650692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:40.651423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:40.652029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:41.458506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:41.460014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:41.470926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:41.477481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:41.480310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:41.482869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:41.487647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:41.488917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:41.641626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:41.675360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:41.680856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:41.685897 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3edd8c4a-4827-43a8-8aeb-b79a5d7f8af2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1753 microversion: 2.42 time: 1.060238 Sep 27 01:53:41.699342 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2540/5059] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:40 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1753 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:42.714546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:42.715207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:42.727910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:42.730753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:42.731788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:42.733851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:42.734717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:42.738090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:43.350577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:43.369237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:43.371058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:43.378185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3283f3d7-d45a-4c1d-9ec3-ca8af8b000d3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1753 microversion: 2.42 time: 0.662397 Sep 27 01:53:43.381437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2541/5060] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:42 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1753 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:53:44.192893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2023947831", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:44.293188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:53:44.759031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:44.777908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aee9364e-68e6-4ced-bc0d-cab948d0340a tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1675 microversion: 2.1 time: 3.323645 Sep 27 01:53:44.778502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2520/5061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:41 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1675 bytes in 3325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:44.810681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:44.810936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:44.825609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:44.837939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:44.838437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:44.838875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:44.842492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:44.845006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:44.845507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:45.220794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:53:45.221851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:53:45.222550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:53:45.223122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:53:45.223718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:53:45.237644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:45.240495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:45.242879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:45.245474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:45.246158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:45.246761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:45.300933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:53:45.319709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:53:45.360762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:53:45.366964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:53:45.442863 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4f757b0-5d9b-47a9-aa9e-b9236c3d9e29 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509579 Sep 27 01:53:45.453609 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2542/5062] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:53:45.468846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7404d1e3-e1ca-4bda-b15a-90827dfd7376 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:45.469740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7404d1e3-e1ca-4bda-b15a-90827dfd7376 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:45.539741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7404d1e3-e1ca-4bda-b15a-90827dfd7376 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:45.550926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7404d1e3-e1ca-4bda-b15a-90827dfd7376 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1193 microversion: 2.1 time: 0.094349 Sep 27 01:53:45.551891 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2543/5063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:45 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:45.811917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:45.811917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:45.827926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:45.828362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:45.828807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:45.829566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:45.830030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:45.830462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:45.998481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:46.008569 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-214bde0d-f5d1-4bc4-a3f6-632451fe2ae3 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1608 microversion: 2.1 time: 0.204454 Sep 27 01:53:46.011789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2544/5064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:45 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1608 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:46.570836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:46.583971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:46.584783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:46.616178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:46.618815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:46.619276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:46.620038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:46.620501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:46.620839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:46.620972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:46.630653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:46.632301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3791b81-507a-47a8-a683-22ea6c49b364 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1753 microversion: 2.42 time: 1.852737 Sep 27 01:53:46.633752 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2521/5065] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:44 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1753 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:46.835358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:46.851445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-802055ba-e19d-46d7-929a-40bd7a96535b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1189 microversion: 2.1 time: 0.278048 Sep 27 01:53:46.852576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2545/5066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:46 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1189 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:46.977096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f957b2c4-cf5f-454f-b71a-66d7bdc01340", "name": "network-vif-deleted", "tag": "c07c6e61-a64a-44e2-9f6b-e1614c490062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:53:47.039442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:47.040460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:47.046426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.048713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.052073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.053199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.053722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.054159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.054872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.055326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.055758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.118754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] Creating event network-vif-deleted:c07c6e61-a64a-44e2-9f6b-e1614c490062 for instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 on n-h1-859358-1 Sep 27 01:53:47.136122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-23ca8203-299b-4ae2-9549-b9b8d0355de5 req-c524b760-644f-4d1f-9270-bd970920dd26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161985 Sep 27 01:53:47.164482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2522/5067] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:53:47.316134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fecdf5face2426cb4fc1c97b6632e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7334a772e20e4fa6ac6bc5ee87a4c050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:47.334246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0cecbfe-b533-41ea-bb6c-8a1cda0453e2 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 200 len: 1608 microversion: 2.1 time: 0.296826 Sep 27 01:53:47.336671 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2546/5068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:47 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 1608 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:47.666347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:47.667579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:47.695421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.701504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.702108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.704794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.705273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.706076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.893931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:47.900835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:47.919256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.924290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.924882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:47.925884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:47.926446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:47.926969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:48.086338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:48.097756 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29f455d9-6a76-4f20-bb92-cd8ecf82327f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1253 microversion: 2.1 time: 0.221394 Sep 27 01:53:48.117508 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2547/5069] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:47 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1253 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:48.363757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:48.364898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] [instance: f957b2c4-cf5f-454f-b71a-66d7bdc01340] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:48.397008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:48.403390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:48.404150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:48.406029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:48.411524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:48.412285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:48.476806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] HTTP exception thrown: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Request method failure captured: Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 HTTP/1.1 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlVcJrPLFtdNVmrx8ttn2U7MWlEsjzmE3-QPa61-pqIWmPnpIuLluA7X1JJL4uxuI5d06t-Mpl_NGnuWCAdOHr7994Q_rVIFapU1XLXIpZ7hGEhw8oWpv9DvYgAQI64-ht_I6pTYlDWzq7dasLI7BBYan0J6dSzlKP8tcROotjv0Xaw Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7334a772e20e4fa6ac6bc5ee87a4c050"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7334a772e20e4fa6ac6bc5ee87a4c050", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 7334a772e20e4fa6ac6bc5ee87a4c050 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-1799092881 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9fecdf5face2426cb4fc1c97b6632e76 Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-1799092881-project Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f957b2c4-cf5f-454f-b71a-66d7bdc01340'} Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:53:48.479065 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. Sep 27 01:53:48.483008 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:53:48.484766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Returning 404 to user: Instance f957b2c4-cf5f-454f-b71a-66d7bdc01340 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:53:48.485909 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12dc6aa7-4874-496e-ae42-b0bb79346bb0 tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340" status: 404 len: 111 microversion: 2.1 time: 0.127443 Sep 27 01:53:48.493798 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2548/5070] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:48 2022] GET /compute/v2.1/servers/f957b2c4-cf5f-454f-b71a-66d7bdc01340 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:53:48.498783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4dc6c374-2f60-40e2-a69a-7d1c1f458baf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] Calling method '.version_select at 0x7f24d58c5c10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:48.542403 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4dc6c374-2f60-40e2-a69a-7d1c1f458baf tempest-ServerActionsTestJSON-1799092881 tempest-ServerActionsTestJSON-1799092881-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944148951" status: 202 len: 0 microversion: 2.1 time: 0.047015 Sep 27 01:53:48.543288 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2549/5071] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 01:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944148951 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:53:48.886707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:48.898548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:48.899994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:48.901176 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4dd4458b-530e-4725-8d49-75ba653b92ed tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1800 microversion: 2.42 time: 1.241360 Sep 27 01:53:48.919452 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2523/5072] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:47 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1800 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:49.137800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:49.139031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:49.170841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:49.171693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:49.172960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:49.173949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:49.174625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:49.175325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:49.491446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:49.504376 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7575336f-0d7d-4ebf-996a-56a8d22b562e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1251 microversion: 2.1 time: 0.369789 Sep 27 01:53:49.505238 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2550/5073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:49 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1251 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:49.945203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:49.945982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:49.955669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:49.970180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:49.971060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:49.972397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:49.973851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:49.974508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:50.537073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:50.537073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:50.557545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:50.558032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:50.559543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:50.564054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:50.564540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:50.564977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:50.624822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:50.642276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:50.642974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:50.646098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:50.647288 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a240384-54ff-4961-a672-40d304c08a76 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1800 microversion: 2.42 time: 0.707249 Sep 27 01:53:50.669991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2524/5074] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:49 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1800 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:50.754443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:50.778378 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd641443-6064-4674-8619-44f48afd3fab tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1251 microversion: 2.1 time: 0.251478 Sep 27 01:53:50.781879 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2551/5075] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:50 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1251 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:51.687143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:51.687742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:51.707745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:51.708240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:51.708770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:51.711904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:51.712570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:51.713177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:51.808542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:51.809818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:51.819894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:51.824935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:51.825612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:51.826644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:51.832011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:51.832678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:51.991281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:52.000394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09b2c6fb-60b6-45b5-a48e-1b548223b329 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1251 microversion: 2.1 time: 0.195858 Sep 27 01:53:52.006592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2552/5076] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:51 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1251 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:53.033033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:53.033691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:53.049417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:53.050431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:53.050889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:53.051618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:53.054588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:53.055086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:53.424975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:53.437577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:53.440445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:53.442562 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25bed46f-1b53-4357-8bda-6c430dc73a97 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1800 microversion: 2.42 time: 1.759775 Sep 27 01:53:53.443276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2525/5077] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:51 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1800 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:53.892274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:53.906761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2d4855a-7f11-4c3d-a5ac-27e71a1a90aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.878321 Sep 27 01:53:53.910339 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2553/5078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:53 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:53:54.472532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:54.473710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:54.483684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:54.491878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:54.492677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:54.493688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:54.494382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:54.495033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:54.979977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:54.981669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:55.025656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:55.026131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:55.026579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:55.035500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:55.036061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:55.036559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:55.271517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:55.544785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:53:55.758679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:55.771785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23f9aae7-b937-4bbf-91c6-4a14234e50aa tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.812666 Sep 27 01:53:55.774405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2554/5079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:54 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:55.836272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:55.871699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:55.885982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:55.898738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d8dadc9-8a24-4917-a427-7922cdd56c94 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1847 microversion: 2.42 time: 1.425132 Sep 27 01:53:55.906415 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2526/5080] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:54 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1847 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:56.801665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:56.802297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:56.815274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:56.816299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:56.816765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:56.834529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:56.834529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:56.834529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:56.933286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:56.934102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:56.954088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:56.957370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:56.958160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:56.964730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:56.966659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:56.966659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:58.876507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:58.898767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:58.903787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:58.918319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af748c79-6374-4804-901f-377580587d13 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1847 microversion: 2.42 time: 1.989250 Sep 27 01:53:58.922427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2527/5081] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:56 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1847 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:53:59.232815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:53:59.245805 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7077d316-acf7-4a22-8ee8-e4717ad80f08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 2.449369 Sep 27 01:53:59.250275 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2555/5082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:53:56 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:53:59.954926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:53:59.971336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:53:59.982771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:59.983593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:59.984221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:53:59.986506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:53:59.988263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:53:59.990782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:00.243076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29bf3a9-78d7-4018-9a49-a2daab68a24e", "tag": "c3322fa5-0abd-467a-9c00-5115bd2f8d55"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:00.294666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:00.296075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:00.298975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:00.362457 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] Creating event network-changed:c3322fa5-0abd-467a-9c00-5115bd2f8d55 for instance b29bf3a9-78d7-4018-9a49-a2daab68a24e on n-h2-859358-1 Sep 27 01:54:00.374622 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a1c130f2-e88c-49bb-9b3e-f7da10bec7aa req-d026437a-c917-46e4-bc7b-cf86c54eea91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138905 Sep 27 01:54:00.386588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2556/5083] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:00.411491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:00.412332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:00.420561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:00.421212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:00.421778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:00.422783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:00.423353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:00.424031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:01.242090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:01.277376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:01.282423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:01.295146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13108efd-582f-4235-baf8-5d650e0fa558 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1835 microversion: 2.42 time: 1.344316 Sep 27 01:54:01.298322 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2528/5084] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:53:59 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1835 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:01.323168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:01.325101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:01.325629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:01.346473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2bfd106-a1d2-4bc6-9728-98d3312041a3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.958338 Sep 27 01:54:01.347584 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2557/5085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:00 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:01.394632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:01.395625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:01.396100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:01.396832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:01.403601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:01.404142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:01.499673 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-54d521a1-75e7-40ca-847c-54393a0503cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/ips" status: 200 len: 151 microversion: 2.20 time: 0.200233 Sep 27 01:54:01.502578 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2529/5086] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Sep 27 01:54:01 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/ips => generated 151 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:54:02.330839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:02.331925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:02.340857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:02.341729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:02.345185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:02.349137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:02.349137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:02.349137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:02.382049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:02.383359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:02.418484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:02.419203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:02.420467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:02.421203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:02.421688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:02.422108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:03.236390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:03.250233 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7050a6f6-fa13-411d-a9fd-2a7de0c2600b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.874478 Sep 27 01:54:03.251108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2530/5087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:02 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:03.265123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "00d3fb02-c4c7-4018-8f37-2aaef4236ae6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:03.281177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:03.282044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:03.282635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:03.309876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] Creating event network-changed:00d3fb02-c4c7-4018-8f37-2aaef4236ae6 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:03.318515 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1941f4ac-28eb-4126-aa56-f0eb149e7103 req-37fd801b-ec2e-46fc-9f2d-6377e43b1bb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066102 Sep 27 01:54:03.320397 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2531/5088] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:03.479556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:03.498661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:03.504526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:03.508115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74a8862b-9d59-405a-a2c0-4811e709772a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1835 microversion: 2.42 time: 1.180472 Sep 27 01:54:03.510174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2558/5089] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:02 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1835 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:04.275650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:04.276354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:04.292914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.293470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.293918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.294663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.295103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.295523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.537708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:04.538370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:04.547903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:04.551416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.552085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.553507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.554467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.555137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.556101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.873657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:04.885065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-81037a99-e78d-44d4-950b-5cedd2732a4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.615239 Sep 27 01:54:04.904643 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2532/5090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:04 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:04.911449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:04.912012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:04.919636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.920284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.921171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.921932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:04.922398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:04.922885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:04.960313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:04.980369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lazy-loading 'flavor' on Instance uuid f6e68e01-ef21-4703-b3bd-0a21b1a7e073 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:54:05.147397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:05.165707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:05.170415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:05.173733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4401d9c-6729-4a9c-8d39-cfbca7a0fc2f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1856 microversion: 2.42 time: 0.639764 Sep 27 01:54:05.176724 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2559/5091] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:04 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1856 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:05.473590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "c1b74e3f-ff04-4311-849d-af8536d9d1ed"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:05.514904 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ee8054b-60c5-424f-ab1a-ea408341401c tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/action" status: 202 len: 0 microversion: 2.20 time: 0.603298 Sep 27 01:54:05.516190 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2533/5092] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:54:04 2022] POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:54:05.528321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:05.540349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:05.549443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:05.550840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:05.552024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:05.563290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:05.564928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:05.566877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:05.572273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:05.573382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:05.576267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:05.596076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] Creating event network-changed:c1b74e3f-ff04-4311-849d-af8536d9d1ed for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:05.605796 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4547132f-b910-4861-8875-7a8189fe78b8 req-acb86f47-52e5-4142-b68e-f6c9790dbeef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136467 Sep 27 01:54:05.611000 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2560/5093] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:54:05.919597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:05.920533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:05.941253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:05.941799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:05.942252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:05.949626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:05.950142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:05.950602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:06.564643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:06.587428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:06.587428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:06.587428 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24ce1c90-2c92-4424-b7a9-887ee2a93527 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 1.059049 Sep 27 01:54:06.587428 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2534/5094] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:05 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:06.595730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:06.597995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:06.626747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:06.627252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:06.627728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:06.628454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:06.633442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:06.634010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:06.988843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:06.997167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fe6c6d4-302e-4c16-9214-7559a874b3d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 1.083041 Sep 27 01:54:07.005958 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2561/5095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:05 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:07.612028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:07.612916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:07.632302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:07.633108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:07.633791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:07.634686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:07.635437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:07.636038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:07.739880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:07.781434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:07.790162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:07.792375 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62504aef-29ac-488a-9758-5b0e76edd249 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1856 microversion: 2.42 time: 1.205473 Sep 27 01:54:07.792961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2535/5096] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:06 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1856 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:08.029655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:08.030273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:08.046044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:08.046887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:08.047531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:08.048730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:08.049405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:08.050568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:08.280842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:08.294142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:08.300993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:08.306988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f31c9929-d4a1-498b-bb1d-f576864468ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.698497 Sep 27 01:54:08.307880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2562/5097] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:07 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:08.488850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "5953da3c-c32e-4866-9b77-afd7b6c69d89"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:08.502916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:08.509143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:08.510638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:08.513101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:08.518075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e06902e-3597-4dd8-80e6-2720670be136 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.490938 Sep 27 01:54:08.519850 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2536/5098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:08 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:08.541407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] Creating event network-changed:5953da3c-c32e-4866-9b77-afd7b6c69d89 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:08.556911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8a743c3f-b072-4e13-8a37-029198c2a0a7 req-65ccf321-e8e8-4137-891a-8261b18d48cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071822 Sep 27 01:54:08.558162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2563/5099] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:08.825772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:08.827360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:08.858072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:08.859161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:08.862277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:08.863680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:08.865200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:08.866150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:09.339402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:09.340214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:09.359597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:09.360085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:09.360519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:09.361439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:09.361814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:09.362276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:09.720158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.744386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.752457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.759752 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-21c77989-0b44-4782-9e20-ebdb49bcb6cf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.934517 Sep 27 01:54:09.777363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2537/5100] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:08 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:09.790881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:09.791481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:09.806754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:09.807273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:09.807709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:09.812958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:09.814497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:09.817630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:09.902456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.912789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.933284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:09.935804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4b4eae0-fa3d-49e3-a360-832c9d55db68 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.601623 Sep 27 01:54:09.936438 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2564/5101] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:09 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:10.411636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:10.423295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4de363b0-a523-4cb9-8482-4bfd3516f0bc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.650371 Sep 27 01:54:10.423997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2538/5102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:09 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:10.793881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:10.794500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:10.805009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:10.805534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:10.805970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:10.806681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:10.807133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:10.807556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:10.909567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Calling method '.version_select at 0x7f24d5f99820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:10.915338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:10.917961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:10.919221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:10.957981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:10.971144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:10.974003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.003832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.004434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.005265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.017517 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7603f0fb-382c-44e5-99ac-35a2a4648171 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1618806893-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.561105 Sep 27 01:54:11.022062 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2565/5103] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 01:54:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:11.039369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:11.040617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:11.052137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.053093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.059270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.060093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.060685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.061130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.432585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.500399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.505465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.520678 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-08b542dd-1c1e-45d3-a8b9-e308b274d0bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.727658 Sep 27 01:54:11.527454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2539/5104] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:10 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:11.546590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:11.556983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:11.603378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.603958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.605854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.608825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.609326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.617996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.772955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.787080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.791195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:11.795725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7b98032-1960-466b-89e0-e87e850c7cfb tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.772235 Sep 27 01:54:11.799268 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2566/5105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:11 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:11.813453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "1de62522-b15b-4657-84dc-1a13fc8b611e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:11.839850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:11.840785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:11.842837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:11.869408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] Creating event network-changed:1de62522-b15b-4657-84dc-1a13fc8b611e for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:11.877818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4e0625ba-df1d-4bc3-b25d-569b5129b389 req-5334c393-893b-4822-b5c5-275d49dd97e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075331 Sep 27 01:54:11.879210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2567/5106] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:12.231305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29bf3a9-78d7-4018-9a49-a2daab68a24e", "name": "network-vif-plugged", "status": "completed", "tag": "c3322fa5-0abd-467a-9c00-5115bd2f8d55"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:12.256921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:12.257708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:12.258335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:12.286598 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] Creating event network-vif-plugged:c3322fa5-0abd-467a-9c00-5115bd2f8d55 for instance b29bf3a9-78d7-4018-9a49-a2daab68a24e on n-h2-859358-1 Sep 27 01:54:12.298942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-21f37a05-c07d-47b7-b335-b41e17646f69 req-330501dc-747c-428a-9356-178212798c32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073028 Sep 27 01:54:12.300783 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2568/5107] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:54:12.557688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:12.559104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:12.567918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:12.569922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:12.570567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:12.571494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:12.572250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:12.572973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:12.813941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:12.826976 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-568ed666-9af2-408b-8906-ae280866ee0f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 1.296489 Sep 27 01:54:12.843861 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2540/5108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:11 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:13.162600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:13.163507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:13.179582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:13.181171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:13.183804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:13.186641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:13.187893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:13.191224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:13.566162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.583841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.585314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.586532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa940efa-331a-45c8-8e27-5256d1f5e6b8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.036023 Sep 27 01:54:13.588378 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2569/5109] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:12 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:13.852672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:13.853287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:13.856492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.872077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.876285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:13.887999 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-556a347a-b569-4a76-ba9b-8443a4b664f9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 1.053033 Sep 27 01:54:13.891094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2541/5110] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:12 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:13.901110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:13.907507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:13.909857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:13.915021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:13.918676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:13.919227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:14.621621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:14.622292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:14.640450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:14.643480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:14.643927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:14.644655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:14.645109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:14.645569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:14.689725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:14.708154 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-acecd193-3430-4755-88ad-e6b96de22fdc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1293 microversion: 2.1 time: 0.858055 Sep 27 01:54:14.725742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2570/5111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:13 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1293 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:14.909735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "35dc0dda-3e60-4cb9-b279-cbc928d166a3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:14.931743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:14.933912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:14.936644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:14.966765 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] Creating event network-changed:35dc0dda-3e60-4cb9-b279-cbc928d166a3 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:14.981804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a976775b-0c90-491f-897f-1a02abbb54a6 req-c24022b8-ff8d-4b47-912b-88055944bc85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076210 Sep 27 01:54:14.985542 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2571/5112] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:54:15.005288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:15.008630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:15.024328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:15.026224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:15.027912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:15.029891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:15.030977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:15.032455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:15.048181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:15.671276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.689037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.698657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.707094 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-057d3bae-7517-4266-bc71-bfb0e370ef33 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.718704 Sep 27 01:54:15.708017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2572/5113] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:14 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:15.732120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:15.733446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:15.749885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:15.750765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:15.751444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:15.752932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:15.753689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:15.754382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:15.811640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.846509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.848075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:15.850768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1b9584f-3586-4703-a3eb-3432afb8546f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.233745 Sep 27 01:54:15.853982 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2542/5114] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:14 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:16.734782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:16.735829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:16.751545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=44 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:16.757683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:16.758921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:16.760030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:16.767225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:16.769400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:16.770093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:16.954586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:16.972765 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88266a42-2ac4-4be4-bb18-dbf2b93f227a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1474 microversion: 2.1 time: 1.244407 Sep 27 01:54:16.977583 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2573/5115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:15 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1474 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:16.993453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:16.994430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:17.004011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:17.014351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:17.017453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:17.019155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:17.021934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:17.023800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:17.793647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:17.811978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:17.814172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:17.829759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93016923-4c03-4abe-b68a-75b184e842a7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 1.100264 Sep 27 01:54:17.831821 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2543/5116] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:16 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:17.863606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2101017259", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:18.023955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:54:18.323935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:18.347216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:18.352693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:18.354309 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-914db5fc-9a19-4a8b-8338-aa093def4d84 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.375155 Sep 27 01:54:18.357174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2574/5117] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:16 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:18.863175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:18.864089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:18.881407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:18.885596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:18.885596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:18.889261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:18.893929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:18.896016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:19.692151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:54:19.692722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:54:19.693045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:54:19.693843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:54:19.694269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:54:19.711601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:19.712098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:19.712542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:19.713284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:19.721991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:19.723222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:19.784952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:54:19.791988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:54:19.807189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:54:19.809938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:54:19.898293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1b24e57-5bc5-41af-9892-4dd4aba5c9d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064868 Sep 27 01:54:19.905819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2544/5118] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:54:19.912819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "711dafac-41e8-42d7-bfa7-2290cf11b3b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:19.936836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:19.938876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:19.940633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:19.981737 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] Creating event network-changed:711dafac-41e8-42d7-bfa7-2290cf11b3b4 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:19.996974 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4db9c825-08d2-48e2-9e66-67c72a078f0f req-703c51c1-d567-4c3e-b444-e62cd1934fdb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089280 Sep 27 01:54:20.000372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2545/5119] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:20.016751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:20.027484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:20.070931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:20.071444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:20.077521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:20.078763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:20.080798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:20.083280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:20.452818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.461299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.462762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.473981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99f1f3f4-3b0c-4f71-a4cd-a4f69a1fd3c5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 1.605360 Sep 27 01:54:20.474671 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2575/5120] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:18 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:20.479966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d45246c7-b8a1-4979-ad53-58c4f7aada93 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:20.480460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d45246c7-b8a1-4979-ad53-58c4f7aada93 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:20.547601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d45246c7-b8a1-4979-ad53-58c4f7aada93 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:54:20.914890 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.scheduler.client.report [None req-d45246c7-b8a1-4979-ad53-58c4f7aada93 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Deleted allocations for instance 157ef778-17ff-4aec-8f8c-5cb54188b68a Sep 27 01:54:20.915195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.925978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.935274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:20.936738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ed567db-f1f5-4665-a0d8-2ebf530ed820 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.935020 Sep 27 01:54:20.947743 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d45246c7-b8a1-4979-ad53-58c4f7aada93 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a" status: 204 len: 0 microversion: 2.1 time: 0.471322 Sep 27 01:54:20.951527 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2546/5122] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:20 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:20.957225 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2576/5122] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:54:20 2022] DELETE /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:54:20.957906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:20.958519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:20.969645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:20.970135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:20.970572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:20.971820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:20.972275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:20.972682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:21.197147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:21.211458 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa373f5d-c1de-471f-b2ea-25999837f3ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a" status: 200 len: 1213 microversion: 2.1 time: 0.257803 Sep 27 01:54:21.212806 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2547/5123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:20 2022] GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a => generated 1213 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:21.501964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:21.502806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:21.516185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:21.520375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:21.521413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:21.522536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:21.523231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:21.525920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:21.980131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:21.983412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:21.996915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:21.998059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:21.998883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:22.000609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:22.001600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:22.003503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:22.276861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:22.331521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:22.334554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:22.339727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d6c9a88-a5c3-418e-8bc1-3bd6e89f6248 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1743 microversion: 2.20 time: 0.839066 Sep 27 01:54:22.349567 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2577/5124] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:21 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1743 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:22.360507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:22.362974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:22.375223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:22.375961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:22.376633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:22.377985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:22.378685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:22.379290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:22.401105 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a HTTP/1.1 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '157ef778-17ff-4aec-8f8c-5cb54188b68a'} Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:54:22.403804 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:54:22.408958 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f76c1a09-a043-4599-87ad-fab0279689dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a" status: 404 len: 111 microversion: 2.1 time: 0.054168 Sep 27 01:54:22.417716 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2578/5125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:22 2022] GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:54:22.587361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1611843650", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:22.677947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:54:23.088091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:23.129936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:23.131386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:23.150487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec48c2fd-0010-46f5-84cf-e1f3039ac885 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.158962 Sep 27 01:54:23.151166 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2548/5126] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:21 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:23.176257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "98bff643-583e-47f2-8c2a-3e69937b15d1"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:23.227671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:23.233038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:23.233542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:23.298580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] Creating event network-changed:98bff643-583e-47f2-8c2a-3e69937b15d1 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:54:23.312788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-428e4ed9-4659-48aa-841c-b4ffddb88da3 req-55b55122-ab54-424e-a9c8-49059efd49d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157808 Sep 27 01:54:23.314133 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2549/5127] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:23.369380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:23.370572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:23.383998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:23.387615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:23.388995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:23.389995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:23.390692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:23.393663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:23.404475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:24.227608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:54:24.228625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:54:24.229405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:54:24.230041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:54:24.230703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:54:24.246574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:24.247303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:24.249021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:24.254498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:24.255224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:24.256322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:24.257647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:24.270022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:24.274194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:24.283978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c63c993-e563-47ea-8577-f844e71b23e6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.917657 Sep 27 01:54:24.362158 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2550/5128] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:23 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:24.367941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:24.369308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:54:24.382339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:24.384302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:54:24.414114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:24.422135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:24.422952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:24.423983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:24.424670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:24.426359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:24.454911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:54:24.464180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:54:24.642694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcf6206e-fe32-4123-a095-bf4b94170866 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.061127 Sep 27 01:54:24.651139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2579/5129] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:54:24.664619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c5c6c83-5413-478b-bd05-43957aa2a894 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:24.674390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c5c6c83-5413-478b-bd05-43957aa2a894 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:25.398460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c5c6c83-5413-478b-bd05-43957aa2a894 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:25.423093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c5c6c83-5413-478b-bd05-43957aa2a894 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1221 microversion: 2.1 time: 0.763961 Sep 27 01:54:25.423996 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2580/5130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:24 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1221 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:25.430441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:25.432761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:25.446463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:25.451618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:25.452886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:25.453926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:25.454567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:25.455817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:25.563778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:25.585414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:25.592519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:25.598100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b4d58d12-1ab7-4ce1-9a5c-d4193c5a0cc1 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.233396 Sep 27 01:54:25.615482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2551/5131] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:24 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:26.450662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:26.451587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:26.463429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:26.470195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:26.474693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:26.480468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:26.481140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:26.481633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:27.193679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.212802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.218997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.238235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9aa7935-200f-48ae-bd8d-5891b597eb82 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 1.805501 Sep 27 01:54:27.240437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2581/5132] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:25 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:27.260459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:27.265267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:27.299951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:27.300431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:27.300892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:27.301813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:27.302283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:27.302718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:27.601278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.618118 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab6beb70-5e11-4f79-9edc-fb382f008810 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1273 microversion: 2.1 time: 1.168738 Sep 27 01:54:27.619498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2552/5133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:26 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1273 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:27.636922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "name": "network-vif-plugged", "status": "completed", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:27.663170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:27.672794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:27.679487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:27.711491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] Creating event network-vif-plugged:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:54:27.732363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e911a1d3-1eba-449d-b57b-0cda1530f38d req-8d7a373c-a159-4820-9fa5-7e61f75a7fe3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111398 Sep 27 01:54:27.732989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2553/5134] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:27.808255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.831389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.839388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:27.840464 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8bd98b4-41d6-40fc-87d2-3a8163b2ca02 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.598077 Sep 27 01:54:27.863451 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2582/5135] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:27 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:28.269727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:28.270441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:28.292984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:28.300202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:28.300669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:28.306770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:28.321634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:28.323225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:28.644314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:28.646367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:28.655897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:28.658388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:28.659298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:28.666706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:28.670599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:28.674457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:29.204679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:29.218134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-537fe459-2fe3-4ab0-831f-f1ce03490c8d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1279 microversion: 2.1 time: 0.578874 Sep 27 01:54:29.221490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2583/5136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:28 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1279 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:29.232781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:29.233829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:29.256081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:29.260185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:29.262004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:29.268112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:29.269601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:29.275778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:29.761998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:29.800020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:29.845120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:29.867645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:29.880141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:29.889835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c21ab860-4339-4aee-be81-14d6f52954ea tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 1.623443 Sep 27 01:54:29.890691 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2554/5137] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:28 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:30.121929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:30.152596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:30.162085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:30.164766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25e8f037-8e4d-476f-905a-c9ce3776d9e0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.941856 Sep 27 01:54:30.168096 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2584/5138] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:29 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:30.245986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:30.246814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:30.263095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:30.266884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:30.269486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:30.277092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:30.287411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:30.289278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:30.672240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-223995201", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "059e0d30-98e0-454f-b34c-e0246a57e5bb"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:30.683165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:30.692389 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47609fa9-d67f-4a09-888f-b7445d0a460d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1279 microversion: 2.1 time: 0.450640 Sep 27 01:54:30.699973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2585/5139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:30 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1279 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:30.854443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] validate_networks() for [('059e0d30-98e0-454f-b34c-e0246a57e5bb', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:54:30.921053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:30.921914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:30.949573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:30.950442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:30.951094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:30.952977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:30.956434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:30.958003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:31.534433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:31.583333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:31.586174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:31.587702 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36844a0f-8324-44c2-a8f2-4f3a3d28f7e1 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.675618 Sep 27 01:54:31.588878 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2586/5140] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:30 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:31.594866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:31.595842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:31.608527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:31.609496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:31.610534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:31.611487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:31.612588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:31.613174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:32.306250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:32.324766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:32.341230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:32.343991 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01b24e81-da42-4b2d-bab8-79b9fc13b974 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.753138 Sep 27 01:54:32.348230 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2587/5141] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:31 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:32.374268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:32.375865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:32.391241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:32.394146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:32.395832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:32.398158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:32.402889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:32.403904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:32.639265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:32.659524 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0a89208-32d9-4a6b-86a0-0f01dd5496dc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1279 microversion: 2.1 time: 0.309510 Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2588/5142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:32 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1279 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:32.689906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:32.692016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:32.692539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:32.692992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:33.198472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:33.212411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:33.218797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:33.220190 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa3cb4cc-1574-4197-8183-674e93b62e4d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.557918 Sep 27 01:54:33.226111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2589/5143] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:32 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:33.379852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:33.380476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:33.399093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:33.399795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:33.401053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:33.402744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:33.405888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:33.408957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:34.136848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:34.154847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:34.160223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:34.163146 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e63d0fe9-58a6-4307-a842-0859eb9ef6e8 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.788788 Sep 27 01:54:34.165659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2590/5144] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:33 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:34.181735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:34.182883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:34.196515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:34.197020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:34.197496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:34.198211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:34.198668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:34.199112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:34.321669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:34.646230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:34.666434 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc913180-b0ea-49ca-972c-4b526da3b399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 0.495990 Sep 27 01:54:34.667555 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2591/5145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:34 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:34.685125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:34.687592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:34.706433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:34.709354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:34.712872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:34.713806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:34.716599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:34.718835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:34.719536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:34.744821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:35.407223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:35.664782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:35.693840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:35.698636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:35.700272 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-efbec40f-2941-4f5e-bb5b-de573f41df59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 1.029614 Sep 27 01:54:35.703715 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2592/5146] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:34 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:35.717561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:35.719468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:35.739741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:35.740433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:35.740994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:35.741976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:35.742549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:35.746993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:35.953761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:54:35.954237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:54:35.954760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:54:35.955699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:54:35.956244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:54:35.977074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:35.977592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:35.981279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:35.985233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:35.985852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:35.986968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:36.032601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Getting quotas for project edb366daddab464ca0c880b82c453e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:54:36.044161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Getting quotas for user 45e93bfdb3ec44839755ceb6b84e00b5 and project edb366daddab464ca0c880b82c453e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:54:36.076724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:54:36.091730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:54:36.186822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f5d3d14-5804-447a-836e-d2a8048e303f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.291684 Sep 27 01:54:36.189201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2555/5147] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 6295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:54:36.199674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:36.203729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:36.219686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:36.220958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:36.221503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:36.224652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:36.230113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:36.231049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:36.256065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:36.284742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:36.293670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:36.302068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa1dac59-6d37-4b01-8986-21b8bcd6567a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.589000 Sep 27 01:54:36.308210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2593/5148] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:35 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:36.321177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0d41313-ff11-4b8a-b84e-d7146f967272 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:36.333156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0d41313-ff11-4b8a-b84e-d7146f967272 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:36.483327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0d41313-ff11-4b8a-b84e-d7146f967272 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:36.502223 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0d41313-ff11-4b8a-b84e-d7146f967272 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1224 microversion: 2.1 time: 0.189255 Sep 27 01:54:36.507038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2594/5149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:36 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:36.733020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:36.734179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:36.758104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:36.759619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:36.762916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:36.764833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:36.765923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:36.767212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:37.122856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.132488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.138516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.151579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-869566ec-eb62-4001-a2b9-72e4bd9aeaf8 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.420584 Sep 27 01:54:37.153291 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2595/5150] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:36 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:37.337016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:37.337877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:37.348464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:37.348963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:37.350061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:37.350781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:37.353693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:37.357504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:37.703307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.720038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.723033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.729411 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19475064-f1f8-4c21-b5f4-516bc34c42a2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.394513 Sep 27 01:54:37.731093 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2596/5151] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:37 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:37.758184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:37.759514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:37.766244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:37.767549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:37.768425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:37.769417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:37.770113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:37.771333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:37.868720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:37.879528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17e0254f-169f-4ee7-b16a-9f71f3489b98 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1276 microversion: 2.1 time: 0.145324 Sep 27 01:54:37.881847 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2597/5152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:37 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:38.154063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:38.177310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69f7c8e4-56c4-4a18-97bf-3943299ba03d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 1.981671 Sep 27 01:54:38.179022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:38.180105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:38.180455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2556/5153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:36 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:38.204451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.205838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.206959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:38.207866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.208613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.211606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:38.581844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:38.597766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:38.604465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:38.608189 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-273e7bf1-7c36-4d67-9a25-43842cd539cd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.433674 Sep 27 01:54:38.617374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2598/5154] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:38 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:38.760356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:38.761111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:38.777178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.778009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.779207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:38.780267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.782341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.783506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:38.909628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:38.911019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:38.922945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.924684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.925812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:38.927070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:38.928344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:38.930013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:39.185592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:39.209982 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f9b4b4e-5fff-4135-9ef3-c40b8a59ce0c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1282 microversion: 2.1 time: 0.304937 Sep 27 01:54:39.210988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2599/5155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:38 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:39.253005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:39.253862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:39.272654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:39.277459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:39.278256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:39.281286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:39.283831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:39.283965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:39.752931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:39.772880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:39.775083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:39.779166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0741a90c-6bf2-407d-9383-7f8afd261183 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.023923 Sep 27 01:54:39.782046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2557/5156] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:38 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:39.796036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:39.797044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:39.815303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:39.816080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:39.816717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:39.818138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:39.819244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:39.823565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:39.930934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:39.943039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cf14017-4e18-4367-ac15-aacc9a2e43c7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 0.730440 Sep 27 01:54:39.953432 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2600/5157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:39 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:40.255762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:40.256877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:40.273615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.275980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.277800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.279066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.280896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.283447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.443842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:40.473026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7681334e-7aeb-481a-b9f3-a29b5dcaf46f tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1282 microversion: 2.1 time: 0.221867 Sep 27 01:54:40.476276 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2601/5158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:40 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:40.532324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67a254b-895d-4c2f-9fc0-eee044bb8d77", "tag": "805fabef-7c03-4383-93b0-f28d1b0931f5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:40.566307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.574692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.575638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.606538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] Creating event network-changed:805fabef-7c03-4383-93b0-f28d1b0931f5 for instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 on n-h1-859358-1 Sep 27 01:54:40.623211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8a94708c-d160-4bb7-86f7-0b3d9d9d3e32 req-cf834af1-dc79-43f1-8658-2da023e50f74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095423 Sep 27 01:54:40.632124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2602/5159] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:40.809317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:40.811140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:40.827969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.831115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.832260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.834202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.834619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:40.837523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.838547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.852490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:40.859326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:40.860993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb22a009-d3f4-4429-8627-55435b2030a0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 1.073969 Sep 27 01:54:40.862132 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2558/5160] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:39 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:40.972417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:40.973856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:40.986344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.990078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.990745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:40.992532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:40.994696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:40.995765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:41.665985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:41.682718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:41.684768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:41.687529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc8814e7-d452-4036-9fff-13d663702b08 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.882991 Sep 27 01:54:41.693644 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2603/5161] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:40 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:54:41.712642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:41.719116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:41.736491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:41.743412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:41.745621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:41.748039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:41.749680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:41.759119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:42.013660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:42.026626 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75e17b85-f7ed-4c77-9bde-784fed488dd3 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.330986 Sep 27 01:54:42.028760 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2604/5162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:41 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:42.047111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:42.049592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:42.066204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:42.070142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:42.070897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:42.072121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:42.072786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:42.073731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:42.677528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:42.699377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:42.700446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:42.706120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66460bff-5a22-4310-87d2-594be6637fb2 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.675886 Sep 27 01:54:42.710279 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2605/5163] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:42 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:42.724209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:42.749523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:42.753661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:42.754473 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01efc00d-a559-4de4-8613-e39a27ada8a2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 1.783992 Sep 27 01:54:42.770563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2559/5164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:40 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:42.794424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:42.795235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:42.795864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:42.796753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:42.808122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:42.808860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:43.052697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:43.056483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:43.072322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:43.072820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:43.073260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:43.082544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:43.091506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:43.091967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:43.586492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:43.620392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:43.628393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:43.632500 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a8698cf-59df-4cba-8cd5-a553d9f82753 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.914174 Sep 27 01:54:43.633126 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2606/5165] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:42 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:43.744968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:43.745808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:43.756553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:43.757299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:43.760371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:43.763010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:43.766833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:43.768061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:44.010926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:44.043995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8e58938-8fbd-4b01-87bb-05769fd61855 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.994504 Sep 27 01:54:44.046016 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2560/5166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:43 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:44.072067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:44.072957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:44.094800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:44.095592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:44.096571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:44.097484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:44.098309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:44.098908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:44.200104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:44.212274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:44.216160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:44.220286 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9709ded-ee1d-4960-bf73-ab1ae740a487 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.478549 Sep 27 01:54:44.221853 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2607/5167] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:43 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:44.560523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:44.570120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aa0522af-456f-4ae6-803c-4df419d1612b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 0.509563 Sep 27 01:54:44.593309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2561/5168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:44 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:44.660532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:44.661280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:44.678616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:44.679905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:44.680567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:44.688216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:44.689737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:44.691363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:45.074890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:45.076134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:45.092121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:45.093420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:45.094462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:45.102445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:45.103162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:45.103770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:45.872964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:45.907160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:45.911929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:45.917087 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa938624-77e6-44e1-aeb4-dce230e48f48 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.260851 Sep 27 01:54:45.943899 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2608/5169] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:44 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:45.970551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:45.972766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:46.003543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:46.004579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:46.005308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:46.008944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:46.009471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:46.016373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:46.020122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:46.063514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:46.498392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:46.536871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:46.559022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:46.567588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:46.572449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5b02ce0-c31f-4102-abaa-232bc55e99b5 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.625831 Sep 27 01:54:46.599875 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2609/5170] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:45 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:46.624246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:46.624908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:46.651575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:46.652103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:46.658778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:46.660201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:46.661026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:46.664579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:46.765019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:46.982186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:46.990961 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da80c9c6-484d-4561-8272-04eb0846bdd1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 1.920607 Sep 27 01:54:47.000501 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2562/5171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:45 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:47.015366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:47.017237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:47.057911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:47.059440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:47.059959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:47.060388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:47.061104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:47.065556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:47.066107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:47.549234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:47.561942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15a9ee1d-50ac-4359-a79c-54694bae7072 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 0.960511 Sep 27 01:54:47.598580 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2610/5172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:46 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:47.636087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d928239-dcd1-4848-b4ef-a773d8ec095c", "tag": "1693b24d-6a3f-4be7-abb7-a9100a395216"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:47.656024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:47.656760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:47.658917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:47.692724 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] Creating event network-changed:1693b24d-6a3f-4be7-abb7-a9100a395216 for instance 1d928239-dcd1-4848-b4ef-a773d8ec095c on n-h2-859358-1 Sep 27 01:54:47.707968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e45d8f7a-3a2c-4358-91fc-ac613bd5a55f req-fc742937-acad-4aae-9340-0fc58c420f7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107456 Sep 27 01:54:47.709508 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2611/5173] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:47.725597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:47.727895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:47.740276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:47.743053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:47.745750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:47.746808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:47.747434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:47.752077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:48.205399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.222516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.239606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.244122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a385aa6-d990-4c82-8e77-ca7d2d224886 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.532237 Sep 27 01:54:48.245965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2612/5174] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:47 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:48.263956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:48.264559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:48.280528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:48.281029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:48.281505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:48.282218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:48.282732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:48.283160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:48.631739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.651937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.653825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.654743 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f57f5bd3-4276-43ae-8d97-7846cc750716 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.652354 Sep 27 01:54:48.661585 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2563/5175] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:47 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:48.676364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:48.685130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:48.710443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:48.714604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:48.716504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:48.719338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:48.720831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:48.723335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:48.750527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:48.775076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27291446-5e73-4435-bdef-932fc52639a0 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.521257 Sep 27 01:54:48.781746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2613/5176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:48 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:49.234677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67a254b-895d-4c2f-9fc0-eee044bb8d77", "name": "network-vif-plugged", "status": "completed", "tag": "805fabef-7c03-4383-93b0-f28d1b0931f5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:49.252120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:49.259758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:49.260479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:49.303217 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] Creating event network-vif-plugged:805fabef-7c03-4383-93b0-f28d1b0931f5 for instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 on n-h1-859358-1 Sep 27 01:54:49.326904 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8ba86838-1332-497f-9744-8bcf7fd6b3b7 req-2e20a278-e4eb-4f86-92f2-d61d75427208 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096385 Sep 27 01:54:49.335443 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2614/5177] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 27 01:54:49.365915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:49.367502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:49.399432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:49.405356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:49.405842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:49.406595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:49.407063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:49.407528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:49.810615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:49.823273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:49.826717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:49.830918 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c02adf42-6e37-4424-96ed-2fba83c5be84 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1738 microversion: 2.20 time: 0.491051 Sep 27 01:54:49.842288 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2615/5178] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:49 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:49.852523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:49.852523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:49.858082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:49.858570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:49.859007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:49.859706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:49.860156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:49.861109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:50.087464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:50.097967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83a2a582-1f36-4924-b269-035df949b9c3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1321 microversion: 2.1 time: 1.435150 Sep 27 01:54:50.098730 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2564/5179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:48 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1321 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:50.105009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:50.105845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:50.112838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:50.113443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:50.113957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:50.114842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:50.115455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:50.116029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:50.286823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:50.301434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:50.309747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:50.311142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b85de0b-d5d2-47ec-bd1a-2c555e33e57b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.476996 Sep 27 01:54:50.311733 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2616/5180] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:49 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:50.632583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:50.647439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63be30f5-4efa-45b2-afae-927ef3336d4e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.545341 Sep 27 01:54:50.648450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2565/5181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:50 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:50.861968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:50.864266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:50.902058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:50.903471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:50.906133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:50.908193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:50.912059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:50.915743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.121807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:51.122603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:51.135244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.135756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.136201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.136926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.140435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.141630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.379839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:51.416439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:51.420117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:51.424936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca7a2fb0-4238-46cb-9384-89430934118d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1720 microversion: 2.20 time: 0.568366 Sep 27 01:54:51.425794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2617/5182] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:50 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1720 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:51.440771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:51.442350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:51.480506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.488111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.488871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.490942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.493435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.494107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.771649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:51.781944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3db7e03f-19fc-4523-b1b0-1f983c018825 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1502 microversion: 2.1 time: 0.664304 Sep 27 01:54:51.787115 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2566/5183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:51 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1502 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:51.797116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:51.797807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:51.813979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.814501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.814974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:51.815702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:51.816191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:51.816629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.119734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:52.130097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:52.131526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:52.132707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b70b6a02-069e-4714-b934-d42250e4bf73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.705370 Sep 27 01:54:52.133270 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2618/5184] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:51 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:52.137819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:52.138412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:52.151606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.152430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.153099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.154051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.154734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.155377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.297875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:52.314922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8c419395-d62d-4f5a-8182-ad132afd19fb tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.525030 Sep 27 01:54:52.333023 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2567/5185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:51 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:52.457495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:52.458653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:52.465710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.466514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.467196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.468408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.469958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.470539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.475374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:52.492165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:52.506306 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9c85f7c-b4dc-4351-b34c-c70d3fb0b493 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1502 microversion: 2.1 time: 0.371940 Sep 27 01:54:52.508048 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2619/5186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:52 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:52.537411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:52.538473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:52.545880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.546732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.547450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.548590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.549407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.550187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.582751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:54:52.712086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a78a117-bef9-44fb-93f8-846eef592abb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 204 len: 0 microversion: 2.1 time: 0.180305 Sep 27 01:54:52.725513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2620/5187] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:54:52 2022] DELETE /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:54:52.738794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:52.739827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:52.747610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.748487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.748998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:52.749845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:52.750378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:52.751821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.211301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.225011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.226822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.231669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b163265-2385-473b-b02a-ea17628485d6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1720 microversion: 2.20 time: 0.777602 Sep 27 01:54:53.233489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2568/5188] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:52 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1720 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:53.240605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.244932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:53.247098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:53.251781 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86ddf058-6150-4a6f-af70-39f50b8e3adc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1508 microversion: 2.1 time: 0.518742 Sep 27 01:54:53.252406 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2621/5189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:52 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:53.266988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "name": "network-vif-unplugged", "status": "completed", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:53.269027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:53.269589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:53.270033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.270736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:53.271184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:53.271606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.287882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:53.288861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:53.289497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.332217 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] Creating event network-vif-unplugged:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:54:53.348404 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d59c3f81-4feb-432c-b8a5-29de081b1fdf req-85ddcaed-90a6-47e4-be7a-eef5d37e59aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094743 Sep 27 01:54:53.356845 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2622/5190] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:53.376488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:53.377383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:53.392926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:53.393494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:53.393989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.394716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:53.395174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:53.395603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:53.830322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.845083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.846584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.847764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2cfb1708-c4c7-458f-b440-fe35e8a541b7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.613026 Sep 27 01:54:53.852077 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2569/5191] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:53 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:53.880445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:53.888165 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f24edba-24f5-404e-bbe5-1aa0f4e3ac29 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.529124 Sep 27 01:54:53.888740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2623/5192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:53 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:54.258218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:54.259114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:54.269941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.277446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:54.278592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:54.281690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.284808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.285852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.286555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.288371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.289408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.294686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.295498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.296463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.297138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.297896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.707828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:54.717966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:54.724378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:54.728192 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b3c4569-a6cf-42ae-98f9-20f2ac153601 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1720 microversion: 2.20 time: 0.471315 Sep 27 01:54:54.728864 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2570/5193] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:54 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1720 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:54.879362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:54.881378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:54.888834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.889713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.890368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.892419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.893384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.894038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.913819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:54.924963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-221133dc-83cf-4395-8ed1-0a4ce3f7eb21 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1508 microversion: 2.1 time: 0.651773 Sep 27 01:54:54.929873 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2624/5194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:54 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1508 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:54.949060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:54.953760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:54.962882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.963898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.964260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:54.965074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:54.965807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:54.966447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:55.779480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:55.791560 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-349dc9a8-469c-4b05-bcdb-b1b31b09a13c tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.860307 Sep 27 01:54:55.808909 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2625/5195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:54 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:55.815020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:55.824930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:55.826412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:55.835605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:55.840423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:55.842158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b990a5d-7e1e-402b-bb85-c5fe1e61d441 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.953150 Sep 27 01:54:55.843187 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2571/5196] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:54 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:55.858346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:55.859814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:55.860488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:55.861521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:55.862127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:55.862714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:55.966459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:55.967133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:55.973855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:55.974449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:55.975154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:55.977622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:55.979999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:55.982348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:56.356976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:56.381624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-659492a8-f968-4b21-b9f5-4696e794d44e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1508 microversion: 2.1 time: 0.419675 Sep 27 01:54:56.384943 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2572/5197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:55 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:56.595204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:56.606486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:56.611153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:56.614716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d08a236c-5145-471d-bd93-745c6d14d3db tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1663 microversion: 2.20 time: 0.804411 Sep 27 01:54:56.617566 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2626/5198] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:55 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1663 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:56.646689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df150c4-5887-44d4-9bc4-1308a4f6f3b1"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:56.650305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:56.663163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:56.663886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:56.671979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:56.672377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:56.685012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:56.685012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:56.815664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:56.816569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:56.832294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:56.834262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:56.838543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:56.843180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:56.843772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:56.844385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:56.919024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:54:57.339069 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fec8ee76-7409-4071-b636-8fcbb8947109 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.695786 Sep 27 01:54:57.340521 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2573/5199] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Sep 27 01:54:56 2022] POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments => generated 188 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 01:54:57.354025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:57.354973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:57.363404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:57.364933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:57.365797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:57.367109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:57.367850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:57.368737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:57.952228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:57.969604 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fb2b266-dab5-4b35-86e4-e955e557e244 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 1.158765 Sep 27 01:54:57.985565 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2627/5200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:56 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:54:57.994061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:57.994679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:58.013094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.013826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.016608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.017859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.018516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.021972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.097432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.098531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.099500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.100330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lazy-loading 'fault' on Instance uuid a67a254b-895d-4c2f-9fc0-eee044bb8d77 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:54:58.179921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:58.210180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2a76990-0d61-42a3-a2b1-1e7ae857d82a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 200 len: 1311 microversion: 2.1 time: 0.233478 Sep 27 01:54:58.210793 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2628/5201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:57 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:54:58.256825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:58.257414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:58.278405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.279226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:58.290528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.294815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.295617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.301528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.304215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.317293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:58.321984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:58.325189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f20d059f-0aaf-4907-8824-50938f0acde0 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.982799 Sep 27 01:54:58.328962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2574/5202] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:57 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:58.341121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67a254b-895d-4c2f-9fc0-eee044bb8d77", "name": "network-vif-deleted", "tag": "805fabef-7c03-4383-93b0-f28d1b0931f5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:58.374090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.379990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.380823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.411398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] Creating event network-vif-deleted:805fabef-7c03-4383-93b0-f28d1b0931f5 for instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 on n-h1-859358-1 Sep 27 01:54:58.424482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3558835d-115b-45c9-bac2-db1c0d086e4d req-2e02a7a5-1ed8-4f1e-b932-9aa81d10c110 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089870 Sep 27 01:54:58.428370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2575/5203] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:54:58.827815 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0bb0d6f5-519e-4b96-9d84-96b1dc4eb7d0 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments/8df150c4-5887-44d4-9bc4-1308a4f6f3b1" status: 202 len: 0 microversion: 2.20 time: 0.594975 Sep 27 01:54:58.828369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2629/5204] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Sep 27 01:54:58 2022] DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments/8df150c4-5887-44d4-9bc4-1308a4f6f3b1 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:54:58.943864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:58.944567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:58.962253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.963820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.964474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.966859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:58.971449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:58.972234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:58.999416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:59.000108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:59.021328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.021869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.022295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.023011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.023470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.035017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.104126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128778) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 01:54:59.244031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e571a0c1-178f-48c6-8bbe-b13a2305c4bd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/action" status: 202 len: 0 microversion: 2.20 time: 0.305168 Sep 27 01:54:59.244513 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2576/5205] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 01:54:58 2022] POST /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:54:59.252619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:59.261364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:59.272119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.278236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.279031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.279970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.280730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.292318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.310938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 HTTP/1.1 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a67a254b-895d-4c2f-9fc0-eee044bb8d77'} Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:54:59.313016 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:54:59.318073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:54:59.320333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:54:59.322092 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d2c4601-f657-47e9-992a-4aca0e145c4d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 404 len: 111 microversion: 2.1 time: 0.073166 Sep 27 01:54:59.331717 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2577/5206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:59 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:54:59.337380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:54:59.338366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:54:59.345273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.346595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.347292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.348269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:54:59.349084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:54:59.350016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:54:59.539494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:59.555805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:59.557668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:54:59.559105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea2ccc03-3e2f-4e08-9377-8b055fd66d77 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1671 microversion: 2.20 time: 0.226069 Sep 27 01:54:59.560819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2578/5207] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:54:59 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:54:59.573725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: .version_select at 0x7f24d5495ee0>, body: {"keypair": {"name": "tempest-key-2103285145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvHxg6hjbIZ7pXg2VaEthyKyicm3HU26efAHeYRqROy0F52xMiK6JsDGZeq0DngNaKM3DgzukA75wEeNvXCYI2c0AuvOg9Je5BDm1KWeOuB+ai63C9DT4yODAARUnv90g=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:54:59.619380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:54:59.627942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:54:59.644129 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 01:55:00.227979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:00.237784 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d774822b-82b9-4daf-8658-3fc229142ca7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 1.244958 Sep 27 01:55:00.238385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2630/5208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:54:58 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:00.243051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:00.243860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:00.251104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:00.251810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:00.252396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:00.253247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:00.253932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:00.254538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:00.653746 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58902. Sep 27 01:55:00.676184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-002366fb-2c8f-46f5-b393-53632590e412 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 1.113709 Sep 27 01:55:00.676929 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2579/5209] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:54:59 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:00.690389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d928239-dcd1-4848-b4ef-a773d8ec095c", "name": "network-vif-plugged", "status": "completed", "tag": "1693b24d-6a3f-4be7-abb7-a9100a395216"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:00.712286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:00.712774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:00.713258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:00.727520 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] Creating event network-vif-plugged:1693b24d-6a3f-4be7-abb7-a9100a395216 for instance 1d928239-dcd1-4848-b4ef-a773d8ec095c on n-h2-859358-1 Sep 27 01:55:00.745396 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cf692f20-276b-4241-ba33-4921da5ac8d0 req-6244645c-01ef-48e5-9eee-d75354d48f0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065935 Sep 27 01:55:00.749860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2580/5210] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:00.755997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:00.756984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:00.764046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:00.764778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:00.765561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:00.767109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:00.767801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:00.768463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:00.842794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:00.889322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:00.897537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:00.900100 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c24a0ed-f0a2-4f65-9f75-6585fbc38680 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.660719 Sep 27 01:55:00.902762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2631/5211] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:00 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:00.912298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d0a7542-33b3-4f59-9597-e1a4fa369126 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '.version_select at 0x7f24d57bb550>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:00.947114 n-d-859358-1 devstack@n-api.service[128779]: WARNING oslo_db.sqlalchemy.utils [None req-3d0a7542-33b3-4f59-9597-e1a4fa369126 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 27 01:55:00.958539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d0a7542-33b3-4f59-9597-e1a4fa369126 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.053874 Sep 27 01:55:00.960233 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2632/5212] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 01:55:00 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:01.102207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:01.115167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:01.118677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:01.126362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29eb6561-7a23-4e33-b369-66d8515d2286 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1671 microversion: 2.20 time: 0.372975 Sep 27 01:55:01.127325 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2581/5213] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:00 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1671 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:01.193406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-642540808", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-key-2103285145", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:01.263391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:01.264101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:01.282691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:55:01.285717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:01.286288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:01.286741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:01.294129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:01.294685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:01.295355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:01.693226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:01.701064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a9bc5e7-0f4f-49b3-bdf7-9e94f18840f1 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.442862 Sep 27 01:55:01.701685 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2582/5214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:01 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:01.934890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:01.935901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:01.951158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:01.953816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:01.954497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:01.959193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:01.959925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:01.961436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:02.529984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.544320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.548959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.550497 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-313006f3-4103-4e25-befe-f719c45ba964 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.620120 Sep 27 01:55:02.551327 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2583/5215] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:01 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:02.557957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:02.559188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:02.566486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:02.567713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:02.568973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:02.570075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:02.571670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:02.572355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:02.580366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:02.854325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.877272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.888967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:02.890556 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c80c3e73-025c-4125-9fa7-b37832f48f57 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.337985 Sep 27 01:55:02.891890 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2584/5216] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:02 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:02.896745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:02.902343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:02.916802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:02.918332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:02.920693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:02.922230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:02.923588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:02.928146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:03.290786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:03.302011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e7d4bda-8b21-4f60-8eab-ccea1d7f5eab tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1324 microversion: 2.1 time: 0.408692 Sep 27 01:55:03.303203 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2585/5217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:02 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:03.509779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:55:03.510922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:55:03.511615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:55:03.512033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:55:03.512604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:55:03.536359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:03.542539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:03.543096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:03.544420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:03.544895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:03.545419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:03.582095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:03.582865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:03.592280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:03.592936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:55:03.596469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:03.597299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:03.599628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:03.601412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:03.601822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:55:03.602067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:03.602640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:03.634307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:55:03.638657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:55:03.724716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abf8b0e5-3d81-4c23-bb34-57e450fcd748 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.537508 Sep 27 01:55:03.734505 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2633/5218] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:55:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:55:03.747507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-319137e0-a62e-46d6-94e1-9a1070c3c2d4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:03.748437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-319137e0-a62e-46d6-94e1-9a1070c3c2d4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:03.964778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-319137e0-a62e-46d6-94e1-9a1070c3c2d4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:03.975216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-319137e0-a62e-46d6-94e1-9a1070c3c2d4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1228 microversion: 2.1 time: 0.232035 Sep 27 01:55:03.975842 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2634/5219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:03 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1228 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:03.999920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.025969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:04.067567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.068342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.069056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.069976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.074492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.082106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.097753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:04.123992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:04.126892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:04.132146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-02a96848-8d96-4b24-9dc5-4cccd4b09eec tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.554045 Sep 27 01:55:04.153919 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2586/5220] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:03 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:04.329886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.330798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:04.337822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.338662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.339321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.340284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.340949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.341621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.549041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:04.558541 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d4faf363-adbd-441f-9af7-05e59b852412 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1522 microversion: 2.1 time: 0.234905 Sep 27 01:55:04.559242 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2587/5221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:04 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:04.581580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.582330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:04.592394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.594008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.595302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.598285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.599338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.600530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.655893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] HTTP exception thrown: Instance is not a member of specified network Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Request method failure captured: Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c/ips/invalid HTTP/1.1 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlfUL-e5H4n2Tibsf3hugBVusdU9DEJ6A_wCSuWkEdvtFhKliXSiV_yKtjXy8bpN3n7bdds1TAasDXJQ8aiN-oorz90WgPy5v0Cvn9qZT7gb8wLqrPcxEMQzm0Cw65OtKoQKPv9MEroxpih8j6OPr0Z2cDSrZHaiDWMBw9mpSzCABfE Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_edb366daddab464ca0c880b82c453e2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 45e93bfdb3ec44839755ceb6b84e00b5 Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance is not a member of specified network Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '1d928239-dcd1-4848-b4ef-a773d8ec095c', 'id': 'invalid'} Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 27 01:55:04.661646 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.668719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:55:04.670608 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9436a2ac-1c22-457f-a4ac-c02957f9634b tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.092842 Sep 27 01:55:04.671845 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2588/5222] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 01:55:04 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:55:04.686115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.686739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Failed to fetch instance by id 999 {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 27 01:55:04.687371 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] HTTP exception thrown: Instance 999 could not be found. Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Request method failure captured: Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlfUL-e5H4n2Tibsf3hugBVusdU9DEJ6A_wCSuWkEdvtFhKliXSiV_yKtjXy8bpN3n7bdds1TAasDXJQ8aiN-oorz90WgPy5v0Cvn9qZT7gb8wLqrPcxEMQzm0Cw65OtKoQKPv9MEroxpih8j6OPr0Z2cDSrZHaiDWMBw9mpSzCABfE Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_edb366daddab464ca0c880b82c453e2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 45e93bfdb3ec44839755ceb6b84e00b5 Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 999 could not be found. Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '999'} Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 27 01:55:04.689626 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:04.694179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:55:04.694179 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0833a31-40f9-4162-8854-69fae4a9e5f9 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010481 Sep 27 01:55:04.694179 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2589/5223] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 01:55:04 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 01:55:04.715064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.715970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:04.735329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.736183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.739205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.740360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.742580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.743308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.792995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:55:04.928541 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e9231e0-04a8-41c4-9476-88266757da10 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 204 len: 0 microversion: 2.1 time: 0.222481 Sep 27 01:55:04.932366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2590/5224] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:55:04 2022] DELETE /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:55:04.939644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:04.940506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:04.948102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.948691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.949757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:04.950561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:04.950561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:04.950911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:05.355703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:05.367720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:05.370715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:05.371963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2602c6e5-8f0d-48f1-bab7-4f5c4938e20d tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 1.375959 Sep 27 01:55:05.372903 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2635/5225] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:03 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:05.378643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:05.379596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:05.386263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:05.386959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:05.387580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:05.388711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:05.389421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:05.390017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:05.524445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:05.534763 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8092f8cd-86c4-463f-af30-5f5cfd40fb2e tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1528 microversion: 2.1 time: 0.600790 Sep 27 01:55:05.540359 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2591/5226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:04 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1528 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:05.558211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:05.559540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:05.572859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:05.581807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:05.582351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:05.583180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:05.583709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:05.584513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:05.817984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:05.828410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99e44441-1164-49a4-b081-accc04dff171 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1280 microversion: 2.1 time: 0.453006 Sep 27 01:55:05.832225 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2636/5227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:05 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1280 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:06.399131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:06.400615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:06.412773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:06.414029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:06.416065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:06.417192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:06.421585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:06.423016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:07.052180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.077581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.080514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.086895 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f29d15d-63fd-4c9f-bcef-4c3b5218f7b9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.545055 Sep 27 01:55:07.102557 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2592/5228] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:05 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:07.126280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:07.127244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:07.135532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:07.140032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:07.142400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:07.143382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:07.144878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:07.150109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:07.497057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.512226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.516990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.523803 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c799cb06-674d-48c6-888a-1cfad8d60195 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 1.125405 Sep 27 01:55:07.524447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2637/5229] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:06 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:07.546345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:07.548768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:07.559524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:07.561232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:07.565261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:07.566113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:07.566585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:07.567022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:07.923422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.944098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f97f3e75-8d87-4d43-b2b0-12a5f4a743c7 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1528 microversion: 2.1 time: 0.836455 Sep 27 01:55:07.948267 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2593/5230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:07 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1528 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:07.978794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:07.986858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-051ea12f-033a-4d9b-a621-0608c4a1c31a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1286 microversion: 2.1 time: 0.458096 Sep 27 01:55:07.990097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2638/5231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:07 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1286 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:08.131966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:08.133706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:08.161379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:08.162237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:08.165172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:08.166920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:08.168467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:08.169842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:08.550105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:08.550651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:08.572755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:08.573356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:08.573829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:08.574546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:08.581490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:08.583495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.475933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.493282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.502193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.504077 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fcb053df-3cc1-47bc-894e-45684ab77af7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.386085 Sep 27 01:55:09.525367 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2594/5232] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:08 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:09.525367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d928239-dcd1-4848-b4ef-a773d8ec095c", "name": "network-vif-deleted", "tag": "1693b24d-6a3f-4be7-abb7-a9100a395216"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:09.558376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.558862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.564966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.610306 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] Creating event network-vif-deleted:1693b24d-6a3f-4be7-abb7-a9100a395216 for instance 1d928239-dcd1-4848-b4ef-a773d8ec095c on n-h2-859358-1 Sep 27 01:55:09.636592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5db2f4df-baf9-498b-911b-4cd435cacf59 req-0c4d8b90-3659-47d1-810d-1721f3dbbc37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126642 Sep 27 01:55:09.646659 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2595/5233] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:09.670716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:09.674318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:09.682637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:09.691509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.712814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.713616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.714341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.714974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.716420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.722649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:09.723193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.723908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.728913 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-11765c65-3fcf-4feb-bfdb-001dd9feb568 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 1.181414 Sep 27 01:55:09.732413 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2639/5234] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:08 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:09.752965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:09.756304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:09.784266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.785292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.787899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.792974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.796805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.797662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.811470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:09.814025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:09.816107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:09.818610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lazy-loading 'fault' on Instance uuid 1d928239-dcd1-4848-b4ef-a773d8ec095c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:55:10.100196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e93bfdb3ec44839755ceb6b84e00b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb366daddab464ca0c880b82c453e2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:10.125160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56e158f1-1417-4e06-8a37-b972f9b2de34 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 200 len: 1314 microversion: 2.1 time: 0.474434 Sep 27 01:55:10.126395 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2596/5235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:09 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:10.541384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:10.542087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:10.566878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:10.567581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:10.568038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:10.568793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:10.569306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:10.569769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:11.085441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:11.103877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:11.112509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:11.116123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d97ee94-19b2-404c-8ac6-56996aab7ea6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.579246 Sep 27 01:55:11.121931 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2597/5236] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:10 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:11.134086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:11.135819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:11.155361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:11.157051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:11.159548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:11.161958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:11.162674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:11.164849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:11.469002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:11.488054 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32a318f5-4e22-4a1b-b5b8-ade7db0cbb0b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 1.743711 Sep 27 01:55:11.490301 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2640/5237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:09 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:11.523320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:11.524372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] [instance: 1d928239-dcd1-4848-b4ef-a773d8ec095c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:11.549786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:11.554793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:11.555474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:11.556402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:11.557292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:11.557975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:11.591615 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] HTTP exception thrown: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Request method failure captured: Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c HTTP/1.1 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlfUL-e5H4n2Tibsf3hugBVusdU9DEJ6A_wCSuWkEdvtFhKliXSiV_yKtjXy8bpN3n7bdds1TAasDXJQ8aiN-oorz90WgPy5v0Cvn9qZT7gb8wLqrPcxEMQzm0Cw65OtKoQKPv9MEroxpih8j6OPr0Z2cDSrZHaiDWMBw9mpSzCABfE Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edb366daddab464ca0c880b82c453e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_edb366daddab464ca0c880b82c453e2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: edb366daddab464ca0c880b82c453e2e Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-919426431 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 45e93bfdb3ec44839755ceb6b84e00b5 Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-919426431-project Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '1d928239-dcd1-4848-b4ef-a773d8ec095c'} Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:11.596959 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. Sep 27 01:55:11.601933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:55:11.603141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] Returning 404 to user: Instance 1d928239-dcd1-4848-b4ef-a773d8ec095c could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:55:11.604161 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44dfb72c-313f-4b20-9123-49962fb36b04 tempest-ServerAddressesNegativeTestJSON-919426431 tempest-ServerAddressesNegativeTestJSON-919426431-project] 10.222.0.52 "GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c" status: 404 len: 111 microversion: 2.1 time: 0.111371 Sep 27 01:55:11.610280 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2641/5238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:11 2022] GET /compute/v2.1/servers/1d928239-dcd1-4848-b4ef-a773d8ec095c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:55:12.150906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:12.151530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:12.164893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:12.165430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:12.165870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:12.169785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:12.170666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:12.171350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:12.458776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.468784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.475874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.482931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c19ef79b-ddc7-4c8f-aebe-6d3e82f93b73 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 1.359583 Sep 27 01:55:12.484660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2598/5239] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:11 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:12.513057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:12.513988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:12.533285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:12.534059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:12.534677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:12.535715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:12.536341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:12.543121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:12.607274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.639868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.648897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:12.652592 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-068ba643-25f5-4530-b4ac-1b05aac4ddca tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.507896 Sep 27 01:55:12.655511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2642/5240] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:12 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:13.292720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:13.301648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-74aff98f-3640-46d0-aba9-606eb8859e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.792995 Sep 27 01:55:13.306608 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2599/5241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:12 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:13.520604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:13.522447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:13.542790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:13.550752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:13.551383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:13.553457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:13.556011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:13.557290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:13.620471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:13.684298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:13.685936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:13.719663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:13.721677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:13.725981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:13.726738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:13.727206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:13.727648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:13.972505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:14.461221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:14.471085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:14.487346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:14.488859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c11de80-0fc1-4c7f-9bfc-ae5701c17f23 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.976663 Sep 27 01:55:14.489630 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2643/5242] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:13 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:14.497162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:14.517096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:14.525180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:14.526661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:14.529884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:14.530808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:14.534346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:14.534839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:14.958445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:14.962456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:14.986091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50aa91d3-6ce0-4ea1-80a2-19944b69bdb0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.494901 Sep 27 01:55:14.987077 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2644/5243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:14 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:15.516633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:15.518030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:15.565368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:15.568822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:15.575056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:15.576306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:15.577057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:15.580798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:16.217905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.228284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:16.240976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.244719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.248506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f44b480-61c9-49b4-b2d9-a3eaf0aae19c tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 2.570828 Sep 27 01:55:16.250012 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2600/5244] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:13 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 2573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:16.272514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd327e4-b5cf-4588-948a-2034c0c56662", "tag": "8025042f-36fa-44dc-ab6c-c90a8c50305d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:16.290166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:16.290872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:16.291485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:16.306683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] Creating event network-changed:8025042f-36fa-44dc-ab6c-c90a8c50305d for instance bdd327e4-b5cf-4588-948a-2034c0c56662 on n-h1-859358-1 Sep 27 01:55:16.313526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-219c4d40-abbf-401d-9683-8a6977aef566 req-ce747f91-77b8-44de-bd58-00ecaefc472c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059219 Sep 27 01:55:16.314704 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2601/5245] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:16.320226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:16.321165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:16.327199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:16.330170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:16.330877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:16.331709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:16.332988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:16.333659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:16.334390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:16.824860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.843200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.850732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:16.852468 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-209e1338-9f48-41dc-bcb1-227ad3370fde tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 1.341198 Sep 27 01:55:16.855554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2645/5246] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:15 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:17.276791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:17.277904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:17.289714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:17.294215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:17.294972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:17.296137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:17.296735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:17.299187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:18.031911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:18.046884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b56cbb1c-afa8-4526-8003-1800eccd3e19 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 1.730538 Sep 27 01:55:18.049172 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2602/5247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:16 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:18.078988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:18.079796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:18.098746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:18.100362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:18.100811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:18.104342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:18.105017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:18.105556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:18.804752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:18.821736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:18.825991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:18.827463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77e31676-6e69-4864-806b-9bda9d85ae98 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.775209 Sep 27 01:55:18.830128 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2603/5248] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:18 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:18.992776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "1de62522-b15b-4657-84dc-1a13fc8b611e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:19.017115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:19.018014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:19.020524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:19.063693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] Creating event network-vif-plugged:1de62522-b15b-4657-84dc-1a13fc8b611e for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:19.078369 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0c3fa943-c849-4324-93e0-f83c2f5f8416 req-d730b3d4-2d63-4642-a0ea-ce8cfa576c3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090103 Sep 27 01:55:19.080972 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2604/5249] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:19.096108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:19.097756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:19.112962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:19.113901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:19.114597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:19.116259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:19.116930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:19.117837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:19.321963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:19.347733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:19.349607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:19.354169 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b503ae80-3cb1-4a95-85b3-9807f6e683f4 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 2.081698 Sep 27 01:55:19.356801 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2646/5250] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:17 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:19.658169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:19.680071 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46bcd311-520c-409f-9a79-79cfbb9de399 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.597479 Sep 27 01:55:19.698112 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2605/5251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:19 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:19.856177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:19.857087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:19.864878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:19.869665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:19.870440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:19.871414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:19.872093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:19.872743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:20.391462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:20.392794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:20.402517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:20.403264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:20.408330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:20.409548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:20.410281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:20.410942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:20.542085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:20.553579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:20.555508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:20.557772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-938d3d41-f4d4-4ed7-9a42-4ff96ba3e1c6 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.704720 Sep 27 01:55:20.579518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2647/5252] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:19 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:20.702475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:20.703632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:20.715806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:20.716306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:20.719799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:20.720595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:20.721245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:20.721866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:21.246068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.260862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f74d126f-2042-4621-b03f-53220bc47df6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.562119 Sep 27 01:55:21.261682 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2648/5253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:20 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:21.271811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "5953da3c-c32e-4866-9b77-afd7b6c69d89"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "711dafac-41e8-42d7-bfa7-2290cf11b3b4"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "98bff643-583e-47f2-8c2a-3e69937b15d1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:21.294245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:21.294747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:21.300446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:21.322777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Creating event network-vif-plugged:5953da3c-c32e-4866-9b77-afd7b6c69d89 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:21.323716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Creating event network-vif-plugged:711dafac-41e8-42d7-bfa7-2290cf11b3b4 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:21.324394 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] Creating event network-vif-plugged:98bff643-583e-47f2-8c2a-3e69937b15d1 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:21.336290 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c3dc9a0f-34f4-4aa7-b554-3f910eb977dd req-a6d42f83-d9b4-4830-9d5e-f0a2fd5249bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072889 Sep 27 01:55:21.338410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2649/5254] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:21.588212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:21.589637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:21.607927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:21.608418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:21.608856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:21.617972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:21.618443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:21.618875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:21.711847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.736974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.742157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.746287 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5d3bf92-a063-4baa-a895-ba51300f8760 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 1.361846 Sep 27 01:55:21.749147 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2606/5255] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:20 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:21.967644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.982578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.986220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:21.987492 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77a1dd7e-d3cb-4fec-89d7-176fd00e086e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.404897 Sep 27 01:55:21.988080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2650/5256] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:21 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:22.287177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:22.288269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:22.297447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:22.298300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:22.299018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:22.300315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:22.301169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:22.301889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:22.777616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:22.778833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:22.786530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:22.787864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:22.788479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:22.789855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:22.790468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:22.791051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:23.221247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.240803 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d2538f4-fcc4-4acb-ba95-8a1dc77db6e8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.957020 Sep 27 01:55:23.244274 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2607/5257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:22 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:23.260073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:23.260716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:23.271422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:23.272373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:23.273030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:23.273869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:23.274673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:23.275089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:23.549220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.563152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.570403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.571852 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-732f4756-d47a-496e-b897-18e7066644d2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.798255 Sep 27 01:55:23.597651 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2651/5258] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:22 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:23.604003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "35dc0dda-3e60-4cb9-b279-cbc928d166a3"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "00d3fb02-c4c7-4018-8f37-2aaef4236ae6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:23.616242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:23.617037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:23.617682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:23.638080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Creating event network-vif-plugged:35dc0dda-3e60-4cb9-b279-cbc928d166a3 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:23.638903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] Creating event network-vif-plugged:00d3fb02-c4c7-4018-8f37-2aaef4236ae6 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:23.658911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f7ffbec8-0e00-4675-964a-8b0f1e485f4b req-09419be5-5eb0-4936-b99d-eece0e1965c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059298 Sep 27 01:55:23.660182 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2652/5259] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:23.946543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.970464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.973968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:23.976443 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-445c50d2-6f98-4e33-a6a4-d6a24bf64657 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.729656 Sep 27 01:55:23.997659 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2608/5260] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:23 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:24.279355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:24.281440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:24.294866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:24.295749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:24.296411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:24.301118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:24.301854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:24.302529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:24.603573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:24.606102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:24.623761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:24.625916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:24.627478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:24.629825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:24.630824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:24.631894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:24.739070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:24.753740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e6938c3-a709-46fb-a667-a2bdae23bcb9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.486450 Sep 27 01:55:24.754816 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2653/5261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:24 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:25.006347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:25.006894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:25.013528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:25.017410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:25.017902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:25.018666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:25.019752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:25.020193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:25.138357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.148804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.150884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.152408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6f39b67-1f60-44da-81eb-37a3d971ee3a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.554970 Sep 27 01:55:25.166706 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2609/5262] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:24 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:25.351461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.367452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.374040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:25.376532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6a5474b0-e0e2-4d0b-a317-ca9a4b02fb0a tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.373631 Sep 27 01:55:25.379604 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2654/5263] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:25 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:55:25.758300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd327e4-b5cf-4588-948a-2034c0c56662", "name": "network-vif-plugged", "status": "completed", "tag": "8025042f-36fa-44dc-ab6c-c90a8c50305d"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-plugged", "status": "completed", "tag": "c1b74e3f-ff04-4311-849d-af8536d9d1ed"}, {"server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "name": "network-vif-plugged", "status": "completed", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:25.777703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:25.778632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:25.801447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:25.804359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:25.806057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:25.809065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:25.811525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:25.812013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:25.813068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:25.813666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:25.814904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:25.857717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Creating event network-vif-plugged:8025042f-36fa-44dc-ab6c-c90a8c50305d for instance bdd327e4-b5cf-4588-948a-2034c0c56662 on n-h1-859358-1 Sep 27 01:55:25.858340 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Creating event network-vif-plugged:c1b74e3f-ff04-4311-849d-af8536d9d1ed for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:25.858991 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] Creating event network-vif-plugged:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:55:25.872543 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b10db200-76f9-4093-a081-628633355711 req-5d595fb3-e47d-4a40-9e77-becbb0b905ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.118999 Sep 27 01:55:25.873816 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2610/5264] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:26.183890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:26.186576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:26.202047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:26.202556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:26.204476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:26.209018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:26.211140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:26.212126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:26.621644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:26.637554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2477dda-4828-431d-851b-af280bc7c86f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.863968 Sep 27 01:55:26.638805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2655/5265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:25 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:26.661564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:26.662376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:26.677328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:26.690175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:26.690860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:26.692038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:26.692958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:26.693613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:26.853981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:26.866369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:26.869188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:26.870596 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28f44ed4-8cf4-47ff-a09d-4d3a117a22be tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.693795 Sep 27 01:55:26.888095 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2611/5266] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:26 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:27.113242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:27.123014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:27.124921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:27.126235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-415c39d4-a083-4a7d-ae4f-be85124280c4 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.486360 Sep 27 01:55:27.141822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2656/5267] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:26 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:27.660575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:27.661323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:27.683713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:27.684649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:27.685297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:27.686664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:27.688295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:27.688955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:27.904715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:27.905537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:27.927512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:27.928230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:27.928927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:27.930471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:27.931329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:27.934730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:28.237755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.246313 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a894b15-7715-441a-8e7c-355e82a2988a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1328 microversion: 2.1 time: 0.589425 Sep 27 01:55:28.247344 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2612/5268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:27 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1328 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:28.255505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:28.256752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:28.279621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:28.280130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:28.280570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:28.283337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:28.283986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:28.286006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:28.529419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.545084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.547843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.549264 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1aa0f4c8-7c0a-47c5-a673-49bba8570c5f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1877 microversion: 2.42 time: 0.648787 Sep 27 01:55:28.551590 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2657/5269] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:27 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1877 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:28.713320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.725753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.727201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:28.728384 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b878e82-cb84-4bbf-90bf-2122e1924589 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1729 microversion: 2.20 time: 0.480043 Sep 27 01:55:28.728945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2613/5270] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:28 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1729 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:29.276199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:29.277654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:29.285253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.286264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.286930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:29.287874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.288795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.289674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:29.582967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:29.584631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:29.602140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.603099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.603775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:29.604849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.605775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.607386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:29.666678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:29.681539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7ea6302-720b-4f4e-882b-96a811a417f7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1510 microversion: 2.1 time: 0.410839 Sep 27 01:55:29.697375 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2658/5271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:29 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:29.705384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:29.706208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:29.713473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.716187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.719490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:29.720682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:29.720787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:29.721123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.008496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.021225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.021972 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-985649a8-cc81-4c75-a776-3333edc68020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1510 microversion: 2.1 time: 0.319280 Sep 27 01:55:30.022579 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2659/5272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:29 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:30.030375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:30.035260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.040405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:30.045198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.048940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.051147 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15f9fe61-1123-4453-a359-bc946135e7a6 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2833 microversion: 2.42 time: 0.476185 Sep 27 01:55:30.052561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.053042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.054438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.054911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.055347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.073659 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2614/5273] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:29 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2833 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:30.310042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-560865474", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "c156eff5-9d55-4184-a823-6d151e1450fb"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:30.412078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] validate_networks() for [('c156eff5-9d55-4184-a823-6d151e1450fb', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:55:30.621472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.669032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.675736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:30.678486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e3a240a-08da-4a8d-9e93-c434e741c622 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1716 microversion: 2.20 time: 0.653584 Sep 27 01:55:30.680541 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2660/5274] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:55:30 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1716 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:30.696564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:30.697399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:30.707105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.708726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.710440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.711603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.715576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.716760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.755218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:55:30.794872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:30.916313 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7cd60a8-20ff-4e1c-ba2e-f04ee4d38d90 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 204 len: 0 microversion: 2.1 time: 0.234328 Sep 27 01:55:30.928090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2661/5275] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:55:30 2022] DELETE /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:55:30.936337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:30.939914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:30.950918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.951780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.953633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:30.964336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:30.965978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:30.966657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:31.175891 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cfe2e0f-0be0-4ad6-89ce-d9c794f86c78 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.246560 Sep 27 01:55:31.177401 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2662/5276] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:55:30 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a/os-interface => generated 1830 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:55:31.183917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:31.186015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:31.195940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:31.198674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:31.199493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:31.201482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:31.203542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:31.205454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:31.817006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:31.830726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9791a5b5-6bfe-4e17-b63e-d3378e4c6a4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1516 microversion: 2.1 time: 0.646826 Sep 27 01:55:31.831666 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2663/5277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:31 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1516 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:32.106444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:55:32.107019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:55:32.107433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:55:32.107850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:55:32.108264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:55:32.128641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:32.131077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:32.132141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:32.133098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:32.133502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:32.134021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:32.174109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Getting quotas for project 8d2d7e20f783425085547d9661d8b278. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:55:32.190404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Getting quotas for user b29dba208fbc4c86bb8eb23ed6e22e58 and project 8d2d7e20f783425085547d9661d8b278. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:55:32.220606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:55:32.224126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:55:32.339042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac4f6832-ca71-465f-9ae8-0c579956a523 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.261916 Sep 27 01:55:32.339750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2615/5278] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:55:32.352008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbaafd98-e594-46b7-bdca-23d04e24d10c tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:32.352638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbaafd98-e594-46b7-bdca-23d04e24d10c tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:32.545799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbaafd98-e594-46b7-bdca-23d04e24d10c tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:32.561324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbaafd98-e594-46b7-bdca-23d04e24d10c tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1213 microversion: 2.1 time: 0.213421 Sep 27 01:55:32.562518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2664/5279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:32 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:32.859389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:32.860298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:32.876079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:32.876940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:32.877597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:32.878503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:32.879132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:32.879727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:33.223612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:33.238030 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e95d0f82-8c4a-4797-b644-c296ba6554e0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1516 microversion: 2.1 time: 0.384327 Sep 27 01:55:33.239345 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2616/5280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:32 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:33.584077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:33.584760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:33.602278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:33.602701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:33.603136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:33.610379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:33.611336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:33.611937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:33.902487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:33.924983 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61a3afa8-23c2-4c26-b0cd-4df06d63b447 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1265 microversion: 2.1 time: 0.342709 Sep 27 01:55:33.925712 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2665/5281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:33 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:34.261860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:34.262537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:34.277683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:34.278245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:34.278914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:34.280061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:34.281265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:34.283880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:34.416935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd327e4-b5cf-4588-948a-2034c0c56662", "name": "network-vif-deleted", "tag": "8025042f-36fa-44dc-ab6c-c90a8c50305d"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:34.444499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:34.448720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:34.449933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:34.450700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:34.497419 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] Creating event network-vif-deleted:8025042f-36fa-44dc-ab6c-c90a8c50305d for instance bdd327e4-b5cf-4588-948a-2034c0c56662 on n-h1-859358-1 Sep 27 01:55:34.508289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-eb5d637f-ffd6-4448-bf14-c32ee4ecc292 req-de1ffded-1244-46db-b42e-e7895691a8ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097722 Sep 27 01:55:34.511298 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2666/5282] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:34.572709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:34.618219 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fbc7ba02-942c-4517-93eb-bf75b187d991 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 200 len: 1474 microversion: 2.1 time: 0.357323 Sep 27 01:55:34.621033 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2617/5283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:34 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:34.952025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:34.954001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:34.972999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:34.973528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:34.977779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:34.978527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:34.978998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:34.979431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:35.117325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:35.131578 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc81d815-13e4-491c-960d-933eca1abff6 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1271 microversion: 2.1 time: 0.186973 Sep 27 01:55:35.132669 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2667/5284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:34 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:35.645547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:35.646138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:35.660235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:35.661900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:35.666463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:35.667453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:35.667931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:35.668360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:35.706079 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 HTTP/1.1 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'bdd327e4-b5cf-4588-948a-2034c0c56662'} Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:35.707869 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:55:35.713675 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e63e7da6-d945-4f7a-b924-3bd57c7dc5e4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 404 len: 111 microversion: 2.1 time: 0.068954 Sep 27 01:55:35.718858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2361d13-9150-4cf1-b2d7-599e19cf46ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '.version_select at 0x7f24d54bc790>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:35.735021 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2618/5285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:35 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:55:35.774901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2361d13-9150-4cf1-b2d7-599e19cf46ae tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-2103285145" status: 202 len: 0 microversion: 2.1 time: 0.060464 Sep 27 01:55:35.775728 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2668/5286] 10.222.0.52 () {58 vars in 1209 bytes} [Tue Sep 27 01:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2103285145 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:55:35.971823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-145944157", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:36.044371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:55:36.156660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:36.158056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:36.170193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:36.172465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:36.173207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:36.174525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:36.175386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:36.176047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:36.328473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:36.342708 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b7fb1a3-6073-4fc0-9c34-ff24978c16fe tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1271 microversion: 2.1 time: 0.190383 Sep 27 01:55:36.343882 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2669/5287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:36 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:36.539087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "tag": "00d3fb02-c4c7-4018-8f37-2aaef4236ae6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:36.558331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:36.559262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:36.559881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:36.582068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] Creating event network-changed:00d3fb02-c4c7-4018-8f37-2aaef4236ae6 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:55:36.592417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-61831e4f-7926-4300-af7a-76c494d14083 req-2b28eaf6-afae-40c5-832e-cacc80644966 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057897 Sep 27 01:55:36.593679 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2670/5288] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:55:37.399004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:37.406642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:37.443137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:37.443641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:37.444083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:37.444806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:37.445262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:37.445716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:37.840471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:37.855076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce6f9f1b-1d44-45fe-b170-c706710ab542 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.491885 Sep 27 01:55:37.858006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2671/5289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:37 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:38.880767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:38.881562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:38.897639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:38.898391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:38.898993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:38.899886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:38.900504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:38.901119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:39.329625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:55:39.330138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:55:39.330499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:55:39.331096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:55:39.331517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:55:39.361961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:39.377108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:39.378024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:39.380458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:39.382134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:39.382876 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b56ccd76-9424-4e14-978c-09222c3cc680 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.504593 Sep 27 01:55:39.386387 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2672/5290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:38 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:39.392058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:39.392718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:39.425911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:55:39.436930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:55:39.485685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:55:39.488975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:55:39.569706 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed296245-26eb-4f57-9b3d-351bad248639 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.604311 Sep 27 01:55:39.581921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-853cc0dd-e697-4dd8-b5ad-1c54dcf36020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:39.582542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-853cc0dd-e697-4dd8-b5ad-1c54dcf36020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:39.591127 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2619/5291] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:55:39.822733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-853cc0dd-e697-4dd8-b5ad-1c54dcf36020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:39.833883 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-853cc0dd-e697-4dd8-b5ad-1c54dcf36020 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1208 microversion: 2.1 time: 0.256290 Sep 27 01:55:39.842200 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2673/5292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:39 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1208 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:40.419463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:40.424033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:40.453880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:40.455041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:40.456096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:40.460290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:40.460462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:40.462988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:40.889134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:40.891201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:40.903615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:40.904723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:40.906928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:40.908477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:40.909175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:40.910378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:41.151893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:41.175023 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9da8a30-d6a1-44a2-9f8a-e352a0f6ae0a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1260 microversion: 2.1 time: 0.321196 Sep 27 01:55:41.181984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2674/5293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:40 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:41.867793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:41.887540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3faad2ee-5af6-4de0-925d-95d5b8338d9a tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 1.482995 Sep 27 01:55:41.890945 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2620/5294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:40 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:42.201650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:42.202912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:42.210081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:42.210851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:42.211458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:42.212329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:42.212941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:42.213583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:42.371282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:42.384403 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3894aa77-cf46-42a9-bb54-80cfe9228c14 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1266 microversion: 2.1 time: 0.186417 Sep 27 01:55:42.402501 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2675/5295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:42 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:42.912075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:42.913331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:42.919984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:42.920462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:42.922540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:42.923458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:42.924087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:42.924694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:42.954164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:43.072461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5065d5f2-85be-4791-b532-0fdbaf4a493f", "tag": "e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:43.098557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:43.099482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:43.107325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:43.128857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] Creating event network-changed:e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e for instance 5065d5f2-85be-4791-b532-0fdbaf4a493f on n-h1-859358-1 Sep 27 01:55:43.142818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4659dad1-a0ae-4878-a0a0-0c6ee77e506e req-93037d17-a6c7-4396-be7f-848977ec3b52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077209 Sep 27 01:55:43.143479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2676/5296] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:55:43.587828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-414172128", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:43.656784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] validate_networks() for [('12da5829-5ce4-4c3a-8540-8363f87c68b2', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:55:43.951369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:43.991935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9cb799d-3a4d-4574-b14f-d1bcfda28596 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 1.081073 Sep 27 01:55:43.993382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2621/5297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:42 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:44.012818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:44.015283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:44.032781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:44.032959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:44.033428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:44.038323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:44.039715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:44.040289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:44.641132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:55:44.641744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:55:44.642062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:55:44.642472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:55:44.642886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:55:44.654327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:44.656107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:44.656739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:44.657698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:44.658612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:44.659438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:44.699070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Getting quotas for project ed175d86660a4eaab145f925a3f9ed61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:55:44.706446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Getting quotas for user 07776c2072b64797b9f2bcd3f48d1fa5 and project ed175d86660a4eaab145f925a3f9ed61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:55:44.711964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:44.723798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-179b26a9-d951-44c9-bffa-c78a471a4d8e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.728195 Sep 27 01:55:44.732816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:55:44.740078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2622/5298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:43 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:44.740833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:55:44.835225 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8561b40b-211e-4729-8029-4f8df413c25f tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431926 Sep 27 01:55:44.836839 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2677/5299] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:55:44.857675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-831a6b4e-68c4-433f-96b3-66cc0288379d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:44.861072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-831a6b4e-68c4-433f-96b3-66cc0288379d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:45.021051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:45.021806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:45.032995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:45.038201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:45.039022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:45.039860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:45.040416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:45.041047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:45.108440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-831a6b4e-68c4-433f-96b3-66cc0288379d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:45.128793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-831a6b4e-68c4-433f-96b3-66cc0288379d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1223 microversion: 2.1 time: 0.284532 Sep 27 01:55:45.140444 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2623/5300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:44 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1223 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:45.206895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d3bf62-3500-451c-b364-9b5aaccf2742", "tag": "6834163b-a98d-45e7-912d-5f63e3ab8abd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:45.232418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:45.233892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:45.237913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:45.261870 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] Creating event network-changed:6834163b-a98d-45e7-912d-5f63e3ab8abd for instance e8d3bf62-3500-451c-b364-9b5aaccf2742 on n-h1-859358-1 Sep 27 01:55:45.276988 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d156b75c-a3ee-42f2-810d-d7c4d6caa26d req-61af06b1-1967-4cda-a146-c4bcd7b8456b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073860 Sep 27 01:55:45.283553 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2624/5301] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:45.450157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:45.466795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d295ecd-cc65-4154-9908-3998498a68ab tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.450182 Sep 27 01:55:45.473160 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2678/5302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:45 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:45.756260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:45.766998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:45.786728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:45.787734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:45.788351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:45.789563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:45.790192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:45.790795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:46.154032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:46.157739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:46.173781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:46.174451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:46.175058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:46.175986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:46.176603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:46.177427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:46.314234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:46.325312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ef3018a-db3c-44c6-aa9d-9321acf5d6a6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1275 microversion: 2.1 time: 0.176740 Sep 27 01:55:46.341368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2679/5303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:46 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:46.498505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:46.499654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:46.512206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:46.513270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:46.529032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:46.533469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:46.535374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:46.540077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:46.586716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:46.617322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a470b9dc-1b40-4c51-b7cd-bb507c08b41f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.870463 Sep 27 01:55:46.617951 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2625/5304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:45 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:46.926276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:46.937311 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf86e693-5da6-47dd-afea-79b3543b726b tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.442195 Sep 27 01:55:46.942362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2680/5305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:46 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:47.351946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:47.352561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:47.366127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:47.367632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.368285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.373674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:47.374548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.375038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.375486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:47.641425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:47.642184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:47.651987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.653137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.653694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:47.656071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.656620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.657724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:47.755316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:47.767553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d346098d-f360-4c12-a809-200fcd40a41c tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1281 microversion: 2.1 time: 0.419383 Sep 27 01:55:47.768914 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2626/5306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:47 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:47.857949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:47.868599 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b3a095c-ed75-4516-9966-7818e55936d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.231951 Sep 27 01:55:47.887477 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2681/5307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:47 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:47.963525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:47.964161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:47.975544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.976049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.976521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:47.977869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:47.978330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:47.978920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:48.779356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:48.795431 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b4b8935-f956-4fe3-a23b-920877c5bc78 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.835975 Sep 27 01:55:48.802129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:48.804772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:48.814206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2627/5308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:47 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:48.821805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:48.822411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:48.822979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:48.823916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:48.824450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:48.824957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:48.896483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:48.897907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:48.904796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:48.905331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:48.906098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:48.906853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:48.907540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:48.908240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:48.966890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:48.976607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a900ffad-3cae-4669-acb4-f0317f1bc9f8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1281 microversion: 2.1 time: 0.185972 Sep 27 01:55:48.977068 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2682/5309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:48 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:49.387556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:49.421747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:49.429819 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bf2fd189-12e3-4ad0-ae8e-cc98d86d506a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.536047 Sep 27 01:55:49.458898 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2628/5310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:48 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:49.570247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065d5f2-85be-4791-b532-0fdbaf4a493f", "name": "network-vif-plugged", "status": "completed", "tag": "e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:49.581101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:49.581955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:49.582644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:49.603998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] Creating event network-vif-plugged:e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e for instance 5065d5f2-85be-4791-b532-0fdbaf4a493f on n-h1-859358-1 Sep 27 01:55:49.615157 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5d2f5c89-eb4a-45b8-8f6d-cf2eea8fd740 req-063a51c0-9f05-4910-82b7-b1b50012ec2a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053411 Sep 27 01:55:49.616031 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2683/5311] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:49.820639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:49.822460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:49.832558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:49.833195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:49.833977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:49.834949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:49.835758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:49.836256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:50.007714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:50.008232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:50.016285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:50.016783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:50.017506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:50.018755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:50.020976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:50.021707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:50.045896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:50.284270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:50.299120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-046b93a5-0b64-44f7-be9a-2c0a97c6b7ea tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.482849 Sep 27 01:55:50.300628 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2629/5312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:49 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:50.368574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:50.380988 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0975f8ca-0430-401f-abf7-9ee9bce9c804 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.380195 Sep 27 01:55:50.381739 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2684/5313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:49 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:50.466968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:50.467939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:50.475329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:50.476061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:50.476705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:50.478071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:50.478781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:50.481637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:50.841743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:50.851599 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8882e76d-209f-4324-bc8c-2af4ebf2054a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.389801 Sep 27 01:55:50.852366 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2630/5314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:50 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:51.346421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:51.348518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:51.417568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:51.421073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:51.433315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.442894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.446514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.447017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.447546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.448273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.448777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.449154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.450052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.450678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.451198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.451578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.892504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:51.910085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75f62dbd-50f9-4df7-b5d2-1ae35009df12 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.505672 Sep 27 01:55:51.910692 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2631/5315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:51 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:51.931893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:51.932734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:51.939530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.940025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.940469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.941182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:51.941666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:51.942285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:51.974144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:51.982198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-408cbe4d-f7de-4ed8-90d8-d8902d5f8189 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1313 microversion: 2.1 time: 0.655792 Sep 27 01:55:51.983877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2685/5316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:51 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:52.195848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1428bea2-0973-4286-b513-266463f18e96", "tag": "cedf8f74-4f4b-442c-8b6e-ed6da3398c57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:52.206718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:52.207190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:52.207612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:52.219654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] Creating event network-changed:cedf8f74-4f4b-442c-8b6e-ed6da3398c57 for instance 1428bea2-0973-4286-b513-266463f18e96 on n-h2-859358-1 Sep 27 01:55:52.224866 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-55f7f642-501a-4fce-985c-11cc1e7005b7 req-25dbb94f-7c97-4e06-b74d-ba0d533032fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 Sep 27 01:55:52.225506 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2686/5317] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:52.322484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:52.331221 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-73414686-549f-4f3c-ad59-2685166a91fc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.403306 Sep 27 01:55:52.331892 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2632/5318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:51 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:52.936352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:52.937143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:52.943467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:52.943956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:52.944426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:52.945382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:52.945837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:52.947336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.006878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:53.007583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:53.018720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:53.019213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:53.019876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.020762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:53.021410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:53.022037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.277398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:53.284792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:53.293423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2d8e268-dc28-4a55-86ba-2b5de43eda0f tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1498 microversion: 2.1 time: 0.291621 Sep 27 01:55:53.296367 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2633/5319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:53 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1498 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:53.297208 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba85d6bf-8978-4e7e-8a87-e6f46c7d0fbf tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.366381 Sep 27 01:55:53.297939 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2687/5320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:52 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:53.360618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:53.361262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:53.375769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:53.376221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:53.376667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.381013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:53.392672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:53.393274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.562167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d3bf62-3500-451c-b364-9b5aaccf2742", "name": "network-vif-plugged", "status": "completed", "tag": "6834163b-a98d-45e7-912d-5f63e3ab8abd"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:53.584252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:53.587648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:53.588231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:53.622421 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] Creating event network-vif-plugged:6834163b-a98d-45e7-912d-5f63e3ab8abd for instance e8d3bf62-3500-451c-b364-9b5aaccf2742 on n-h1-859358-1 Sep 27 01:55:53.643116 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d9efcebf-ef0f-4791-bb5e-0eec4a3d0187 req-e82ea16c-d11f-4e79-ac7a-9400da9ef8e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076961 Sep 27 01:55:53.644649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2688/5321] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:55:53.828303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:53.853130 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46f5f1b1-08db-484e-8afd-3673368f13a8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.498997 Sep 27 01:55:53.870650 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2634/5322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:53 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:54.324350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:54.325200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:54.343041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:54.344305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:54.349493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:54.350985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:54.351587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:54.352439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:54.683065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:54.715753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:54.876853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:54.877411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:54.885963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:54.886751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:54.887480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:54.888482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:54.889225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:54.890017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:55.126479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:55.175587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:55.186315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92b8d82f-284f-477c-b62f-c8df88205b74 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.867157 Sep 27 01:55:55.193585 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2689/5323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:54 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:55.648569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:55.658206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-921b351d-3459-479e-bf0f-24b38fe9aa5d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1308 microversion: 2.1 time: 0.785013 Sep 27 01:55:55.659485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2635/5324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:54 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:56.211865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:56.212811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:56.227699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:56.228422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:56.229072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:56.231669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:56.232524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:56.233709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:56.684114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:56.685628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:56.696564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:56.698916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:56.713695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:56.713695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:56.713695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:56.713695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:56.748169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:56.772759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e19dff7-5f61-462e-a837-de3339994931 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.565419 Sep 27 01:55:56.773392 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2690/5325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:56 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:57.179957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:57.209802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a8497b5-9b80-487e-be16-bf99e12dfd08 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1490 microversion: 2.1 time: 0.529299 Sep 27 01:55:57.210707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2636/5326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:56 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1490 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:55:57.418563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-145944157", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:57.516267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:55:57.798810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:57.799635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:57.812351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:57.822160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:57.822771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:57.823685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:57.824285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:57.824825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.150400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:58.162816 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-160c20ba-b881-4853-b4b7-ffa771fbd944 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.368638 Sep 27 01:55:58.165817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2637/5327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:57 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:58.178218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:58.179478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:58.187913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.188721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.189455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.190957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.191653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.192355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.228540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:55:58.292837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:55:58.418085 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93c26692-39d5-4c21-b9af-ab8d19a2c516 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 204 len: 0 microversion: 2.1 time: 0.249387 Sep 27 01:55:58.419595 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2638/5328] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:55:58 2022] DELETE /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:55:58.431701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:58.432784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:58.451898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.459107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.459535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.460425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.460897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.461330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.495489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:55:58.496133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:55:58.496529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:55:58.497249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:55:58.497997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:55:58.509239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.510010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.510626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.511592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:58.512233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:58.512835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:58.564040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:55:58.578843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:55:58.614780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:55:58.623917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:55:58.725850 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b5576969-bdab-44fe-9a42-a18f52163b13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311410 Sep 27 01:55:58.727452 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2691/5329] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:55:58.741164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4ab1d19-a7b1-4d32-b5f8-7822eefa0332 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:58.745117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4ab1d19-a7b1-4d32-b5f8-7822eefa0332 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:58.823179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4ab1d19-a7b1-4d32-b5f8-7822eefa0332 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:58.842127 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4ab1d19-a7b1-4d32-b5f8-7822eefa0332 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1208 microversion: 2.1 time: 0.106940 Sep 27 01:55:58.857863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2692/5330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:58 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:59.159081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1428bea2-0973-4286-b513-266463f18e96", "name": "network-vif-plugged", "status": "completed", "tag": "cedf8f74-4f4b-442c-8b6e-ed6da3398c57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:55:59.176054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:59.177409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:59.177409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:59.191895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] Creating event network-vif-plugged:cedf8f74-4f4b-442c-8b6e-ed6da3398c57 for instance 1428bea2-0973-4286-b513-266463f18e96 on n-h2-859358-1 Sep 27 01:55:59.197437 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ac43a180-bcff-4a43-9b01-c7aa5d17686f req-85578071-91a9-4c47-b964-11e6706dc8c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042613 Sep 27 01:55:59.198785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2693/5331] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:55:59.205367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:59.206561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:59.214037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:59.214936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:59.215664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:59.216625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:59.217437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:59.218162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:59.522276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:59.533607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19804b8d-d0ca-4d5a-8927-5ce7e297b823 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.330278 Sep 27 01:55:59.534476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2694/5332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:59 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:59.565149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:55:59.580579 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ba01147e-b235-45ce-b08c-566e30095f24 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1504 microversion: 2.1 time: 1.152632 Sep 27 01:55:59.582969 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2639/5333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:58 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1504 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:55:59.875695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:55:59.876207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:55:59.887387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:59.888191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:59.895578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:55:59.896815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:55:59.897546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:55:59.898154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:00.057496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:00.066122 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7637129-e3a1-4e88-95fd-dfeee089de7e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1260 microversion: 2.1 time: 0.194476 Sep 27 01:56:00.072848 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2695/5334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:55:59 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:00.562417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:00.563045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:00.580263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:00.580951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:00.581279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:00.581938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:00.582394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:00.582824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:00.605273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:00.605921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:00.621951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:00.622484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:00.622994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:00.623778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:00.624235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:00.624664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:00.964384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:00.975718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed4f1594-a932-4eab-b690-665fe670d32e tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1323 microversion: 2.1 time: 0.417670 Sep 27 01:56:00.976326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2640/5335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:00 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:01.096290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:01.097178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:01.106420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.109234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.109958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.116013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.116784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.118109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.294274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:01.303963 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0e12448-6455-456f-b0ab-256c3791d4f4 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1266 microversion: 2.1 time: 0.211754 Sep 27 01:56:01.312574 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2641/5336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:01 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:01.361122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:01.376944 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34a5318f-3c63-4e9a-8afe-718402826a46 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1504 microversion: 2.1 time: 0.770398 Sep 27 01:56:01.392773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2696/5337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:00 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1504 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:01.711790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:01.716454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:01.760195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.761041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.762198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.764711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.765477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.767048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.834480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-689f7986-9322-4da0-92e6-f884493bc94b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.127913 Sep 27 01:56:01.835442 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2642/5338] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Sep 27 01:56:01 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:01.909313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:01.910918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:01.921576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.922670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.923733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.924702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.925383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.925811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.950916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5065d5f2-85be-4791-b532-0fdbaf4a493f", "name": "network-vif-deleted", "tag": "e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:01.967517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:56:01.975569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:01.976449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:01.977197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:01.999638 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] Creating event network-vif-deleted:e16c4d3e-7fc7-4d46-9eb0-8c6e74575c8e for instance 5065d5f2-85be-4791-b532-0fdbaf4a493f on n-h1-859358-1 Sep 27 01:56:02.005518 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a9fcfd7b-f5b7-4dfa-b9b4-924691eee0ec req-1ad22ab3-80e4-41b0-92fd-4fe3fc5ed334 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059187 Sep 27 01:56:02.006560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2643/5339] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:02.017500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:02.018216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:02.051626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.052124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.052782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.053535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.053999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.054427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.098894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:02.109705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3573dc97-f4ec-4988-96ea-9e2279e6559e tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 204 len: 0 microversion: 2.20 time: 0.205605 Sep 27 01:56:02.110735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2697/5340] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:56:01 2022] DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:56:02.123117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:02.125231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:02.134143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.135534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.136217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.137178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.137949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.140028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.535612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:02.550295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-247283be-7612-4464-913b-dc5d99aea8f4 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1519 microversion: 2.1 time: 0.542219 Sep 27 01:56:02.566680 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2644/5341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:02 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:02.580498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:02.581398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:02.589981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.590856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.591689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.593899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.594564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.595192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.801209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:02.810103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16bf3100-ca81-4229-bdb3-06f2f8a38c4a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1266 microversion: 2.1 time: 0.241848 Sep 27 01:56:02.813961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2645/5342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:02 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:02.833621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:02.834244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:02.851987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.852489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.852925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.853671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.854126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.854549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.930643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:02.937865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:02.940345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:02.941009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lazy-loading 'fault' on Instance uuid 5065d5f2-85be-4791-b532-0fdbaf4a493f {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:56:03.055459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b29dba208fbc4c86bb8eb23ed6e22e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2d7e20f783425085547d9661d8b278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:03.063880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b957af45-03be-4140-8f35-8f65a21fcc01 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 200 len: 1303 microversion: 2.1 time: 0.245320 Sep 27 01:56:03.068780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2646/5343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:02 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:03.080040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:03.081355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10ad467b-caa0-4dbd-8383-604fecb2f033 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-466934099", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10ad467b-caa0-4dbd-8383-604fecb2f033 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 242 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-466934099", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-466934099', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '12da5829-5ce4-4c3a-8540-8363f87c68b2'}]}}} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:56:03.091397 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.099373 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.101838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:03.102036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10ad467b-caa0-4dbd-8383-604fecb2f033 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.102036 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-10ad467b-caa0-4dbd-8383-604fecb2f033 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025849 Sep 27 01:56:03.102036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2647/5344] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:03 2022] POST /compute/v2.1/servers => generated 175 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:03.105156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:03.106811 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4235d02-0498-4fb6-9228-e35bb71cb702 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.990591 Sep 27 01:56:03.107378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:03.109674 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2698/5345] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:02 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:03.131289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 11e2059f-ba4c-40b1-9b47-1e38d19ac020] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:03.143021 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] HTTP exception thrown: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/11e2059f-ba4c-40b1-9b47-1e38d19ac020/metadata HTTP/1.1 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '11e2059f-ba4c-40b1-9b47-1e38d19ac020'} Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.165317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 404 to user: Instance 11e2059f-ba4c-40b1-9b47-1e38d19ac020 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.172206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bcc4327b-8682-4c91-9e4b-484adf65b771 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/11e2059f-ba4c-40b1-9b47-1e38d19ac020/metadata" status: 404 len: 111 microversion: 2.1 time: 0.068506 Sep 27 01:56:03.179039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2648/5346] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 01:56:03 2022] GET /compute/v2.1/servers/11e2059f-ba4c-40b1-9b47-1e38d19ac020/metadata => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:56:03.247212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62f19c3b-6292-4b9a-8ec8-2a1b74d39672 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-260589707", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62f19c3b-6292-4b9a-8ec8-2a1b74d39672 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 498 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-260589707", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-260589707', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '12da5829-5ce4-4c3a-8540-8363f87c68b2'}]}}} Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:56:03.254671 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.261753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.267821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62f19c3b-6292-4b9a-8ec8-2a1b74d39672 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.269092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62f19c3b-6292-4b9a-8ec8-2a1b74d39672 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026497 Sep 27 01:56:03.281294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2699/5347] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:03.338813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c79c2b0-f5e9-4ae8-a296-2abc0bf4ed69 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-413633251", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c79c2b0-f5e9-4ae8-a296-2abc0bf4ed69 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 499 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-413633251", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-413633251', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '12da5829-5ce4-4c3a-8540-8363f87c68b2'}]}}} Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:56:03.344105 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.348425 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.354035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c79c2b0-f5e9-4ae8-a296-2abc0bf4ed69 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.354035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c79c2b0-f5e9-4ae8-a296-2abc0bf4ed69 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017490 Sep 27 01:56:03.354862 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2649/5348] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:03.476938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95988ffc-3c1c-4240-b440-e0576bca372d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699721591", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95988ffc-3c1c-4240-b440-e0576bca372d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 754 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1699721591", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1699721591', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '12da5829-5ce4-4c3a-8540-8363f87c68b2'}]}}} Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:56:03.487978 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:56:03.490868 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:56:03.496732 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.496732 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.496732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95988ffc-3c1c-4240-b440-e0576bca372d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.496732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95988ffc-3c1c-4240-b440-e0576bca372d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.042442 Sep 27 01:56:03.496732 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2700/5349] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 27 01:56:03.570156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-271431a4-186f-4b89-a5c4-d62bfda48542 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2077938022", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-271431a4-186f-4b89-a5c4-d62bfda48542 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 1266 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2077938022", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "12da5829-5ce4-4c3a-8540-8363f87c68b2"}]}} Sep 27 01:56:03.575672 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2077938022', 'imageRef': 'c7f94860-9c0a-4587-87f9-f17df944ca27', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '12da5829-5ce4-4c3a-8540-8363f87c68b2'}]}}} Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.580494 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 01:56:03.583009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 01:56:03.586206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 27 01:56:03.586206 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.587563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-271431a4-186f-4b89-a5c4-d62bfda48542 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.588744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-271431a4-186f-4b89-a5c4-d62bfda48542 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023273 Sep 27 01:56:03.590267 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2650/5350] 10.222.0.52 () {60 vars in 1148 bytes} [Tue Sep 27 01:56:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 27 01:56:03.603510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:03.606314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 039b554d-9167-4cc1-9dde-7c61e9861d52] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:03.616479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] HTTP exception thrown: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/039b554d-9167-4cc1-9dde-7c61e9861d52/metadata/test2 HTTP/1.1 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': '039b554d-9167-4cc1-9dde-7c61e9861d52', 'id': 'test2'} Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:03.620323 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:03.626112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:03.626112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:03.626112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. Sep 27 01:56:03.626112 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:03.628927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 404 to user: Instance 039b554d-9167-4cc1-9dde-7c61e9861d52 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:03.628927 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb5eaef0-fa1d-40d2-8da7-54d7c44be72b tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/039b554d-9167-4cc1-9dde-7c61e9861d52/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.029851 Sep 27 01:56:03.628927 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2701/5351] 10.222.0.52 () {58 vars in 1281 bytes} [Tue Sep 27 01:56:03 2022] GET /compute/v2.1/servers/039b554d-9167-4cc1-9dde-7c61e9861d52/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:03.649201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:03.650244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:03.660592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.661453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.662186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:03.665689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.666314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.666925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:03.700451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:56:03.836532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:03.837497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:03.848309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.849626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.851368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:03.852362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.855440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.856168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:03.907765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b334e247-2c62-4027-b631-616fe800628d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 204 len: 0 microversion: 2.1 time: 0.263494 Sep 27 01:56:03.912522 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2651/5352] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:56:03 2022] DELETE /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:56:03.922245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:03.924004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:03.931190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.931840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.933381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:03.934445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:03.934990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:03.935478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:04.191375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:04.199737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-665dbd34-5caa-4005-ad8c-3c154a6580e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1308 microversion: 2.1 time: 0.367035 Sep 27 01:56:04.217081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2702/5353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:03 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:04.222187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:04.222792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] [instance: 5065d5f2-85be-4791-b532-0fdbaf4a493f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:04.229472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:04.229969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:04.230411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:04.231134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:04.231596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:04.232027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:04.247821 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] HTTP exception thrown: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Request method failure captured: Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f HTTP/1.1 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlgOYEKLsKzbir2QtD84zVBakbR12QMMwjBPw7izo-LsZikStyU2xddnXRgCj_QXU3Rq1sdjPspgS0gQqAk556QtGLiKuS3eWJk8jfqo-lUOIJ3CgYnr2roWOx3zJJ_E4_YWf2pVJcz-Z5B53-NIQdvk3DypcUSQXA1mFFRzZ60QdqY Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8d2d7e20f783425085547d9661d8b278 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesActionsTest-1966541293 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d2d7e20f783425085547d9661d8b278"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8d2d7e20f783425085547d9661d8b278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8d2d7e20f783425085547d9661d8b278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8d2d7e20f783425085547d9661d8b278", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesActionsTest-1966541293 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8d2d7e20f783425085547d9661d8b278 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesActionsTest-1966541293 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesActionsTest-1966541293-project Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b29dba208fbc4c86bb8eb23ed6e22e58 Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesActionsTest-1966541293-project Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '5065d5f2-85be-4791-b532-0fdbaf4a493f'} Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:04.250534 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. Sep 27 01:56:04.255879 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:04.267219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] Returning 404 to user: Instance 5065d5f2-85be-4791-b532-0fdbaf4a493f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:04.268615 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-710c3d69-0cf8-4b3f-9989-e63012a08188 tempest-VolumesActionsTest-1966541293 tempest-VolumesActionsTest-1966541293-project] 10.222.0.52 "GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f" status: 404 len: 111 microversion: 2.1 time: 0.050384 Sep 27 01:56:04.269715 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2703/5354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:04 2022] GET /compute/v2.1/servers/5065d5f2-85be-4791-b532-0fdbaf4a493f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:04.280770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:04.282284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:04.291382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:04.292255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:04.292881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:04.293877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:04.294498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:04.298149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:04.585877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:04.604045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:04.606721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:04.609104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-591268fd-caab-41db-a883-bc449687bfc9 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.338231 Sep 27 01:56:04.609732 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2704/5355] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:04 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:05.018034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7291fe92-34ea-4f4c-887f-c7d608735303", "tag": "6cea8276-fc07-4df9-98c2-e765762cbff5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:05.036772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:05.037538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:05.039873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:05.048865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:05.056713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] Creating event network-changed:6cea8276-fc07-4df9-98c2-e765762cbff5 for instance 7291fe92-34ea-4f4c-887f-c7d608735303 on n-h1-859358-1 Sep 27 01:56:05.061824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7132fb1e-0eed-4160-8d90-3d606a70608d tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1525 microversion: 2.1 time: 1.146764 Sep 27 01:56:05.065087 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bf1c1b3f-8202-4d70-94b0-4b9519b4d83a req-fe989b74-deff-4a4f-80c5-2347b71ba5fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053480 Sep 27 01:56:05.068285 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2652/5356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:03 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1525 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:05.069327 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2705/5357] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:05.223525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:05.224521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:05.231420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:05.232220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:05.232964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:05.233996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:05.234759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:05.235417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:05.639185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:05.639581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:05.649252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:05.654152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:05.655016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:05.655970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:05.658608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:05.659858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:05.998979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:06.009590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:06.011059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:06.013440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f846638d-2d7c-4362-865b-cc2474b7f8c3 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1722 microversion: 2.20 time: 0.378760 Sep 27 01:56:06.014380 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2706/5358] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:05 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:06.018882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:06.033100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4fe91342-db46-4ae5-8b6b-057cb7e369d5 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1308 microversion: 2.1 time: 0.813205 Sep 27 01:56:06.034382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2653/5359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:05 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1308 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:06.091545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:06.092569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:06.099968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:06.100457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:06.100894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:06.101752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:06.102210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:06.103246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:06.123837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:06.305576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:06.317612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7d47ea5-e2f9-4bd0-a1cc-aa1c78fe9ff6 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1525 microversion: 2.1 time: 0.229943 Sep 27 01:56:06.318540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2707/5360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:06 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1525 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:07.047584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:07.049000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:07.058529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:07.059212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:07.065116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.066745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.068537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.070448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.070936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.073639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.084642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.085431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.089610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.092469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.093219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.098115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.601740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:07.615402 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43e98538-e13c-4827-b349-171d52eacf96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1308 microversion: 2.1 time: 0.557579 Sep 27 01:56:07.618136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2708/5361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:07 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1308 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:07.632288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:07.635270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:07.668881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.669901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.671392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.672964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:07.673731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:07.675874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:07.697821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:07.715389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:07.720462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:07.728215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bb1a3e6d-afd4-465a-bda0-0306b4d72de7 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1655 microversion: 2.20 time: 0.686638 Sep 27 01:56:07.733182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2654/5362] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:07 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1655 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:08.332799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:08.358348 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3706c236-fb5c-44fc-a43e-91f54ae935e8 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1525 microversion: 2.1 time: 0.736944 Sep 27 01:56:08.358983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2709/5363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:07 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1525 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:08.647443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:08.648095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:08.657383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:08.658252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:08.658922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:08.660017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:08.660739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:08.661422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:08.733321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1428bea2-0973-4286-b513-266463f18e96", "name": "network-vif-deleted", "tag": "cedf8f74-4f4b-442c-8b6e-ed6da3398c57"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:08.754030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:08.772808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:08.773560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:08.774063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:08.805795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] Creating event network-vif-deleted:cedf8f74-4f4b-442c-8b6e-ed6da3398c57 for instance 1428bea2-0973-4286-b513-266463f18e96 on n-h2-859358-1 Sep 27 01:56:08.815579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-85202b5b-b7d6-47ab-b361-33cd18436424 req-85981371-0384-476b-ba4b-98f903eab670 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091124 Sep 27 01:56:08.816632 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2710/5364] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:08.825256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:08.837169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:08.839647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:08.849247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:08.850142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:08.850885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:08.852027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:08.852710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:08.853423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:09.028785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:09.043519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:09.052447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '305ea2953dde435d9e74bb0bc0da89b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9042d8e2cb974e91b397874370b74c88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:09.057281 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b049ca9-502a-43a6-a0fa-6e71106d8584 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 200 len: 1655 microversion: 2.20 time: 0.238238 Sep 27 01:56:09.060104 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2711/5365] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:08 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 1655 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:09.306618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:09.338960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e89c7ce-2fae-409d-97e6-0fd4514bb0cd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1308 microversion: 2.1 time: 0.696734 Sep 27 01:56:09.340159 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2655/5366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:08 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:09.386601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:09.389090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:09.411323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:09.413789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:09.418826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:09.422853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:09.424653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:09.425880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:09.518586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:09.519086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:09.519528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:09.520045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lazy-loading 'fault' on Instance uuid 1428bea2-0973-4286-b513-266463f18e96 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:56:09.762759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07776c2072b64797b9f2bcd3f48d1fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed175d86660a4eaab145f925a3f9ed61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:09.788092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe8d59f7-7411-44ba-8f18-2dbe96857af3 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 200 len: 1313 microversion: 2.1 time: 0.393021 Sep 27 01:56:09.789140 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2712/5367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:09 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:10.081935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7291fe92-34ea-4f4c-887f-c7d608735303", "name": "network-vif-plugged", "status": "completed", "tag": "6cea8276-fc07-4df9-98c2-e765762cbff5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:10.091927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:10.092830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:10.103156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.106086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.106985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.108032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.108610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.109136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.117799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.118594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.118985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.140012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] Creating event network-vif-plugged:6cea8276-fc07-4df9-98c2-e765762cbff5 for instance 7291fe92-34ea-4f4c-887f-c7d608735303 on n-h1-859358-1 Sep 27 01:56:10.159192 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:10.161076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-77f46b5d-0782-48df-a5e7-5a105cca6401 req-5561e983-4ae5-4b17-b11e-794f1562f381 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077587 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 HTTP/1.1 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f6e68e01-ef21-4703-b3bd-0a21b1a7e073'} Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.161577 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:10.168093 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.169135 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2656/5368] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:10.173883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:10.175095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3af8c3f-6891-4e04-b4a6-73e382c51f59 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 404 len: 111 microversion: 2.20 time: 0.087706 Sep 27 01:56:10.179934 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2713/5369] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:10 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:10.197298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f57a712-0a28-4abf-b942-c3ad477bab37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '.version_select at 0x7f24d55b83a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:10.267507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f57a712-0a28-4abf-b942-c3ad477bab37 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287588850" status: 204 len: 0 microversion: 2.20 time: 0.083665 Sep 27 01:56:10.271644 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2657/5370] 10.222.0.52 () {60 vars in 1259 bytes} [Tue Sep 27 01:56:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287588850 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:56:10.365252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:10.366187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:10.377763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.378607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.379226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.381583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.385606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.386416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.815813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:10.817096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] [instance: 1428bea2-0973-4286-b513-266463f18e96] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:10.825048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.826588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.838117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.838957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.845460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.846097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.852225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:10.860814 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-203b48ff-f82b-4eec-8711-f7c355fce17d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1308 microversion: 2.1 time: 0.499516 Sep 27 01:56:10.861456 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2714/5371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:10 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:10.874805 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] HTTP exception thrown: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Request method failure captured: Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 HTTP/1.1 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlgfmdC8qTew1k_hErqG9ZpZN8wx0HIkgVkhMAbEuof8Pg479RIyPF9BUB9VQ5FCqIallYyshkfJAEWUyBN5Me4TlpmHEHJeEtWsFzqQ2ecIfssXLLEZEFLSACeoUBAnMHMDflwWudsRWf_TLCRc28ecpmQlsJEM66dghmDOEu_DuqQ Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed175d86660a4eaab145f925a3f9ed61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed175d86660a4eaab145f925a3f9ed61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ed175d86660a4eaab145f925a3f9ed61 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1631027113 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 07776c2072b64797b9f2bcd3f48d1fa5 Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1631027113-project Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '1428bea2-0973-4286-b513-266463f18e96'} Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:10.877248 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] Returning 404 to user: Instance 1428bea2-0973-4286-b513-266463f18e96 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6041f27b-d36d-416b-9986-339dc05cde82 tempest-ServerMetadataNegativeTestJSON-1631027113 tempest-ServerMetadataNegativeTestJSON-1631027113-project] 10.222.0.52 "GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96" status: 404 len: 111 microversion: 2.1 time: 0.071519 Sep 27 01:56:10.882789 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2658/5372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:10 2022] GET /compute/v2.1/servers/1428bea2-0973-4286-b513-266463f18e96 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:56:10.888231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e68e01-ef21-4703-b3bd-0a21b1a7e073", "name": "network-vif-deleted", "tag": "e7ea101e-a02e-4b09-a6af-5373308703c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:10.911264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:10.911820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:10.912248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:10.937059 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] Creating event network-vif-deleted:e7ea101e-a02e-4b09-a6af-5373308703c0 for instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 on n-h1-859358-1 Sep 27 01:56:10.954096 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-902daed5-ee81-400d-abe7-e35cd0f62103 req-544d2b91-cc47-46fe-8b44-319e12dfc7c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069931 Sep 27 01:56:10.954756 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2715/5373] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:11.886328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:11.886945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:11.904996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:11.905875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:11.906814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:11.907934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:11.909995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:11.910664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:13.056201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:13.075385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:13.084934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6f65c06-85d4-412e-b0e2-c99e2962e868 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1489 microversion: 2.1 time: 1.202443 Sep 27 01:56:13.116538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:13.119326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2659/5374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:11 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1489 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:13.120632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:13.135168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:13.135679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:13.136120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:13.141857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:13.142713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:13.143427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:13.537842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:13.549224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2cefa16f-723e-4ac9-879a-a288c4073aaf tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1490 microversion: 2.1 time: 0.438435 Sep 27 01:56:13.550676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2716/5375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:13 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1490 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:13.573929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:13.574911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:13.584443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:13.585266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:13.585948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:13.587170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:13.587838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:13.588747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:14.016706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:14.030354 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6b5e0d4e-776f-4f39-af16-49bdea62c6f1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1489 microversion: 2.1 time: 0.459864 Sep 27 01:56:14.030874 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2660/5376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:13 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1489 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:14.057763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:14.058601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:14.068966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:14.069583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:14.071231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:14.072696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:14.073280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:14.075399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:14.122002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:56:14.329611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75db229a-f22a-4260-aff2-eaa75259dc60 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 204 len: 0 microversion: 2.1 time: 0.276919 Sep 27 01:56:14.331738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2717/5377] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:56:14 2022] DELETE /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:56:14.342491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:14.343678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:14.351333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:14.352292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:14.353127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:14.354071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:14.354721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:14.355321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:14.686262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:14.694044 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04858944-1219-4dfa-b676-5aa8284e7dd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1495 microversion: 2.1 time: 0.357044 Sep 27 01:56:14.694625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2661/5378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:14 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1495 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:15.719101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:15.720004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:15.734444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:15.735092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:15.735643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:15.736497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:15.737730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:15.741524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:16.556709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:16.573037 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a41c6ef-b649-43ed-9ffc-59473bd18d89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1495 microversion: 2.1 time: 0.858451 Sep 27 01:56:16.575894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2718/5379] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:15 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1495 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:17.272838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:17.273387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:17.281528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.282022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.283249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:17.283964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.284419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.284898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:17.305162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 HTTP/1.1 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f6e68e01-ef21-4703-b3bd-0a21b1a7e073'} Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:17.320166 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.327067 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.330309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:17.331607 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d61ac2ed-76c4-48d4-9422-769b632c0b7b tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 404 len: 111 microversion: 2.20 time: 0.062778 Sep 27 01:56:17.336962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2662/5380] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:56:17 2022] DELETE /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:17.345571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:17.346619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: f6e68e01-ef21-4703-b3bd-0a21b1a7e073] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:17.358615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.362858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.363835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:17.364762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.367374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.368048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:17.399466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 HTTP/1.1 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f6e68e01-ef21-4703-b3bd-0a21b1a7e073'} Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.405243 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:17.410937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance f6e68e01-ef21-4703-b3bd-0a21b1a7e073 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:17.421217 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ebf26c6-30d3-4edc-8b75-0db1bcc361dd tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073" status: 404 len: 111 microversion: 2.20 time: 0.080092 Sep 27 01:56:17.421964 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2719/5381] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:17 2022] GET /compute/v2.1/servers/f6e68e01-ef21-4703-b3bd-0a21b1a7e073 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:17.600700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:17.601547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:17.617358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:17.619141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.620343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.621531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:17.625636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:17.626415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:17.627812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:18.163357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:18.180557 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-072fe111-c400-473e-9948-29d5adb8dd26 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1495 microversion: 2.1 time: 0.579036 Sep 27 01:56:18.201453 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2663/5382] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:17 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1495 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:18.499537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7291fe92-34ea-4f4c-887f-c7d608735303", "name": "network-vif-deleted", "tag": "6cea8276-fc07-4df9-98c2-e765762cbff5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:18.532564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:18.542233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:18.543072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:18.594557 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] Creating event network-vif-deleted:6cea8276-fc07-4df9-98c2-e765762cbff5 for instance 7291fe92-34ea-4f4c-887f-c7d608735303 on n-h1-859358-1 Sep 27 01:56:18.614305 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-00925b2d-8798-4dc3-9828-7d5d57ccd6f5 req-d33b4b0c-8c2c-4d49-a1be-ad4dfa82a2f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119165 Sep 27 01:56:18.618697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2720/5383] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:19.200120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:19.201481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:19.215562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:19.217671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:19.231119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:19.233328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:19.236177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:19.236871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:19.240779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:19.241250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:19.242300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:19.242659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:19.242904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:19.243451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:19.244974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:19.247245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:19.316204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:19.321466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:19.322195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:19.322841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lazy-loading 'fault' on Instance uuid 7291fe92-34ea-4f4c-887f-c7d608735303 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:56:19.718531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:19.727449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23dd73fa-8d15-4ab5-8f49-6cf56c766675 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 200 len: 1298 microversion: 2.1 time: 0.516874 Sep 27 01:56:19.730332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2721/5384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:19 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 1298 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:20.084709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:20.103407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:20.110020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:20.114103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-642e04af-daba-460c-91b9-48c2a50016a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2951 microversion: 2.42 time: 0.918799 Sep 27 01:56:20.116356 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2664/5385] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:19 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2951 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:20.149822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:20.150363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:20.163251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.170330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.170819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.171578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.176562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.177061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.710164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71e961f1-cb28-4bd7-afbd-46d318884310 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.559479 Sep 27 01:56:20.710164 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2722/5386] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Sep 27 01:56:20 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a/os-interface => generated 1830 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:56:20.766113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:20.767345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:20.783993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.784986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.785663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.787314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.790836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.791547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.828767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 HTTP/1.1 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7291fe92-34ea-4f4c-887f-c7d608735303'} Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:20.831013 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:56:20.836969 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:20.840201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:20.842824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-62ffb89f-1f1c-4e29-923a-2d5370806922 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 404 len: 111 microversion: 2.1 time: 0.082315 Sep 27 01:56:20.845497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2665/5387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:20 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:20.857086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:20.858236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:20.869177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.871914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.873705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.876887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:20.877772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:20.879819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:20.946093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:56:21.069433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:21.112550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4d71ad8-0d61-47ef-b5fe-7f86c824b80e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 204 len: 0 microversion: 2.1 time: 0.259924 Sep 27 01:56:21.113139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2723/5388] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:56:20 2022] DELETE /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:56:21.122103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:21.123829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:21.131225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:21.132301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:21.133495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:21.134560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:21.135312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:21.136066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:21.673092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:21.710013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4fc56cfa-b5a3-45bc-8f54-749af361f3de tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1496 microversion: 2.1 time: 0.591859 Sep 27 01:56:21.710696 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2666/5389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:21 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1496 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:22.736721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:22.737474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:22.744023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:22.744503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:22.744940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:22.745654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:22.750033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:22.750845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:23.183902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:23.197961 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-125bce17-b52b-40a2-b2e1-e62cda3b988f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1496 microversion: 2.1 time: 0.465890 Sep 27 01:56:23.198559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2724/5390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:22 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1496 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:23.227137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:23.228259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:23.249610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:23.250460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:23.251064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:23.251955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:23.252590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:23.266319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:23.286321 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 HTTP/1.1 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '02eb52cb-8186-4531-b89b-680215671893'} Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:23.288219 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.293757 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.298718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:23.300565 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd701a9d-37a8-47fd-b5ce-afebaf846357 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 404 len: 111 microversion: 2.20 time: 0.077602 Sep 27 01:56:23.313719 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2667/5391] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:56:23 2022] DELETE /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:23.324010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:23.324741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] [instance: 02eb52cb-8186-4531-b89b-680215671893] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:23.332945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:23.333581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:23.334132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:23.335056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:23.335580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:23.336143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:23.364227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] HTTP exception thrown: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Request method failure captured: Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 HTTP/1.1 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlaXe8CEFfv4jn5wNWbmxzvCe1bu9HePaq-suC6dZlyxNfdhCGcxYq2tPRDT-IoX50pAmXm9h9gOxOPD6znYhYYaVaP8Mn1IXdAHS4RqapjOYc0Z8deeAFdcpkFzXdiEa3A_U_zRItySO51kOQ3mfp3Ls2OhNvvijbfxm4SIIVHkTg4 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9042d8e2cb974e91b397874370b74c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9042d8e2cb974e91b397874370b74c88", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 9042d8e2cb974e91b397874370b74c88 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1797688541 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 305ea2953dde435d9e74bb0bc0da89b4 Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1797688541-project Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '02eb52cb-8186-4531-b89b-680215671893'} Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.369366 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:23.373961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] Returning 404 to user: Instance 02eb52cb-8186-4531-b89b-680215671893 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:23.375777 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60f2100a-556a-487c-8db2-739a97a9c004 tempest-AttachVolumeShelveTestJSON-1797688541 tempest-AttachVolumeShelveTestJSON-1797688541-project] 10.222.0.52 "GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893" status: 404 len: 111 microversion: 2.20 time: 0.056869 Sep 27 01:56:23.377416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2725/5392] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:56:23 2022] GET /compute/v2.1/servers/02eb52cb-8186-4531-b89b-680215671893 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:56:24.229707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:24.230503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:24.239913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:24.244114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:24.244920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:24.245992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:24.248699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:24.249500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:24.447705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:24.462019 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-00a1c1b9-bdb4-4420-a05e-b6edb743d59e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 200 len: 1454 microversion: 2.1 time: 0.236210 Sep 27 01:56:24.463028 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2668/5393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:24 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:24.649146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d3bf62-3500-451c-b364-9b5aaccf2742", "name": "network-vif-deleted", "tag": "6834163b-a98d-45e7-912d-5f63e3ab8abd"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:24.712707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:24.717478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:24.718126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:24.768082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] Creating event network-vif-deleted:6834163b-a98d-45e7-912d-5f63e3ab8abd for instance e8d3bf62-3500-451c-b364-9b5aaccf2742 on n-h1-859358-1 Sep 27 01:56:24.780213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b6bfe12a-053b-4492-ac02-06e2166f35ff req-54c0a388-4faa-4785-a8f2-338be301dbe7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133402 Sep 27 01:56:24.781507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2726/5394] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:25.491382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:25.492613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:25.510670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:25.511570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:25.512236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:25.514038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:25.514761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:25.515432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:25.550311 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 HTTP/1.1 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'e8d3bf62-3500-451c-b364-9b5aaccf2742'} Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:25.552390 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:56:25.557125 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:25.560505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:25.561501 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c1d9848-5897-458e-9a1f-b77fe4428a5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 404 len: 111 microversion: 2.1 time: 0.074658 Sep 27 01:56:25.562152 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2669/5395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:25 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:56:25.667449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1920469514", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:25.754074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:56:27.641762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:56:27.642301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:56:27.642664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:56:27.643081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:56:27.643505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:56:27.677916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:27.678420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:27.678871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:27.684253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:27.685910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:27.686556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:27.734230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:56:27.741176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:56:27.771993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:56:27.776404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:56:27.848199 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7a57e43-8486-47e8-8e1f-8cef8ff4feec tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186830 Sep 27 01:56:27.850323 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2727/5396] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:56:27.870700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-695c1f04-08a5-40da-8d69-9a830ffce6d2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:27.872798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-695c1f04-08a5-40da-8d69-9a830ffce6d2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:28.017063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-695c1f04-08a5-40da-8d69-9a830ffce6d2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:28.030220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-695c1f04-08a5-40da-8d69-9a830ffce6d2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1209 microversion: 2.1 time: 0.171578 Sep 27 01:56:28.031660 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2670/5397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:27 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1209 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:29.055298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:29.056369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:29.082136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:29.082785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:29.083229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:29.084297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:29.090564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:29.094672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:29.287441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:29.299715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc296f28-5236-4df6-b979-4717b02fc2d8 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1205 microversion: 2.1 time: 0.248742 Sep 27 01:56:29.300379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2728/5398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:29 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1205 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:30.335006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:30.335630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:30.365518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:30.372313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:30.374843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:30.379911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:30.380653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:30.382275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:30.946870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:30.956455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-683731b0-4334-4d74-b9d8-c2e2a27be967 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1267 microversion: 2.1 time: 0.632202 Sep 27 01:56:30.965707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2671/5399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:30 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1267 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:32.001074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:32.002372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:32.018989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:32.020236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:32.021183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:32.022113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:32.022778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:32.023586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:33.507136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:33.519623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-62ea0332-7c8c-4629-8e15-a7c61950fd96 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 1.528406 Sep 27 01:56:33.520225 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2729/5400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:31 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:34.548079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:34.548719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:34.560460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:34.578178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:34.578907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:34.579693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:34.580169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:34.580609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:35.345665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:35.360646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69197d04-3b51-4948-836e-1aa3ae51be1b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.817238 Sep 27 01:56:35.362003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2672/5401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:34 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:36.388848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:36.389540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:36.392206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:36.404570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:36.405112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:36.406057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:36.406987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:36.407609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:36.408198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:36.911647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959cd57c-7941-419b-81db-835e261fef5e", "tag": "5aeedf7f-1918-460e-88d9-dc5b28d38077"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:36.936129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:36.939923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:36.940596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:36.981285 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] Creating event network-changed:5aeedf7f-1918-460e-88d9-dc5b28d38077 for instance 959cd57c-7941-419b-81db-835e261fef5e on n-h1-859358-1 Sep 27 01:56:36.994624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e5ae5192-bd0c-4926-ad3c-94133c2fa010 req-f57f586f-a2e5-4efc-9903-5894a9e8a5c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087342 Sep 27 01:56:36.998238 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2673/5402] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:37.271108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:37.287318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-86fc04be-45b3-4d24-b702-c2e711b64d88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.906225 Sep 27 01:56:37.296535 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2730/5403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:36 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:38.315133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:38.316601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:38.349135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:38.352227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:38.353694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:38.354332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:38.360848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:38.361655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:38.362276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:38.725981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:38.739838 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56df9c8e-0dbb-4427-946d-d5614a901636 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.430393 Sep 27 01:56:38.744779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2674/5404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:38 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:39.768410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:39.769472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:39.783110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:39.786264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:39.790123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:39.791958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:39.794800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:39.797294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:39.797294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:39.799108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:40.100944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:40.112740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a85f4123-4c7d-436f-b5ff-04d087ec7601 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.348180 Sep 27 01:56:40.113640 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2731/5405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:39 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:40.408338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e74dab5-1f50-436c-8995-1a0b783d1854 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Action: 'create', calling method: .version_select at 0x7f24d5604e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-58127301"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:41.008383 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e74dab5-1f50-436c-8995-1a0b783d1854 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.873003 Sep 27 01:56:41.009017 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2675/5406] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Sep 27 01:56:40 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 874 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 27 01:56:41.022882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4bba577c-a1ff-4212-a371-9b266c425481 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5397040>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:41.136769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:41.138440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:41.159776 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4bba577c-a1ff-4212-a371-9b266c425481 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 343 microversion: 2.1 time: 0.140220 Sep 27 01:56:41.160592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2732/5407] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:41 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 343 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:41.162005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:41.162700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:41.163600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:41.164595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:41.165520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:41.166119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:41.895528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959cd57c-7941-419b-81db-835e261fef5e", "name": "network-vif-plugged", "status": "completed", "tag": "5aeedf7f-1918-460e-88d9-dc5b28d38077"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:41.918876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:41.923248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:41.924559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:41.925098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:41.932459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e4ce43de-d11b-4998-bebf-14930957a913 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.797077 Sep 27 01:56:41.937399 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2676/5408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:41 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:41.959573 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] Creating event network-vif-plugged:5aeedf7f-1918-460e-88d9-dc5b28d38077 for instance 959cd57c-7941-419b-81db-835e261fef5e on n-h1-859358-1 Sep 27 01:56:41.970995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fb6e415a-dfd8-4d2b-b629-adbab0595126 req-243430d9-6306-40d9-a3b2-1de10e1a4a6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080047 Sep 27 01:56:41.971753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2733/5409] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:42.178714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3db0cc4-bd32-492b-943a-a56af3b73be7 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24da5e3c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:42.255727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3db0cc4-bd32-492b-943a-a56af3b73be7 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 343 microversion: 2.1 time: 0.080880 Sep 27 01:56:42.256569 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2677/5410] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:42 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 343 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:42.975628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:42.976750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:43.003697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:43.006159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:43.009451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:43.013901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:43.015756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:43.017822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:43.271605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5c2be3d-82e1-467f-8cf8-18340df881e6 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d62dac10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:43.385150 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5c2be3d-82e1-467f-8cf8-18340df881e6 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 344 microversion: 2.1 time: 0.119127 Sep 27 01:56:43.386347 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2678/5411] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:43 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:43.400083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97082069-5917-4892-8304-c974a49b9b9d tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Action: 'create', calling method: .version_select at 0x7f24d563f280>, body: {"snapshot": {"volume_id": "5a9b28f4-3365-4fb5-a088-e96e51fffc2d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-453141844"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:43.648323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:43.661972 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a766ea8-5165-47a0-bb3b-54cb8df4e1f9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1309 microversion: 2.1 time: 0.700366 Sep 27 01:56:43.666234 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2734/5412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:42 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1309 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:43.864488 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97082069-5917-4892-8304-c974a49b9b9d tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.468231 Sep 27 01:56:43.865873 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2679/5413] 10.222.0.52 () {60 vars in 1162 bytes} [Tue Sep 27 01:56:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:43.877814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31037645-dbb9-4d0c-a196-9ab73c25e17c tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d53a29d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:44.004135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31037645-dbb9-4d0c-a196-9ab73c25e17c tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.130275 Sep 27 01:56:44.004708 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2735/5414] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:43 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:44.016787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c475494a-4598-4093-888a-0a931792aa38 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5607700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:44.150610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c475494a-4598-4093-888a-0a931792aa38 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.138438 Sep 27 01:56:44.157379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2680/5415] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 27 01:56:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:44.163193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1fc3e04-9785-4312-bd39-cae15c87e361 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5365940>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:44.232255 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1fc3e04-9785-4312-bd39-cae15c87e361 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.072819 Sep 27 01:56:44.233257 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2736/5416] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:44 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:44.699191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:44.705046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:44.722631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:44.723141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:44.723591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:44.724322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:44.724788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:44.725224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:44.780847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=71 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:45.183721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:45.203373 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b7e10d5-8156-49a2-8006-cb68d154dacc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1490 microversion: 2.1 time: 0.516715 Sep 27 01:56:45.203974 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2681/5417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:44 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1490 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:45.230830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:45.235534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:45.246997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0dbecf2-91af-4c97-b83c-f00b35c50e7f tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5475d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:45.252779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:45.254452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:45.256661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:45.261581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:45.298530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:45.299047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:45.354109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0dbecf2-91af-4c97-b83c-f00b35c50e7f tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.111083 Sep 27 01:56:45.354983 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2682/5418] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:45 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:45.550135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ec76aaf-5d33-415b-ac26-db203194670b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "PUT /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1085 microversion: 2.1 time: 0.323518 Sep 27 01:56:45.553711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2737/5419] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:56:45 2022] PUT /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1085 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:45.571401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:45.578261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:45.608542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:45.609321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:45.610042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:45.614209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:45.614950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:45.615671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:46.215919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:46.231362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab460938-1033-41a1-92ac-79b060c14efd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1511 microversion: 2.1 time: 0.663663 Sep 27 01:56:46.234502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2683/5420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:45 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:46.266178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:46.266722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:46.290941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:46.291480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:46.291921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:46.292661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:46.293111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:46.297807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:46.367363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-546b2184-ee02-42c2-acc1-fba04b9bfc35 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d62da820>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:46.404916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-546b2184-ee02-42c2-acc1-fba04b9bfc35 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.041347 Sep 27 01:56:46.410785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2684/5421] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:46 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:47.089093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:47.100926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da300da5-991f-48ba-8df4-a5e5b4aa86e1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1511 microversion: 2.1 time: 0.843060 Sep 27 01:56:47.104211 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2738/5422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:46 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:47.133034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:47.134170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:47.143843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:47.145162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:47.145810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:47.148005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:47.148683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:47.149583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:47.182485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:56:47.336588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1487721850", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:47.387241 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a052e9ab-2c7e-42a9-9974-1260669d7bd0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 204 len: 0 microversion: 2.1 time: 0.244608 Sep 27 01:56:47.389263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2685/5423] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:56:47 2022] DELETE /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:56:47.410034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:47.417980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:47.440874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:47.442357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:47.445011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:47.448447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:47.450665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:47.451982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:47.460572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] validate_networks() for [('cf52ba32-42ed-48bf-b274-4b9fc6c48620', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:56:47.841209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:47.854930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d1661db-b714-4283-9adf-9872ef226cb1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1517 microversion: 2.1 time: 0.454033 Sep 27 01:56:47.855834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2686/5424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:47 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1517 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:47.863040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d136d330-755c-4a3c-9432-35be1cf5e216 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d598f8b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:47.928451 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d136d330-755c-4a3c-9432-35be1cf5e216 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 287 microversion: 2.1 time: 0.071289 Sep 27 01:56:47.929253 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2687/5425] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:47 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:47.941036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f724c5f-490a-4376-9e5c-9b3d511671bd tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24da531040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:48.035240 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f724c5f-490a-4376-9e5c-9b3d511671bd tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 202 len: 0 microversion: 2.1 time: 0.097990 Sep 27 01:56:48.036466 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2688/5426] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 27 01:56:47 2022] DELETE /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:56:48.044814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2f6825b-2195-49a8-b6bd-33168a51ff9f tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d59f3550>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:48.082756 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2f6825b-2195-49a8-b6bd-33168a51ff9f tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.042143 Sep 27 01:56:48.083576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2689/5427] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:48 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:48.896656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:48.897437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:48.946276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:48.956428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:48.962119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:48.962582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:48.970275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:48.970805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:48.971265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:49.545880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:49.564242 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e84e707-7be5-478b-857d-7d930ec4ad5e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1517 microversion: 2.1 time: 0.687992 Sep 27 01:56:49.564844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2690/5428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:48 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1517 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:49.574118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b311a4bd-c1b6-41cd-af22-d74c3fa39960 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d62da040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:49.623087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b311a4bd-c1b6-41cd-af22-d74c3fa39960 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 200 len: 286 microversion: 2.1 time: 0.052675 Sep 27 01:56:49.628449 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2691/5429] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:49 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:50.597280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:50.599027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:50.609224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:50.610323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:50.613530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:50.614674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:50.615317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:50.615920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:51.088352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:51.101006 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22af6308-511e-4311-9216-14e76eb7c1b2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1517 microversion: 2.1 time: 0.513840 Sep 27 01:56:51.102039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2692/5430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:50 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:51.107052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfba2d5e-2f7d-4e0e-ba39-5d322951a168 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d62dac10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:51.151320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:56:51.151911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:56:51.152358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:56:51.153242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:56:51.153772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:56:51.181252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:51.182150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:51.188604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:51.191929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:51.192709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:51.193377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:51.226831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=60,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:56:51.261949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Getting quotas for project 400da454e0af45dc9ccd62d706ab7c0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:56:51.280254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Getting quotas for user efe87283ca054abc81f00d46efce41bc and project 400da454e0af45dc9ccd62d706ab7c0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:56:51.327091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:56:51.330081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:56:51.414298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cfba2d5e-2f7d-4e0e-ba39-5d322951a168 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] HTTP exception thrown: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfba2d5e-2f7d-4e0e-ba39-5d322951a168 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Request method failure captured: Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb HTTP/1.1 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlhXC6PQeJ7b8Lalpm1Qc34Gj4kAxfgCY6UzpBOVkzFk4GAmV_13r7ItvEIjdFdqI9Us8n3uXY3NfJAkMDGmpP-7Zwerg2FFsXS3bGgcPqA67SWKZ_z28jZQmYEvhqpbCUrh0hENPLaJhOVafnDpksBEKh8urjnqSDbHT8b8AmGOqjE Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed8b5f59c8a4dc093a191f01e33ee37", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d810d63b9d5245ec8e47ee1a7e06d6b0 Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: exception: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '80cfff76-48a2-4995-b111-ad67cd04a0bb'} Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. (HTTP 404) (Request-ID: req-33809201-c2f8-4f6d-b0b8-121fb6e9aab0) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:56:51.422286 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfba2d5e-2f7d-4e0e-ba39-5d322951a168 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Returning 404 to user: Snapshot 80cfff76-48a2-4995-b111-ad67cd04a0bb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cfba2d5e-2f7d-4e0e-ba39-5d322951a168 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb" status: 404 len: 111 microversion: 2.1 time: 0.323225 Sep 27 01:56:51.429888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2693/5431] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 01:56:51 2022] GET /compute/v2.1/os-snapshots/80cfff76-48a2-4995-b111-ad67cd04a0bb => generated 111 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:51.445150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c098b73f-ba1f-4883-b8de-82b142098684 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d561a4c0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:51.504879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b53d4824-96c1-4dea-8db3-767292bdb822 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.289902 Sep 27 01:56:51.509366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2739/5432] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 4297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:56:51.521906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0203f2f-5568-4348-8a3e-6624f186c6cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:51.524224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0203f2f-5568-4348-8a3e-6624f186c6cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:51.643665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c098b73f-ba1f-4883-b8de-82b142098684 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 202 len: 0 microversion: 2.1 time: 0.210028 Sep 27 01:56:51.645302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2694/5433] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:56:51 2022] DELETE /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:56:51.656738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e42cca8-7e89-408d-9efd-b87471e79a35 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d561a700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:51.718226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0203f2f-5568-4348-8a3e-6624f186c6cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:51.730403 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0203f2f-5568-4348-8a3e-6624f186c6cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1214 microversion: 2.1 time: 0.214398 Sep 27 01:56:51.733427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2740/5434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:51 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:51.782606 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e42cca8-7e89-408d-9efd-b87471e79a35 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 343 microversion: 2.1 time: 0.132374 Sep 27 01:56:51.783813 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2695/5435] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:51 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 343 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:56:52.132904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:52.134029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:52.151661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:52.156886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:52.159677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:52.161847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:52.165220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:52.166080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:52.453329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:52.453624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959cd57c-7941-419b-81db-835e261fef5e", "name": "network-vif-deleted", "tag": "5aeedf7f-1918-460e-88d9-dc5b28d38077"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:52.468769 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-71c97723-6e47-4657-ba93-74574238b475 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 200 len: 1475 microversion: 2.1 time: 0.344348 Sep 27 01:56:52.470569 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2741/5436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:52 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:52.481291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:52.483065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:52.483981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:52.549528 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] Creating event network-vif-deleted:5aeedf7f-1918-460e-88d9-dc5b28d38077 for instance 959cd57c-7941-419b-81db-835e261fef5e on n-h1-859358-1 Sep 27 01:56:52.562152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-79e37136-a283-4910-b293-7dec84dd7261 req-a0ae3c9d-b204-461a-8422-4dffcaafed3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117102 Sep 27 01:56:52.563774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2696/5437] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:52.760938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:52.761645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:52.773243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:52.775754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:52.778665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:52.780696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:52.784133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:52.784761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:52.805187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22931e2c-41aa-4463-a32f-1423962e65ef tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5a20b80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:52.923730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:52.950510 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1cd19bf-b072-40b5-84b3-eb0c4e99c3bf tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1210 microversion: 2.1 time: 0.196741 Sep 27 01:56:52.951246 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2742/5438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:52 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1210 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:53.451165 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22931e2c-41aa-4463-a32f-1423962e65ef tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 343 microversion: 2.1 time: 0.655858 Sep 27 01:56:53.452743 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2697/5439] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:52 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 343 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:53.492973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:53.493920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:53.505565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:53.506067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:53.511366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:53.512945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:53.513650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:53.514389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:53.549650 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e HTTP/1.1 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '959cd57c-7941-419b-81db-835e261fef5e'} Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:53.552619 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:56:53.557504 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:56:53.561072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:53.564108 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a8f35a1-c221-43de-a728-fe43d38fdb8f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 404 len: 111 microversion: 2.1 time: 0.075701 Sep 27 01:56:53.568352 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2743/5440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:53 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:53.732138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1027680674", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "456cbd49-8220-4244-91be-27feb3e17515"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:53.916238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] validate_networks() for [('456cbd49-8220-4244-91be-27feb3e17515', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:56:53.981275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:53.982946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:54.014696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:54.020255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:54.020874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:54.021685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:54.024500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:54.024974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:54.570695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:54.584260 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-228253ee-6d41-454f-96c4-71e13b7aeb4e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1284 microversion: 2.1 time: 0.611447 Sep 27 01:56:54.584875 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2744/5441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:53 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1284 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:54.604972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6be5f9bf-2f86-4d44-9aeb-7bbb63304be7 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d53550d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:54.667802 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6be5f9bf-2f86-4d44-9aeb-7bbb63304be7 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 200 len: 343 microversion: 2.1 time: 0.081029 Sep 27 01:56:54.669129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2745/5442] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:54 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 343 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:56:55.510439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:56:55.510944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:56:55.511342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:56:55.511828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:56:55.512750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:56:55.533129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:55.535156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:55.535620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:55.538700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:55.539204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:55.542099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:55.611725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:55.612367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:55.625520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:55.631517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:55.631927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:56:55.632571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:55.637514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:55.638441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:55.642304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:55.644046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Getting quotas for user 701e33cd78094812bd73c191c5a403bf and project 6708057baea74bfd9536644f97a91a5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:56:55.678539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:56:55.681201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:56:55.778215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-709e5f2c-a824-48d7-a759-544aea20f752 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051427 Sep 27 01:56:55.779124 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2698/5443] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:56:55.799185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6491b87b-24cd-4395-bc5e-d39af86ae693 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5637c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:55.847032 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6491b87b-24cd-4395-bc5e-d39af86ae693 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] HTTP exception thrown: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6491b87b-24cd-4395-bc5e-d39af86ae693 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Request method failure captured: Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d HTTP/1.1 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlhXC6PQeJ7b8Lalpm1Qc34Gj4kAxfgCY6UzpBOVkzFk4GAmV_13r7ItvEIjdFdqI9Us8n3uXY3NfJAkMDGmpP-7Zwerg2FFsXS3bGgcPqA67SWKZ_z28jZQmYEvhqpbCUrh0hENPLaJhOVafnDpksBEKh8urjnqSDbHT8b8AmGOqjE Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed8b5f59c8a4dc093a191f01e33ee37", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d810d63b9d5245ec8e47ee1a7e06d6b0 Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: exception: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5a9b28f4-3365-4fb5-a088-e96e51fffc2d'} Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. (HTTP 404) (Request-ID: req-4ee139cb-e283-407f-82fd-8b1752cee27c) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:56:55.849509 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:55.854313 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:55.861904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6491b87b-24cd-4395-bc5e-d39af86ae693 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Returning 404 to user: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:55.861904 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6491b87b-24cd-4395-bc5e-d39af86ae693 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 404 len: 109 microversion: 2.1 time: 0.076805 Sep 27 01:56:55.861904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2699/5444] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:55 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:55.879054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-57563bed-8955-4fa8-97df-3bf83c0dea72 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:55.880314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-57563bed-8955-4fa8-97df-3bf83c0dea72 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:56.005785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-57563bed-8955-4fa8-97df-3bf83c0dea72 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:56.014626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-57563bed-8955-4fa8-97df-3bf83c0dea72 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1209 microversion: 2.1 time: 0.151284 Sep 27 01:56:56.036912 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2700/5445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:55 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1209 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:56.081674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d4d3365-1716-45fb-b0c9-07b61a33a0f3 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d5a20310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:56.148779 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5d4d3365-1716-45fb-b0c9-07b61a33a0f3 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] HTTP exception thrown: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d4d3365-1716-45fb-b0c9-07b61a33a0f3 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Request method failure captured: Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d HTTP/1.1 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlhXC6PQeJ7b8Lalpm1Qc34Gj4kAxfgCY6UzpBOVkzFk4GAmV_13r7ItvEIjdFdqI9Us8n3uXY3NfJAkMDGmpP-7Zwerg2FFsXS3bGgcPqA67SWKZ_z28jZQmYEvhqpbCUrh0hENPLaJhOVafnDpksBEKh8urjnqSDbHT8b8AmGOqjE Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed8b5f59c8a4dc093a191f01e33ee37", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d810d63b9d5245ec8e47ee1a7e06d6b0 Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: exception: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5a9b28f4-3365-4fb5-a088-e96e51fffc2d'} Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. (HTTP 404) (Request-ID: req-98430503-5882-425e-ae5f-9d89cb1f46b6) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:56:56.151367 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d4d3365-1716-45fb-b0c9-07b61a33a0f3 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Returning 404 to user: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:56.157193 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d4d3365-1716-45fb-b0c9-07b61a33a0f3 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 404 len: 109 microversion: 2.1 time: 0.115711 Sep 27 01:56:56.160785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2701/5446] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:56:56 2022] DELETE /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:56.166683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90234c9-c0f2-48c0-a460-b5b1141bbd40 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Calling method '.version_select at 0x7f24d563f8b0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:56.260671 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d90234c9-c0f2-48c0-a460-b5b1141bbd40 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] HTTP exception thrown: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90234c9-c0f2-48c0-a460-b5b1141bbd40 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Request method failure captured: Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d HTTP/1.1 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlhXC6PQeJ7b8Lalpm1Qc34Gj4kAxfgCY6UzpBOVkzFk4GAmV_13r7ItvEIjdFdqI9Us8n3uXY3NfJAkMDGmpP-7Zwerg2FFsXS3bGgcPqA67SWKZ_z28jZQmYEvhqpbCUrh0hENPLaJhOVafnDpksBEKh8urjnqSDbHT8b8AmGOqjE Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8ed8b5f59c8a4dc093a191f01e33ee37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8ed8b5f59c8a4dc093a191f01e33ee37", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8ed8b5f59c8a4dc093a191f01e33ee37 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1834316234 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: d810d63b9d5245ec8e47ee1a7e06d6b0 Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1834316234-project Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: exception: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5a9b28f4-3365-4fb5-a088-e96e51fffc2d'} Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. (HTTP 404) (Request-ID: req-2e44b978-2597-433e-af74-1f01e9ec5c54) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 01:56:56.268319 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90234c9-c0f2-48c0-a460-b5b1141bbd40 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] Returning 404 to user: Volume 5a9b28f4-3365-4fb5-a088-e96e51fffc2d could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:56:56.273592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d90234c9-c0f2-48c0-a460-b5b1141bbd40 tempest-VolumesSnapshotsTestJSON-1834316234 tempest-VolumesSnapshotsTestJSON-1834316234-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d" status: 404 len: 109 microversion: 2.1 time: 0.111874 Sep 27 01:56:56.281459 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2702/5447] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 01:56:56 2022] GET /compute/v2.1/os-volumes/5a9b28f4-3365-4fb5-a088-e96e51fffc2d => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:56:56.451260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:56.470748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a19f1b30-dd4d-4abc-ae09-84e4560ec732 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1272 microversion: 2.1 time: 0.860408 Sep 27 01:56:56.471557 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2746/5448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:55 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1272 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:56:57.048060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:57.048707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:57.084698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:57.088027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:57.088756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:57.089561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:57.090088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:57.090529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:57.495336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:57.496692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:57.510107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:57.511265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:57.512529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:57.513851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:57.515602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:57.517838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:57.660739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:57.679503 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-658e34bd-fc97-4ead-b93f-cfec442658a7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1272 microversion: 2.1 time: 0.187486 Sep 27 01:56:57.682180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2747/5449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:57 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:57.958936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:57.969877 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1915d64-b6c4-42ab-a1ec-ac37e713d276 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1213 microversion: 2.1 time: 0.931197 Sep 27 01:56:57.974182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2703/5450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:57 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1213 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:58.467651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1359677214", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:56:58.530158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:56:58.704616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:58.705302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:58.715522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:58.716039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:58.716471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:58.721659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:58.722156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:58.722608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:59.253663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:59.266720 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f369dbad-2803-46b5-8af2-761b85bab053 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.566233 Sep 27 01:56:59.288741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2704/5451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:58 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:59.305060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:59.307095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:56:59.315317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:59.316278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:59.318205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:59.319275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:59.319978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:59.320698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:59.467622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:56:59.476227 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71145e5c-8fdd-4572-a159-2c8db6880312 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1267 microversion: 2.1 time: 0.185745 Sep 27 01:56:59.489922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2705/5452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:59 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:56:59.740038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:56:59.748093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:56:59.749037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:56:59.750277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:56:59.751104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:56:59.767437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:59.768406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:59.769135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:59.771879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:56:59.772941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:56:59.773509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:56:59.802913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Getting quotas for project c4663ebb4c3a4430b64f9e0a0a94ddda. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:56:59.815411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Getting quotas for user cf1ffd377d3b43e78efadd2891d2494d and project c4663ebb4c3a4430b64f9e0a0a94ddda. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:56:59.840628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:56:59.843262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:56:59.956737 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a35e825-1247-4989-86c1-fe77277532dc tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496127 Sep 27 01:56:59.962060 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2748/5453] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:56:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:56:59.974544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0993d672-dc40-430e-b9ba-4f242d8a66c7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:56:59.976294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0993d672-dc40-430e-b9ba-4f242d8a66c7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:00.101030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0993d672-dc40-430e-b9ba-4f242d8a66c7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:00.110101 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0993d672-dc40-430e-b9ba-4f242d8a66c7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1214 microversion: 2.1 time: 0.141149 Sep 27 01:57:00.125607 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2706/5454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:56:59 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:00.293427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:00.294360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:00.304565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:00.305288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:00.305941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:00.306878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:00.307571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:00.308171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:00.501919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:00.506796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:00.551147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:00.553916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:00.556711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:00.557806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:00.560788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:00.561608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:00.754521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:00.767014 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9143e8a2-0bc0-4973-8e43-3d20a87a1657 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1267 microversion: 2.1 time: 0.269836 Sep 27 01:57:00.769924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2707/5455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:00 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:00.857572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:00.872360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8881692a-7e2c-4ef8-a127-d67116fb2366 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.583842 Sep 27 01:57:00.872955 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2749/5456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:00 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:01.109147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f28dda-00b7-4bb5-8fca-782adc12a79c", "tag": "2a82cf9e-b336-432c-b66f-416f2c25cd7b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:01.135428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:01.136330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:01.144973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.146490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.147214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.149485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.152827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.153289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.154062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.154707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.155432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.185080 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] Creating event network-changed:2a82cf9e-b336-432c-b66f-416f2c25cd7b for instance c2f28dda-00b7-4bb5-8fca-782adc12a79c on n-h2-859358-1 Sep 27 01:57:01.197970 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ac8730a4-d685-4709-86d9-c152575cfca2 req-e45728a2-7055-4bb6-acf6-9427e85068e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092208 Sep 27 01:57:01.200354 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2708/5457] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:01.492247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:01.540933 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a0f015e-4c54-4c2c-8d08-83834ff7efda tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1266 microversion: 2.1 time: 0.409440 Sep 27 01:57:01.544556 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2750/5458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:01 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:01.796158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:01.796830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:01.807558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.807978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.809004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.809762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.827789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.828259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.901170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:01.902367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:01.934757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.949908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.950778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:01.955849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:01.956578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:01.957865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:02.350069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:02.359816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53c2b096-2a63-4313-836c-4a9a361eaf84 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.463783 Sep 27 01:57:02.378547 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2751/5459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:01 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:02.569686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:02.569903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:02.577367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:02.578005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:02.578620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:02.580116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:02.580751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:02.581366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:02.757381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:02.765391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba25132d-c23a-47eb-9e90-d68fff00af5d tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1272 microversion: 2.1 time: 0.200657 Sep 27 01:57:02.765985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2752/5460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:02 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:02.826024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:02.850337 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7862af6e-7e60-4a10-b06c-2a238b498283 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 1.058691 Sep 27 01:57:02.866975 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2709/5461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:01 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:03.385357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:03.385984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:03.394197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:03.394781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:03.395813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:03.396832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:03.397685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:03.399025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:03.795403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:03.796331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:03.818369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:03.821599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:03.822272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:03.824306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:03.827419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:03.829511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:04.102562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:04.128442 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92133939-cfee-48d6-9eb8-aadd0f0dfe9f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.746789 Sep 27 01:57:04.129960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2753/5462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:03 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:04.135689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:04.137619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:04.147420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:04.148292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:04.150316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:04.151780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:04.153247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:04.156699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:04.426312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:04.435836 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd918c79-ca90-48d5-82cb-dbd705794862 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.646086 Sep 27 01:57:04.437031 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2710/5463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:03 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:04.602131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b06a9fa-0c64-448e-9fd3-a0f0f000942b", "tag": "04322dfc-7d1f-4544-abce-77a496e9bdd6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:04.625485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:04.626832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:04.627486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:04.641282 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] Creating event network-changed:04322dfc-7d1f-4544-abce-77a496e9bdd6 for instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b on n-h1-859358-1 Sep 27 01:57:04.647090 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-46196f3d-0abc-4eb9-8248-309ef043b031 req-fbb1bb70-8ebf-402e-b1ec-85c1365f5033 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051686 Sep 27 01:57:04.648022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2711/5464] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:04.697192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:04.708536 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9080fefd-4d27-4c5d-8c13-cfdbbf11c8d3 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 0.577174 Sep 27 01:57:04.710470 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2754/5465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:04 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:05.162366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:05.164278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:05.173831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.176108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.176774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:05.178069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.178707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.180007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:05.472938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:05.474202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:05.486651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.488322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.489270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:05.490862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.491511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.492112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:05.587395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:05.877675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:05.886324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef78f1f8-c796-4507-a71b-56f8212069c6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.428558 Sep 27 01:57:05.893288 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2755/5466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:05 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:05.905969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:05.906585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:05.920550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.921052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.921532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:05.922316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:05.922695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:05.923127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:06.157157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:06.171550 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75eb793c-724c-4c12-b9fb-5dac676fac2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 1.017299 Sep 27 01:57:06.172809 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2712/5467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:05 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:06.196957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:06.213014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8750cb2-fb2f-4941-8549-d31abd8c53d9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 0.318369 Sep 27 01:57:06.214473 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2756/5468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:05 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:06.920097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:06.921794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:06.929372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:06.930719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:06.931495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:06.932751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:06.934049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:06.934822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:07.197221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:07.198471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:07.210958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:07.215477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:07.216431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:07.217155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:07.218352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:07.219316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:07.220031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:07.735466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:07.761078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18680a7b-e53f-455b-8a6e-261f3ca90fc4 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.563188 Sep 27 01:57:07.786238 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2757/5469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:07 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:07.793898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:07.799238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:07.805318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:07.809617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:07.823126 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b4a2523-0b45-435b-9e41-d1b4537b15b1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.907459 Sep 27 01:57:07.833837 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2713/5470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:06 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:07.838333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:07.840866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:07.841590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:07.848351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:07.848351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:07.848351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:08.038730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8628ad-5cad-4f41-90fd-d4378afb832f", "tag": "e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:08.079359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:08.081405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:08.083293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:08.132839 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] Creating event network-changed:e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e for instance 2e8628ad-5cad-4f41-90fd-d4378afb832f on n-h1-859358-1 Sep 27 01:57:08.147139 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-08005e4e-3618-48a2-b3d9-d35e0a84b032 req-2480c2ef-976f-4e35-b6cf-ca0d206a19c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117459 Sep 27 01:57:08.151846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2714/5471] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:08.473532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:08.482697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fbeab15-95a6-423c-b382-769be6ac7875 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 0.694587 Sep 27 01:57:08.495124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2758/5472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:07 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:08.793321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:08.794346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:08.806545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:08.809712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:08.810492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:08.812639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:08.814692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:08.815374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:08.859725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:08.861646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:08.874410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:08.877169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:08.883333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:08.884399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:08.885584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:08.889131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:09.177363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:09.179869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:09.189521 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f26dbc0-e586-4b97-a524-03489451c5bd tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.336304 Sep 27 01:57:09.219005 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2759/5473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:08 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:09.523784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:09.524392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:09.544521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:09.552268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:09.553223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:09.554178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:09.554802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:09.555635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:09.794037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:09.797413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:09.809247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1061f3e2-cd20-4586-b5af-f9fdba20986d tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 0.289631 Sep 27 01:57:09.814305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2760/5474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:09 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:10.109737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:10.165668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:10.179996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c03cb7e2-bfc5-4d01-8b70-37bd7a430a25 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 1.393870 Sep 27 01:57:10.180884 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2715/5475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:08 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:10.231860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:10.234610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:10.244311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:10.259418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:10.260167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:10.261614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:10.264058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:10.264970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:10.265810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:10.362246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b06a9fa-0c64-448e-9fd3-a0f0f000942b", "name": "network-vif-plugged", "status": "completed", "tag": "04322dfc-7d1f-4544-abce-77a496e9bdd6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:10.375715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:10.376500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:10.377142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:10.395456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] Creating event network-vif-plugged:04322dfc-7d1f-4544-abce-77a496e9bdd6 for instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b on n-h1-859358-1 Sep 27 01:57:10.403430 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5989f8a3-8680-4e30-aa30-8fa345e280a7 req-6bbfb9d1-d099-41f6-a95a-5e4dd7536825 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047275 Sep 27 01:57:10.405023 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2716/5476] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:57:10.649824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:10.695834 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c617f43-6700-4618-afbd-34b17e858e53 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.463118 Sep 27 01:57:10.696829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2761/5477] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:10 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:10.843570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:10.849814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:10.867868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:10.883261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:10.886254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:10.888680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:10.890437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:10.891128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:11.213732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:11.214961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:11.225919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:11.227074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:11.227769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:11.230205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:11.231038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:11.232321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:11.383436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:11.393133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab41c683-ecfb-42a6-88c5-6296960181e7 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 0.556016 Sep 27 01:57:11.405174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2717/5478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:10 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:11.833776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:11.834910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:11.857034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:11.860102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:11.861777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:11.864308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:11.865673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:11.867409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:11.868093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:11.870602 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1258462-9531-4799-b005-9de63f4b844d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.668660 Sep 27 01:57:11.871411 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2762/5479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:11 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:12.425498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:12.427697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:12.436190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:12.437286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:12.438098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:12.442092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:12.442840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:12.443539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:12.534371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:12.562295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29d05c1e-0c2a-4d7d-a033-c7019e6f6e0e tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.734026 Sep 27 01:57:12.577750 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2718/5480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:11 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:12.584018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f28dda-00b7-4bb5-8fca-782adc12a79c", "name": "network-vif-plugged", "status": "completed", "tag": "2a82cf9e-b336-432c-b66f-416f2c25cd7b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:12.610749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:12.611515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:12.612151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:12.633874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] Creating event network-vif-plugged:2a82cf9e-b336-432c-b66f-416f2c25cd7b for instance c2f28dda-00b7-4bb5-8fca-782adc12a79c on n-h2-859358-1 Sep 27 01:57:12.648834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bcbc53a0-03a2-4853-a5ea-3e8a41fb4d54 req-68fe4d91-60e8-4644-b58b-ccff4af17f25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069429 Sep 27 01:57:12.651534 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2719/5481] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:12.904292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:12.905245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:12.919102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:12.923547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:12.924197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:12.926908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:12.927598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:12.929584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:13.270526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:13.289491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64efc20f-c6a7-4e17-85ed-49d6d727ad49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.391103 Sep 27 01:57:13.292948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2720/5482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:12 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:13.476702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:13.491361 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3ae8fac-944f-4b10-818c-e89009ba6eea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1309 microversion: 2.1 time: 1.071068 Sep 27 01:57:13.492554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2763/5483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:12 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1309 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:13.591366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:13.592003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:13.607891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:13.609170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:13.609675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:13.610545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:13.613004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:13.614337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.107540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:14.117187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a129727-a06e-462d-a2aa-58ba8afc54c1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.531006 Sep 27 01:57:14.120687 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2721/5484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:13 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:14.321440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:14.322360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:14.333684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:14.335282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:14.336205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.337253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:14.338080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:14.338755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.519283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:14.520163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:14.527302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:14.528074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:14.528714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.529679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:14.530366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:14.531085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.647976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:14.661575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d53dade6-d112-487a-889f-8eae59fc9e90 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1314 microversion: 2.1 time: 0.349263 Sep 27 01:57:14.678677 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2764/5485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:14 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:14.733001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8628ad-5cad-4f41-90fd-d4378afb832f", "name": "network-vif-plugged", "status": "completed", "tag": "e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:14.748020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:14.748020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:14.748020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:14.764524 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] Creating event network-vif-plugged:e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e for instance 2e8628ad-5cad-4f41-90fd-d4378afb832f on n-h1-859358-1 Sep 27 01:57:14.772149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d1a189ea-5aaf-4f2c-9fd1-a6ccee0c68d0 req-e1353f68-b1e9-4c5e-bdce-7133070a9ef3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054502 Sep 27 01:57:14.779206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2765/5486] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:14.983999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:14.994005 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff4b5b86-6805-4268-85bb-2b7304670836 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1491 microversion: 2.1 time: 0.479665 Sep 27 01:57:15.010393 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2722/5487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:14 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1491 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:15.021533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1175461961"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:15.025805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:15.033793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.034520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.036924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.037969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.039714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.040494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.143436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d078ed83-b838-4b01-a7b1-7e3ad2db4abe tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "PUT /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1076 microversion: 2.1 time: 0.126503 Sep 27 01:57:15.145490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:15.146502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:15.154026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.154750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.155342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.156219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.156964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.157580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.161460 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2766/5488] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:57:15 2022] PUT /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1076 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:15.174045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:15.175162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:15.189713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.195431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.196666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.199849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.200640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.203993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.557857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:15.570507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b84cb97f-879d-4320-908c-c07c453ec3c3 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1314 microversion: 2.1 time: 0.430490 Sep 27 01:57:15.571173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2723/5489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:15 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:15.690149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:15.690774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:15.697725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.698565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.699185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.700283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:15.700901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:15.701545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:15.948211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:15.957395 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7be4e273-3f38-4488-bf4e-f757a4603d46 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1502 microversion: 2.1 time: 0.794444 Sep 27 01:57:15.958263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2767/5490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:15 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1502 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:15.985161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:15.985837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:15.998323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.000590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.001796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.002513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.004920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.005592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.079038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:16.088049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ca61435-bc16-4ff1-b525-5ab07baa9450 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1500 microversion: 2.1 time: 0.401978 Sep 27 01:57:16.089589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2724/5491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:15 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1500 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:16.111878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:16.114790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:16.121462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.122848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.123463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.124743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.127708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.128343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.207639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lazy-loading 'flavor' on Instance uuid c2f28dda-00b7-4bb5-8fca-782adc12a79c {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:57:16.380732 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50f2e048-6982-4884-a729-52e540c22bbb tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "POST /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c/action" status: 200 len: 32 microversion: 2.1 time: 0.272825 Sep 27 01:57:16.382161 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2725/5492] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:57:16 2022] POST /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 01:57:16.405116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:16.406651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:16.417698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.418379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.419024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.420437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.421068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.421901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.596955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:16.608611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-798813a1-579a-41fe-b388-a32c5f3aec89 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1502 microversion: 2.1 time: 0.630701 Sep 27 01:57:16.610117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2768/5493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:15 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:16.616417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:16.618054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:16.626198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.626922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.627616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:16.628665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:16.629639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:16.630399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:17.612375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:17.625652 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b44bd378-470a-454e-b159-2ceb1afe5331 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1464 microversion: 2.1 time: 1.010767 Sep 27 01:57:17.626895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2769/5494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:16 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1464 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:17.634806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:17.653301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:17.654383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:17.655056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:17.704526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 01:57:17.747730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:17.767370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23eacb59-230e-4ec8-9c87-59d7c4784a6d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 1.364689 Sep 27 01:57:17.768336 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2726/5495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:16 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:17.779109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3925784-e7d1-444f-a485-2abc623a2818 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "POST /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b/action" status: 202 len: 0 microversion: 2.1 time: 0.150313 Sep 27 01:57:17.779968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43d1762e-e117-427f-9e55-5f9573e40706", "device": "/dev/sdb"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:17.780729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2770/5496] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:57:17 2022] POST /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:57:17.786605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:17.795470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:17.797466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:17.806657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:17.807551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:17.809488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:17.814398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:17.814654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:17.814883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:17.815192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:17.815320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:17.815641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:17.818686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:17.818975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:17.821248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:18.280680 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5909f4bb-9fca-4783-bfdb-8d47328336e6 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "POST /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510258 Sep 27 01:57:18.281303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2727/5497] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:57:17 2022] POST /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:18.332933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:18.345689 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a9fee40-962f-4377-a633-b5d1f2fe1817 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.560101 Sep 27 01:57:18.346592 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2771/5498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:17 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:18.794973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:18.796827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:18.832583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:18.840970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:18.842668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:18.844821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:18.851643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:18.852414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:19.178161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:19.205759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c178835b-d541-4973-bcf1-1587c10649ee tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.415942 Sep 27 01:57:19.217461 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2728/5499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:18 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:19.375297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:19.375937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:19.388351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:19.388849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:19.393637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:19.395406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:19.398884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:19.399740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:20.238591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:20.239385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:20.254660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:20.260515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:20.263342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:20.264589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:20.266937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:20.268889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:20.269997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:20.307490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:20.359088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:20.374899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f261d189-481c-411d-92fd-65420a74e4a6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 1.001995 Sep 27 01:57:20.394491 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2772/5500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:19 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:20.793892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:20.809363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25c499ff-867a-4189-92b7-9b2469d4a147 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.579551 Sep 27 01:57:20.823817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2729/5501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:20 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:21.401454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:21.402269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:21.416057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:21.420009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:21.420748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:21.421847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:21.422871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:21.423482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:21.838008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:21.839763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:21.855081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:21.859006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:21.859620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:21.860673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:21.861250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:21.864108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:21.980233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:21.999898 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af465a25-7af9-4e25-811c-18d26dce6a40 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.602517 Sep 27 01:57:22.000910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2773/5502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:21 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:22.288772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:22.306419 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9fdcba02-f9d7-4a75-9375-c91949b50835 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.472875 Sep 27 01:57:22.307025 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2730/5503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:21 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:23.047464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:23.048938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:23.076712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:23.077526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:23.078732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:23.080827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:23.081514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:23.082802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:23.334884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:23.335523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:23.348460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:23.348965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:23.349461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:23.361173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:23.361739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:23.362199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:24.036618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:24.057160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec9b9033-e8f2-4ea3-a57e-41b01c642488 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 1.017566 Sep 27 01:57:24.075118 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2774/5504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:23 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:24.221493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:24.237769 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbbc4dc7-9048-47d9-a944-98f86c869888 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.903251 Sep 27 01:57:24.239307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2731/5505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:23 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:25.086277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:25.090316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:25.099014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:25.101679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:25.102645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:25.107119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:25.107870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:25.108603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:25.161110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:25.268059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:25.268680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:25.294768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:25.295299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:25.295718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:25.296437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:25.299016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:25.299869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:25.723674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:25.732205 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e03dd03-e7c4-4f54-af0c-712b63be2b2c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.650551 Sep 27 01:57:25.736764 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2775/5506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:25 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:26.466269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:26.484699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17d9fab7-0428-481f-a565-fb0fbb837cf0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 1.220367 Sep 27 01:57:26.503638 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2732/5507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:25 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:26.767178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:26.773810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:26.782602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:26.783383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:26.783996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:26.784884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:26.785792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:26.786425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:27.084425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:27.093941 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1c41781-c465-405d-bb7b-f86a9eb24ba9 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.330982 Sep 27 01:57:27.094942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2776/5508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:26 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:27.518618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:27.519436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:27.533431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:27.537020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:27.539518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:27.540557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:27.546395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:27.548741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:28.019326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:28.039745 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8158856-3113-4235-8ffa-42190c71fea8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.531025 Sep 27 01:57:28.043714 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2733/5509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:27 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:28.133297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:28.136622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:28.154134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:28.154877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:28.155500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:28.156609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:28.157519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:28.158324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:28.456018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:28.467756 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98d1307f-5361-45d9-a57b-4b550e127f13 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.351837 Sep 27 01:57:28.482006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2777/5510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:28 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:29.075906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:29.078011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:29.109754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:29.110533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:29.112078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:29.117545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:29.118557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:29.119714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:29.494263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:29.497814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:29.513145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:29.517168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:29.517648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:29.520862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:29.524381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:29.525638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:29.647568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:29.664608 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c23e6e5-c1c8-401e-b37a-49f99c808b73 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.593049 Sep 27 01:57:29.679249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2734/5511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:29 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:30.012615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:30.026312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8b7b27c-423f-4d02-ad38-debb363f484a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.538483 Sep 27 01:57:30.027436 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2778/5512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:29 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:30.695395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:30.696667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:30.720444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:30.721006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:30.721403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:30.722120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:30.722577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:30.723006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:31.052603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:31.053834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:31.061218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:31.062364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:31.063117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:31.063850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:31.064317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:31.064760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:31.192739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:31.211168 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5089f32a-c878-4cca-855c-f7f92b91ad2f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.520802 Sep 27 01:57:31.222676 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2735/5513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:30 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:32.006527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:32.025197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4cb6c25e-56cf-484a-ad6f-ec30289ff6fb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.976404 Sep 27 01:57:32.040304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2779/5514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:31 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:32.240411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:32.241715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:32.256308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:32.263006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:32.263481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:32.264241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:32.264705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:32.265571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:32.658820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:32.670796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9758d28-f73b-4dab-bbd4-3adced8097a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.436109 Sep 27 01:57:32.672097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2736/5515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:32 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:33.051827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:33.052463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:33.065142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:33.068665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:33.069144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:33.070649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:33.071129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:33.072469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:33.698403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:33.699461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:33.709144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:33.710115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:33.711027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:33.712127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:33.712912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:33.714006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:33.772406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:33.790859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7e35d780-5b90-47d9-bf4f-c4341cfbcb51 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.742357 Sep 27 01:57:33.792008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2780/5516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:33 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:34.035893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:34.056676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-801ea0ef-804e-4b4d-bdbc-1f85976a4529 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.363053 Sep 27 01:57:34.057380 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2737/5517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:33 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:34.824654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:34.826796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:34.841123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:34.843901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:34.845936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:34.847706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:34.848378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:34.849004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:35.079901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:35.080512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:35.096187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:35.096694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:35.097144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:35.097900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:35.098364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:35.098802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:35.484254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:35.496135 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ff6794c-8705-4d67-8f5d-07d9e8d1a47f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.676967 Sep 27 01:57:35.496965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2781/5518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:34 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:35.534972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:35.550853 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97e0bda5-2bb6-4ec9-8aca-b0732b371d04 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.474746 Sep 27 01:57:35.551962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2738/5519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:35 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:36.522322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:36.523031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:36.541965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:36.545136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:36.545945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:36.546985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:36.549624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:36.550416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:36.581642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:36.583364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:36.619065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:36.624811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:36.628013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:36.629055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:36.629604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:36.631266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:36.896395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:36.909016 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b938b2e3-bb73-496d-8234-345c3016c5ff tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.392604 Sep 27 01:57:36.927967 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2782/5520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:36 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:37.091683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:37.107954 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1d35e5c-8dca-45e0-ad9c-8cc6ab130432 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.534089 Sep 27 01:57:37.108625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2739/5521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:36 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:37.940348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:37.944509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:37.957856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=52 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:37.962443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:37.964306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:37.965442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:37.967323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:37.972449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:37.973798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:38.134922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:38.136720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:38.160841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:38.167971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:38.173161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:38.175725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:38.180765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:38.188531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:39.253745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:39.276993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-469a8cee-da1c-4695-842b-7850c822ad3b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 1.147343 Sep 27 01:57:39.279059 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2740/5522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:38 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:39.653753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:39.667430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad5fc201-b00c-43cf-9d05-df325f1f47b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 1.733486 Sep 27 01:57:39.668033 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2783/5523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:37 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:40.307931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:40.308540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:40.334560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:40.335274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:40.336311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:40.337208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:40.337855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:40.340693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:40.696076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:40.698180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:40.717637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:40.718220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:40.718672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:40.719396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:40.719853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:40.720279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:40.948009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:40.957623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-937519c7-cbb3-441e-8988-8df2850a40dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.654819 Sep 27 01:57:40.968444 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2741/5524] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:40 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:41.741491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:41.757374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2deb55e2-17b2-4ea5-978d-32858c934ade tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 1.063421 Sep 27 01:57:41.761151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2784/5525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:40 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:41.992139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:41.992701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:42.000738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:42.001229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:42.020003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:42.021019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:42.021719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:42.022389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:42.786138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:42.787928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:42.808357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:42.810222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:42.817204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:42.820104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:42.820822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:42.828154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:43.071236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:43.085360 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9586fc11-7f90-4d9c-9a45-4715d0f4743e tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 1.095810 Sep 27 01:57:43.088823 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2742/5526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:41 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:43.230879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:43.245512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-080374d8-685f-432e-9fa6-6bbafcb07c45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.465130 Sep 27 01:57:43.261762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2785/5527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:42 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:44.118613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:44.120947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:44.143063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:44.144135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:44.145219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:44.147207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:44.149122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:44.149980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:44.273134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:44.280409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:44.297797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:44.298303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:44.303938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:44.307298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:44.308028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:44.309880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:44.655894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:44.670338 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eec7c333-98bc-44a3-9934-c6b7ae83ea4e tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.395674 Sep 27 01:57:44.694092 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2786/5528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:44 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:45.091783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:45.108733 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ab3e96b-d577-4a29-a5d4-7a0d68877e1b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.995923 Sep 27 01:57:45.112457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2743/5529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:44 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:45.701025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:45.703599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:45.714622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:45.715115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:45.715560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:45.716275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:45.721808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:45.722570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:46.138904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:46.140255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:46.152095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:46.163646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:46.164308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:46.165174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:46.170358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:46.171102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:46.510810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:46.521221 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-167d3369-ab05-453c-91dc-05a392d37542 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.824582 Sep 27 01:57:46.529613 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2787/5530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:45 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:47.085011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:47.093437 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2944b90-9320-433b-ae2e-ed654327e069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.959254 Sep 27 01:57:47.098516 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2744/5531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:46 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:47.553779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:47.554402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:47.573387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:47.575878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:47.576715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:47.581097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:47.584174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:47.584637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:47.992428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:48.006302 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1ef5597-7b73-4c74-95ba-e408fb9ffc73 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1512 microversion: 2.1 time: 0.453043 Sep 27 01:57:48.006302 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2788/5532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:47 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:48.123430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:48.124078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:48.148711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:48.152419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:48.154263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:48.155431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:48.157201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:48.158485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:48.782026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:48.784298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:48.794119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b1e0146-cfdd-4961-911c-d7592b380bfa tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1506 microversion: 2.1 time: 0.674749 Sep 27 01:57:48.799299 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2745/5533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:48 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:49.047522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:49.051421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:49.083510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.085719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.091081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:49.093750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.099256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.100638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:49.828183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:49.829626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:49.847319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.859120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:49.866520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.867092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:49.873084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-126960da-3227-4ba7-8c96-a21aaee2711f tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1489 microversion: 2.1 time: 0.847075 Sep 27 01:57:49.876093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.876887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.887371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:49.893780 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2789/5534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:49 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1489 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:49.901160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1931530394"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:49.928366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:49.956662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.957555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.958481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:49.963720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:49.964504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:49.965182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:50.218534 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65b9f01a-4030-4606-a7e8-28e09e8909ea tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "PUT /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1062 microversion: 2.1 time: 0.321570 Sep 27 01:57:50.234858 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2790/5535] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 01:57:49 2022] PUT /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1062 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:50.253096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:50.255041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:50.271748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:50.275541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:50.276462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:50.277561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:50.281364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:50.282247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:50.320834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:50.461899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:50.485941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab57644a-c8e0-4fc0-932f-98852e598d58 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1486 microversion: 2.1 time: 0.661584 Sep 27 01:57:50.501229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2746/5536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:49 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1486 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:50.756452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1415173524", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:50.817910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:57:50.881277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] validate_networks() for [('cf52ba32-42ed-48bf-b274-4b9fc6c48620', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:57:51.097031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:51.107357 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9cfa5ec6-7c5c-4887-90d6-754aa88e9c06 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1489 microversion: 2.1 time: 0.865613 Sep 27 01:57:51.126543 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2791/5537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:50 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1489 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:51.155528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:51.156149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:51.198208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:51.198720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:51.199169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:51.199902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:51.200435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:51.200778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:51.766018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:57:51.766484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:57:51.767170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:57:51.767590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:57:51.768062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:57:51.779351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:51.780284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:51.780960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:51.781982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:51.782843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:51.783547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:51.810012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Getting quotas for project 400da454e0af45dc9ccd62d706ab7c0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:57:51.817278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Getting quotas for user efe87283ca054abc81f00d46efce41bc and project 400da454e0af45dc9ccd62d706ab7c0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:57:51.832623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:57:51.835857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:57:51.901692 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b581b67c-f652-4a7c-bb6b-cea5c3df538f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.149352 Sep 27 01:57:51.902384 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2747/5538] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:57:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 01:57:51.916832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b0bc7c5a-0122-4755-b907-72f1c422142b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:51.917796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0bc7c5a-0122-4755-b907-72f1c422142b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:52.278461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:52.290484 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-465e15c7-b410-40f5-9cf9-2bd31316e8dd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1489 microversion: 2.1 time: 1.138774 Sep 27 01:57:52.302303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2792/5539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:51 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1489 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:52.316579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:52.317420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:52.326465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:52.327270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:52.327920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:52.335603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:52.336383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:52.337084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:52.378968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:57:52.573390 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4b09f5e9-df0b-4fb1-ad81-171380f8a1ad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 204 len: 0 microversion: 2.1 time: 0.261378 Sep 27 01:57:52.574687 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2793/5540] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:52 2022] DELETE /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:57:52.583540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:52.585740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:52.601637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:52.602138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:52.603864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:52.604680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:52.606940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:52.607367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:52.795909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0bc7c5a-0122-4755-b907-72f1c422142b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:52.806093 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b0bc7c5a-0122-4755-b907-72f1c422142b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1214 microversion: 2.1 time: 0.895640 Sep 27 01:57:52.809695 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2748/5541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:51 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1214 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:53.489907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:53.504791 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d85e43b6-d22e-4334-a900-d2e0dc472687 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1495 microversion: 2.1 time: 0.922151 Sep 27 01:57:53.505902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2794/5542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:52 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1495 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:57:53.828937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:53.830204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:53.840561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:53.849896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:53.850565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:53.851512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:53.852331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:53.853684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:53.970858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:53.980502 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec5334c3-d9bc-4bcd-b7b6-525c3d34a7c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1266 microversion: 2.1 time: 0.155425 Sep 27 01:57:53.984245 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2749/5543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:53 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:54.532726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:54.533372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:54.547440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:54.548359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:54.548983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:54.550551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:54.552598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:54.553221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:55.005768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:55.006579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:55.015590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:55.016098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:55.027096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:55.028001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:55.028501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:55.028952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:55.188695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:55.241634 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bafeadf-b4be-4100-a454-da306b8088d0 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1495 microversion: 2.1 time: 0.714651 Sep 27 01:57:55.264179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2795/5544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:54 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1495 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:55.846314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:55.857428 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f5d24d52-1429-4d6d-b475-a18b234fe86f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1272 microversion: 2.1 time: 0.855558 Sep 27 01:57:55.874797 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2750/5545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:55 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1272 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:56.082674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b06a9fa-0c64-448e-9fd3-a0f0f000942b", "name": "network-vif-deleted", "tag": "04322dfc-7d1f-4544-abce-77a496e9bdd6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:57:56.118314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.119693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.121038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:56.138748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] Creating event network-vif-deleted:04322dfc-7d1f-4544-abce-77a496e9bdd6 for instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b on n-h1-859358-1 Sep 27 01:57:56.147585 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ab2a044b-66a7-4b85-baae-d6bed9afc952 req-fe3743ab-640d-4371-995f-53d389b03776 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068731 Sep 27 01:57:56.148902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2796/5546] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:57:56.272371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:56.272990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:56.296392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.297128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.301675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:56.303977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.306967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.309976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:56.390691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.393115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.395689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:56.396363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lazy-loading 'fault' on Instance uuid 3b06a9fa-0c64-448e-9fd3-a0f0f000942b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:57:56.636663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:56.650719 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-120ee128-9351-42cd-9a92-e66d781232be tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 200 len: 1310 microversion: 2.1 time: 0.382577 Sep 27 01:57:56.667124 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2751/5547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:56 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:56.889671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:56.890508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:56.898049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.909987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.911744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:56.915125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:56.918233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:56.918895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.120095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:57.137538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3cec5d5-c373-4a63-ab4d-c187b33995a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1272 microversion: 2.1 time: 0.247160 Sep 27 01:57:57.138751 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2797/5548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:56 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:57.685810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:57.686495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:57.706278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.707885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.708824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.721189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.721725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.722748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.766283 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b HTTP/1.1 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3b06a9fa-0c64-448e-9fd3-a0f0f000942b'} Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.768012 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.771694 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.782817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:57.783786 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f06e3924-c4c2-4ca6-880d-d6410f8a9198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 404 len: 111 microversion: 2.1 time: 0.104689 Sep 27 01:57:57.786554 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2752/5549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:57 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:57.806745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:57.807362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:57.814628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.815480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.816394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.817308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.817945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.818516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.835550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b HTTP/1.1 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3b06a9fa-0c64-448e-9fd3-a0f0f000942b'} Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.837745 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.840625 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.842395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:57.843284 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17b0039b-fb1a-4eb2-a1d9-2cdc1f5ea8fd tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 404 len: 111 microversion: 2.1 time: 0.040954 Sep 27 01:57:57.849676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2798/5550] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:57 2022] DELETE /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:57.855635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:57.856412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 3b06a9fa-0c64-448e-9fd3-a0f0f000942b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:57.866814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.871372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.873603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.881193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.883961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.885103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.943047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b HTTP/1.1 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3b06a9fa-0c64-448e-9fd3-a0f0f000942b'} Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.955271 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. Sep 27 01:57:57.958627 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:57.959980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 3b06a9fa-0c64-448e-9fd3-a0f0f000942b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:57.961019 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a7b32be-6ec6-4d06-a928-7a6118b040a1 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b" status: 404 len: 111 microversion: 2.1 time: 0.109928 Sep 27 01:57:57.968572 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2753/5551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:57 2022] GET /compute/v2.1/servers/3b06a9fa-0c64-448e-9fd3-a0f0f000942b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:57.975990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:57.976503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:57.985862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.986361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.986804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:57.991017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:57.991518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:57.991961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.077994 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e HTTP/1.1 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '959cd57c-7941-419b-81db-835e261fef5e'} Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.088184 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.091235 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.093918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.097656 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-50c5c711-d4f4-4d1e-9db7-30a84907a23c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 404 len: 111 microversion: 2.1 time: 0.126682 Sep 27 01:57:58.100803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2799/5552] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:57 2022] DELETE /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.109490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.110406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 959cd57c-7941-419b-81db-835e261fef5e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.124873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.130847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.131699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.133317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.134025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.134712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.170619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.171867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.182917 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.187559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e HTTP/1.1 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '959cd57c-7941-419b-81db-835e261fef5e'} Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.192061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. Sep 27 01:57:58.195240 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.197869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.199787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.214514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 959cd57c-7941-419b-81db-835e261fef5e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.218926 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9d0c585-cd84-4646-963b-020de3f67fad tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e" status: 404 len: 111 microversion: 2.1 time: 0.114185 Sep 27 01:57:58.219154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.233699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.234199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.242438 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2754/5553] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/959cd57c-7941-419b-81db-835e261fef5e => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.251221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.251727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.287224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.289739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.292592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.293576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.297980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.300054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.355905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 HTTP/1.1 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7291fe92-34ea-4f4c-887f-c7d608735303'} Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.357712 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.361997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88f288e3-8e29-4ba7-8969-56633adf8c88 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 404 len: 111 microversion: 2.1 time: 0.113230 Sep 27 01:57:58.372852 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2755/5554] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:58 2022] DELETE /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.383553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.390317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 7291fe92-34ea-4f4c-887f-c7d608735303] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.401165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.405194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.405953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.406927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.407587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.408220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.443767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 HTTP/1.1 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '7291fe92-34ea-4f4c-887f-c7d608735303'} Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.445731 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. Sep 27 01:57:58.449386 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.450722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 7291fe92-34ea-4f4c-887f-c7d608735303 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.451784 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ff328ea-5809-459b-b759-bfbe73f34490 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303" status: 404 len: 111 microversion: 2.1 time: 0.077526 Sep 27 01:57:58.452538 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2756/5555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/7291fe92-34ea-4f4c-887f-c7d608735303 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.465634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.466653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.485768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.486328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.486878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.487753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.488224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.488731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.519378 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 HTTP/1.1 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'e8d3bf62-3500-451c-b364-9b5aaccf2742'} Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.524639 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.529889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1df6a88-7e39-4a74-b6ed-73fc98808f1a tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 404 len: 111 microversion: 2.1 time: 0.070128 Sep 27 01:57:58.554448 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2757/5556] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:58 2022] DELETE /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:57:58.562481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.563645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: e8d3bf62-3500-451c-b364-9b5aaccf2742] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.588666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.589286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.589895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.590714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.595420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.595912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.629455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 HTTP/1.1 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'e8d3bf62-3500-451c-b364-9b5aaccf2742'} Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.651764 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.654849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance e8d3bf62-3500-451c-b364-9b5aaccf2742 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.658946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3061086-45c3-4b73-8ef6-9ed0117e4784 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742" status: 404 len: 111 microversion: 2.1 time: 0.103021 Sep 27 01:57:58.669856 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2758/5557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/e8d3bf62-3500-451c-b364-9b5aaccf2742 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.680469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.683775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.703704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.704847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.705464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.706329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.706935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.707641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.731368 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.731875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 HTTP/1.1 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'bdd327e4-b5cf-4588-948a-2034c0c56662'} Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.741660 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.745405 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.746463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f652c07-3889-480e-a5a3-8607d470f7f5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.578348 Sep 27 01:57:58.747460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.758862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67d654b4-5984-453d-bb3e-f804f9508c82 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 404 len: 111 microversion: 2.1 time: 0.087877 Sep 27 01:57:58.759970 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2800/5558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:57:58.764040 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2759/5559] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:58 2022] DELETE /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.772574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.777609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: bdd327e4-b5cf-4588-948a-2034c0c56662] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.790690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.791276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.793743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.794608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.795176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.795936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.861812 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 HTTP/1.1 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'bdd327e4-b5cf-4588-948a-2034c0c56662'} Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.871759 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. Sep 27 01:57:58.875161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.876759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance bdd327e4-b5cf-4588-948a-2034c0c56662 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.877862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c90849a-cc26-4be3-9363-c9d2b6735d9b tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662" status: 404 len: 111 microversion: 2.1 time: 0.112938 Sep 27 01:57:58.878606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2801/5560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/bdd327e4-b5cf-4588-948a-2034c0c56662 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.888118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.888849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.900370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.901267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.901999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.904247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.904913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.909370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.932539 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 HTTP/1.1 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a67a254b-895d-4c2f-9fc0-eee044bb8d77'} Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:58.947881 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:58.950991 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:58.952813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:58.953946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6289647a-9522-4758-ac08-f3d8cc0537b6 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 404 len: 111 microversion: 2.1 time: 0.071107 Sep 27 01:57:58.963885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:58.965907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: a67a254b-895d-4c2f-9fc0-eee044bb8d77] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:58.972162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2760/5561] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:58 2022] DELETE /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:58.973917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.974944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.975461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:58.976255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:58.976799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:58.977320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.001727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 HTTP/1.1 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a67a254b-895d-4c2f-9fc0-eee044bb8d77'} Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.015007 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance a67a254b-895d-4c2f-9fc0-eee044bb8d77 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:59.018406 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7d3bab4-203f-4889-a581-0ec300274b22 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77" status: 404 len: 111 microversion: 2.1 time: 0.057425 Sep 27 01:57:59.022224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2802/5562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:58 2022] GET /compute/v2.1/servers/a67a254b-895d-4c2f-9fc0-eee044bb8d77 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:59.027150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:59.027912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:59.035075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.035741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.036351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.037198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.037814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.038642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.070997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a HTTP/1.1 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '157ef778-17ff-4aec-8f8c-5cb54188b68a'} Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.073586 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.076847 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.079080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:59.081862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ed0782a-36d6-41a1-94f4-4fed8df5cd45 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a" status: 404 len: 111 microversion: 2.1 time: 0.060202 Sep 27 01:57:59.090880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:59.091714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: 157ef778-17ff-4aec-8f8c-5cb54188b68a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:59.101756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.102552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.103473 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2761/5563] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:59 2022] DELETE /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:57:59.103902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.104869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.105565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.106231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.154436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a HTTP/1.1 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '157ef778-17ff-4aec-8f8c-5cb54188b68a'} Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.156038 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance 157ef778-17ff-4aec-8f8c-5cb54188b68a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:57:59.160866 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7c8d60c-d2ea-4756-a947-b46b96453ecc tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a" status: 404 len: 111 microversion: 2.1 time: 0.070903 Sep 27 01:57:59.167894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2803/5564] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:59 2022] GET /compute/v2.1/servers/157ef778-17ff-4aec-8f8c-5cb54188b68a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 01:57:59.171471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:59.172033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:59.188034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.190977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.191455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.207423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.207974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.208720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.292292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:57:59.506995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-757b276e-6acb-4b1d-83b1-f228b92ee1f2 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 204 len: 0 microversion: 2.1 time: 0.342576 Sep 27 01:57:59.510725 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2762/5565] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:57:59 2022] DELETE /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:57:59.517819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:59.519613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:59.530028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.531103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.532044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.533438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.534401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.535309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.771277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:57:59.772663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:57:59.790063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.791456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.792105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.793087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:57:59.793798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:57:59.794462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:57:59.903906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:57:59.912616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98e193ce-5433-420e-9673-fe37fba4ca99 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1480 microversion: 2.1 time: 0.400447 Sep 27 01:57:59.933674 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2804/5566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:59 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1480 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:00.660436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:00.669860 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7f2d917-c15c-4d42-9827-cc7195d09922 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.903524 Sep 27 01:58:00.672506 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2763/5567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:57:59 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:00.940786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:00.941477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:00.964813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:00.965331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:00.965802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:00.966530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:00.966992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:00.967428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:01.244397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:01.256694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41b6c8e0-2f87-4ed7-99cc-1e016cd9b326 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1480 microversion: 2.1 time: 0.320535 Sep 27 01:58:01.274049 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2805/5568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:00 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1480 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:01.694802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:01.695897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:01.711818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:01.712444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:01.715445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:01.717887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:01.720103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:01.721110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:01.798877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:02.284905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:02.286081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:02.295806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:02.296298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:02.296902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:02.300169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:02.300811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:02.301442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:02.655567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:02.668209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6229470c-2c26-4bbe-8a29-c0a6d68bbf15 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1480 microversion: 2.1 time: 0.387453 Sep 27 01:58:02.673483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2806/5569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:02 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1480 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:02.801632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:02.874049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:02.883994 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e43dbe14-6a47-4358-ba2f-4c424b5220f7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 1.190977 Sep 27 01:58:02.889509 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2764/5570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:01 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:03.637583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aad20cf-315a-4f67-8329-7043cbfabafa", "tag": "4e93e003-ecc9-4fba-b8c6-432db46e626e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:03.660083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:03.660813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:03.661267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:03.696478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] Creating event network-changed:4e93e003-ecc9-4fba-b8c6-432db46e626e for instance 4aad20cf-315a-4f67-8329-7043cbfabafa on n-h2-859358-1 Sep 27 01:58:03.698290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:03.699402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:03.706660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fbc0ff48-5b5f-4a1a-a1a5-21c8f2a26b69 req-624fbd8f-c47e-480b-ae7b-637c9f29bf62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075994 Sep 27 01:58:03.713209 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2807/5571] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:58:03.717602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:03.719680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:03.720410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:03.721750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:03.724717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:03.725572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:03.910962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:03.911676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:03.926691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:03.928135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:03.929998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:03.931277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:03.938328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:03.938832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:04.276794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:04.286176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-80ed77b3-a039-450a-9118-e2a97b4d6b49 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.380135 Sep 27 01:58:04.286757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2808/5572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:03 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:04.706746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:04.717064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-817c15ae-b241-4580-8713-f7f03301ad4c tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1480 microversion: 2.1 time: 1.025406 Sep 27 01:58:04.721415 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2765/5573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:03 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1480 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:05.317767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:05.318557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:05.328043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.341080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.342121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:05.343189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.345326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.347190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:05.744118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:05.745624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:05.775579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.785430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.787742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:05.791569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.793113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.810781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:05.817788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:05.838274 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58cf6ccb-c79e-4fa6-9ce4-c5e5235de069 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.522288 Sep 27 01:58:05.841649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2809/5574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:05 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:05.864592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29bf3a9-78d7-4018-9a49-a2daab68a24e", "name": "network-vif-deleted", "tag": "c3322fa5-0abd-467a-9c00-5115bd2f8d55"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:05.907283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.908142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.908766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:05.909415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lazy-loading 'fault' on Instance uuid b29bf3a9-78d7-4018-9a49-a2daab68a24e {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:58:05.923293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:05.931969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:05.934442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:06.014653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] Creating event network-vif-deleted:c3322fa5-0abd-467a-9c00-5115bd2f8d55 for instance b29bf3a9-78d7-4018-9a49-a2daab68a24e on n-h2-859358-1 Sep 27 01:58:06.089243 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1c1fa0af-0a6c-4223-9bf5-b90944a48e62 req-979bb452-26c6-4ea5-ba99-653dc32d5323 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243162 Sep 27 01:58:06.094049 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2810/5575] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:58:06.269848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:06.292149 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87ffa041-9398-4088-825f-83d148274d20 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1283 microversion: 2.1 time: 0.551871 Sep 27 01:58:06.292917 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2766/5576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:05 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1283 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:06.869726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:06.870630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:06.878134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:06.879603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:06.879603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:06.879802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:06.880477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:06.881098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:07.213295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:07.215671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:07.254358 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b94cf203-23b0-48d1-859e-746527962d36 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.389800 Sep 27 01:58:07.254973 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2811/5577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:06 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:07.316365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:07.317081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:07.337622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:07.338370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:07.349844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:07.350856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:07.354526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:07.356690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:07.507343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:07.508454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:07.510862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:07.511337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lazy-loading 'fault' on Instance uuid b29bf3a9-78d7-4018-9a49-a2daab68a24e {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:58:07.717631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '701e33cd78094812bd73c191c5a403bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6708057baea74bfd9536644f97a91a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:07.730380 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d3a9c666-0ddb-48a1-bbda-f7551e4f47eb tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 200 len: 1283 microversion: 2.1 time: 0.418013 Sep 27 01:58:07.730972 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2767/5578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:07 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 1283 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:08.280509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:08.282036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:08.286669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:08.307159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:08.309209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:08.310057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:08.312608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:08.313368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:08.318074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:08.540716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:08.558743 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2873c6ce-218c-47e3-b4e1-78c6f0cb8fc9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.284586 Sep 27 01:58:08.559250 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2812/5579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:08 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:08.786575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:08.788679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] [instance: b29bf3a9-78d7-4018-9a49-a2daab68a24e] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:08.821917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:08.823805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:08.823805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:08.826479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:08.829160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:08.829948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:08.835002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:08.867553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] HTTP exception thrown: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Request method failure captured: Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e HTTP/1.1 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlenPFRMbz00G6x1iFyjVUXOYyYJMbyyXFBevDSsU01D0tcgKfee4xZyOIV5W5wbUAZf89v6_7iWkGucc6wKGxS75Yk9KjL7I9wME367oKe6h8C91EEe8Mtv7BwKVUKO72AQdupajtat14Nrhs5LssyhifWJYzRdrTkXwFmfsEIIDWY Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6708057baea74bfd9536644f97a91a5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6708057baea74bfd9536644f97a91a5a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersTestJSON-1805491460 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6708057baea74bfd9536644f97a91a5a Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersTestJSON-1805491460 Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersTestJSON-1805491460-project Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 701e33cd78094812bd73c191c5a403bf Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersTestJSON-1805491460-project Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b29bf3a9-78d7-4018-9a49-a2daab68a24e'} Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:58:08.869318 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] Returning 404 to user: Instance b29bf3a9-78d7-4018-9a49-a2daab68a24e could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:58:08.877692 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1e8ffe51-0b05-430e-b547-650caaefa198 tempest-ServersTestJSON-1805491460 tempest-ServersTestJSON-1805491460-project] 10.222.0.52 "GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e" status: 404 len: 111 microversion: 2.1 time: 0.100160 Sep 27 01:58:08.881661 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2768/5580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:08 2022] GET /compute/v2.1/servers/b29bf3a9-78d7-4018-9a49-a2daab68a24e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:58:09.586479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:09.587678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:09.609801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:09.611855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:09.612672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:09.613659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:09.614311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:09.615111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:10.830854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:10.842942 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a867ccfb-3fbc-42dc-8551-ee75291460cd tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 1.261449 Sep 27 01:58:10.879005 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2813/5581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:09 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:11.831976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aad20cf-315a-4f67-8329-7043cbfabafa", "name": "network-vif-plugged", "status": "completed", "tag": "4e93e003-ecc9-4fba-b8c6-432db46e626e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:11.881030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:11.881542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:11.881983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:11.882059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:11.882959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:11.900219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:11.901474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:11.902763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:11.903687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:11.904344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:11.904985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:11.919511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] Creating event network-vif-plugged:4e93e003-ecc9-4fba-b8c6-432db46e626e for instance 4aad20cf-315a-4f67-8329-7043cbfabafa on n-h2-859358-1 Sep 27 01:58:11.944879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bce0b837-b0e2-44fd-8e5c-fb9489c247e9 req-9657300f-a70c-49b6-80d2-912722e69964 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118130 Sep 27 01:58:11.945901 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2769/5582] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:58:12.531244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:12.540412 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-255aa5d7-b70c-4d60-9700-d715e749b622 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.675905 Sep 27 01:58:12.541244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2814/5583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:11 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:13.570570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:13.571925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:13.608135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:13.613926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:13.614630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:13.619071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:13.620372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:13.623250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:14.174903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:14.183523 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f1e6be4-1740-432f-b81c-b26ebb09fe35 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1314 microversion: 2.1 time: 0.618953 Sep 27 01:58:14.190154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2770/5584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:13 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:15.212504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:15.213189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:15.236493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:15.237001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:15.237492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:15.238210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:15.238676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:15.239492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:16.060545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:16.070838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-def25efb-0bd1-401f-8a08-88534f9253dc tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1500 microversion: 2.1 time: 0.862463 Sep 27 01:58:16.089600 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2815/5585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:15 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1500 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:16.094278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:16.096678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:16.128948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:16.129669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:16.130854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:16.132212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:16.133135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:16.133841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:16.171454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lazy-loading 'flavor' on Instance uuid 4aad20cf-315a-4f67-8329-7043cbfabafa {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:58:16.365872 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ceff551-6ca3-4000-a03d-188bf8259d97 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "POST /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa/action" status: 200 len: 32 microversion: 2.1 time: 0.275683 Sep 27 01:58:16.366910 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2771/5586] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:58:16 2022] POST /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 01:58:16.378856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:16.380052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:16.394376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:16.395253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:16.395897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:16.396848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:16.398393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:16.399816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:16.918131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:16.934521 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3549f79c-d15a-430b-bd51-1a62da1b56ef tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.556712 Sep 27 01:58:16.936147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2816/5587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:16 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:17.962084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:17.963384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:17.975125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:17.978275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:17.978905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:17.979808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:17.980450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:17.982348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:20.112625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:20.130163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ff69f0a5-9b82-47fa-a011-58d9dfc71d31 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 2.173713 Sep 27 01:58:20.131063 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2772/5588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:17 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:21.163836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:21.165086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:21.180674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:21.181172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:21.184204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:21.185406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:21.186552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:21.187006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:21.564431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:21.575160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad36c3f1-6ac5-4b91-89a4-8de575fe6551 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.417838 Sep 27 01:58:21.575752 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2817/5589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:21 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:22.602579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:22.603277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:22.615020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:22.616839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:22.617393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:22.618016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:22.618752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:22.622150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:22.622721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:23.094456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:23.113119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.513285 Sep 27 01:58:23.125821 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2773/5590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:22 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:24.150227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:24.150874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:24.188633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:24.189292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:24.190962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:24.193806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:24.195235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:24.198020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:24.905609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:24.907300 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002090 Sep 27 01:58:24.909165 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2774/5591] 10.222.0.52 () {56 vars in 886 bytes} [Tue Sep 27 01:58:24 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 27 01:58:24.918148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:24.920841 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003588 Sep 27 01:58:24.921598 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2775/5592] 10.222.0.52 () {54 vars in 1035 bytes} [Tue Sep 27 01:58:24 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 27 01:58:24.929142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:24.932361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003590 Sep 27 01:58:24.932899 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2776/5593] 10.222.0.52 () {54 vars in 1041 bytes} [Tue Sep 27 01:58:24 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:58:24.942543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:24.943605 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5840483-ca09-4491-98b0-94bf6196d090 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001772 Sep 27 01:58:24.944192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2777/5594] 10.222.0.52 () {56 vars in 886 bytes} [Tue Sep 27 01:58:24 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 27 01:58:25.178475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:25.194506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cdc1e0a5-c151-40fc-976c-8497761691a3 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.059192 Sep 27 01:58:25.196559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2818/5595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:24 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:26.225797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:26.227070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:26.246054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:26.249918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:26.250593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:26.251479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:26.252023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:26.252532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:27.152841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:27.165987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9cadb846-c8a0-4df5-848e-1ba0337fdf18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.945742 Sep 27 01:58:27.170008 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2778/5596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:26 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:27.267621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:27.268667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:27.278025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:27.278760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:27.279476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:27.280329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:27.280926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:27.281589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:27.321937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:58:27.509234 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3330b57-0e1b-4692-8547-61c7d1993394 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 204 len: 0 microversion: 2.42 time: 0.663911 Sep 27 01:58:27.510001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2819/5597] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:58:26 2022] DELETE /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 01:58:27.518819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:27.519590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:27.533924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:27.534657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:27.535323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:27.536242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:27.537068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:27.538477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:28.146031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:28.165743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:28.171609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:28.173259 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e1bf18c-49d1-40b2-94b1-dfad71f69665 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2957 microversion: 2.42 time: 0.658932 Sep 27 01:58:28.189371 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2779/5598] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:27 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2957 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:28.197730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:28.198665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:28.214203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:28.216322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:28.217730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:28.218649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:28.220452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:28.221849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:28.779185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:28.790042 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75e8b261-b139-48e4-bd6e-f9e284d077ae tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.594546 Sep 27 01:58:28.794730 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2820/5599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:28 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:29.210717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:29.212673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:29.262824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:29.264002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:29.265762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:29.268017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:29.270033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:29.271067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:29.816098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:29.817375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:29.831939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:29.835760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:29.836939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:29.846858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:29.847998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:29.850016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:30.024540 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 01:58:30.025531 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 01:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa (ip 10.222.0.52) !!! Sep 27 01:58:30.252222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:30.265757 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9902350-0bf5-45d3-9815-f29cad7aff2d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.451793 Sep 27 01:58:30.268384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2821/5600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:29 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:30.590935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:30.618765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:30.623671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:30.625524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e79e76d-f165-4712-9d13-0611ff38188a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2957 microversion: 2.42 time: 1.419737 Sep 27 01:58:30.655848 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2780/5601] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:29 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2957 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:31.300690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:31.302146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:31.312495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:31.313374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:31.314193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:31.315053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:31.315661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:31.316284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:31.672234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:31.672895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:31.687182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:31.687707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:31.688116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:31.688852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:31.689296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:31.690226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:31.730821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:31.742508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8938b8b-e1d2-4599-a05d-f774363be9e8 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.447222 Sep 27 01:58:31.745041 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2822/5602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:31 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:32.697447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:32.724773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:32.735318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:32.736935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-363fe7e0-e954-4a9e-a53f-32c216a286bf tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2957 microversion: 2.42 time: 1.068747 Sep 27 01:58:32.737722 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2781/5603] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:31 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2957 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:58:32.770989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:32.771570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:32.779234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:32.779941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:32.780734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:32.781824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:32.797968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:32.798931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:33.148876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:33.159858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4393cc1-fbf4-42a7-99c3-fe57c9e94bb6 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.393663 Sep 27 01:58:33.162737 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2823/5604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:32 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:33.768693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:33.786353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:33.818975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:33.819477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:33.819920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:33.821295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:33.821774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:33.832630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:34.184840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:34.186098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:34.196622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:34.200404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:34.201041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:34.201961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:34.202998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:34.208777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:35.062038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:35.072451 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9ab9a56-bef5-4a69-8382-994fcb1cc957 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.891183 Sep 27 01:58:35.073837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2824/5605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:34 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:35.336725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:35.355161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:35.358651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:35.359998 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1eafd1be-015d-4667-ba07-67d2cb6594bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2957 microversion: 2.42 time: 1.595275 Sep 27 01:58:35.360879 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2782/5606] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:33 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2957 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:36.098388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:36.099174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:36.116969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:36.120630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:36.123474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:36.128060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:36.130462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:36.132301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:36.452272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "35dc0dda-3e60-4cb9-b279-cbc928d166a3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:36.475770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:36.476304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:36.476684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:36.477165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:36.489134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a775703-1415-44b2-8d35-efad26f64237 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.395384 Sep 27 01:58:36.493431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2783/5607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:36 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:36.509847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:36.510635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:36.515748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] Creating event network-vif-unplugged:35dc0dda-3e60-4cb9-b279-cbc928d166a3 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:36.527042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:36.528085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:36.529973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:36.530931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:36.532042 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ed9119fa-b768-4d98-88a1-45b14f4c2853 req-696eb923-3a31-4014-b1fa-d05bb974ab67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.705316 Sep 27 01:58:36.532790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:36.533239 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2825/5608] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:58:36.536248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:37.495168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:37.512575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:37.516897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:37.517777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:37.519971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:37.521635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1fa36200-86d2-4fbb-9902-b8e1ccd25e0f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2936 microversion: 2.42 time: 1.030347 Sep 27 01:58:37.537364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2784/5609] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:36 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2936 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:37.537606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:37.952668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:37.965583 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a67c56e1-028b-4b68-9645-a36803c46ed7 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.452893 Sep 27 01:58:37.966307 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2826/5610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:37 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:38.566002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:38.566002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:38.576213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "c1b74e3f-ff04-4311-849d-af8536d9d1ed"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "711dafac-41e8-42d7-bfa7-2290cf11b3b4"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "1de62522-b15b-4657-84dc-1a13fc8b611e"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "98bff643-583e-47f2-8c2a-3e69937b15d1"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-unplugged", "status": "completed", "tag": "00d3fb02-c4c7-4018-8f37-2aaef4236ae6"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:38.584078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:38.584714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:38.586207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:38.586759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:38.587677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:38.589152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:38.590507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:38.598271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:38.602799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:38.603522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:38.630857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:38.634055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Creating event network-vif-unplugged:c1b74e3f-ff04-4311-849d-af8536d9d1ed for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:38.636053 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Creating event network-vif-unplugged:711dafac-41e8-42d7-bfa7-2290cf11b3b4 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:38.636657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Creating event network-vif-unplugged:1de62522-b15b-4657-84dc-1a13fc8b611e for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:38.637249 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Creating event network-vif-unplugged:98bff643-583e-47f2-8c2a-3e69937b15d1 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:38.637877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] Creating event network-vif-unplugged:00d3fb02-c4c7-4018-8f37-2aaef4236ae6 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:38.644353 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-60556a84-f49f-47c3-9705-a20a84f04b3f req-1b131a5d-fed4-4a4b-a87d-a442f0668f9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.071998 Sep 27 01:58:38.645441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2827/5611] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:58:39.031042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:39.031781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:39.066725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:39.072572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:39.074594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:39.076442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:39.082144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:39.088178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:39.110127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:39.169669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:39.187753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:39.198705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0bb6e36b-0bd1-4623-aa0a-4043635d53d5 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2915 microversion: 2.42 time: 0.641248 Sep 27 01:58:39.202382 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2785/5612] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:38 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2915 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:40.326168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-deleted", "tag": "1de62522-b15b-4657-84dc-1a13fc8b611e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:40.376652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:40.377146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:40.388025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:40.425428 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] Creating event network-vif-deleted:1de62522-b15b-4657-84dc-1a13fc8b611e for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:40.437921 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-34b0d518-572a-4b44-af5a-b19996b723ec req-4c852c98-5cef-43c2-9818-27ef1c713d1a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.798539 Sep 27 01:58:40.467047 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2786/5613] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:58:40.481049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:40.488075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:40.509430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:40.510105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:40.517371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:40.517371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:40.517371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:40.520979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:40.693315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:40.713089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fc47fc8-d854-4fad-92ef-a4b9b257a74f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.695024 Sep 27 01:58:40.713982 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2828/5614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:39 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:41.254844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:41.277592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:41.281282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:41.286353 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2d273813-2bef-4501-923f-cac93b546c93 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2707 microversion: 2.42 time: 0.818029 Sep 27 01:58:41.290596 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2787/5615] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:40 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2707 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:41.741605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:41.743960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:41.762807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:41.763411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:41.763858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:41.770179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:41.771284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:41.771728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:42.330696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:42.331507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:42.362440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:42.363195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:42.376367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:42.377498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:42.379357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:42.380874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:42.474309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:43.044945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:43.062230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:43.063895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:43.067469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb5c4380-8f1b-4a23-b040-f94d71864821 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2660 microversion: 2.42 time: 0.741692 Sep 27 01:58:43.070311 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2788/5616] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:42 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2660 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:43.082900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-deleted", "tag": "98bff643-583e-47f2-8c2a-3e69937b15d1"}, {"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-deleted", "tag": "711dafac-41e8-42d7-bfa7-2290cf11b3b4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:43.111096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:43.111613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:43.112054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:43.157412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Creating event network-vif-deleted:98bff643-583e-47f2-8c2a-3e69937b15d1 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:43.158124 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] Creating event network-vif-deleted:711dafac-41e8-42d7-bfa7-2290cf11b3b4 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:43.183715 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cb6c1e0d-5575-4f9a-829d-25c1ea220f35 req-a5380cce-efc6-4dc8-847a-a3397e678fc8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.111481 Sep 27 01:58:43.184515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2789/5617] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:58:43.369823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:43.394651 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da139599-0bff-428e-866a-4278fc439319 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.661609 Sep 27 01:58:43.395870 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2829/5618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:41 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:44.102376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:44.103083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:44.116236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:44.117718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:44.119823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:44.123632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:44.127669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:44.130371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:44.408378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf23c9f7-dd55-4000-bcff-e39e630a1de9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: .version_select at 0x7f24d611c550>, body: {"keypair": {"name": "tempest-keypair-4818566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXUwC95zq8LEqodGYs26HvRrV7GWF2F1drpSgrinN6sDscSizdvaNzvMnOQjyUt03fTo78VkRjx1TG0YLkQsf5tJpJQK4EalJah/jGDoeiQFc1uDDWhbplclS6ns77Dhw=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:44.485943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cf23c9f7-dd55-4000-bcff-e39e630a1de9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:58:44.508012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cf23c9f7-dd55-4000-bcff-e39e630a1de9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for user 67774f0eba764daaac0a50d3d6082a2a and project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:58:44.518348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:44.550904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:44.553064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:44.560847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8be85aef-35d1-4964-81a8-2b13816e7dd7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2273 microversion: 2.42 time: 0.463074 Sep 27 01:58:44.562038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2830/5619] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:44 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:44.582966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:44.583596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:44.598775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf23c9f7-dd55-4000-bcff-e39e630a1de9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.742071 Sep 27 01:58:44.612187 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2790/5620] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 01:58:43 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:58:44.645859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:44.647487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:44.651318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:44.653891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:44.655236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:44.656177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:45.340885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-deleted", "tag": "35dc0dda-3e60-4cb9-b279-cbc928d166a3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:45.375466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:45.391357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:45.391994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:45.428361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] Creating event network-vif-deleted:35dc0dda-3e60-4cb9-b279-cbc928d166a3 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:45.447668 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-652d82e8-a9d2-4e11-ab77-96178fca8d43 req-e72c2a1f-4b01-4563-8a69-21b938066bc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111469 Sep 27 01:58:45.450050 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2791/5621] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:58:45.589452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:45.593887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:45.594780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:45.598095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1a20399-051f-4bd3-8b16-4f4545a74cd0 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.034879 Sep 27 01:58:45.599169 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2831/5622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:44 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:45.633747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:45.634255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:45.642957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:45.649720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:45.650915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:45.651437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:45.954653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:45.987015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:46.003900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:46.005251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6b43f8e-637c-48aa-96fe-9a509658b2c9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 2160 microversion: 2.42 time: 0.416694 Sep 27 01:58:46.012967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2792/5623] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:45 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 2160 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:46.626980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:46.627755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:46.646005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:46.646565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:46.648685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:46.651612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:46.652139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:46.652588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:47.050769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:47.051404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:47.066444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:47.066942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:47.080584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:47.083172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:47.085852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:47.086289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:47.506087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:47.548196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:47.550216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:47.551533 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd1f876d-e55c-40e6-89bc-5af7155b8546 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.511672 Sep 27 01:58:47.570340 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2793/5624] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:47 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:47.594849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd491be-be45-41ef-86f0-71aad304798a", "name": "network-vif-deleted", "tag": "00d3fb02-c4c7-4018-8f37-2aaef4236ae6"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:47.607892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:47.621669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:47.622230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:47.674626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] Creating event network-vif-deleted:00d3fb02-c4c7-4018-8f37-2aaef4236ae6 for instance 3cd491be-be45-41ef-86f0-71aad304798a on n-h2-859358-1 Sep 27 01:58:47.690301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-16a1e906-d30c-4ca2-935c-3dfae81214d7 req-784a2020-4ec0-482e-a4d2-3a76d8e5a4e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104525 Sep 27 01:58:47.692628 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2794/5625] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 27 01:58:47.731711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:47.744327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27b6901e-3e86-49c6-b1db-55f829c2b42d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.122147 Sep 27 01:58:47.747797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2832/5626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:46 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:48.585794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:48.586632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:48.601999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:48.612737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:48.615256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:48.621097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:48.623300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:48.625430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:48.772968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:48.773859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:48.791476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:48.798771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:48.799263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:48.800022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:48.800500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:48.800931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:49.390678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:49.410725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:49.425085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:49.426639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:49.428383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72c09021-f3e8-411d-b674-919a2979703b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.652946 Sep 27 01:58:49.432851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2833/5627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:48 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:49.436770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71fdeb62-50ae-4d7b-bb19-9b231d4f9437 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.847360 Sep 27 01:58:49.460865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2795/5628] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:48 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:50.472597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:50.473112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:50.474856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:50.477621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:50.511108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:50.516935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:50.520070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:50.521099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:50.527230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:50.528016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:50.530801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:50.534093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:50.535683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:50.541610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:50.543632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:50.546960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:50.907012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:50.934949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:50.937561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:50.940989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25a60e69-98ec-4390-8e14-0c384ef95e9a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.478072 Sep 27 01:58:50.942975 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2796/5629] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:50 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:58:51.971817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:51.973784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:51.983634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:51.984404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:51.985287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:51.986337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:51.987059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:51.987686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:52.005990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:52.017568 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b3baf10-e4d2-4769-b171-28cd9379c788 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1486 microversion: 2.1 time: 1.558214 Sep 27 01:58:52.030241 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2834/5630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:50 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1486 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:52.053272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:52.053927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:52.061563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:52.062274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:52.062867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:52.063916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:52.064732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:52.065478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:52.156062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73ea06dc-0c74-46dc-8203-4b91caed988c tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "POST /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa/action" status: 202 len: 0 microversion: 2.1 time: 0.110109 Sep 27 01:58:52.171296 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2835/5631] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 01:58:52 2022] POST /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 01:58:52.192130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1652117292", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdbb7e5c-8b68-4ca5-a993-70f1ced520ae"}], "security_groups": [{"name": "tempest-securitygroup--726900440"}], "key_name": "tempest-keypair-4818566", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:58:52.270902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:52.304742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:52.310496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:52.319060 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-404316cd-c3fd-4d4c-9822-449bd625abb3 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.352570 Sep 27 01:58:52.321772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2797/5632] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:51 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:52.336698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:52.338940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:52.364949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:52.368695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:52.371092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:52.375081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:52.379240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:52.382214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:52.991013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:53.003824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-568f592e-544c-4996-81ba-4c9f661926d1 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1494 microversion: 2.1 time: 0.678390 Sep 27 01:58:53.020976 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2798/5633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:52 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1494 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:53.188736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] validate_networks() for [('bdbb7e5c-8b68-4ca5-a993-70f1ced520ae', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:58:53.353174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:53.354138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:53.372046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:53.378855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:53.379619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:53.388507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:53.389670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:53.390003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:53.390455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:53.699382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:53.724973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:53.730587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:53.732117 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a8a8804-6e21-44d0-a2ff-b35a68f53cdb tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.383786 Sep 27 01:58:53.734551 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2799/5634] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:53 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:54.034991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:54.035618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:54.046751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.047246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.047677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.048387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.048837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.049261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.384881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:54.396431 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0b7e3b6a-a7bf-48a5-a28d-ad922d0b148f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1494 microversion: 2.1 time: 0.365228 Sep 27 01:58:54.397199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2800/5635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:54 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:58:54.483176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:58:54.483659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:58:54.484083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:58:54.484503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:58:54.484928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:58:54.515550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.526758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.527255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.528097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.528578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.529014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.576807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:58:54.599071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for user 67774f0eba764daaac0a50d3d6082a2a and project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:58:54.634579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:58:54.638212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:58:54.728008 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06f9c547-a73f-4bd9-8fe9-f4f254bed2e8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.547489 Sep 27 01:58:54.742248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a5e3cee-43d0-4495-a908-c30554934f03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:54.742874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a5e3cee-43d0-4495-a908-c30554934f03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:54.745021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:58:54.748607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2836/5636] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:58:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:58:54.763248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:54.763863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:54.784974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.790892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.791444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.793329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:54.796543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:54.797015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:54.915624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a5e3cee-43d0-4495-a908-c30554934f03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:54.928989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a5e3cee-43d0-4495-a908-c30554934f03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1235 microversion: 2.1 time: 0.191301 Sep 27 01:58:54.942804 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2801/5637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:54 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1235 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:54.973948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:55.007584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:55.024041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:55.025230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16b7f785-2da0-4eac-8ba6-5f7760a6ff20 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.266180 Sep 27 01:58:55.047519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2837/5638] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:54 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 01:58:55.429145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:55.430010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:55.474718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:55.476087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:55.477090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:55.497584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:55.500633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:55.502863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:55.954743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45f640ec-8695-4329-b222-7e914a533d34 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:55.955871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:55.956084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45f640ec-8695-4329-b222-7e914a533d34 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:55.968317 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c04e650-70e4-4d5a-9e4d-3d29697bd5c2 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1494 microversion: 2.1 time: 0.544980 Sep 27 01:58:55.976206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2802/5639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:55 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1494 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:56.059995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:56.060619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:56.088268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:56.101802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:56.107436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:56.108745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:56.111832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:56.116419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:56.117267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45f640ec-8695-4329-b222-7e914a533d34 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:56.127158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45f640ec-8695-4329-b222-7e914a533d34 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1235 microversion: 2.1 time: 0.176432 Sep 27 01:58:56.128954 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2838/5640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:55 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1235 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:56.341742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:56.365171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:56.369406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:56.370676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d7ed8eb-d7b7-4955-9a5e-8a56d4ad9caa tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.314825 Sep 27 01:58:56.396111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2803/5641] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:56 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:57.025688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:57.027636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:57.060642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.061804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.062490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.063507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.064193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.070637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.155442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:57.156924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:57.178064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.181033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.182803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.184014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.187990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.189093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.387883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:57.414824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7aa95c36-cd3b-496f-a3ed-0f0636f33a93 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1295 microversion: 2.1 time: 0.263739 Sep 27 01:58:57.421734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2804/5642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:57 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1295 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:57.427647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:57.443025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:57.444045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:57.445396 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6c87559-d097-41ee-a33b-26a1d8b92c8a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1500 microversion: 2.1 time: 0.428883 Sep 27 01:58:57.449404 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2839/5643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:57 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1500 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:57.465020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.474079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.474835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.475652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.476296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.476880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.486029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:57.486541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:57.495535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.496410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.497868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.502725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.503456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.505870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.590334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:58:57.786571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:57.823232 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c72ba1e6-e180-43b6-9199-1e2a31d5c32f tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 204 len: 0 microversion: 2.1 time: 0.342405 Sep 27 01:58:57.825017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2840/5644] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:58:57 2022] DELETE /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:58:57.838456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:57.847911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:57.850328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:57.851893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93ff9489-1c50-44dc-96a3-7d9b85201bf7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.428750 Sep 27 01:58:57.852529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:57.858492 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2805/5645] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:57 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:58:57.867819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.872556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.873089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:57.873859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:57.874331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:57.874781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:58.446802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:58.447434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:58.483137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:58.483661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:58.484120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:58.484871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:58.485355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:58.485809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:58.950746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:58.974922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-829cfff2-6016-4962-86c1-a0b5da9ab74c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1293 microversion: 2.1 time: 0.533431 Sep 27 01:58:58.989363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2806/5646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:58 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1293 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:59.008821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:58:59.014191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:58:59.028971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:59.029514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:59.029958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:59.030677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:58:59.031136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:58:59.031568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:58:59.082354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:59.092547 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d40ba19f-98fe-43ec-a534-a8320cbd52c9 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 1.262570 Sep 27 01:58:59.093131 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2841/5647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:57 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:58:59.206268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:59.216456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:59.218112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:58:59.219362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-baa1c1f7-4f8a-4498-8a1c-cae67de703bc tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.230511 Sep 27 01:58:59.228900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2807/5648] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:58:58 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:00.003817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:00.004720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:00.016980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.017742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.019245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.022419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.023295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.024090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.121331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:00.122663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:00.136706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.138884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.139681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.140760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.142214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.144226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.336282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:00.352602 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12640073-a10e-44db-a4e2-301a5e1697b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1293 microversion: 2.1 time: 0.353086 Sep 27 01:59:00.356665 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2842/5649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:58:59 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1293 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:00.369667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:00.370380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:00.386963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.387571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.388316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.389981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:00.404713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:00.405186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:00.489447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:00.527470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:00.530090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:00.540514 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aaf928cf-b86b-4810-b577-808e12631b18 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.423533 Sep 27 01:59:00.541406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2808/5650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:00 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:00.693450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:00.708526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:00.721456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:00.722841 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1654a593-b4c9-46c8-863e-d9187b26015b tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.364779 Sep 27 01:59:00.737658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2843/5651] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:00 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:01.381119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:01.382516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:01.390265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:01.390757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:01.391192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:01.408466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:01.408983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:01.409460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:01.566545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:01.567852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:01.587402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:01.593714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:01.594424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:01.595352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:01.596071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:01.596669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:02.171695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:02.181170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c19b106f-4eeb-487d-b6b9-dc53507a3017 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1506 microversion: 2.1 time: 0.620540 Sep 27 01:59:02.194450 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2844/5652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:01 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:02.210162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:02.213047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:02.228946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:02.231862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:02.233940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:02.235500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:02.238313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:02.239342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:02.243039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:02.252644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fe84891-6e00-4c40-85a9-60dc5032ac61 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.871594 Sep 27 01:59:02.253304 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2809/5653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:01 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:02.447713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:02.462865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:02.465999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:02.470581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c2b03f7-2c54-4338-a08e-65ee372eec69 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.273706 Sep 27 01:59:02.485838 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2845/5654] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:02 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:03.084365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aad20cf-315a-4f67-8329-7043cbfabafa", "name": "network-vif-deleted", "tag": "4e93e003-ecc9-4fba-b8c6-432db46e626e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:03.128795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.132052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.132683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.179871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] Creating event network-vif-deleted:4e93e003-ecc9-4fba-b8c6-432db46e626e for instance 4aad20cf-315a-4f67-8329-7043cbfabafa on n-h2-859358-1 Sep 27 01:59:03.197260 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-62f73865-43d8-4f18-a426-a1cc63513c59 req-364660c7-0435-4533-a401-5316803d5d48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113157 Sep 27 01:59:03.200112 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2810/5655] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:03.215419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:03.216979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:03.233226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.233756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.234205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.234920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.235377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.240604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.280556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:03.281293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:03.299121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.299624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.300061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.300776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.301284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.301774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.404814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.409866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.420654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.421708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lazy-loading 'fault' on Instance uuid 4aad20cf-315a-4f67-8329-7043cbfabafa {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:59:03.655970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:03.675293 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b61ebfb-b488-4cec-8e24-7b5d72688311 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 200 len: 1304 microversion: 2.1 time: 0.464040 Sep 27 01:59:03.685120 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2846/5656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:03 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 1304 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:03.695057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:03.696575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:03.712069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.713623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.714625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.716314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:03.716939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:03.717668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:03.828833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:03.843491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:03.850471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:03.852977 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b93203fb-af7c-4797-9bc2-585ec28a64a9 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.165943 Sep 27 01:59:03.853856 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2847/5657] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:03 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:04.337175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:04.347563 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-057cf8d5-25c1-4d29-9777-865e87bb2ef4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 1.071465 Sep 27 01:59:04.358226 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2811/5658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:03 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:04.701832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:04.703125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: 4aad20cf-315a-4f67-8329-7043cbfabafa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:04.706112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:04.723164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.730433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.731174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.732105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.737423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.739778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.856051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] HTTP exception thrown: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Request method failure captured: Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa HTTP/1.1 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlheVjr9YKWLd8OJaO4TWnAimz941szqPGgDbcvHeJBlDrlER4TZhEk5GYUCz0sxa3VI6YE-lXT3J0QFuH_x1yD-YbDUEwYNyP8PsjJThE-By-C9fO32jXQvtMNWTseLV0XS2M29dHQkhgU5--R7O5vOvru0UAb_tx-54chd6UEJhZE Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 400da454e0af45dc9ccd62d706ab7c0e Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_400da454e0af45dc9ccd62d706ab7c0e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 400da454e0af45dc9ccd62d706ab7c0e Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerRescueTestJSON-1144925848-project Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: efe87283ca054abc81f00d46efce41bc Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerRescueTestJSON-1144925848-project Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '4aad20cf-315a-4f67-8329-7043cbfabafa'} Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:04.861832 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:04.866131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Returning 404 to user: Instance 4aad20cf-315a-4f67-8329-7043cbfabafa could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:04.871831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f0d2796-1f4f-4c7c-a60e-42da31aa4534 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa" status: 404 len: 111 microversion: 2.1 time: 0.174167 Sep 27 01:59:04.872894 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2848/5659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:04 2022] GET /compute/v2.1/servers/4aad20cf-315a-4f67-8329-7043cbfabafa => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:59:04.885302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:04.885974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:04.898536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:04.899055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:04.904765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.905307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.906465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.907206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.907671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.908104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.923319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.923828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.924277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.925009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:04.933184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:04.933706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:04.958284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:05.021283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:59:05.080682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:05.095151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:05.100140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:05.101773 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8f902ba-70c2-4d41-8e01-e1a39f96a090 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.222915 Sep 27 01:59:05.102911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2812/5660] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:04 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:05.170575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd8e5cea-be0c-4ed5-9d32-9e9f8189d3c5 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 204 len: 0 microversion: 2.1 time: 0.275518 Sep 27 01:59:05.171228 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2849/5661] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:59:04 2022] DELETE /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:59:05.183053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:05.183648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:05.198638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:05.199280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:05.200529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:05.201702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:05.202317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:05.203184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:05.289530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6420aa-6f9e-4be5-8398-0f23c2d02bb6", "tag": "c5c826d7-c07e-4135-a5ad-679f2f8efd37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:05.313646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:05.322501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:05.326593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:05.359211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] Creating event network-changed:c5c826d7-c07e-4135-a5ad-679f2f8efd37 for instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 on n-h1-859358-1 Sep 27 01:59:05.382288 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-14f18d10-d54d-4471-b833-0ee2527ab2d0 req-29e3c349-908f-4725-9e99-1237932a0be1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096424 Sep 27 01:59:05.383426 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2850/5662] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:59:05.419698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:05.420871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:05.431009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:05.432095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:05.433452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:05.441659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:05.446610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:05.447585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:05.624955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:05.640592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16529057-cf9f-472e-9c9e-fa5cf5934f7a tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1492 microversion: 2.1 time: 0.464734 Sep 27 01:59:05.641222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2813/5663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:05 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1492 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:05.776027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:05.786175 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52b7e5e0-cc84-4615-9cc9-f3368489b421 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.399276 Sep 27 01:59:05.786815 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2851/5664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:05 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:06.132130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:06.133114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:06.144182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.145118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.148337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:06.149328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.151661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.154693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:06.389870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:06.406236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:06.408872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:06.410837 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d8c57fbc-e7bf-4cd0-a274-f0f7dcb474a7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.282666 Sep 27 01:59:06.414566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2814/5665] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:06 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:06.664818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:06.666392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:06.680926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:06.704872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.710555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.712101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:06.715187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.716060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.718999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:06.813990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:06.814610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:06.826714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.827220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.827737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:06.828372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:06.828833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:06.829264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:07.048615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:07.060385 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e2b64333-1c79-4c72-93c9-ed6e66db1660 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1492 microversion: 2.1 time: 0.398671 Sep 27 01:59:07.078111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2852/5666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:06 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1492 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:07.449973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:07.451345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:07.469523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:07.470734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:07.471337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:07.473106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:07.473599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:07.474033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:07.600825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:07.617401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:07.620342 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3029efd3-9c65-4454-9729-4c783f542b38 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.810323 Sep 27 01:59:07.625949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2815/5667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:06 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:07.641523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:07.645571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:07.647950 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-581f1409-5eb8-42d3-b77c-d3c3134ed9ae tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.210984 Sep 27 01:59:07.649148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2853/5668] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:07 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:08.109426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:08.110051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:08.134067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.134589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.135043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:08.137584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.138241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.139742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:08.650989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:08.651600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:08.678538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.681934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.689908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:08.693039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.698072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.698725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:08.736564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:08.753128 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84b8144c-3882-462c-b4a5-3bb071929102 tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1492 microversion: 2.1 time: 0.655299 Sep 27 01:59:08.754168 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2816/5669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:08 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1492 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:08.762391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:08.763451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:08.773398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.784614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.785901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:08.789593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:08.790394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:08.792286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:09.015418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:09.025092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:09.030395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:09.031643 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b16c662-1470-4b46-8ac8-01f73e80b431 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.275717 Sep 27 01:59:09.032219 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2817/5670] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:08 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:09.066720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:09.082630 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f4e1e32-fa44-4e8d-aa13-2f62d323a9c8 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.435421 Sep 27 01:59:09.084385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2854/5671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:08 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:09.784756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:09.787001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:09.810813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:09.811916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:09.814341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:09.820079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:09.820866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:09.822177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:09.870226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f28dda-00b7-4bb5-8fca-782adc12a79c", "name": "network-vif-deleted", "tag": "2a82cf9e-b336-432c-b66f-416f2c25cd7b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:09.880667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:09.899295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:09.905088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:09.905809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:09.935623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] Creating event network-vif-deleted:2a82cf9e-b336-432c-b66f-416f2c25cd7b for instance c2f28dda-00b7-4bb5-8fca-782adc12a79c on n-h2-859358-1 Sep 27 01:59:09.945747 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0702322d-87f6-43ad-9245-8ccdcbeef7f6 req-e20b61d6-c8a3-4116-8f3a-4c233a15bb54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078851 Sep 27 01:59:09.946569 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2855/5672] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:59:09.975488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efe87283ca054abc81f00d46efce41bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400da454e0af45dc9ccd62d706ab7c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:09.986880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5f3d588-061b-4899-887e-ad0badc0468d tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 200 len: 1450 microversion: 2.1 time: 0.208069 Sep 27 01:59:09.989670 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2818/5673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:09 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 1450 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:10.062860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:10.063575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:10.098067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:10.098564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:10.098999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:10.109167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:10.110337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:10.110475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:10.116624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:10.117164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:10.122629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:10.124566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:10.125770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:10.127895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:10.129738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:10.130547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:10.306763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:10.329149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:10.333699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:10.337915 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b46ee4bc-7f9d-47a6-bafe-96211205183a tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.279176 Sep 27 01:59:10.340620 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2856/5674] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:10 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:10.467001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:10.478527 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-99e17026-6744-487c-b64c-b3fa89e8faf0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.373698 Sep 27 01:59:10.484860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2819/5675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:10 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:10.523283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6420aa-6f9e-4be5-8398-0f23c2d02bb6", "name": "network-vif-plugged", "status": "completed", "tag": "c5c826d7-c07e-4135-a5ad-679f2f8efd37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:10.550049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:10.550830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:10.551425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:10.590653 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] Creating event network-vif-plugged:c5c826d7-c07e-4135-a5ad-679f2f8efd37 for instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 on n-h1-859358-1 Sep 27 01:59:10.598415 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-be6f00d8-ce66-4387-91eb-12c7e1cee4c1 req-c99969a5-980f-4665-beba-46be5e9f2eda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078915 Sep 27 01:59:10.600942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2857/5676] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:11.014553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:11.016363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] [instance: c2f28dda-00b7-4bb5-8fca-782adc12a79c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:11.035439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.036090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.036596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.038420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.039033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.040387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.074225 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] HTTP exception thrown: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Request method failure captured: Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c HTTP/1.1 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlheVjr9YKWLd8OJaO4TWnAimz941szqPGgDbcvHeJBlDrlER4TZhEk5GYUCz0sxa3VI6YE-lXT3J0QFuH_x1yD-YbDUEwYNyP8PsjJThE-By-C9fO32jXQvtMNWTseLV0XS2M29dHQkhgU5--R7O5vOvru0UAb_tx-54chd6UEJhZE Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 400da454e0af45dc9ccd62d706ab7c0e Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/400da454e0af45dc9ccd62d706ab7c0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_400da454e0af45dc9ccd62d706ab7c0e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 400da454e0af45dc9ccd62d706ab7c0e Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerRescueTestJSON-1144925848 Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerRescueTestJSON-1144925848-project Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: efe87283ca054abc81f00d46efce41bc Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerRescueTestJSON-1144925848-project Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'c2f28dda-00b7-4bb5-8fca-782adc12a79c'} Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:11.075947 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] Returning 404 to user: Instance c2f28dda-00b7-4bb5-8fca-782adc12a79c could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5f7bd4ae-6d8d-477b-81bb-ee1b38c4ff2b tempest-ServerRescueTestJSON-1144925848 tempest-ServerRescueTestJSON-1144925848-project] 10.222.0.52 "GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c" status: 404 len: 111 microversion: 2.1 time: 0.068815 Sep 27 01:59:11.079458 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2820/5677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:11 2022] GET /compute/v2.1/servers/c2f28dda-00b7-4bb5-8fca-782adc12a79c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:59:11.366942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:11.370092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:11.397684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.399965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.400643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.402632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.405063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.406940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.508501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:11.509518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:11.518789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.524785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.525535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.526442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:11.531125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:11.531807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:11.560662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:11.575940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:11.580733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:11.585952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a38bbba1-8c3c-49db-9c8f-364ef38e6a73 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.224550 Sep 27 01:59:11.588948 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2858/5678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:11 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:11.915765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:11.929262 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17448433-b88e-4538-932a-3c5eaa3402e6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1360 microversion: 2.1 time: 0.422594 Sep 27 01:59:11.931254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2821/5679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:11 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1360 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:12.616709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:12.617929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:12.639129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:12.639815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:12.640445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:12.641168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:12.641868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:12.642640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:12.810036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:12.831109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:12.834723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:12.840055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74042acf-88dc-4bee-ae8b-d2f4cf1c62c7 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.228420 Sep 27 01:59:12.841240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2859/5680] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:12 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:12.963299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:12.963925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:12.989673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:12.990199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:12.993812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:12.997703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:12.998236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:13.001236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:13.621359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:13.643298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b1258aab-f9e2-4322-a837-636da882bb43 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1545 microversion: 2.1 time: 0.686424 Sep 27 01:59:13.645990 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2822/5681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:12 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1545 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:13.670785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:13.671954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:13.687406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:13.687897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:13.688335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:13.689161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:13.689668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:13.690822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:13.870587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:13.871212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:13.880463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:13.881509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:13.881959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:13.882671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:13.883116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:13.889324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:13.940398 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83b1d06c-7925-48d0-a984-544b4ca1e206 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273868 Sep 27 01:59:13.941440 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2860/5682] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 01:59:13 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:14.158601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:14.191091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:14.192650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:14.194551 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-57ddbeda-1509-4cc5-a8e3-5e73d32ac536 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.327823 Sep 27 01:59:14.207573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2823/5683] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:13 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:15.225740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:15.226483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:15.244838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:15.246487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:15.248415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:15.249253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:15.251262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:15.252561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:15.313001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:15.467456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:15.483278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:15.485515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:15.487397 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-de717eeb-0342-4940-b524-5a691841f3ef tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.267104 Sep 27 01:59:15.498759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2861/5684] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:15 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:16.519696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:16.520860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:16.533153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:16.533672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:16.534118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:16.534843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:16.535289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:16.540297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:16.759039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:16.772130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:16.781585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:16.788395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-968abf28-f150-4579-b431-ce6e9c920a21 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1602 microversion: 2.42 time: 0.272711 Sep 27 01:59:16.791573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2824/5685] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:16 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1602 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:16.822858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6420aa-6f9e-4be5-8398-0f23c2d02bb6", "tag": "c5c826d7-c07e-4135-a5ad-679f2f8efd37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:16.852947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:16.854471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:16.854944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:16.892446 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] Creating event network-changed:c5c826d7-c07e-4135-a5ad-679f2f8efd37 for instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 on n-h1-859358-1 Sep 27 01:59:16.907901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-76c7bba5-88f6-4df3-8d20-c43c9ba9c24a req-843b281d-5c87-4525-bf1b-7be1e69407ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090074 Sep 27 01:59:16.909169 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2862/5686] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:17.820558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:17.821902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:17.832164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:17.845479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:17.846266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:17.847267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:17.848785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:17.850805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:17.939216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:17.940893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:17.943078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:17.945283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lazy-loading 'fault' on Instance uuid 3cd491be-be45-41ef-86f0-71aad304798a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:59:18.117107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:18.127584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:18.142911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c59bb9619964ae89c641404d974ed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f67d35052374bdbbbd97d406009ba76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:18.145054 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c69e828e-06b1-457f-a373-4b2b3ef10c3e tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 200 len: 1607 microversion: 2.42 time: 0.329374 Sep 27 01:59:18.151108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2825/5687] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:17 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 1607 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 01:59:19.200355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:19.203966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:19.221716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:19.222815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:19.224404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:19.226893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:19.227575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:19.228466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:19.272084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] HTTP exception thrown: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Request method failure captured: Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a HTTP/1.1 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlc1K_Y6WHxsbcNdyhtBwMG1j8z0AhqhKuJuq1XadAKeRS2t513Df5sChi74j4u2n8w5LV95AklPTvxl0GHQOcv94DfMe0ckpedJnxmB3WHg0vjTTgtI-dS8BrlYTu5AeMzmUgn0ckpu24tOKAITNBuxX_2l64PLN1iNaPbBc14OLQU Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.42 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f67d35052374bdbbbd97d406009ba76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1c59bb9619964ae89c641404d974ed49 Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3cd491be-be45-41ef-86f0-71aad304798a'} Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:19.279791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:19.284303 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:19.286468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Returning 404 to user: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:19.299075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fd39258-9645-4f33-baf3-5fdd859f9d8f tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 404 len: 111 microversion: 2.42 time: 0.107162 Sep 27 01:59:19.301253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2863/5688] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:19 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:59:19.310776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-76ccceba-f257-44c7-99ee-005c47d40151 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '.version_select at 0x7f24da70c0d0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:19.351984 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-76ccceba-f257-44c7-99ee-005c47d40151 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-201855387" status: 204 len: 0 microversion: 2.42 time: 0.044633 Sep 27 01:59:19.352710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2826/5689] 10.222.0.52 () {60 vars in 1259 bytes} [Tue Sep 27 01:59:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-201855387 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 27 01:59:28.199762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:28.200284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:28.208072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:28.208619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:28.209148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:28.209950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:28.210412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:28.210843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:28.247121 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] HTTP exception thrown: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Request method failure captured: Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a HTTP/1.1 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlc1K_Y6WHxsbcNdyhtBwMG1j8z0AhqhKuJuq1XadAKeRS2t513Df5sChi74j4u2n8w5LV95AklPTvxl0GHQOcv94DfMe0ckpedJnxmB3WHg0vjTTgtI-dS8BrlYTu5AeMzmUgn0ckpu24tOKAITNBuxX_2l64PLN1iNaPbBc14OLQU Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.42 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f67d35052374bdbbbd97d406009ba76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1c59bb9619964ae89c641404d974ed49 Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3cd491be-be45-41ef-86f0-71aad304798a'} Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:28.250106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.255162 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.261089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Returning 404 to user: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:28.262167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77b5d20c-8500-4402-9331-9029d54765e2 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 404 len: 111 microversion: 2.42 time: 0.068989 Sep 27 01:59:28.263357 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2864/5690] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 01:59:28 2022] DELETE /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:59:28.276081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:28.280505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] [instance: 3cd491be-be45-41ef-86f0-71aad304798a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:28.331783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:28.342248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:28.346471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:28.347186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:28.349999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:28.351660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:28.352529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:28.354538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:28.393494 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] HTTP exception thrown: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Request method failure captured: Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a HTTP/1.1 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlc1K_Y6WHxsbcNdyhtBwMG1j8z0AhqhKuJuq1XadAKeRS2t513Df5sChi74j4u2n8w5LV95AklPTvxl0GHQOcv94DfMe0ckpedJnxmB3WHg0vjTTgtI-dS8BrlYTu5AeMzmUgn0ckpu24tOKAITNBuxX_2l64PLN1iNaPbBc14OLQU Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Openstack-Nova-Api-Version: 2.42 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f67d35052374bdbbbd97d406009ba76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f67d35052374bdbbbd97d406009ba76", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4f67d35052374bdbbbd97d406009ba76 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1198615311 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1c59bb9619964ae89c641404d974ed49 Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1198615311-project Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '3cd491be-be45-41ef-86f0-71aad304798a'} Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.405804 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. Sep 27 01:59:28.410068 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 01:59:28.413837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] Returning 404 to user: Instance 3cd491be-be45-41ef-86f0-71aad304798a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:28.415308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c26f13ed-8cc7-43fa-a731-37239d141b55 tempest-TaggedBootDevicesTest_v242-1198615311 tempest-TaggedBootDevicesTest_v242-1198615311-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a" status: 404 len: 111 microversion: 2.42 time: 0.146505 Sep 27 01:59:28.417921 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2827/5691] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 01:59:28 2022] GET /compute/v2.1/servers/3cd491be-be45-41ef-86f0-71aad304798a => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 01:59:30.511949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:30.513121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:30.524586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:30.525455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:30.526150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:30.538103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:30.538615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:30.539069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:30.759953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lazy-loading 'services' on Instance uuid 2e8628ad-5cad-4f41-90fd-d4378afb832f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:59:30.889900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fc2b4a3-0a56-4173-a6d7-6e3d6aa2f6e7 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f/os-volume_attachments/43d1762e-e117-427f-9e55-5f9573e40706" status: 202 len: 0 microversion: 2.1 time: 0.381691 Sep 27 01:59:30.891300 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2865/5692] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 01:59:30 2022] DELETE /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f/os-volume_attachments/43d1762e-e117-427f-9e55-5f9573e40706 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 01:59:41.615915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:41.616412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:41.625792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:41.627614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:41.628412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:41.629115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:41.630614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:41.631264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:41.632583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:41.688912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 01:59:41.860343 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-114d0a15-a1d1-4ef2-b6e9-e914eaefd582 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 204 len: 0 microversion: 2.1 time: 0.247858 Sep 27 01:59:41.860994 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2828/5693] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 01:59:41 2022] DELETE /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 01:59:41.869253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=21 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:41.870163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 01:59:41.877084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:41.877845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:41.896790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:41.897295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:41.897768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:41.898490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:41.903792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:41.905179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:42.150838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:42.162174 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7db8c1f-4083-472b-be7b-039ff1590aff tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1470 microversion: 2.1 time: 0.294892 Sep 27 01:59:42.163724 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2866/5694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:41 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:43.187867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:43.189474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:43.213124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:43.213650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:43.214085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:43.218721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:43.220295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:43.223383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:43.603984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:43.624089 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7671d7c2-dc7b-412a-b187-2a2754c46b49 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1470 microversion: 2.1 time: 0.441142 Sep 27 01:59:43.639162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2829/5695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:43 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:44.248043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8628ad-5cad-4f41-90fd-d4378afb832f", "name": "network-vif-deleted", "tag": "e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:44.291951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:44.292515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:44.292876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:44.348378 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] Creating event network-vif-deleted:e8c28748-de2d-46a1-ad8e-29b3ed9d5b0e for instance 2e8628ad-5cad-4f41-90fd-d4378afb832f on n-h1-859358-1 Sep 27 01:59:44.359755 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fdb39f09-3ef0-4955-ad75-7a72fb3835d7 req-a605c65d-ddae-47f9-bebc-b396788aa4f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120558 Sep 27 01:59:44.363863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2867/5696] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 01:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:44.654661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:44.655318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:44.670606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:44.671718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:44.672609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:44.674670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:44.679187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:44.680520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:44.740934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:44.750134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:44.751177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:44.760011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lazy-loading 'fault' on Instance uuid 2e8628ad-5cad-4f41-90fd-d4378afb832f {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 01:59:44.874194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1ffd377d3b43e78efadd2891d2494d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4663ebb4c3a4430b64f9e0a0a94ddda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:44.901924 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f4d802f-dde7-4d7f-83da-083febbc49b9 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 200 len: 1304 microversion: 2.1 time: 0.251268 Sep 27 01:59:44.905989 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2830/5697] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:44 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:45.962307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:45.964260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] [instance: 2e8628ad-5cad-4f41-90fd-d4378afb832f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:45.984618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:45.987396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:45.988915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:45.990459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:45.993583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:45.994987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:46.075048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] HTTP exception thrown: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Request method failure captured: Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f HTTP/1.1 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlhmHLlCoQZoH7s88bDbDEev0zvnanqjCG9Mh-S4qKdqVjU99nmoMMaD2IqJfxBqiJCOaI-QgKrAhBD8Eyg3xXdIWEE3S6lJWQQwMHLpV1tDAkLLElXg1PJXrHPadTNeWO4dIgKMVSliOEWgUJEKoKOXokRE9Ods5C9eWyiboBrcQqg Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c4663ebb4c3a4430b64f9e0a0a94ddda Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesBackupsTest-1786910986 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4663ebb4c3a4430b64f9e0a0a94ddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4663ebb4c3a4430b64f9e0a0a94ddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4663ebb4c3a4430b64f9e0a0a94ddda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4663ebb4c3a4430b64f9e0a0a94ddda", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesBackupsTest-1786910986 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c4663ebb4c3a4430b64f9e0a0a94ddda Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesBackupsTest-1786910986 Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesBackupsTest-1786910986-project Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: cf1ffd377d3b43e78efadd2891d2494d Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesBackupsTest-1786910986-project Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2e8628ad-5cad-4f41-90fd-d4378afb832f'} Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:46.077115 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] Returning 404 to user: Instance 2e8628ad-5cad-4f41-90fd-d4378afb832f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 01:59:46.083554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e3bc7e6-a3cd-4ccf-acdf-94ceca4ee2f1 tempest-VolumesBackupsTest-1786910986 tempest-VolumesBackupsTest-1786910986-project] 10.222.0.52 "GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f" status: 404 len: 111 microversion: 2.1 time: 0.122782 Sep 27 01:59:46.089084 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2868/5698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:45 2022] GET /compute/v2.1/servers/2e8628ad-5cad-4f41-90fd-d4378afb832f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 01:59:49.379430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:49.381268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:49.401702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:49.404908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:49.407448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:49.412047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:49.413191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:49.413880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:49.476290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05eb1f27-93b6-4c97-a304-e621586a7949 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/ips" status: 200 len: 144 microversion: 2.1 time: 0.100950 Sep 27 01:59:49.478085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2831/5699] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 01:59:49 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/ips => generated 144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 01:59:53.705824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-630415043", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8396fcaa-a3a2-4074-b01a-07f0de3ffa51"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:53.875972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] validate_networks() for [('8396fcaa-a3a2-4074-b01a-07f0de3ffa51', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 01:59:54.818760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553bd7ff-0753-46cb-b210-b688c485a42b"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 01:59:54.821873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:54.838312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:54.858057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:54.861164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:54.865803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:54.866426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:54.873908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:54.941287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 01:59:54.942290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 01:59:54.943176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 01:59:54.943640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 01:59:54.943929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 01:59:54.970507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:54.971457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:54.973735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:54.975516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:54.977493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:54.978038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:55.072676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Getting quotas for project 512339208f954958a55266b4db14f988. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 01:59:55.088481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Getting quotas for user 13772336c20c4ee695aaf888db5dd80c and project 512339208f954958a55266b4db14f988. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 01:59:55.124758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 01:59:55.146156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 01:59:55.351559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ca5e2e4-707a-4944-8d7f-13dc2bfb4d92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652442 Sep 27 01:59:55.357723 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2869/5700] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 01:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 01:59:55.378682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1735658-0136-4fc1-83b2-ef072d6846e6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:55.380206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1735658-0136-4fc1-83b2-ef072d6846e6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:55.669210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1735658-0136-4fc1-83b2-ef072d6846e6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:55.679531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1735658-0136-4fc1-83b2-ef072d6846e6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1213 microversion: 2.1 time: 0.317157 Sep 27 01:59:55.690008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2870/5701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:55 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:55.719593 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d81fef56-6b10-4008-a5c6-98d9ae7cb589 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904948 Sep 27 01:59:55.730063 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2832/5702] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 01:59:54 2022] POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 01:59:56.724822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ad792b5-0b2c-42cd-989d-7306b03440af tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:56.728372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ad792b5-0b2c-42cd-989d-7306b03440af tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:56.832258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad792b5-0b2c-42cd-989d-7306b03440af tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:56.845167 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ad792b5-0b2c-42cd-989d-7306b03440af tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1213 microversion: 2.1 time: 0.123694 Sep 27 01:59:56.846918 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2871/5703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:56 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 01:59:57.869014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3532a62a-06fc-4c43-b67e-4d1827c2beea tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:57.869877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3532a62a-06fc-4c43-b67e-4d1827c2beea tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:58.140803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3532a62a-06fc-4c43-b67e-4d1827c2beea tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:58.151892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3532a62a-06fc-4c43-b67e-4d1827c2beea tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1213 microversion: 2.1 time: 0.285109 Sep 27 01:59:58.153597 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2833/5704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:57 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 01:59:59.200307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 01:59:59.205703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 01:59:59.239828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:59.242800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:59.244542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:59.248531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 01:59:59.250218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 01:59:59.250946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 01:59:59.626761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 01:59:59.643598 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d601e46-3f7d-4aad-bde3-9eabc5d9f6c8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1217 microversion: 2.1 time: 0.460476 Sep 27 01:59:59.654697 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2872/5705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 01:59:59 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1217 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:00.677698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:00.678304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:00.710485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:00.711323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:00.712123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:00.729408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:00.731769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:00.732237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:01.238001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:01.250374 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dadcd14c-dac7-492a-ac31-5cdc3547fad1 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1283 microversion: 2.1 time: 0.578004 Sep 27 02:00:01.253002 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2834/5706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:00 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1283 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:02.282585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:02.283213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:02.310793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:02.311553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:02.311996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:02.312720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:02.313177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:02.313646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:02.565171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:02.574805 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5fe00c6-60f6-40c6-9477-dced0c79ad6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1271 microversion: 2.1 time: 0.296981 Sep 27 02:00:02.575384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2873/5707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:02 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:03.607022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:03.607742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:03.617871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:03.618767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:03.619373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:03.620107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:03.620573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:03.621008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:04.105784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:04.116328 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bbecc821-6561-460f-bb78-23ee1b9667f0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1271 microversion: 2.1 time: 0.513374 Sep 27 02:00:04.116939 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2835/5708] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:03 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:05.147449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:05.148065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:05.171962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:05.177742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:05.178563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:05.179596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:05.181817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:05.182466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:05.183832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:06.723735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:06.734046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3241fe7-b7ab-4ab3-9615-912050218a18 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 1.591726 Sep 27 02:00:06.739255 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2874/5709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:05 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:07.772993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:07.775671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:07.796384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:07.797362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:07.798145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:07.799125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:07.799907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:07.800542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:08.149686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:09.141561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:09.165664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4373e3c2-6b61-46bc-bda9-76e414be3b92 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 1.401831 Sep 27 02:00:09.167824 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2836/5710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:07 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:10.201611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:10.205521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:10.247602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:10.343194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:10.345921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:10.346388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:10.355600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:10.356300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:10.356579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:10.685073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2e3dec-e35c-4976-9998-4242636e5b0b", "tag": "157dbc55-2a36-4be9-886b-adb57ce08dde"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:10.805374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:10.807213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:10.808934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:10.910209 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] Creating event network-changed:157dbc55-2a36-4be9-886b-adb57ce08dde for instance fd2e3dec-e35c-4976-9998-4242636e5b0b on n-h2-859358-1 Sep 27 02:00:10.939426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-dfa522d6-6b37-4664-be22-a6f79421cee5 req-9ef2daa2-9a5d-46cd-bf58-94d7ff6946f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265629 Sep 27 02:00:10.960318 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2837/5711] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:00:11.097029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:11.107945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e73ae364-2352-432c-b67e-8c5415b49e96 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 0.921079 Sep 27 02:00:11.118942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2875/5712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:10 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:12.145906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:12.146615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:12.157166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:12.198153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:12.203002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:12.208142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:12.210035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:12.243589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:12.243589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:12.295005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:13.285727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:13.337152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-001caf29-f402-4223-901a-146891dd4b48 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 1.196818 Sep 27 02:00:13.342488 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2838/5713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:12 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:14.370938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:14.371593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:14.398637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:14.402688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:14.407766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:14.411717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:14.412935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:14.415524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:14.416194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:14.436182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=37 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:15.197699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:15.221742 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9930f6bc-9495-4095-b6d1-7111225a2ef6 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 0.861147 Sep 27 02:00:15.231857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2876/5714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:14 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:16.252364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:16.252974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:16.280333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:16.281135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:16.283699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:16.284966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:16.285674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:16.289196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:17.430182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:17.438182 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2da69fb-4546-4938-a217-e9348fef125c tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 1.189641 Sep 27 02:00:17.443869 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2839/5715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:16 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:18.469787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:18.471085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:18.489329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:18.495144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:18.495651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:18.498756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:18.499248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:18.499685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:18.982588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:19.010757 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6b659cf-36c0-4572-979d-d2d2ac8bb85a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 0.543637 Sep 27 02:00:19.015578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2877/5716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:18 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:20.041959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:20.042639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:20.059636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:20.061541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:20.062022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:20.062695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:20.068985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:20.074217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:20.467544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:20.481170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d79639ef-8f9e-485f-a0bb-193af67a9a51 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 0.444331 Sep 27 02:00:20.494811 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2840/5717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:20 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:20.565240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:20.578286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:20.580481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:20.581249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:20.636473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 02:00:20.736180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59ee6946-9c2f-4744-a265-b2119ec5945a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.174729 Sep 27 02:00:20.737146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2878/5718] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:00:20 2022] POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:00:20.746323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:20.747327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:20.769718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:20.770586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:20.771843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:20.774789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:20.775690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:20.776382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:21.201167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2e3dec-e35c-4976-9998-4242636e5b0b", "name": "network-vif-plugged", "status": "completed", "tag": "157dbc55-2a36-4be9-886b-adb57ce08dde"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:21.216868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:21.237553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:21.238335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:21.274198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] Creating event network-vif-plugged:157dbc55-2a36-4be9-886b-adb57ce08dde for instance fd2e3dec-e35c-4976-9998-4242636e5b0b on n-h2-859358-1 Sep 27 02:00:21.283896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9b097ce2-d0d9-4b2f-84da-f7a4aacd8d86 req-e60db799-9a29-4999-8f5c-01998fe504df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091546 Sep 27 02:00:21.287189 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2879/5719] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:00:21.364045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:21.381682 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b0336fd-ac04-4869-ae08-c2c75cceb109 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.639508 Sep 27 02:00:21.397825 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2841/5720] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:20 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:21.506810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:21.507671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:21.525635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:21.526505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:21.529278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:21.530328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:21.536354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:21.538386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:21.998736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:22.013477 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c676dba-a165-4d0f-82fe-a505ce7e32cf tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 0.507281 Sep 27 02:00:22.035634 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2880/5721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:21 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:22.408408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:22.409206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:22.432130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:22.442110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:22.446122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:22.448717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:22.449422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:22.450024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:23.041160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:23.041838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:23.051206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:23.051690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:23.058405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:23.059577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:23.060233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:23.060820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:23.412689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:23.431067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-abcf9317-5126-4098-b77d-1ebdcc743dfb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 1.027227 Sep 27 02:00:23.455389 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2842/5722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:22 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:24.463506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:24.464996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:24.504425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:24.506268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:24.508512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:24.509145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:24.510094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:24.510577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:24.511290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:24.529178 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc691ae2-2e96-4fdc-aea2-9c6801a76ea0 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1313 microversion: 2.1 time: 1.492467 Sep 27 02:00:24.550930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2881/5723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:23 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1313 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:25.548627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:25.562702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:25.563221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:25.572018 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-299ec2e8-777b-4d35-b8b0-bcb67e4926a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 1.115691 Sep 27 02:00:25.582469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:25.582956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:25.583384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:25.584091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:25.599915 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2843/5724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:24 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:25.600625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:25.600625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:26.616740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:26.617569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:26.630909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:26.640768 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fc37dc0-0a4c-457c-a5e2-480863a96868 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1498 microversion: 2.1 time: 1.090673 Sep 27 02:00:26.644654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:26.652288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:26.657229 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2882/5725] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:25 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1498 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:26.657866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:26.660839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:26.662379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:26.663195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:27.314140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:27.335627 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca88a5ba-be7b-4643-a5e4-4183924fbb69 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.715019 Sep 27 02:00:27.336979 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2844/5726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:26 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:27.707719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:27.708625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:27.739718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:27.742319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:27.744489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:27.745973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:27.751397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:27.757824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:27.880274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:00:28.111164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1e1fd36-5a6d-4488-8201-5d16b6dce63e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 204 len: 0 microversion: 2.1 time: 0.407214 Sep 27 02:00:28.116340 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2883/5727] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:00:27 2022] DELETE /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 02:00:28.122864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:28.124513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:28.156676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:28.157740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:28.158834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:28.162656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:28.171958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:28.172798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:28.367820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:28.368683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:28.388025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:28.388528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:28.388969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:28.389718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:28.393171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:28.398010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:28.872332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:28.923644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b02632a-2cf2-438e-a5b0-562912aa7c36 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1504 microversion: 2.1 time: 0.806003 Sep 27 02:00:28.942177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:28.947374 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2845/5728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:28 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1504 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:28.949818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d33e3aa-3b2d-48db-a4c7-306954c6640b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.591440 Sep 27 02:00:28.957800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2884/5729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:28 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:29.955022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:29.955643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:29.968448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:29.968962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:29.969416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:29.970124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:29.970578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:29.971001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:29.984870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:29.985517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:30.022665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:30.024007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:30.028194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:30.029978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:30.030629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:30.032573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:30.657672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:30.668096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-788eadad-aac3-4d0b-a993-3daee717aa6d tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1504 microversion: 2.1 time: 0.716722 Sep 27 02:00:30.670961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2846/5730] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:29 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:30.839413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:30.855529 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-430a1baf-2dba-4123-aabf-f688f10e1726 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.874712 Sep 27 02:00:30.856509 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2885/5731] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:29 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:31.703864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:31.708004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:31.732503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:31.735381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:31.735875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:31.736689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:31.746208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:31.751622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:31.890585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:31.891500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:31.918380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:31.921012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:31.921685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:31.923598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:31.925852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:31.929224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:32.387796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:32.400331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25894840-bd84-4080-9a03-8d6646ba96b4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1504 microversion: 2.1 time: 0.701115 Sep 27 02:00:32.401203 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2847/5732] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:31 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:32.802624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:32.826740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d02b9086-bc23-4918-8e5a-93c7a6f05c04 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.935033 Sep 27 02:00:32.861684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2886/5733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:31 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:32.884851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2e3dec-e35c-4976-9998-4242636e5b0b", "name": "network-vif-deleted", "tag": "157dbc55-2a36-4be9-886b-adb57ce08dde"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:32.921243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:32.921825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:32.922269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:32.966749 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] Creating event network-vif-deleted:157dbc55-2a36-4be9-886b-adb57ce08dde for instance fd2e3dec-e35c-4976-9998-4242636e5b0b on n-h2-859358-1 Sep 27 02:00:32.996438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cb5dc485-811b-4576-aa4d-4f2160c13297 req-78863ec2-e4cc-41b6-bed7-02a0e8d9cfdc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115287 Sep 27 02:00:32.997301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2848/5734] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:00:33.427547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:33.428988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:33.442266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:33.444507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:33.445894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:33.448036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:33.449598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:33.451497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:33.557275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:33.559010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:33.560925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:33.561639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lazy-loading 'fault' on Instance uuid fd2e3dec-e35c-4976-9998-4242636e5b0b {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:00:33.736250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:33.755727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88084d85-4154-44a0-ab6e-898343e90471 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 200 len: 1303 microversion: 2.1 time: 0.329624 Sep 27 02:00:33.759822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2887/5735] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:33 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 1303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:33.856798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:33.857632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:33.869705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:33.870317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:33.870897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:33.874200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:33.874991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:33.875624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:34.333080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:34.355257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afc99d32-8651-45b9-b28b-d636ba872d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.502665 Sep 27 02:00:34.372942 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2849/5736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:33 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:34.785536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:34.786793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: fd2e3dec-e35c-4976-9998-4242636e5b0b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:34.834573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:34.836055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:34.837037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:34.839205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:34.840310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:34.843415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:34.925945 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] HTTP exception thrown: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Request method failure captured: Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b HTTP/1.1 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlkUESwzMSp4o5IQ2O7Kk2lZSwQnQKpflinAu7oILg4Njdg8Dd_-PEiwwqiwmhRf7dD7xpJlW76qT4wlezyNc6aPoIut3vDSmFyR5K8t_zFAYAzFMV1Tr4riBRiHD9S_DsZSXmNW-eoxHF_n0xhds4sbvkqBa-1uDxWRQ0hqXvYxjuI Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 512339208f954958a55266b4db14f988 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesActionsTest-1920124772 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/512339208f954958a55266b4db14f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/512339208f954958a55266b4db14f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/512339208f954958a55266b4db14f988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_512339208f954958a55266b4db14f988", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesActionsTest-1920124772 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 512339208f954958a55266b4db14f988 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesActionsTest-1920124772 Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesActionsTest-1920124772-project Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 13772336c20c4ee695aaf888db5dd80c Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesActionsTest-1920124772-project Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'fd2e3dec-e35c-4976-9998-4242636e5b0b'} Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:00:34.931264 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. Sep 27 02:00:34.937443 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:00:34.940289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Returning 404 to user: Instance fd2e3dec-e35c-4976-9998-4242636e5b0b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:00:34.948321 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12c0f6ae-4dfd-409d-b207-f79fea680869 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b" status: 404 len: 111 microversion: 2.1 time: 0.163230 Sep 27 02:00:34.958640 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2888/5737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:34 2022] GET /compute/v2.1/servers/fd2e3dec-e35c-4976-9998-4242636e5b0b => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:00:35.331848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-728365434", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8396fcaa-a3a2-4074-b01a-07f0de3ffa51"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:35.380611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:35.381254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:35.394164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:35.394607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:35.395059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:35.402526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:35.403496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:35.403963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:35.496039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] validate_networks() for [('8396fcaa-a3a2-4074-b01a-07f0de3ffa51', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:00:35.842124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:35.852710 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22699b4a-c24d-43f3-94da-5a1a2bc1cded tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1719 microversion: 2.1 time: 0.476705 Sep 27 02:00:35.873791 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2889/5738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:35 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1719 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:36.884636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:36.885283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:36.913166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:36.918167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:36.919830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:36.920629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:36.930168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:36.931083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:37.309421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:37.321679 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf79a607-7be8-460f-8acc-e2b858436254 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1696 microversion: 2.1 time: 0.444139 Sep 27 02:00:37.344006 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2890/5739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:36 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1696 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:37.357602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:37.390475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:37.392040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:37.392689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:37.397798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:37.426181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Going to try to start instance {{(pid=128779) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 02:00:37.524959 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9e00e7a-43f8-4da8-b523-03a9e8434cb7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.172711 Sep 27 02:00:37.526302 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2891/5740] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:00:37 2022] POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:00:37.535229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:37.542373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:37.553894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:37.556020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:37.558244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:37.559358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:37.562228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:37.573988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:37.858046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:37.879197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-97ebe3f1-eaf8-4d6a-a8ca-2087d4fcdd8c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1705 microversion: 2.1 time: 0.340809 Sep 27 02:00:37.879197 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2892/5741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:37 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1705 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:38.908478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:38.909183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:38.923954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:38.927048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:38.928426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:38.929793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:38.937680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:38.941149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:38.957214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:00:38.957868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:00:38.958938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:00:38.959731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:00:38.960656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:00:39.011421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:39.016431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:39.016991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:39.020783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:39.025158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:39.025923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:39.138082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Getting quotas for project 512339208f954958a55266b4db14f988. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:00:39.165501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Getting quotas for user 13772336c20c4ee695aaf888db5dd80c and project 512339208f954958a55266b4db14f988. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:00:39.246629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:00:39.260182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:00:39.343415 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98053939-5f30-4356-b5f9-c1dd6e9385a7 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.016538 Sep 27 02:00:39.351602 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2850/5742] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:00:39.357362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7b2c240a-ccbb-4011-933b-934c3e362982 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:39.358280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7b2c240a-ccbb-4011-933b-934c3e362982 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:39.483807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:39.500258 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf6d58ab-0cdd-4f23-a0d7-d4220e7ab0ad tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1705 microversion: 2.1 time: 0.595543 Sep 27 02:00:39.503977 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2893/5743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:38 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1705 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:39.778088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7b2c240a-ccbb-4011-933b-934c3e362982 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:39.791441 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7b2c240a-ccbb-4011-933b-934c3e362982 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1213 microversion: 2.1 time: 0.438461 Sep 27 02:00:39.792865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2851/5744] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:39 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1213 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:40.537988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:40.539373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:40.570617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:40.571461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:40.572062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:40.573811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:40.575646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:40.577139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:40.834678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:40.836139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:40.885370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:40.888672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:40.889197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:40.890027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:40.890491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:40.890998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:41.067840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:41.080305 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3446298-6a60-4a51-b141-04921bef1ab4 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1265 microversion: 2.1 time: 0.250628 Sep 27 02:00:41.081296 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2852/5745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:40 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:41.653834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:41.666373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2073e9f7-ea6b-432e-b7b9-605590e76402 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1705 microversion: 2.1 time: 1.134246 Sep 27 02:00:41.672645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2894/5746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:40 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1705 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:42.105611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:42.106238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:42.115192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:42.126844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:42.129113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:42.131222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:42.137637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:42.138803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:42.465707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:42.481968 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c50a02b1-b387-4daf-b5b1-f53e7306e8ae tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1271 microversion: 2.1 time: 0.379871 Sep 27 02:00:42.486097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2853/5747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:42 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:42.697668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:42.699234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:42.713914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:42.734250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:42.734993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:42.737617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:42.738538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:42.741844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:43.150594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:43.163181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e254501-c573-46fa-b3a9-619116f5ca0b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1709 microversion: 2.1 time: 0.467503 Sep 27 02:00:43.165543 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2895/5748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:42 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1709 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:43.508690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:43.509320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:43.526322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:43.529876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:43.531059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:43.532422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:43.536921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:43.538356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:43.634986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1109817526", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a8891cec-a25e-4e0c-baaa-8632e509eeb1"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:43.710630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:43.730184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:43.740246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c68b6fd1-fe19-4c66-9d32-20d9f5db33dc tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1271 microversion: 2.1 time: 0.235689 Sep 27 02:00:43.747693 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2896/5749] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:43 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:43.792753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] validate_networks() for [('a8891cec-a25e-4e0c-baaa-8632e509eeb1', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:00:44.772338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:44.772967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:44.778953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:44.794512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:44.795018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:44.795468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:44.796201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:44.796672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:44.797108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:45.234957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:45.255498 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f410415-25e5-44b0-93a6-35f621f17051 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 0.483963 Sep 27 02:00:45.265276 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2897/5750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:44 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:45.891302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:00:45.891796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:00:45.892378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:00:45.893670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:00:45.894200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:00:45.921473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:45.923976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:45.928461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:45.932396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:45.933063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:45.933680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:45.960251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=82 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:45.998877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:00:46.023291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for user 1aac51023fab484fab464c6d6ea0183a and project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:00:46.059722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:00:46.067766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:00:46.197292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a812a20f-f1d7-43f1-819f-825321f843be tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.166701 Sep 27 02:00:46.202658 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2854/5751] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:00:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:00:46.294685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:46.297284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:46.300504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d062abb6-3264-4273-a904-a73230cb3266", "tag": "8ea92bbf-6535-4cc2-b62c-868d47f07943"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:46.307526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:46.308295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:46.309093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:46.310181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:46.311170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:46.312432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:46.343102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:46.351102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:46.354839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:46.404307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] Creating event network-changed:8ea92bbf-6535-4cc2-b62c-868d47f07943 for instance d062abb6-3264-4273-a904-a73230cb3266 on n-h2-859358-1 Sep 27 02:00:46.427565 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a4d6b58b-abc3-4314-ac04-036c70ee08b3 req-2929723b-1193-43e4-9ca2-814aebec8315 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130775 Sep 27 02:00:46.430290 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2855/5752] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:00:46.588709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-193000857", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a8891cec-a25e-4e0c-baaa-8632e509eeb1"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:46.754024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] validate_networks() for [('a8891cec-a25e-4e0c-baaa-8632e509eeb1', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:00:47.586368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:47.599941 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aabedabd-a9cd-44d7-b334-e90e1b78225a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 1.317382 Sep 27 02:00:47.600553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2898/5753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:46 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:48.172403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:00:48.173047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:00:48.173484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:00:48.175504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:00:48.176272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:00:48.197569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:48.203390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:48.208077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:48.211397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:48.212109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:48.213781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:48.276080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:00:48.288317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for user 1aac51023fab484fab464c6d6ea0183a and project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:00:48.309331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:00:48.311856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:00:48.413798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-046737cd-44d2-4cba-b355-44642e4726c7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845927 Sep 27 02:00:48.425728 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2856/5754] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:00:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:00:48.631618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:48.632669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:48.659291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:48.661100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:48.661602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:48.669420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:48.670202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:48.671554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:48.672856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1715540401", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "451", "networks": [{"uuid": "a8891cec-a25e-4e0c-baaa-8632e509eeb1"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:48.757737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] validate_networks() for [('a8891cec-a25e-4e0c-baaa-8632e509eeb1', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:00:49.013838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:49.026959 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d280bbd8-399e-44ac-89ff-54b4d3466115 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 0.401936 Sep 27 02:00:49.042210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2899/5755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:48 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:50.056197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:50.057063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:50.065760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:50.069673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:50.070775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:50.071520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:50.072033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:50.072475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:50.295917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:50.311657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6b879a05-46ef-4bfb-ac40-8b7f6eaca984 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 0.258784 Sep 27 02:00:50.331485 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2900/5756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:50 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:50.365736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:00:50.366222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:00:50.366691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:00:50.367166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:00:50.367591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:00:50.389404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:50.389757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:50.390190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:50.390926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:50.400942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:50.401620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:50.481654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:00:50.495743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Getting quotas for user 1aac51023fab484fab464c6d6ea0183a and project a318cfd108f64e7f88faaeb54e94c938. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:00:50.529405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:00:50.540638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:00:50.616548 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e1e6a8cf-967b-4b45-87f6-4556b74c556d tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.947517 Sep 27 02:00:50.618151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2857/5757] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:00:50.631578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2aa3f226-dad7-49af-9f25-561603f91dd5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:50.632853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2aa3f226-dad7-49af-9f25-561603f91dd5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:50.742433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2aa3f226-dad7-49af-9f25-561603f91dd5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:50.767441 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2aa3f226-dad7-49af-9f25-561603f91dd5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1221 microversion: 2.1 time: 0.141886 Sep 27 02:00:50.769765 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2901/5758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:50 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:51.344642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:51.347023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:51.383522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:51.384188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:51.390303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:51.393056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:51.393562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:51.403368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:51.795925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:51.796949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:51.825945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:51.828852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:51.829511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:51.832175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:51.835561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:51.836276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:51.957663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:51.972574 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-79b9216c-7010-4dec-a4c3-005a30d844a7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1225 microversion: 2.1 time: 0.182565 Sep 27 02:00:51.974608 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2902/5759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:51 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:53.002467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:53.003979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:53.022167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:53.023240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:53.024730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:53.027360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:53.028076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:53.030333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:53.084991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:53.098909 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2cc7ca3-50dc-4657-901d-8ef7a34c0508 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 1.764141 Sep 27 02:00:53.099510 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2858/5760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:51 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:53.346776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:53.356187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53b89420-dd74-4348-bcc7-33719b26f45a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1281 microversion: 2.1 time: 0.361285 Sep 27 02:00:53.380743 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2903/5761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:52 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1281 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:54.124185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:54.124811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:54.144629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:54.144787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:54.145141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:54.145943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:54.146398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:54.146825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:54.393220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:54.394823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:54.409350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:54.414779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:54.415501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:54.416615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:54.417301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:54.418502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:54.614444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:54.629417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0dfd8688-da54-4e4b-9733-b2a0f0141ab1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1279 microversion: 2.1 time: 0.238116 Sep 27 02:00:54.630772 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2904/5762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:54 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:00:54.756825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062abb6-3264-4273-a904-a73230cb3266", "name": "network-vif-plugged", "status": "completed", "tag": "8ea92bbf-6535-4cc2-b62c-868d47f07943"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:54.776313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:54.778073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:54.779498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:54.820443 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] Creating event network-vif-plugged:8ea92bbf-6535-4cc2-b62c-868d47f07943 for instance d062abb6-3264-4273-a904-a73230cb3266 on n-h2-859358-1 Sep 27 02:00:54.832515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-945064bb-f849-4eeb-84e2-1fa1fde3030f req-d2d7f8c6-10a3-4d19-bd3e-ac372606183c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079254 Sep 27 02:00:54.835992 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2905/5763] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:00:55.043288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:55.059271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-be2f65ea-fc72-489d-81ee-d1ae554c1d90 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 0.939541 Sep 27 02:00:55.075896 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2859/5764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:54 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:55.663095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:55.664551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:55.681579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:55.682083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:55.682533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:55.683263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:55.683728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:55.684163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:56.091252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:56.092423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:56.103032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:56.103859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:56.104480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:56.106617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:56.107711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:56.111250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:56.381255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:56.395620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fce5bc5-fedd-4869-9d71-070fdc1851bd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.742873 Sep 27 02:00:56.410317 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2906/5765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:55 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:57.308311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:57.321302 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ecf62b3-e5a8-4a71-92d1-ccd05ce7eaa5 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1313 microversion: 2.1 time: 1.237724 Sep 27 02:00:57.327568 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2860/5766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:56 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1313 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:57.423481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:57.424467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:57.441122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:57.441712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:57.445517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:57.446289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:57.446768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:57.447216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:57.451961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a704405-4137-40f4-b334-e1328f44458f", "tag": "43022281-9fa1-453c-959d-08a3195b7a75"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:00:57.493180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:57.494645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:57.497006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:57.545857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] Creating event network-changed:43022281-9fa1-453c-959d-08a3195b7a75 for instance 3a704405-4137-40f4-b334-e1328f44458f on n-h1-859358-1 Sep 27 02:00:57.568609 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9dd0df01-8af7-476d-91b9-28d4549b3f66 req-3381b485-71ed-43f8-8b06-0e00f712c5ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118600 Sep 27 02:00:57.572463 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2861/5767] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:00:57.907600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:57.921024 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-948d1870-6dd7-4885-a2dd-2b8a1cfe67c3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.500943 Sep 27 02:00:57.923312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2907/5768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:57 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:00:58.352999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:58.354438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:58.372376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:58.373185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:58.384349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:58.388097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:58.389404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:58.390292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:58.949602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:00:58.950234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:00:58.975738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:58.976155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:58.976608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:58.977356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:00:58.984763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:00:58.985236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:00:59.054059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:00:59.259503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:00:59.271590 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c0c81d9d-6fe5-4bb0-8afe-0980fc6de382 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1497 microversion: 2.1 time: 0.923736 Sep 27 02:00:59.275575 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2862/5769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:58 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1497 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:00.525098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:00.525787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:00.528546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:00.529301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=26 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:00.545313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:00.546088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:00.549312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:00.551073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:00.552048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:00.552704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:00.628000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:01:00.748255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:00.788044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:00.800940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0369e63-0a57-4e03-bf79-3148a4537acb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 1.856033 Sep 27 02:01:00.823923 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2908/5770] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:00:58 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:00.848618 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e0c6345-01d3-4156-9a16-eace8e065da8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 204 len: 0 microversion: 2.1 time: 0.328906 Sep 27 02:01:00.849861 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2863/5771] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:01:00 2022] DELETE /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:01:00.858551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:00.859355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:00.866902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:00.875596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:00.878724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:00.879789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:00.885879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:00.901625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:01.038475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e5ede0-6285-45b0-92f8-c2cc1df09aaa", "tag": "db67ed44-ee53-4c4e-9e4b-507d3a259f76"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:01.061742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:01.062231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:01.062671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:01.100066 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] Creating event network-changed:db67ed44-ee53-4c4e-9e4b-507d3a259f76 for instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa on n-h2-859358-1 Sep 27 02:01:01.112612 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6631950b-90b7-468a-b32e-891b709c5f94 req-a3f9edf0-462b-4d00-9245-ad03f830006e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080019 Sep 27 02:01:01.113633 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2864/5772] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:01.665282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:01.683707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-beed0732-003f-4311-922d-8a31471b653a tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1503 microversion: 2.1 time: 0.825593 Sep 27 02:01:01.685071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2909/5773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:00 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1503 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:01.834689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:01.836404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:01.854022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:01.855393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:01.856064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:01.862817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:01.872688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:01.874401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:02.271673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79", "tag": "33200d90-c152-434f-81c5-3c7597e815c8"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:02.299729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:02.304201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:02.305086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:02.357197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] Creating event network-changed:33200d90-c152-434f-81c5-3c7597e815c8 for instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 on n-h1-859358-1 Sep 27 02:01:02.377370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-329d1508-6edf-4abd-8b4e-e379f2b8ce08 req-2593a7a3-86e2-4f83-a7b7-3869265a0f9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.582052 Sep 27 02:01:02.383023 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2865/5774] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:02.712068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:02.713082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:02.730233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:02.730812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:02.730988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:02.731598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:02.740254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:02.741127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:02.741749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:02.742849 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e323058a-ec7f-4b82-9cbc-f6e9705d7d85 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.915651 Sep 27 02:01:02.743492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2910/5775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:01 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:03.769645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:03.770943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:03.780087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:03.802144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:03.802902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:03.803825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:03.804445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:03.805055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:04.333953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:04.341991 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f43f18e-11b9-4983-a163-842c9da58783 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.575885 Sep 27 02:01:04.342570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2911/5776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:03 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:04.985099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:05.000541 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4947e6d5-ff38-463e-8d9b-985228398dce tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1503 microversion: 2.1 time: 2.292882 Sep 27 02:01:05.001141 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2866/5777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:02 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1503 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:05.315693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a704405-4137-40f4-b334-e1328f44458f", "name": "network-vif-plugged", "status": "completed", "tag": "43022281-9fa1-453c-959d-08a3195b7a75"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:05.347046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:05.350170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:05.350787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:05.372430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:05.373384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:05.391596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:05.402059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:05.402812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:05.406423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:05.407167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:05.408402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:05.411310 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] Creating event network-vif-plugged:43022281-9fa1-453c-959d-08a3195b7a75 for instance 3a704405-4137-40f4-b334-e1328f44458f on n-h1-859358-1 Sep 27 02:01:05.438915 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a7058ec0-c3af-4631-8b30-1afe3e1afd30 req-0db2d898-1a68-453d-aa32-d72eaf897324 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126956 Sep 27 02:01:05.443460 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2912/5778] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:06.032418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:06.033279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:06.055658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:06.062081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:06.064747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:06.067792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:06.069911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:06.075502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:06.411460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13772336c20c4ee695aaf888db5dd80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '512339208f954958a55266b4db14f988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:06.429673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eceeb339-c708-4997-b58f-092b5968b5b8 tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 200 len: 1461 microversion: 2.1 time: 0.405825 Sep 27 02:01:06.440525 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2913/5779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:06 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 1461 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:06.459053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d062abb6-3264-4273-a904-a73230cb3266", "name": "network-vif-deleted", "tag": "8ea92bbf-6535-4cc2-b62c-868d47f07943"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:06.493771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:06.496644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:06.497657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:06.508504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:06.521727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cc29a8f-5f52-4d5b-8fdc-2c2037407d96 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 1.161489 Sep 27 02:01:06.529617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] Creating event network-vif-deleted:8ea92bbf-6535-4cc2-b62c-868d47f07943 for instance d062abb6-3264-4273-a904-a73230cb3266 on n-h2-859358-1 Sep 27 02:01:06.533563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2867/5780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:05 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:06.541512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3c3ca8ec-f6cc-4f60-b9f6-d7042a61073e req-6ad5dcd4-9200-4483-b221-9d966e759581 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095015 Sep 27 02:01:06.547850 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2914/5781] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:07.478505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:07.479137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] [instance: d062abb6-3264-4273-a904-a73230cb3266] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:07.496223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:07.496646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:07.497089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:07.497888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:07.498369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:07.498800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:07.536549 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] HTTP exception thrown: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Request method failure captured: Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 HTTP/1.1 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlkUESwzMSp4o5IQ2O7Kk2lZSwQnQKpflinAu7oILg4Njdg8Dd_-PEiwwqiwmhRf7dD7xpJlW76qT4wlezyNc6aPoIut3vDSmFyR5K8t_zFAYAzFMV1Tr4riBRiHD9S_DsZSXmNW-eoxHF_n0xhds4sbvkqBa-1uDxWRQ0hqXvYxjuI Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 512339208f954958a55266b4db14f988 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesActionsTest-1920124772 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/512339208f954958a55266b4db14f988"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/512339208f954958a55266b4db14f988"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/512339208f954958a55266b4db14f988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_512339208f954958a55266b4db14f988", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesActionsTest-1920124772 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 512339208f954958a55266b4db14f988 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesActionsTest-1920124772 Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesActionsTest-1920124772-project Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 13772336c20c4ee695aaf888db5dd80c Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesActionsTest-1920124772-project Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'd062abb6-3264-4273-a904-a73230cb3266'} Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:07.538197 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] Returning 404 to user: Instance d062abb6-3264-4273-a904-a73230cb3266 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:01:07.543236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e775d04-0f71-4473-bd56-30e715056d8e tempest-VolumesActionsTest-1920124772 tempest-VolumesActionsTest-1920124772-project] 10.222.0.52 "GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266" status: 404 len: 111 microversion: 2.1 time: 0.070105 Sep 27 02:01:07.556709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:07.558533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:07.563157 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2868/5782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:07 2022] GET /compute/v2.1/servers/d062abb6-3264-4273-a904-a73230cb3266 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:01:07.570650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:07.571508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:07.574269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:07.575436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:07.576876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:07.577591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:08.052889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:08.066965 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d30bee21-6246-46d2-8cfb-57daea85127a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.514665 Sep 27 02:01:08.067735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2915/5783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:07 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:09.044412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79", "name": "network-vif-plugged", "status": "completed", "tag": "33200d90-c152-434f-81c5-3c7597e815c8"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:09.060851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:09.062814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:09.070084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:09.087938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] Creating event network-vif-plugged:33200d90-c152-434f-81c5-3c7597e815c8 for instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 on n-h1-859358-1 Sep 27 02:01:09.094123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:09.095080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:09.110128 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-917da707-9c6b-4d4e-b87a-16b6dc7a42dc req-2347df1e-36b9-44ca-9d7f-2afead15979d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068217 Sep 27 02:01:09.110817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2869/5784] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:09.113735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:09.114721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:09.115591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:09.130841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:09.132203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:09.132801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:09.431898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:09.442766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ce996e7-e1c0-4eeb-b407-705b0e79d3b7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.352539 Sep 27 02:01:09.444145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2916/5785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:09 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:10.475957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:10.482881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:10.494344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:10.494870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:10.496277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:10.499566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:10.500714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:10.505469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:11.170017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:11.180166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f06e92d5-a986-4a84-81ab-de45708af58f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1321 microversion: 2.1 time: 0.709236 Sep 27 02:01:11.184596 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2870/5786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:10 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:12.210958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:12.211635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:12.229213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:12.236626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:12.237868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:12.240136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:12.240622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:12.245103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:12.991802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:13.006263 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b3d370f-0270-4cd9-94c2-3557e5f0ffbd tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1511 microversion: 2.1 time: 0.805948 Sep 27 02:01:13.006864 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2917/5787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:12 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1511 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:13.033550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:13.034223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:13.047571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.049693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.050406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:13.053610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.054347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.055748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:13.442645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:13.476725 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3ee0ee3-f975-48f8-928a-dcff67cef9e1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1512 microversion: 2.1 time: 0.447128 Sep 27 02:01:13.477658 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2871/5788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:13 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1512 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:13.504094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:13.505540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:13.514283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.516097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.520586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:13.521899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.522548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.526188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:13.809842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:13.810597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:13.832168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:13.835905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.836412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.836863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:13.837627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:13.838086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:13.838520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:14.113974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lazy-loading 'services' on Instance uuid ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:01:14.262204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:14.310732 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-583df2c1-1124-44e3-a658-2c019c36e552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1320 microversion: 2.1 time: 0.787699 Sep 27 02:01:14.311605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2918/5789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:13 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1320 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:14.536153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae962143-0735-4e2c-8f22-0e328574f683 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments/553bd7ff-0753-46cb-b210-b688c485a42b" status: 202 len: 0 microversion: 2.1 time: 0.558801 Sep 27 02:01:14.536153 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2872/5790] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:01:13 2022] DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments/553bd7ff-0753-46cb-b210-b688c485a42b => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:01:15.352404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:15.354935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:15.368459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=46 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:15.376367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:15.387854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:15.392287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:15.401665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:15.406104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:15.410737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:15.845231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:15.870517 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b592f074-f7df-4555-bb55-323a61201c42 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1320 microversion: 2.1 time: 0.533956 Sep 27 02:01:15.898103 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2919/5791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:15 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:16.788296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e5ede0-6285-45b0-92f8-c2cc1df09aaa", "name": "network-vif-plugged", "status": "completed", "tag": "db67ed44-ee53-4c4e-9e4b-507d3a259f76"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:16.884182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:16.885807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:16.887385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:16.902467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:16.903760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:16.930791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:16.936844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:16.945071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:16.952969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:16.954658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:16.961756 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] Creating event network-vif-plugged:db67ed44-ee53-4c4e-9e4b-507d3a259f76 for instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa on n-h2-859358-1 Sep 27 02:01:16.963058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:16.973194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:16.991484 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-436c9593-ec2c-4675-8432-3a59cb05da68 req-a9a3194e-c157-4c25-94a6-c4dba12bfcf7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204580 Sep 27 02:01:16.992830 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2873/5792] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:17.333036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:17.349810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd821d37-ed69-4676-ac70-8abc640080e6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1320 microversion: 2.1 time: 0.452703 Sep 27 02:01:17.350928 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2920/5793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:16 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:18.378001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:18.378892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:18.406206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:18.408741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:18.409202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:18.411285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:18.413015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:18.415545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:19.020610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:19.028828 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed75a010-4a47-40ab-b4b8-52cfd3d6bba7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1320 microversion: 2.1 time: 0.657640 Sep 27 02:01:19.033774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2874/5794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:18 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1320 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:20.061111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:20.062543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:20.093258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:20.136836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:20.140734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:20.142567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:20.157194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:20.159870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:20.705230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:20.723758 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-081b0335-ed10-49e2-8cec-ccacf29bb51f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1510 microversion: 2.1 time: 0.663578 Sep 27 02:01:20.728959 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2921/5795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:20 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1510 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:20.778489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:20.804894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:20.810042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:20.871939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:20.872716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:20.874788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:20.877184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:20.878865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:20.884768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:21.311121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:21.474073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:21.480727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:21.481213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:21.485986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:21.912104 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8def20fb-d08a-4175-bf28-256ba11d2bc6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.154231 Sep 27 02:01:21.913710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2875/5796] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 02:01:20 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:21.953319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:21.986930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:21.988484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1109817526', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:22.004548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:22.005453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:22.006136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:22.008678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:22.009411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:22.011825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:22.469289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:22.704789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:22.735436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:22.739527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:22.741891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:23.698433 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d6259c1b-0390-4b9a-8864-3c4492545cb4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1109817526" status: 200 len: 1515 microversion: 2.1 time: 1.753340 Sep 27 02:01:23.699362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2922/5797] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 02:01:21 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1109817526 => generated 1515 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:23.733088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:23.742718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:23.743553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:23.765572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:23.767240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:23.769715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:23.772821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:23.776284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:23.776780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:24.175419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:24.365415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:24.387208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:24.387694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:24.388133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:24.936392 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61955ddf-eb84-4050-a42d-db5c8c032d6a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 1.209945 Sep 27 02:01:24.950399 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2876/5798] 10.222.0.52 () {58 vars in 1173 bytes} [Tue Sep 27 02:01:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:24.980957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:24.989877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:24.992409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.servers [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Removing options 'limit' from query {{(pid=128779) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 27 02:01:24.994432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:25.016722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:25.017547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:25.018002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:25.021465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:25.021936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:25.022362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:25.166139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:25.188654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:25.206997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:25.208674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:25.820218 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10cc3b08-0134-4721-abd0-78e2717f2f44 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.846324 Sep 27 02:01:25.820830 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2923/5799] 10.222.0.52 () {58 vars in 1161 bytes} [Tue Sep 27 02:01:24 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:25.856441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:25.862021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:25.869150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:25.888367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:25.896502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:25.897823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:25.906228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:25.907539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:25.910412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.044662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:26.169134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8874c57e-5f8d-48a9-a46e-91e3bf55f831 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.313529 Sep 27 02:01:26.169134 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2877/5800] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 02:01:25 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:26.180188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:26.199001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:26.199688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.servers [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Removing options 'limit' from query {{(pid=128779) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 27 02:01:26.201101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:26.213846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.218974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.218974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.221267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.221856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.222294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.321299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:26.482029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cea249fd-5c03-4825-8c42-20ce365d9df1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.305753 Sep 27 02:01:26.487125 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2924/5801] 10.222.0.52 () {58 vars in 1150 bytes} [Tue Sep 27 02:01:26 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:26.499954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:26.516783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:26.517611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:26.556029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.559101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.560660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.575708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.576586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.577117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.665055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:26.812339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7fce77b2-8279-470a-9ad5-6fba2697ecc7 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.317352 Sep 27 02:01:26.814361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2878/5802] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 02:01:26 2022] GET /compute/v2.1/servers => generated 1011 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:26.835533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:26.848308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:26.849366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:26.944831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.946523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.946523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:26.947088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:26.947538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:26.947964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:27.387947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:27.437976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:27.722469 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecac1b90-08f2-4a4d-8d04-9500f78aca34 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.890584 Sep 27 02:01:27.728198 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2925/5803] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 02:01:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:27.743150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:27.752104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:27.757578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.servers [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Removing options 'limit' from query {{(pid=128778) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 27 02:01:27.760086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:27.786115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:27.788696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:27.791341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:27.792443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:27.797528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:27.798352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:27.891955 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8c370d90-550e-49d8-a379-83b74c16352f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.144146 Sep 27 02:01:27.898197 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2879/5804] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 27 02:01:27 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:27.914372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:27.919604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:27.930317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1109817526', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:27.959225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:27.974069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:27.977596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:27.979172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:27.986421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:27.995241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:28.290788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:28.531130 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16268d09-d5f8-4321-afe0-c6fb23a4ac5a tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1109817526" status: 200 len: 346 microversion: 2.1 time: 0.622117 Sep 27 02:01:28.535198 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2926/5805] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 02:01:27 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1109817526 => generated 346 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:01:28.547373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:28.560360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:28.562122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:28.562847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:28.634903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Going to try to stop instance {{(pid=128778) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 02:01:28.749538 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5ca9ed2-90ed-420e-9ed7-11869b39bda8 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "POST /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f/action" status: 202 len: 0 microversion: 2.1 time: 0.206125 Sep 27 02:01:28.751175 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2880/5806] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:01:28 2022] POST /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:01:28.767311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:28.768158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:28.796422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:28.803921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:28.808994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:28.812745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:28.821028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:28.825843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:29.318991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:29.341382 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b935551-3834-4501-9165-7ba87533d4e9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1522 microversion: 2.1 time: 0.582960 Sep 27 02:01:29.361519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2927/5807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:28 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:29.842643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:29.868886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:29.869598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:29.869863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:29.966366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Going to try to stop instance {{(pid=128778) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 02:01:30.057512 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8954ac6-1fef-4696-b843-9ea3aa820a3e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.216035 Sep 27 02:01:30.066693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2881/5808] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:01:29 2022] POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:01:30.071279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:30.071966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:30.101564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:30.102665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:30.103287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:30.108301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:30.109056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:30.109918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:30.374455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:30.376112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:30.404108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:30.408833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:30.409778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:30.413134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:30.417653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:30.418413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:30.578225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:30.594520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3267dfcb-4245-45b8-b8eb-200bfedfbc2d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 0.528979 Sep 27 02:01:30.595418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2928/5809] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:30 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:30.644543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:30.659920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64f8db24-e69e-43d9-9ffb-1660354947f6 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1522 microversion: 2.1 time: 0.291641 Sep 27 02:01:30.673806 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2882/5810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:30 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:31.629523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:31.630617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:31.661544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:31.662439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:31.693081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:31.693968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:31.699041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:31.700235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:31.714111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:31.714732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:31.723258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:31.743403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:31.744247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:31.748105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:31.753980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:31.758126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:32.187496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:32.195368 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6a099f2-562b-45d2-a6d2-cb3a852ad59f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1522 microversion: 2.1 time: 0.512623 Sep 27 02:01:32.195954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2883/5811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:31 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:32.858981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:32.877115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e37f792-53da-4d9d-9f41-6f907910869e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 1.246374 Sep 27 02:01:32.879673 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2929/5812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:31 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:33.218291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:33.219140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:33.238211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:33.249699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:33.280623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:33.297804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:33.306058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:33.308944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:33.912890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:33.914636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:33.925167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:33.925915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:33.926508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:33.927367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:33.927971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:33.928575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:34.070548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:34.138789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35251b32-91f5-49f3-8cb2-6f7b9f5db838 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1522 microversion: 2.1 time: 0.924125 Sep 27 02:01:34.139406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2884/5813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:33 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1522 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:34.530537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:34.544844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad1b9eb7-b6eb-4a45-a265-0ebd1b6965b1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 0.638270 Sep 27 02:01:34.566696 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2930/5814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:33 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:35.164262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:35.164881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:35.168723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:35.185459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.185936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.186377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:35.187114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.188062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.188505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:35.572920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:35.574270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:35.582928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:35.588960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.589770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.592320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:35.593470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.596114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.597206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:35.818910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:35.832082 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a15c04e-376c-4461-a024-9c13aee6a83e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1499 microversion: 2.1 time: 0.666705 Sep 27 02:01:35.832833 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2885/5815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:35 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1499 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:35.854919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:35.870500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:35.871330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:35.906953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.907441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.933410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:35.934639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:35.939689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:35.940159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:36.048596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:36.115924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:36.192160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0717e15a-fe46-4931-ab87-9ddbb66b8426 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.340810 Sep 27 02:01:36.200131 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2886/5816] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Sep 27 02:01:35 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:36.212595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:36.237811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:36.238311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:36.238754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:36.267892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:36.284848 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b9d88dd-cf1f-407c-8794-df329f16182d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 0.714919 Sep 27 02:01:36.286125 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2931/5817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:35 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:36.348682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Going to try to start instance {{(pid=128778) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 02:01:36.508937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f4960da-0528-4262-9bc1-73417f11e518 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "POST /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f/action" status: 202 len: 0 microversion: 2.1 time: 0.300405 Sep 27 02:01:36.509591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2887/5818] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:01:36 2022] POST /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:01:36.525188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:36.525841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:36.546680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:36.547211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:36.547740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:36.548392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:36.548870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:36.549307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:36.974622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:36.987468 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d55085c3-c4c4-4e40-bfd4-854331df8859 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1508 microversion: 2.1 time: 0.473481 Sep 27 02:01:36.988237 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2932/5819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:36 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:37.314412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:37.315127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:37.333831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:37.334381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:37.334821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:37.335540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:37.335995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:37.336416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:38.016917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:38.028088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:38.056051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:38.056551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:38.056990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:38.063305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:38.071214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:38.075373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:38.188775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:38.547997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:38.557895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14015233-dd9c-4bba-a26b-83531b667429 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1508 microversion: 2.1 time: 0.547349 Sep 27 02:01:38.562922 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2933/5820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:38 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:39.422904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:39.434891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a7e03e8-b6c1-4637-ae94-ca254ee015a6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 2.125641 Sep 27 02:01:39.439398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2888/5821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:37 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:39.592341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:39.594231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:39.621593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:39.627761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:39.628539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:39.632426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:39.634240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:39.636486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:40.186194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:40.199106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cab7eaa1-351a-4c10-a566-b4027c0bbd06 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1508 microversion: 2.1 time: 0.613233 Sep 27 02:01:40.209374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2934/5822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:39 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:40.462139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:40.462761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:40.479175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:40.479692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:40.480136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:40.480881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:40.493004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:40.493004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:41.044773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:41.055052 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-477409bd-f359-4bcd-b98b-0ea499aee08e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1673 microversion: 2.1 time: 0.596712 Sep 27 02:01:41.060122 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2889/5823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:40 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1673 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:41.228859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:41.230285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:41.242870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:41.248392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:41.249883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:41.251153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:41.254063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:41.255241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.088021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:42.089472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:42.103442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.109421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.112363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.114078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.117480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.121418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.193859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:42.211267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e6433c2-d475-4fa0-9200-06b6d53831f5 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1512 microversion: 2.1 time: 0.986823 Sep 27 02:01:42.231204 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2935/5824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:41 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1512 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:42.256210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:42.274861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:42.278756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.compute.servers [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Removing options 'limit' from query {{(pid=128779) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 27 02:01:42.280657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:42.286451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.287421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.288052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.288970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.289616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.290684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.299328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5efb280f-e101-4e46-947c-dc76735e2ce4 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.055270 Sep 27 02:01:42.309044 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2936/5825] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 27 02:01:42 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:01:42.318922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:42.337789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:42.353839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.354542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.355162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.356048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.361236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.362167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.467647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:42.479741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-151689df-0401-425c-ba0c-a62bc222d03e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1650 microversion: 2.1 time: 0.395446 Sep 27 02:01:42.480940 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2890/5826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:42 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1650 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:42.512018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:42.535905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.550436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.559129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.636653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Going to try to start instance {{(pid=128778) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 02:01:42.809230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69ca3ab4-49c2-4daa-b35b-3d431ad881bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.298627 Sep 27 02:01:42.815916 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2891/5827] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:01:42 2022] POST /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:01:42.832043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:42.835749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:42.854254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.856108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.857105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:42.859932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:42.861114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:42.862363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:43.491366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:43.503986 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-244c8b42-368a-44c8-b214-11deeb5b45b1 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1512 microversion: 2.1 time: 1.193458 Sep 27 02:01:43.507343 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2937/5828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:42 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1512 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:43.532493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:43.533459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:43.552038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:43.553722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:43.555881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:43.556824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:43.557753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:43.559089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:43.669326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:43.684205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f627d95d-29b0-4a3f-8253-a5ce29e339aa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1659 microversion: 2.1 time: 0.860578 Sep 27 02:01:43.686826 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2892/5829] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:42 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1659 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:44.715261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:44.715881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:44.741224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=48 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:44.742731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:44.743215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:44.745992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:44.748818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:44.749512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:44.771510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:44.790603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:44.806299 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eb260bd9-a684-4b08-81e3-ff4e50013832 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1510 microversion: 2.1 time: 1.277804 Sep 27 02:01:44.822174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2938/5830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:43 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1510 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:01:44.848552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:44.857478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:44.891647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:44.892296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:44.892919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:44.894839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:44.895309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:44.908980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:45.292362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:45.304070 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a3313c9-c59f-4f88-9cfc-bce42da52857 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1511 microversion: 2.1 time: 0.475159 Sep 27 02:01:45.307631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2939/5831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:44 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:45.331031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:45.339556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:45.340578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:45.657444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:45.676096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e2c440a-3f62-48d6-9a91-196b30145000 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1659 microversion: 2.1 time: 0.964694 Sep 27 02:01:45.676713 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2893/5832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:44 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1659 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:45.740109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:45.741166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:45.741929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:45.742876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:45.743495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:45.746254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.063263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:46.291793 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-431929d3-cf39-4418-9858-82d9d989f424 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.965690 Sep 27 02:01:46.311770 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2940/5833] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Sep 27 02:01:45 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:46.321659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:46.322535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:46.341201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:46.348710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.350087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.352623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.354204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.355395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.358020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.699404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:46.700287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:46.711247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=46 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:46.721231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.722084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.722855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.723773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.724391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.724994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.840247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:46.850299 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64fc2d83-ba70-45d6-a040-7b0190e3c552 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1512 microversion: 2.1 time: 0.537288 Sep 27 02:01:46.869895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2894/5834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:46 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:46.876640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:46.877621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:46.885777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.886578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.887205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:46.888180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:46.888922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:46.889576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:47.073730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:47.082623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6c36bba-a95f-4ac8-b4d7-8ba8d48e9928 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1663 microversion: 2.1 time: 0.387314 Sep 27 02:01:47.107895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2941/5835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:46 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1663 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:47.789180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:47.805814 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70752c75-5f9c-4399-a6ff-d283af4006ab tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1510 microversion: 2.1 time: 0.933397 Sep 27 02:01:47.832077 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2895/5836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:46 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1510 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:47.860026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:47.860937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:47.879138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:47.891016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:47.891608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:47.892365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:47.892839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:47.899184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:47.929957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:48.604631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:48.640479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-554e7dfe-2365-4c2b-916b-f48bc56b0c7e tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1511 microversion: 2.1 time: 0.781480 Sep 27 02:01:48.641578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2942/5837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:47 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1511 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:48.672845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:48.678979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:48.692132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:48.706794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:48.715052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:48.715722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:48.721122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:48.721950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:48.724020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:48.831620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:48.995354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:49.020590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:49.028197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:49.028914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:49.612581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9bfe5ab1-3aa9-42db-974f-8431e3b283fb tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.946118 Sep 27 02:01:49.613656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2896/5838] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 02:01:48 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:49.649942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:49.691080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:49.692915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:49.974468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:49.975093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:49.975549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:49.976467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:49.977218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:49.977684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:50.115550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:50.195194 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b66d854c-1d06-4846-87fd-d8464c2c8666 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.559766 Sep 27 02:01:50.198045 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2943/5839] 10.222.0.52 () {58 vars in 1150 bytes} [Tue Sep 27 02:01:49 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:50.214705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:50.243439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:50.244808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:50.272280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:50.279565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:50.285070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:50.292693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:50.298829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:50.300605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:50.723667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:50.948997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2054fe84-7204-4869-8561-2e575d1ab755 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.739535 Sep 27 02:01:50.955206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2897/5840] 10.222.0.52 () {58 vars in 1212 bytes} [Tue Sep 27 02:01:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:50.969741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:50.975002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:50.975657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:50.996430 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:01:50.996878 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 (ip 10.222.0.52) !!! Sep 27 02:01:51.007488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.009660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.010134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:51.015994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.023866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.024377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:51.288269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:51.487170 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd528f34-2e3d-42f3-afdb-87d444da708f tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.521160 Sep 27 02:01:51.490203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2944/5841] 10.222.0.52 () {58 vars in 1196 bytes} [Tue Sep 27 02:01:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:51.503239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:51.512626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:51.513633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': '1109817526', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:51.530920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.532054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.533663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:51.534602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.537798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.538930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:51.772530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:51.897653 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4cb475c4-ff37-41d6-9f89-a2e62503e1bf tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=1109817526" status: 200 len: 346 microversion: 2.1 time: 0.398844 Sep 27 02:01:51.898499 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2898/5842] 10.222.0.52 () {58 vars in 1156 bytes} [Tue Sep 27 02:01:51 2022] GET /compute/v2.1/servers?name=1109817526 => generated 346 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:51.916282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:51.924005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:51.930479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128779) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:51.953799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.955562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.956031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:51.956843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:51.957309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:51.967846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:52.118667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.multi_cell_list [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128779) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:52.227863 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dffeed33-f3b1-4263-b577-4a3a1a8bfe58 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.318128 Sep 27 02:01:52.235253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2945/5843] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Sep 27 02:01:51 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:52.247061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:52.252537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:52.257967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-110981752', 'deleted': False, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:01:52.272321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:52.273273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:52.279103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:52.280085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:52.281293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:52.282188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:52.641740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:01:52.815894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:52.823775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5dfde0cf-f2ce-4f5f-be81-e22466e18a92 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-110981752" status: 200 len: 346 microversion: 2.1 time: 0.579404 Sep 27 02:01:52.825904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2899/5844] 10.222.0.52 () {58 vars in 1228 bytes} [Tue Sep 27 02:01:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-110981752 => generated 346 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:52.839827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:52.841462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:52.862759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:52.863249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:52.863685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:52.864401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:52.864849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:52.865271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:52.935691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:01:53.180586 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31ca7b60-bfe2-4f8d-a964-879c1e50acd9 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 204 len: 0 microversion: 2.1 time: 0.345142 Sep 27 02:01:53.184744 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2946/5845] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:01:52 2022] DELETE /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:01:53.191082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:53.191733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:53.201323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:53.229213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:53.238539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:53.239598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:53.240080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:53.240534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:55.170690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:55.180717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6fd7c79-3471-4750-a1a5-2c070f39d6d3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1517 microversion: 2.1 time: 1.994264 Sep 27 02:01:55.181308 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2900/5846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:53 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1517 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:56.211522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:56.212243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:56.232865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:56.238571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:56.238978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:56.242968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:56.243541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:56.243987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:57.242611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:57.252931 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2580a631-eaf1-447b-9e31-96d93c6532a3 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1475 microversion: 2.1 time: 1.047563 Sep 27 02:01:57.304658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2947/5847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:56 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1475 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:57.539917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79", "name": "network-vif-deleted", "tag": "33200d90-c152-434f-81c5-3c7597e815c8"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:01:57.573218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:57.586091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:57.586642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:57.632336 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] Creating event network-vif-deleted:33200d90-c152-434f-81c5-3c7597e815c8 for instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 on n-h1-859358-1 Sep 27 02:01:57.643143 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-42f2d98b-61ca-49c0-9632-6cb800a11220 req-285163c3-5c8a-4f7a-afde-43ce522fabe2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107414 Sep 27 02:01:57.657811 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2901/5848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:01:58.302116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:58.302733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:58.310128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:58.319633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:58.320092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:58.320841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:58.321295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:58.321737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:58.493806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:58.500491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:58.501293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:58.504514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lazy-loading 'fault' on Instance uuid 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:01:58.774593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:01:58.785748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ac72a9c-3be2-4157-b6e4-38228e8ee277 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 200 len: 1311 microversion: 2.1 time: 0.487143 Sep 27 02:01:58.788459 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2948/5849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:58 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:01:59.815016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:59.822626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:01:59.845465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:01:59.859822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:59.862264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:59.865884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:59.871196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:01:59.872231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:01:59.877106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:01:59.951134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] HTTP exception thrown: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Request method failure captured: Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 HTTP/1.1 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMllK00mVT1u8xIFeGtRcAS2r8JFMbPFLtuwao1S6_uyFNObOBJ-jqHjWz08bVPcHWnmMpeFNA204aZWOBZCG0mSfMwgd2u2yD4hcju99hRctx4-1uytsjU8NS97P3U8OIgOo2a_aAngzqJKt6v8-7edb_u5MmfGIzVoISj3RUig4xmo Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a318cfd108f64e7f88faaeb54e94c938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1aac51023fab484fab464c6d6ea0183a Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79'} Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:01:59.957722 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. Sep 27 02:01:59.962299 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:01:59.962788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Returning 404 to user: Instance 5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:01:59.966075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2cb4771-4929-466e-b80a-b76e000ea30c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79" status: 404 len: 111 microversion: 2.1 time: 0.155953 Sep 27 02:01:59.969944 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2902/5850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:01:59 2022] GET /compute/v2.1/servers/5c53fe1c-93ba-4e2f-8abe-0d70dd62ff79 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:01:59.978693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:01:59.979493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:00.006249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:00.022972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:00.028319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:00.032337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:00.036351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:00.036837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:00.162555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:02:00.539956 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc5c6aa6-a5e7-46d2-9a51-86a5344d9463 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "DELETE /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 204 len: 0 microversion: 2.1 time: 0.564607 Sep 27 02:02:00.545019 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2949/5851] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:01:59 2022] DELETE /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:02:00.558213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:00.558843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:00.584118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:00.587621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:00.588091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:00.596834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:00.604863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:00.606504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:00.944212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:00.956923 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7d3ee03-8600-41d3-bd1f-5594932481a0 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1516 microversion: 2.1 time: 0.410374 Sep 27 02:02:00.958276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2903/5852] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:00 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:01.987709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:01.990653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:02.026922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:02.032299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:02.032763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:02.035714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:02.036202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:02.039765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:02.057107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:02.793633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:02.818952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df17d7dd-318b-4c67-bffd-77e8ac7667da tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1516 microversion: 2.1 time: 0.831945 Sep 27 02:02:02.827311 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2950/5853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:01 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1516 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:03.848796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:03.849380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:03.866191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:03.873264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:03.873974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:03.876124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:03.878081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:03.878574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:03.878997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:04.046077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e5ede0-6285-45b0-92f8-c2cc1df09aaa", "name": "network-vif-deleted", "tag": "db67ed44-ee53-4c4e-9e4b-507d3a259f76"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:04.079365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:04.084666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:04.085772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:04.138551 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] Creating event network-vif-deleted:db67ed44-ee53-4c4e-9e4b-507d3a259f76 for instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa on n-h2-859358-1 Sep 27 02:02:04.158121 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dfd6a31e-1962-4863-b74f-29d79a1f913f req-afcd2aa0-3243-4afb-ab58-154c9aeeb8bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116500 Sep 27 02:02:04.161822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2951/5854] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:02:05.572533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:05.580332 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efbc968a-8d7c-497a-a119-358b20cf113c tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 200 len: 1474 microversion: 2.1 time: 1.735698 Sep 27 02:02:05.583934 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2904/5855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:03 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 1474 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:06.610576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:06.611822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 43e5ede0-6285-45b0-92f8-c2cc1df09aaa] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:06.706924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:06.707415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:06.707854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:06.708560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:06.709013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:06.734814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:06.844295 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] HTTP exception thrown: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Request method failure captured: Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa HTTP/1.1 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMllK00mVT1u8xIFeGtRcAS2r8JFMbPFLtuwao1S6_uyFNObOBJ-jqHjWz08bVPcHWnmMpeFNA204aZWOBZCG0mSfMwgd2u2yD4hcju99hRctx4-1uytsjU8NS97P3U8OIgOo2a_aAngzqJKt6v8-7edb_u5MmfGIzVoISj3RUig4xmo Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a318cfd108f64e7f88faaeb54e94c938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1aac51023fab484fab464c6d6ea0183a Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '43e5ede0-6285-45b0-92f8-c2cc1df09aaa'} Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:06.856133 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. Sep 27 02:02:06.862258 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:06.864640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Returning 404 to user: Instance 43e5ede0-6285-45b0-92f8-c2cc1df09aaa could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:02:06.871318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8b147ce-a8d0-4314-9575-4a6ffe2bd698 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa" status: 404 len: 111 microversion: 2.1 time: 0.266902 Sep 27 02:02:06.874438 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2952/5856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:06 2022] GET /compute/v2.1/servers/43e5ede0-6285-45b0-92f8-c2cc1df09aaa => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:02:06.882013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:06.883117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:06.915291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:06.915877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:06.916329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:06.922216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:06.922777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:06.923215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:07.043281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:02:07.314269 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7731403a-ba3f-4a48-9f79-abca1551a168 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 204 len: 0 microversion: 2.1 time: 0.436368 Sep 27 02:02:07.315528 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2905/5857] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:02:06 2022] DELETE /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:02:07.327964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:07.329714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:07.348141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:07.348634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:07.349093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:07.349803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:07.350248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:07.353639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:07.688152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:07.696499 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7f60f0db-d6da-46ea-b248-e038623c1486 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1518 microversion: 2.1 time: 0.377021 Sep 27 02:02:07.709988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2953/5858] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:07 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1518 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:08.727662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:08.729309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:08.746321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:08.749820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:08.750274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:08.751327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:08.751796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:08.752261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:09.393041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:09.412512 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-feeeee3c-4816-4ce1-bdae-f0b63339a4dc tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1518 microversion: 2.1 time: 0.687491 Sep 27 02:02:09.414030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2906/5859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:08 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1518 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:10.450422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:10.451058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:10.467953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:10.468452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:10.468887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:10.469632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:10.470082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:10.470503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:10.836401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aac51023fab484fab464c6d6ea0183a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a318cfd108f64e7f88faaeb54e94c938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:10.851159 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d958ddc-2a10-4331-970a-9856c6f90257 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 200 len: 1476 microversion: 2.1 time: 0.399573 Sep 27 02:02:10.851976 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2954/5860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:10 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:11.099479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a704405-4137-40f4-b334-e1328f44458f", "name": "network-vif-deleted", "tag": "43022281-9fa1-453c-959d-08a3195b7a75"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:11.127427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:11.129032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:11.129262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:11.176826 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] Creating event network-vif-deleted:43022281-9fa1-453c-959d-08a3195b7a75 for instance 3a704405-4137-40f4-b334-e1328f44458f on n-h1-859358-1 Sep 27 02:02:11.188057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-58305433-4089-4a8a-b7e9-481c0199ff03 req-4c01aeec-4709-4484-8429-93cb6d9b0c64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092581 Sep 27 02:02:11.189573 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2907/5861] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:02:11.881365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:11.881980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] [instance: 3a704405-4137-40f4-b334-e1328f44458f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:11.903391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:11.903875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:11.904309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:11.939907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:11.940552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:11.941010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:12.081741 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] HTTP exception thrown: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Request method failure captured: Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f HTTP/1.1 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMllK00mVT1u8xIFeGtRcAS2r8JFMbPFLtuwao1S6_uyFNObOBJ-jqHjWz08bVPcHWnmMpeFNA204aZWOBZCG0mSfMwgd2u2yD4hcju99hRctx4-1uytsjU8NS97P3U8OIgOo2a_aAngzqJKt6v8-7edb_u5MmfGIzVoISj3RUig4xmo Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a318cfd108f64e7f88faaeb54e94c938"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a318cfd108f64e7f88faaeb54e94c938", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a318cfd108f64e7f88faaeb54e94c938 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-825766679 Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1aac51023fab484fab464c6d6ea0183a Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ListServerFiltersTestJSON-825766679-project Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '3a704405-4137-40f4-b334-e1328f44458f'} Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:12.090068 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. Sep 27 02:02:12.094606 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:12.102579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] Returning 404 to user: Instance 3a704405-4137-40f4-b334-e1328f44458f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:02:12.111779 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1669ac3f-b430-4e69-b958-cbc1b72b1602 tempest-ListServerFiltersTestJSON-825766679 tempest-ListServerFiltersTestJSON-825766679-project] 10.222.0.52 "GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f" status: 404 len: 111 microversion: 2.1 time: 0.235164 Sep 27 02:02:12.122410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2955/5862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:11 2022] GET /compute/v2.1/servers/3a704405-4137-40f4-b334-e1328f44458f => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:02:19.926411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:19.928649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:19.939850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:19.953681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:19.954179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:19.954618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:19.955338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:19.955786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:19.956209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.032164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:20.066217 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac4e5c2c-9cc3-4a4a-8459-688d13a1ce8a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143429 Sep 27 02:02:20.069481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2956/5863] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:02:19 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:02:20.187523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:20.188577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:20.200859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.202337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.205964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.206927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.207790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.209031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.273800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:02:20.370690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1863297212", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": "none"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:20.431699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:20.536760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:02:20.538803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:02:20.541645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:02:20.542963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:02:20.543111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-171c7fca-b00e-4779-9e6a-60ed7016f490 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 204 len: 0 microversion: 2.1 time: 0.360599 Sep 27 02:02:20.544229 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2957/5864] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:02:20 2022] DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 02:02:20.544749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:02:20.561403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.562168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.562901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.564244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.564899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.565534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.580525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:20.584670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:20.606613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Getting quotas for project 333d97f3ae584ac69ca8bbd74dedd63b. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:02:20.611301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.613298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.614667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.618067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:20.619034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:20.620974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:20.622756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Getting quotas for user 9587492d85a24bfeab1dc6964d122d79 and project 333d97f3ae584ac69ca8bbd74dedd63b. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:02:20.658978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:02:20.673282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:02:20.789566 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bcfd9e2f-4a9d-4512-9191-30f002bbe225 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.112037 Sep 27 02:02:20.790766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2908/5865] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Sep 27 02:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 02:02:20.826318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:20.827319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:21.159494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:21.168977 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-93ad28a0-b8d1-453f-b387-281af6f63233 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1669 microversion: 2.1 time: 0.614004 Sep 27 02:02:21.169608 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2958/5866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:20 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1669 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:21.989296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:22.002825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:22.008020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:22.012648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc6781ef-338e-4de6-bda5-76f04b0dd527 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1281 microversion: 2.47 time: 1.211822 Sep 27 02:02:22.014084 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2909/5867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:20 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1281 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:22.195847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:22.196461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:22.213961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:22.214672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:22.215122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:22.221670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:22.222255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:22.222716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:22.639715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:22.648431 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-baf91c0a-ffac-418a-83d2-29a5b0aa9d03 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1669 microversion: 2.1 time: 0.456402 Sep 27 02:02:22.670746 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2959/5868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:22 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:23.045001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:23.046238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:23.055925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:23.063424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:23.064196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:23.065849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:23.066705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:23.067481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:23.397001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:23.403747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:23.408448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:23.411325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:23.413094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3916aa98-6550-40a3-9cbe-55de126e9a67 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1351 microversion: 2.47 time: 0.371903 Sep 27 02:02:23.414423 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2910/5869] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:23 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1351 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:23.677363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:23.681658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:23.702214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:23.702721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:23.703603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:23.704932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:23.705328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:23.706044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:24.206220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:24.226002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4345621-cc18-48b9-86ba-8c6596f19f41 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1669 microversion: 2.1 time: 0.543016 Sep 27 02:02:24.254280 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2960/5870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:23 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1669 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:24.447788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:24.450941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:24.468311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:24.488981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:24.489673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:24.490572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:24.500272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:24.501874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:24.735961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:24.746789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:24.751511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:24.754476 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f85e9140-44a0-425b-bcfb-c7ddbce5fe55 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1339 microversion: 2.47 time: 0.313778 Sep 27 02:02:24.758677 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2911/5871] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:24 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:25.281192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:25.281952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:25.307486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:25.308803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:25.309270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:25.310128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:25.313251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:25.316427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:25.662549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:25.673705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-564e2b05-8a5d-4100-b4e3-59682358f83c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1602 microversion: 2.1 time: 0.399321 Sep 27 02:02:25.679907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2961/5872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:25 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1602 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:25.787429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:25.788102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:25.811590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:25.812345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:25.813780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:25.816940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:25.817968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:25.820069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:26.116947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:26.128266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:26.131984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:26.147857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86732831-3f14-435d-8acc-1fe46bae7eae tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1339 microversion: 2.47 time: 0.363814 Sep 27 02:02:26.162587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2912/5873] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:25 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1339 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:26.493102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6420aa-6f9e-4be5-8398-0f23c2d02bb6", "name": "network-vif-deleted", "tag": "c5c826d7-c07e-4135-a5ad-679f2f8efd37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:26.539746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:26.541256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:26.544194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:26.575392 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] Creating event network-vif-deleted:c5c826d7-c07e-4135-a5ad-679f2f8efd37 for instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 on n-h1-859358-1 Sep 27 02:02:26.589703 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0010fba7-dbab-44af-ac0c-92a986fc518b req-611be841-8830-47fa-80b4-eeb5b35b6614 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113677 Sep 27 02:02:26.598257 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2962/5874] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:02:26.716500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:26.720423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:26.749656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:26.750254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:26.750707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:26.751469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:26.751914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:26.752347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:26.913362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:26.915680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:26.923722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:26.924830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lazy-loading 'fault' on Instance uuid ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:02:27.180934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:27.181853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:27.200690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:27.202671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:27.203727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:27.208758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:27.213881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:27.214640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:27.268009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:27.294162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f2c75a2-4cd7-4e5f-9148-3211c1cd225e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 200 len: 1325 microversion: 2.1 time: 0.588726 Sep 27 02:02:27.300764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2913/5875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:26 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 1325 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:27.526453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:27.541442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:27.542898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:27.544080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c57fa10-96fe-449c-a0f0-2d9b1b2ad90a tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1339 microversion: 2.47 time: 0.367435 Sep 27 02:02:27.544650 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2963/5876] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:27 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1339 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 02:02:28.332588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:28.333669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:28.346730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.351552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.352272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:28.353531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.357888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.358941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:28.387100 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 HTTP/1.1 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ab6420aa-6f9e-4be5-8398-0f23c2d02bb6'} Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:02:28.390696 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:02:28.394803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:02:28.398220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:02:28.400240 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c82cd9b-3a86-42ea-9c7a-8166e8e347a2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 404 len: 111 microversion: 2.1 time: 0.074545 Sep 27 02:02:28.412611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6823104-e7e2-40ef-a771-be059eb6ed5c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '.version_select at 0x7f24d554c820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:28.417726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2914/5877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:28 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:02:28.461224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6823104-e7e2-40ef-a771-be059eb6ed5c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4818566" status: 202 len: 0 microversion: 2.1 time: 0.052132 Sep 27 02:02:28.467265 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2964/5878] 10.222.0.52 () {58 vars in 1212 bytes} [Tue Sep 27 02:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4818566 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:02:28.578686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:28.579664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:28.590437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.593314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.595062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:28.596636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.598392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.598995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:28.868013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:28.881118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:28.887056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:28.888534 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec6a9e98-1dbb-4e0a-af51-12c6ab9eae60 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1360 microversion: 2.47 time: 0.318793 Sep 27 02:02:28.892036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2915/5879] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:28 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:28.926700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2050722485"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:28.931428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:28.954724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.956926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.957655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:28.960119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:28.961909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:28.962617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:29.523959 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34ad27a0-a09b-40a7-b81f-65a9415c1329 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "POST /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae/action" status: 202 len: 52 microversion: 2.47 time: 0.601658 Sep 27 02:02:29.542400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:29.543062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:29.547719 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2965/5880] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Sep 27 02:02:28 2022] POST /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae/action => generated 52 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 27 02:02:29.555134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:29.557289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:29.560083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:29.561307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:29.563639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:29.565229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:29.709060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:02:29.992861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-529720ea-79f9-472f-be10-23f630168974 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 204 len: 0 microversion: 2.47 time: 0.455531 Sep 27 02:02:29.994391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2916/5881] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Sep 27 02:02:29 2022] DELETE /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 02:02:30.006412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:30.007785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:30.038759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:30.039319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:30.048938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:30.050070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:30.054398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:30.055174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:30.260157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:30.270234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:30.274945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:30.276158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8117fdf3-77dc-4395-8df6-ea1d562ea0b7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1366 microversion: 2.47 time: 0.275406 Sep 27 02:02:30.300173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2966/5882] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:29 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:31.306387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-798172b1-35a9-4e1c-a13b-7b68d080b5d1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: .version_select at 0x7f24d50778b0>, body: {"keypair": {"name": "tempest-keypair-838029343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUA07gJ+OWteoqJjc1zi+HAYHwUjII105J4E5xBPhFHipWRuF4R4cF/qeWzKQwGSsTaf+Ycivz65KYiYX3LjvvrfMTDHA1fkUif3INTgK9f8fNfibeAk6yZsgAxAisG1w=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:31.318632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:31.329780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:31.331220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:31.356221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:31.358163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:31.360038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:31.364197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:31.365725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:31.366766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:31.380631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-798172b1-35a9-4e1c-a13b-7b68d080b5d1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:02:31.408340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-798172b1-35a9-4e1c-a13b-7b68d080b5d1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for user 67774f0eba764daaac0a50d3d6082a2a and project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:02:31.484784 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-798172b1-35a9-4e1c-a13b-7b68d080b5d1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183618 Sep 27 02:02:31.504758 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2917/5883] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:02:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:02:31.602607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:31.622999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:31.625039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:31.626878 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-01487e59-4c30-4d70-aab4-28b80068e5aa tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1366 microversion: 2.47 time: 0.302256 Sep 27 02:02:31.649762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2967/5884] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:31 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 02:02:32.683240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:32.684146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:32.698705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:32.700497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:32.702667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:32.704553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:32.706597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:32.708810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:32.918507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:32.933987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:32.935561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:32.936783 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1070eadc-b146-4c56-8f80-e5fe564ed0a7 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1366 microversion: 2.47 time: 0.260710 Sep 27 02:02:32.955046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2918/5885] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:32 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:33.971733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:33.972491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:33.986225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:33.988549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:33.990062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:33.991454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:33.992735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:33.994865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:34.238853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:34.249961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:34.260901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:34.265673 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afc0ef7f-9442-4796-842f-45273e13a655 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1366 microversion: 2.47 time: 0.302744 Sep 27 02:02:34.269657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2968/5886] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:33 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:35.298589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:35.299799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:35.315959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:35.316459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:35.316898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:35.317636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:35.318096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:35.318559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:35.639138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:35.672453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:35.679211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9587492d85a24bfeab1dc6964d122d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '333d97f3ae584ac69ca8bbd74dedd63b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:35.686767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-85d734ec-288f-4e92-8c9c-9c70414c3b00 tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 200 len: 1366 microversion: 2.47 time: 0.392911 Sep 27 02:02:35.689605 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2919/5887] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:35 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 02:02:36.723775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:36.725016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] [instance: 5780a06f-88f3-428e-84a2-25b7070e46ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:36.740833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:36.746930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:36.748529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:36.750057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:36.751652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:36.753125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:36.783208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-416424813", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdbb7e5c-8b68-4ca5-a993-70f1ced520ae"}], "security_groups": [{"name": "tempest-securitygroup--1751189525"}], "key_name": "tempest-keypair-838029343", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:36.827200 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] HTTP exception thrown: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Request method failure captured: Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae HTTP/1.1 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlmrHIEOOHSgxkhnAZOqAgbpJxFCCn23Z34pqUrJdnJ4qZ5_eDhFvu5w3h3fnZFk45g65CHCNyR0Z0BPe7IEDkcQzojtPDJ8p8UMVyRLCdYe4FwJcbhoB_UBj_NCw5zwPvsUQlYri8EPcA8buCWkAqDZhxC7nKbrtW8VpN74N1u56g8 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Openstack-Nova-Api-Version: 2.47 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 333d97f3ae584ac69ca8bbd74dedd63b Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAaction247Test-840104124 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/333d97f3ae584ac69ca8bbd74dedd63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/333d97f3ae584ac69ca8bbd74dedd63b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/333d97f3ae584ac69ca8bbd74dedd63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_333d97f3ae584ac69ca8bbd74dedd63b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAaction247Test-840104124 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 333d97f3ae584ac69ca8bbd74dedd63b Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAaction247Test-840104124 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAaction247Test-840104124-project Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9587492d85a24bfeab1dc6964d122d79 Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAaction247Test-840104124-project Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '5780a06f-88f3-428e-84a2-25b7070e46ae'} Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:02:36.840753 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. Sep 27 02:02:36.845960 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:02:36.847786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] Returning 404 to user: Instance 5780a06f-88f3-428e-84a2-25b7070e46ae could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:02:36.852017 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a292b487-c80c-4da1-963d-29a1e333ee6d tempest-ServersAaction247Test-840104124 tempest-ServersAaction247Test-840104124-project] 10.222.0.52 "GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae" status: 404 len: 111 microversion: 2.47 time: 0.136142 Sep 27 02:02:36.857191 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2969/5888] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Sep 27 02:02:36 2022] GET /compute/v2.1/servers/5780a06f-88f3-428e-84a2-25b7070e46ae => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:02:37.096370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] validate_networks() for [('bdbb7e5c-8b68-4ca5-a993-70f1ced520ae', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:02:39.339978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:02:39.342579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:02:39.343081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:02:39.343501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:02:39.347245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:02:39.378047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:39.381801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:39.382372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:39.383381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:39.383844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:39.385892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:39.443092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:02:39.457475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Getting quotas for user 67774f0eba764daaac0a50d3d6082a2a and project c4e74e9a2b3d476c98bac6781bac6411. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:02:39.517637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:02:39.527200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:02:39.669457 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e9d6ca2-ceed-45e3-abe0-070a4e15c8b6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.902397 Sep 27 02:02:39.682108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2920/5889] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:02:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:02:39.683108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8c54885-5b17-4d46-855b-db631a5c80c0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:39.683785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8c54885-5b17-4d46-855b-db631a5c80c0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:40.012070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8c54885-5b17-4d46-855b-db631a5c80c0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:40.038062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8c54885-5b17-4d46-855b-db631a5c80c0 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1236 microversion: 2.1 time: 0.360317 Sep 27 02:02:40.046540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2970/5890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:39 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1236 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:02:41.061766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:41.062978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:41.081561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:41.082067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:41.082570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:41.083303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:41.093641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:41.106305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:41.260816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:41.284850 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4649bd6-7a15-4542-95cc-f742d855d1bc tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1240 microversion: 2.1 time: 0.224673 Sep 27 02:02:41.288741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2921/5891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:41 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1240 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:42.309297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:42.310111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:42.329860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:42.333743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:42.334593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:42.335362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:42.339893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:42.341710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:43.309058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:43.326862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9625b6b9-cc08-4cee-b0b8-07892b7e3a21 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1306 microversion: 2.1 time: 1.021513 Sep 27 02:02:43.327580 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2971/5892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:42 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1306 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:44.352505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:44.353246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:44.372432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:44.372948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:44.373427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:44.374168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:44.374632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:44.375065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:44.798271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:44.809194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1b319773-85da-4b94-9c8d-f69f04920a73 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1294 microversion: 2.1 time: 0.462384 Sep 27 02:02:44.838201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2922/5893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:44 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1294 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:45.859797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:45.861168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:45.890277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:45.895366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:45.898229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:45.902767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:45.908035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:45.913564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:46.303537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:46.326121 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60c535da-c751-414d-804c-13c208e498f7 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 0.469105 Sep 27 02:02:46.326914 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2972/5894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:45 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:47.364786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:47.366257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:47.383776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:47.385084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:47.385886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:47.387392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:47.388860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:47.401782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:48.181968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:48.191641 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce873151-5d73-4bdd-9181-b422cd9376d9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 0.830878 Sep 27 02:02:48.192254 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2923/5895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:47 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:49.221804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:49.222431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:49.232195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:49.233131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:49.234937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:49.235839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:49.236371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:49.236870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:49.267896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:50.036502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:50.494734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:50.510350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c44f5f69-7b30-445c-b7be-240f240adebd tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 1.293083 Sep 27 02:02:50.514303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2973/5896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:49 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:50.756702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a10b68-2026-45f4-8a92-b9cb02ffba01", "tag": "eebda79b-5b29-4487-9862-fe4c8d83f116"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:02:50.782589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:50.785157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=18 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:50.787795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:50.791699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:50.792722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:50.793618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:50.812574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] Creating event network-changed:eebda79b-5b29-4487-9862-fe4c8d83f116 for instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 on n-h2-859358-1 Sep 27 02:02:50.819738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-22e2dba1-a73b-4707-be74-fcb3acdc8a1c req-11a7439f-d675-46c5-9907-8b8eec3e05f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069987 Sep 27 02:02:50.821427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2924/5897] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:02:51.538221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:51.538922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:51.572038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:51.577239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:51.584549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:51.585139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:51.595204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:51.610520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:51.612981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:52.749473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:52.761601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42d79d45-9b6a-490a-b6ac-fc182121d2b4 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 1.228813 Sep 27 02:02:52.765678 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2974/5898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:51 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:53.789402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:53.791542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:53.829734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:53.833249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:53.833941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:53.837848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:53.838712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:53.840330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:54.711717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:54.721225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:02:54.726405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2301b540-d848-4a8f-9d04-65afd8dc8170 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 0.942431 Sep 27 02:02:54.726996 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2925/5899] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:53 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:55.756614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:55.757270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:55.781189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:55.781750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:55.782196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:55.782926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:55.796916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:55.799842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:56.992983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:57.012697 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a9d86c47-633a-44e7-9152-85fb434507b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 1.260084 Sep 27 02:02:57.017447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2975/5900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:55 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:02:58.049391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:02:58.053609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:02:58.099679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:58.107552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:58.110039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:58.138828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:02:58.139445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:02:58.139905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:02:59.524002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:02:59.533601 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-336d1feb-ef39-4ebd-a802-f31445f0f0fa tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 1.496797 Sep 27 02:02:59.534199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2926/5901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:02:58 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:00.187609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-680411287", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "6a99d59f-2d09-4919-bc5d-ac48e145c43f"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:00.353162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] validate_networks() for [('6a99d59f-2d09-4919-bc5d-ac48e145c43f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:03:00.575309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:00.575975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:00.614894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:00.615513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:00.617834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:00.624063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:00.625528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:00.627816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:01.362775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:01.383644 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f5c6aff-04bc-49c3-acb1-0b43416c3f29 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 0.821984 Sep 27 02:03:01.384273 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2927/5902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:00 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:02.367114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a10b68-2026-45f4-8a92-b9cb02ffba01", "name": "network-vif-plugged", "status": "completed", "tag": "eebda79b-5b29-4487-9862-fe4c8d83f116"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:02.402297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:02.403332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:02.403776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:02.430959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:03:02.431697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:03:02.432184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:03:02.432600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:03:02.433021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:03:02.471262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:02.475614 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] Creating event network-vif-plugged:eebda79b-5b29-4487-9862-fe4c8d83f116 for instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 on n-h2-859358-1 Sep 27 02:03:02.485036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:02.485749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:02.486611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:02.487095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:02.487690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:02.517058 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8c64a399-117f-43cf-97be-b277ab3414e2 req-03521293-b2b3-40f9-b8cd-7f2caa45125a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153573 Sep 27 02:03:02.517707 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2928/5903] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:03:02.557464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:02.559377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:02.564414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Getting quotas for project 0326733780294e9986269428b2203e33. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:03:02.586072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Getting quotas for user bf24a873ea144875a696c68624e831fd and project 0326733780294e9986269428b2203e33. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:03:02.608622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:02.609124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:02.609601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:02.628273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:02.628789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:02.629248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:02.640938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:03:02.656902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:03:02.814267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf4ab741-182c-4836-9766-392cac8a484c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.158001 Sep 27 02:03:02.821294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2976/5904] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:03:02.827144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ffc0df6-61fb-482b-aede-403ffab774a6 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:02.827778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ffc0df6-61fb-482b-aede-403ffab774a6 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:03.024470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ffc0df6-61fb-482b-aede-403ffab774a6 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:03.031925 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ffc0df6-61fb-482b-aede-403ffab774a6 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1216 microversion: 2.1 time: 0.209181 Sep 27 02:03:03.051303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2977/5905] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:02 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:04.058713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fd2fd24-f8f9-4542-bfb1-c1a5fe3803cb tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:04.059498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fd2fd24-f8f9-4542-bfb1-c1a5fe3803cb tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:04.217030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fd2fd24-f8f9-4542-bfb1-c1a5fe3803cb tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:04.232487 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fd2fd24-f8f9-4542-bfb1-c1a5fe3803cb tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1216 microversion: 2.1 time: 0.176568 Sep 27 02:03:04.234266 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2978/5906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:04 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:04.533878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:04.552360 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a60d0bdf-6b53-41e7-89a1-6750f4a082b2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 2.019580 Sep 27 02:03:04.553255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2929/5907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:02 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:05.256084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:05.257847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:05.305183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:05.309218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:05.312273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:05.315416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:05.316174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:05.316885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:05.564627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:05.585063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:05.585899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:05.604665 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8792ae58-ed80-4263-8c2d-5ed73ba2bf2d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1268 microversion: 2.1 time: 0.348457 Sep 27 02:03:05.621853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:05.621853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:05.621853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:05.621853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:05.622722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2979/5908] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:05 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1268 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:05.622833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:05.622833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:06.642542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:06.643896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:06.651266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:06.652199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:06.652928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:06.653916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:06.654584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:06.655458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:06.766277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:06.779095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95657bf9-d712-4876-8374-9fb39a7654aa tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1274 microversion: 2.1 time: 0.142264 Sep 27 02:03:06.797504 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2980/5909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:06 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:06.835304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:06.855395 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5645f20a-4270-479b-a1c3-0fd454ebb118 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1362 microversion: 2.1 time: 1.274983 Sep 27 02:03:06.883693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2930/5910] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:05 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1362 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:07.811961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:07.812734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:07.822929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:07.825860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:07.827057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:07.828764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:07.829700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:07.830691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:07.922375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:07.926038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:07.957058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:07.960446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:07.985776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:07.986578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:07.987060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:07.987502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:08.047945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:08.111357 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ad471819-b1e2-4c29-a3ff-5cffb3fbc97c tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1274 microversion: 2.1 time: 0.304563 Sep 27 02:03:08.115390 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2981/5911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:07 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:08.922188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:08.935001 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3ba41cd-e776-41d4-9e75-320c26aa9148 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1547 microversion: 2.1 time: 1.018956 Sep 27 02:03:08.936464 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2931/5912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:07 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1547 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:08.974583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:08.982413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:09.002123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:09.002628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:09.003073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:09.003794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:09.004257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:09.004689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:09.142097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:09.143131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:09.159362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:09.160203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:09.160877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:09.162324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:09.163583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:09.164856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:09.189012 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b68b734-634d-40f9-9b00-2cf323115516 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221976 Sep 27 02:03:09.198655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2982/5913] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:03:08 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:10.321827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:10.330930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-284dba5e-a594-46f5-87b5-34e745bc96c8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 1.194765 Sep 27 02:03:10.336951 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2932/5914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:09 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:11.365056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:11.366894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:11.385671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:11.386187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:11.391951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:11.399826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:11.400381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:11.402987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:12.538436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:12.904044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:12.912376 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6343583-af14-4a00-a7b1-61565b428be8 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 1.551949 Sep 27 02:03:12.918405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2983/5915] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:11 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:13.520949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99dfa35a-d7a8-4ec1-9255-5ddcd826dbba", "tag": "3d8e8700-50dc-4298-b8e6-a835bb979d74"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:13.559635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:13.561019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:13.563459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:13.625695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] Creating event network-changed:3d8e8700-50dc-4298-b8e6-a835bb979d74 for instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba on n-h1-859358-1 Sep 27 02:03:13.635305 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c05176cd-22c7-4168-ba4f-d2ec636900b9 req-0ddb9d40-4f00-4170-b41c-fcff672d6c99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118377 Sep 27 02:03:13.642303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2933/5916] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:13.953617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:13.954653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:13.976597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:13.990748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:13.991211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:14.001399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:14.009433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:14.009433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:14.230892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:14.899417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:14.926940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e526c021-0603-4b97-9f15-68b57523b9de tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.982386 Sep 27 02:03:14.927561 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2984/5917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:13 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:15.107209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a10b68-2026-45f4-8a92-b9cb02ffba01", "tag": "eebda79b-5b29-4487-9862-fe4c8d83f116"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:15.132030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:15.138062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:15.138909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:15.199842 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] Creating event network-changed:eebda79b-5b29-4487-9862-fe4c8d83f116 for instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 on n-h2-859358-1 Sep 27 02:03:15.209613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c519c88f-23a0-4a61-a277-7947733f7fc2 req-23f7bf07-2296-438d-9935-c05dc706f82b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108428 Sep 27 02:03:15.213304 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2934/5918] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:15.956982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:15.957629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:15.977197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:15.977861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:15.978158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:15.978873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:15.979326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:15.979750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:16.734231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:16.743267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7c89d84-0218-4d97-94f9-41eb487255fd tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.790111 Sep 27 02:03:16.747264 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2985/5919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:15 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:17.775110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:17.775836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:17.795613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:17.796105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:17.799012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:17.799758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:17.800227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:17.800713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:18.844251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:18.863367 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f79e077-aee4-420b-9b08-af819a893c3e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 1.087693 Sep 27 02:03:18.883074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2935/5920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:17 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:19.891538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:19.892667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:19.912261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:19.919693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:19.921879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:19.927386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:19.928351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:19.930141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:20.034731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=60 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:20.999398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:21.020579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-546cf86b-8e2b-4362-9690-94daca31273f tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 1.130383 Sep 27 02:03:21.023490 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2986/5921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:19 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:22.050274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:22.050921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:22.075180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:22.075676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:22.076117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:22.076831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:22.077289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:22.077745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:22.302370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:22.311830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-40acb8b3-a9aa-46d1-a70e-e7adf15ceb17 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.265332 Sep 27 02:03:22.312412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2936/5922] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:22 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:23.336773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:23.337468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:23.384677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:23.387289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:23.387791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:23.396785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:23.398849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:23.416058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:23.418263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:23.855019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:23.872746 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6322f00d-d4b1-4087-8796-deaece645097 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.531944 Sep 27 02:03:23.876420 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2987/5923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:23 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:24.912585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:24.914439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:24.923509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=26 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:24.925310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:24.928071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:24.940209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:24.941070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:24.941707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:24.944427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:25.509805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:25.530045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e0bdfac-b425-49a6-bd9b-a0e787c631b7 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.621606 Sep 27 02:03:25.561259 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2937/5924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:24 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:26.569187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:26.570005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:26.593875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:26.594500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:26.595773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:26.597361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:26.599038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:26.601897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:26.962203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:26.971235 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06ddaa7c-a776-471a-84b9-5dab15263e24 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.406959 Sep 27 02:03:26.975052 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2988/5925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:26 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:28.000209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:28.000844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:28.029001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:28.035236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:28.035945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:28.040599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:28.042917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:28.043544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:28.609446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:28.616625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=66 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:28.619048 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f0ec736-aa14-4547-b797-941f2525ed4a tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.622801 Sep 27 02:03:28.630688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2938/5926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:27 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:29.353741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dfa35a-d7a8-4ec1-9255-5ddcd826dbba", "name": "network-vif-plugged", "status": "completed", "tag": "3d8e8700-50dc-4298-b8e6-a835bb979d74"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:29.383753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:29.383753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:29.383917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:29.418086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] Creating event network-vif-plugged:3d8e8700-50dc-4298-b8e6-a835bb979d74 for instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba on n-h1-859358-1 Sep 27 02:03:29.426062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3c84bf47-c6ae-484a-9630-e93ec890e747 req-71f0c7b1-8c14-48e5-b252-8a6af56a9050 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077310 Sep 27 02:03:29.428929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2989/5927] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:29.660048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:29.660776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:29.679049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:29.682287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:29.683421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:29.684343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:29.684973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:29.685601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:30.234382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:30.247531 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a46258b0-e72f-4c83-a4e2-bc0033f93260 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1316 microversion: 2.1 time: 0.593944 Sep 27 02:03:30.262682 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2939/5928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:29 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:31.120660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.125159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.126579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.127283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.129935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.130554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.131168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.169520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48a6f5ed-e3ef-46af-bbc4-202ee35141d8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.330652 Sep 27 02:03:31.170832 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2990/5929] 10.222.0.52 () {58 vars in 1185 bytes} [Tue Sep 27 02:03:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:31.274875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.275585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:31.295713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.312700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.317950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.318836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.319381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.319923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.443724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-824587575", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "availability_zone": "nova:n-h2-859358-1", "networks": [{"uuid": "068f7897-a7d3-4da7-872f-5c66c12da2b9"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:31.629102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] validate_networks() for [('068f7897-a7d3-4da7-872f-5c66c12da2b9', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:03:31.690416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:31.704932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75cb1ca7-5af9-4167-be7d-802efa0c3557 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1505 microversion: 2.1 time: 0.436349 Sep 27 02:03:31.706195 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2940/5930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:31 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:31.728970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.730018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:31.741602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.742499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.743093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.743999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.744613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.745264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.787162 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-391438e6-1b23-46d6-8c5b-36355cb77489 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips" status: 200 len: 109 microversion: 2.1 time: 0.061634 Sep 27 02:03:31.804388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2941/5931] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:03:31 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips => generated 109 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:03:31.811195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.815676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:31.836083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.836839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.837525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.838401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.839064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.839810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.871938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04ec95cc-2444-4145-b2d1-d63a87848638 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips" status: 200 len: 109 microversion: 2.1 time: 0.066092 Sep 27 02:03:31.872766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2942/5932] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:03:31 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips => generated 109 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:31.884410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.885141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:31.892713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.893563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.894237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.895111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.895726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.896313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.937613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e59816d1-a467-4a31-8dbb-156e4754c556 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips/tempest-ServerAddressesTestJSON-1976359028-network" status: 200 len: 94 microversion: 2.1 time: 0.056840 Sep 27 02:03:31.939475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2943/5933] 10.222.0.52 () {58 vars in 1401 bytes} [Tue Sep 27 02:03:31 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba/ips/tempest-ServerAddressesTestJSON-1976359028-network => generated 94 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:03:31.956118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:31.957118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:31.972620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.973518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.974130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:31.975559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:31.976402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:31.977010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:32.030100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:03:32.236495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5084633-a74c-4f24-92d4-646f9c58f81e tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "DELETE /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 204 len: 0 microversion: 2.1 time: 0.285143 Sep 27 02:03:32.237818 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2944/5934] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:03:31 2022] DELETE /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:03:32.269741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:32.273511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:32.284138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:32.286201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:32.287163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:32.289141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:32.289899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:32.290776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:32.678324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:32.688307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60211d10-5b50-4c76-bb43-52fd84bfaf67 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1511 microversion: 2.1 time: 0.445988 Sep 27 02:03:32.692644 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2945/5935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:32 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:33.201674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:03:33.206917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:03:33.213115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:03:33.214321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:03:33.214948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:03:33.243711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:33.247362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:33.248014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:33.248952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:33.251861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:33.252507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:33.293402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Getting quotas for project f5fee7a40e64444db8bcdb2cc02c7a8b. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:03:33.310186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Getting quotas for user ef68840953b2453fbd62afce3e8b7f8d and project f5fee7a40e64444db8bcdb2cc02c7a8b. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:03:33.366647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:03:33.369455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:03:33.459707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c8ee337-ba63-4c70-b862-8af8fdacde19 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.020131 Sep 27 02:03:33.460372 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2991/5936] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:03:33.474976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af3e120b-b629-457c-977a-29a536a0daa4 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:33.475606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af3e120b-b629-457c-977a-29a536a0daa4 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:33.719497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:33.720811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:33.726067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af3e120b-b629-457c-977a-29a536a0daa4 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1328 microversion: 2.1 time: 0.255028 Sep 27 02:03:33.730108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2946/5937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:33 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:33.738016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:33.738516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:33.738957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:33.739673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:33.740136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:33.752940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:34.050289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:34.068082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-131fc4ab-995a-4c7c-a8f8-cced85d0eb87 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1511 microversion: 2.1 time: 0.350314 Sep 27 02:03:34.071631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2992/5938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:33 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:34.728337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99dfa35a-d7a8-4ec1-9255-5ddcd826dbba", "name": "network-vif-deleted", "tag": "3d8e8700-50dc-4298-b8e6-a835bb979d74"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:34.756765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09ff7662-979a-43d2-807f-ac583e05e74a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:34.758313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09ff7662-979a-43d2-807f-ac583e05e74a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:34.781048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:34.787336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:34.788246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:34.837267 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] Creating event network-vif-deleted:3d8e8700-50dc-4298-b8e6-a835bb979d74 for instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba on n-h1-859358-1 Sep 27 02:03:34.859310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f97db62a-7c46-4b67-aaab-c5285e21d623 req-d4c0ecf2-d2c1-44eb-ba9d-61f2b85fbfe9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133489 Sep 27 02:03:34.865556 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2947/5939] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:03:35.102823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:35.103529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:35.126602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:35.134016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:35.134468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:35.135217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:35.135722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:35.136320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:35.211860 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09ff7662-979a-43d2-807f-ac583e05e74a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1328 microversion: 2.1 time: 0.458680 Sep 27 02:03:35.215203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2993/5940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:34 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1328 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:35.241146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:35.244714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:35.245900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:35.252094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lazy-loading 'fault' on Instance uuid 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:03:35.427285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf24a873ea144875a696c68624e831fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0326733780294e9986269428b2203e33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:03:35.444872 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b7447e16-b498-4168-80e2-6c16280bf82d tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 200 len: 1306 microversion: 2.1 time: 0.356455 Sep 27 02:03:35.473525 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2948/5941] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:35 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 1306 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:36.251158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:36.257743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:36.292437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:36.297174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:36.297807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:36.306045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:36.324739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:36.326858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:36.501434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:36.502685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] [instance: 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:36.532381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1de67ad0-97aa-49e3-ba51-6b7ec4b4a3f9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1415 microversion: 2.1 time: 0.294793 Sep 27 02:03:36.540553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:36.541408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:36.542153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:36.549364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:36.552201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:36.552541 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2994/5942] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:36 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1415 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:36.555696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:36.615173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] HTTP exception thrown: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Request method failure captured: Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba HTTP/1.1 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlnTuuXaele2orX6TJAfaUtFE5ll7YiY3it4aQtzZxyJOsTpky_ywvVgzBto4JwXQmYvdS_I6CO0iVG_g9lY164m-HFNkDA5YqYGgGgvhCkpTJ7O-Ydspknm1iCmX_ugBo0c7IxS0_VlDKb0jzCnhbrAGK9pQTI02jXbOt7Pl-uMaBU Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0326733780294e9986269428b2203e33 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerAddressesTestJSON-1378492625 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0326733780294e9986269428b2203e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0326733780294e9986269428b2203e33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0326733780294e9986269428b2203e33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0326733780294e9986269428b2203e33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerAddressesTestJSON-1378492625 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0326733780294e9986269428b2203e33 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1378492625 Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerAddressesTestJSON-1378492625-project Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: bf24a873ea144875a696c68624e831fd Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerAddressesTestJSON-1378492625-project Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '99dfa35a-d7a8-4ec1-9255-5ddcd826dbba'} Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:03:36.618834 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. Sep 27 02:03:36.625231 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:03:36.632638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] Returning 404 to user: Instance 99dfa35a-d7a8-4ec1-9255-5ddcd826dbba could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:03:36.633894 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbb282bf-add0-4416-9be5-8809a2aef8b4 tempest-ServerAddressesTestJSON-1378492625 tempest-ServerAddressesTestJSON-1378492625-project] 10.222.0.52 "GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba" status: 404 len: 111 microversion: 2.1 time: 0.141811 Sep 27 02:03:36.635160 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2949/5943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:36 2022] GET /compute/v2.1/servers/99dfa35a-d7a8-4ec1-9255-5ddcd826dbba => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:03:37.560230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:37.560841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:37.572035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:37.574214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:37.578136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:37.579702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:37.580653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:37.581247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:37.753776 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbd37a60-e4e9-424e-95be-30ba22962592 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1421 microversion: 2.1 time: 0.197688 Sep 27 02:03:37.770931 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2995/5944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:37 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1421 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:38.780773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:38.782359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:38.805408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:38.806276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:38.806892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:38.808369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:38.808999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:38.809637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:39.142765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd838d8f-ea66-4609-b03b-f66bca1f6f95 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1421 microversion: 2.1 time: 0.366415 Sep 27 02:03:39.144764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2950/5945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:38 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1421 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:40.168104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:40.168872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:40.188448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:40.189023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:40.192050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:40.192995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:40.193670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:40.194301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:40.356782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db8f834e-418f-4dfb-b3a5-178f997ee219 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1421 microversion: 2.1 time: 0.193659 Sep 27 02:03:40.361179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2996/5946] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:40 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1421 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:41.386723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:41.392168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:41.424958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:41.430596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:41.431181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:41.435215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:41.436052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:41.440019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:42.229806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-889a38e2-0c80-4457-b685-4f796eb0ba9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.846267 Sep 27 02:03:42.230396 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2951/5947] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:41 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:43.258850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:43.260033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:43.272628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:43.273161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:43.277888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:43.278908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:43.279390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:43.283152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:43.286621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:44.446485 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40b64d35-8352-40d2-8dd3-7cbeb7259ecd tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 1.192645 Sep 27 02:03:44.452576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2997/5948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:43 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:44.634754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:44.816980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21eeeda-45ef-47fc-90e8-0b697201dc81", "tag": "7a1d6e34-ef87-4820-95de-f6c69f899eee"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:44.837842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:44.840299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:44.841798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:44.865270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] Creating event network-changed:7a1d6e34-ef87-4820-95de-f6c69f899eee for instance b21eeeda-45ef-47fc-90e8-0b697201dc81 on n-h2-859358-1 Sep 27 02:03:44.872487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-27689408-9819-44e8-a0d7-de6a1434af27 req-fef526c6-8f9e-4afb-a496-064fb5a04fca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249842 Sep 27 02:03:44.873943 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2952/5949] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:45.484296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:45.484923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:45.505198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:45.539641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:45.545310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:45.548821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:45.552077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:45.554266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:45.559814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:46.058847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3580eae-7b3d-4823-9e45-99c0ae60a651 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.579206 Sep 27 02:03:46.063037 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2998/5950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:45 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:47.092961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:47.093869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:47.114915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:47.115428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:47.116015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:47.116981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:47.117480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:47.117915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:47.659114 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.571672 Sep 27 02:03:47.662817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2953/5951] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:47 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:48.686257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:48.687434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:48.717153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:48.718340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:48.720714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:48.721791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:48.722771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:48.725003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:49.599261 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ceec18c-cb9f-4b52-b5a0-eb5f3bcbea41 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.917606 Sep 27 02:03:49.599852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 2999/5952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:48 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:49.751605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:49.752583 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e383ef14-ccdf-45e9-9e9b-57fed52811b3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001349 Sep 27 02:03:49.752927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2954/5953] 10.222.0.52 () {56 vars in 886 bytes} [Tue Sep 27 02:03:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 27 02:03:50.628414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:50.629637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:50.668798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:50.677736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:50.678575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:50.680565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:50.684595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:50.690172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:50.710712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=66 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:51.085450 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42598998-55d0-416d-8a1a-10e91b2ffd5d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.459855 Sep 27 02:03:51.105818 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3000/5954] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:50 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:52.108868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:52.109591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:52.120546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:52.121039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:52.130573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:52.137429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:52.148588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:52.154574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:53.049628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b029dc4d-c4cb-44f4-81b4-b9f4ad1085f8 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.944468 Sep 27 02:03:53.065984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2955/5955] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:52 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:03:54.078169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:54.080383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:54.104898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:54.105693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:54.110579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:54.116530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:54.118085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:54.118738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:54.277973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21eeeda-45ef-47fc-90e8-0b697201dc81", "name": "network-vif-plugged", "status": "completed", "tag": "7a1d6e34-ef87-4820-95de-f6c69f899eee"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:03:54.303083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:54.315828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:54.321297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:54.335738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:54.479643 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] Creating event network-vif-plugged:7a1d6e34-ef87-4820-95de-f6c69f899eee for instance b21eeeda-45ef-47fc-90e8-0b697201dc81 on n-h2-859358-1 Sep 27 02:03:54.512589 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ed7aec85-9c31-4ebd-a117-4fa0e665921f req-f9c65419-0935-468c-8a1d-79b55fd41a0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.805722 Sep 27 02:03:54.518497 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3001/5956] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:03:55.094533 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc0ae6ed-6bb7-4537-9b11-4990fede1f9a tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 1.022197 Sep 27 02:03:55.101805 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2956/5957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:54 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:56.121632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:56.122465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:56.138550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:56.139651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:56.140491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:56.152800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:56.171509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:56.174737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:56.529754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d120618d-6bab-4d20-81ff-841d2159c95c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1463 microversion: 2.1 time: 0.414421 Sep 27 02:03:56.532379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3002/5958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:56 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1463 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:57.559712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:57.560338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:57.575777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:03:57.577200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:57.578003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:57.578875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:57.580177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:57.580812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:57.581498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:58.179585 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c24ead2-671c-4de8-8f5d-84d368a74083 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1648 microversion: 2.1 time: 0.623713 Sep 27 02:03:58.180162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2957/5959] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:57 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1648 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:58.207335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:58.207806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:58.245011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:58.246022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:58.246781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:58.247852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:58.248527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:58.249214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:58.764842 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5606f063-8232-4cf2-99bc-2cf6aecef2c0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1648 microversion: 2.1 time: 0.542668 Sep 27 02:03:58.790567 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3003/5960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:58 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1648 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:03:58.810415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:03:58.812200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:03:58.847432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:58.852250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:58.853584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:58.855470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:03:58.863869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:03:58.864619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:03:58.996161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:00.030747 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fcbfd8e4-3358-46cf-b506-2a62cb7c155d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1648 microversion: 2.1 time: 1.235563 Sep 27 02:04:00.053875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2958/5961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:03:58 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1648 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:00.393744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1476690454", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "availability_zone": "nova:n-h1-859358-1", "networks": [{"uuid": "068f7897-a7d3-4da7-872f-5c66c12da2b9"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:00.564255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] validate_networks() for [('068f7897-a7d3-4da7-872f-5c66c12da2b9', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:04:02.371461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:04:02.373166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:04:02.373942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:04:02.374640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:04:02.375786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:04:02.402212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:02.404690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:02.406099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:02.415247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:02.416429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:02.419796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:02.539069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Getting quotas for project f5fee7a40e64444db8bcdb2cc02c7a8b. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:04:02.573699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Getting quotas for user ef68840953b2453fbd62afce3e8b7f8d and project f5fee7a40e64444db8bcdb2cc02c7a8b. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:04:02.623224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:04:02.627679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:04:02.866203 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2abfbdb-8d52-455d-8530-f7fabfd7cd12 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462651 Sep 27 02:04:02.869301 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3004/5962] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:04:02.879027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4bac03dc-921d-49b1-8679-17d130069001 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:02.880254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4bac03dc-921d-49b1-8679-17d130069001 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:03.066384 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4bac03dc-921d-49b1-8679-17d130069001 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1329 microversion: 2.1 time: 0.188521 Sep 27 02:04:03.069673 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2959/5963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:02 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:04.098641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:04.099333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:04.123727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:04.149626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:04.150296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:04.151067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:04.152352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:04.153017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:04.410464 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bfd5f9bf-c9d3-40ac-9df1-1c38e34fe347 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1338 microversion: 2.1 time: 0.321499 Sep 27 02:04:04.416916 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3005/5964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:04 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1338 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:05.443857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:05.445093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:05.459093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:05.459762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:05.461646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:05.462543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:05.472019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:05.472599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:05.727290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7a8adb7-f9e3-4067-9290-14f3cee17237 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1422 microversion: 2.1 time: 0.287314 Sep 27 02:04:05.746701 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2960/5965] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:05 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1422 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:06.771824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:06.772455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:06.782891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:06.783381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:06.783820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:06.784542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:06.784979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:06.785433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:07.001518 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9493a01a-6848-4859-815a-1cb7b184cede tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1422 microversion: 2.1 time: 0.231051 Sep 27 02:04:07.002662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3006/5966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:06 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1422 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:08.028661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:08.029992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:08.047398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:08.053047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:08.054449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:08.059826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:08.061137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:08.061980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:08.591916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-30bec21b-b78d-4a7a-9db0-fd4adebfacb0 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1464 microversion: 2.1 time: 0.567839 Sep 27 02:04:08.592505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2961/5967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:08 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1464 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:08.909124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6b56d79-b2fd-4ce8-81a5-21aaffc4906a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: .version_select at 0x7f24da5b3160>, body: {"keypair": {"name": "tempest-keypair-510131669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJruoP0tbNFfl/B0alLUVQXxRbZpxCHkWTFygmJqBTSyovM45s+1U4ahFKxYgVekUHSeFvt/MJVjIEF6j89XzycUFKpw3Hom/z8BAQ4qgUbxDyspQeiaeatZszlNrBDgtA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:08.936595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6b56d79-b2fd-4ce8-81a5-21aaffc4906a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:04:08.945868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f6b56d79-b2fd-4ce8-81a5-21aaffc4906a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:04:08.986546 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6b56d79-b2fd-4ce8-81a5-21aaffc4906a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196489 Sep 27 02:04:08.987696 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3007/5968] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:04:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:09.454350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324b4dd1-e8b2-4729-a15f-c93d7147352d", "tag": "8b348454-2c39-435a-9610-025e662f22fb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:09.486610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:09.487121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:09.491030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:09.531170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] Creating event network-changed:8b348454-2c39-435a-9610-025e662f22fb for instance 324b4dd1-e8b2-4729-a15f-c93d7147352d on n-h1-859358-1 Sep 27 02:04:09.549251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e39a3f47-1318-48ef-9c15-f60fdfb5c2a3 req-7e50ccd5-1f60-4783-8a45-d1b04d6cc623 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097134 Sep 27 02:04:09.558648 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2962/5969] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:09.641054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:09.641936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:09.676647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:09.677153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:09.701049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:09.703807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:09.704596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:09.705882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:10.152736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cce03c9-7260-48dd-aee1-82c5a2c5d993 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1464 microversion: 2.1 time: 0.530530 Sep 27 02:04:10.156773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3008/5970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:09 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1464 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:11.180679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:11.182563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:11.203350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:11.204144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:11.204762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:11.205703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:11.206324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:11.206917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:12.270309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4ac901cb-8e13-4e61-a4f5-422bed6479c5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1464 microversion: 2.1 time: 1.025276 Sep 27 02:04:12.270309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2963/5971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:11 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1464 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:13.230499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:13.231534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:13.241255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:13.244439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:13.245048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:13.254326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:13.260309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:13.261998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:13.269450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:13.672877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41985c09-e3a1-490e-a655-17f136fa89ea tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1464 microversion: 2.1 time: 0.444281 Sep 27 02:04:13.675914 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3009/5972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:13 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1464 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:13.778296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-98127789", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63819575-c2e2-431a-81ef-d6223fc06634"}], "security_groups": [{"name": "tempest-securitygroup--679207231"}], "key_name": "tempest-keypair-510131669", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:13.831501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:14.102966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] validate_networks() for [('63819575-c2e2-431a-81ef-d6223fc06634', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:04:14.974450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:14.976394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:14.988516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:14.991728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:14.993102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:14.997150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:14.997940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.000054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.053091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-68eff61e-31fc-429f-90d3-0db6da59256c tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/ips" status: 200 len: 144 microversion: 2.1 time: 0.705653 Sep 27 02:04:15.062272 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3010/5973] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:04:14 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/ips => generated 144 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:04:15.065674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b4dd1-e8b2-4729-a15f-c93d7147352d", "name": "network-vif-plugged", "status": "completed", "tag": "8b348454-2c39-435a-9610-025e662f22fb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:15.080402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:04:15.080928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:04:15.081326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:04:15.081876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:04:15.082390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:04:15.085526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:15.086203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.087670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.115395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:15.116113 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] Creating event network-vif-plugged:8b348454-2c39-435a-9610-025e662f22fb for instance 324b4dd1-e8b2-4729-a15f-c93d7147352d on n-h1-859358-1 Sep 27 02:04:15.116272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.116769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.120428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:15.121232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.121968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.123046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f9807d8f-8edb-4129-a2f9-0c5b35eb74be req-630a3bda-bf43-44fb-845e-3fbaaca3d007 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066811 Sep 27 02:04:15.124720 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3011/5974] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:15.134653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:15.135577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:15.164746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:15.169066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.169632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.170929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:15.171396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:15.171837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:15.212851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:04:15.220787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:04:15.238756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:04:15.243640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:04:15.363211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33fe4072-a1df-4214-8054-640e9f202531 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.590473 Sep 27 02:04:15.371927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2964/5975] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:04:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:04:15.383720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd6ff828-bbc5-483d-87ef-dc8e09f53278 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:15.385150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd6ff828-bbc5-483d-87ef-dc8e09f53278 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:15.638939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd6ff828-bbc5-483d-87ef-dc8e09f53278 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:15.655108 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd6ff828-bbc5-483d-87ef-dc8e09f53278 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1239 microversion: 2.1 time: 0.278606 Sep 27 02:04:15.669365 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2965/5976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:15 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1239 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:15.851828 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41fbac44-67e1-4d19-b8d9-de8f386aa0f5 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1464 microversion: 2.1 time: 0.718450 Sep 27 02:04:15.853665 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3012/5977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:15 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1464 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:16.685658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:16.694366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:16.718490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:16.718989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:16.721439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:16.724066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:16.724870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:16.725524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:16.880440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:16.881391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:16.893739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:16.894237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:16.894679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:16.895479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:16.902082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:16.902966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:17.001181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:17.025422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5fbaf55-7084-4fd8-9be9-7e20eebccfec tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1235 microversion: 2.1 time: 0.345115 Sep 27 02:04:17.028246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2966/5978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:16 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1235 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:18.051368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:18.052828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:18.079545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:18.082684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:18.083194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:18.083960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:18.084434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:18.084873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:18.451759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:18.468683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-426d4dec-68d1-422b-ab9d-baa32679ccb2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1297 microversion: 2.1 time: 0.421891 Sep 27 02:04:18.496156 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2967/5979] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:18 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1297 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:18.957797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=10 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:19.084185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3cffd4c6-8b36-4037-a28d-bccf7496e85d tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1649 microversion: 2.1 time: 2.210024 Sep 27 02:04:19.084785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3013/5980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:16 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1649 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:19.107463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:19.109370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:19.127964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.128669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.129476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.130762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.131383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.132142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.491876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:19.492490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:19.504829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.505229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.506761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.507626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.509653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.512419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.629253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7abf3a4-0d63-4f7d-8e15-7ca83ec1deda tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1649 microversion: 2.1 time: 0.525896 Sep 27 02:04:19.630827 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2968/5981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:19 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1649 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:19.660219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec568010-0c72-4af4-8d63-0ac9f0e3db6e"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:19.686867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:19.709888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:19.724436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c91cf53-1274-4a45-b1d6-b27c0ec5a194 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1297 microversion: 2.1 time: 0.234148 Sep 27 02:04:19.744540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3014/5982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:19 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:19.748100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.756125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.757201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.760308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.762688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.763474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.763979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:19.765688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:19.782810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.783899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.787084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:19.788284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:19.804873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:19.806689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:20.353378 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35ad5b67-02f4-4ed0-a0d6-9c10a424311c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1649 microversion: 2.1 time: 0.605622 Sep 27 02:04:20.369364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3015/5983] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:19 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1649 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:20.412858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:20.414906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:20.454101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:20.455590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:20.456233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:20.458015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:20.473466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:20.475662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:20.491818 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4a1f8c5-1f7f-4360-8fa4-6e0468b18f4e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843202 Sep 27 02:04:20.494222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2969/5984] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:04:19 2022] POST /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:20.669075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:04:20.751232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:20.752136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:20.770701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=82 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:20.771337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:20.778149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:20.779073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:20.780008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:20.780638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:20.781253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:20.974946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b939560-b6d0-4007-a42b-4431ac5ecc5e tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 204 len: 0 microversion: 2.1 time: 0.598098 Sep 27 02:04:20.982916 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3016/5985] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:04:20 2022] DELETE /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:04:20.991544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:20.999787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:21.023229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:21.023734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:21.024172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:21.024920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:21.025381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:21.025817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:21.708948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-040751c5-794d-4a57-b803-f882b08b67f1 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1655 microversion: 2.1 time: 0.721425 Sep 27 02:04:21.710829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3017/5986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:20 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1655 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:21.871339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:21.893565 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eed2ed48-db83-41b0-984a-c65aeafbc841 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 1.146604 Sep 27 02:04:21.909545 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2970/5987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:20 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:22.740472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:22.742046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:22.756976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:22.757733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:22.759190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:22.767066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:22.769843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:22.770487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:22.927797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:22.928944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:22.947171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:22.951170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:22.953452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:22.955615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:22.957909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:22.958539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:23.816368 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a375dc01-3e89-45d9-87dd-556a0441d134 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1655 microversion: 2.1 time: 1.081973 Sep 27 02:04:23.845792 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3018/5988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:22 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1655 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:23.887456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:23.895939 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-19d46594-2f08-4ddd-a134-984b74fb2681 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.977976 Sep 27 02:04:23.896535 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2971/5989] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:22 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:24.541609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b4dd1-e8b2-4729-a15f-c93d7147352d", "name": "network-vif-deleted", "tag": "8b348454-2c39-435a-9610-025e662f22fb"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:24.577111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:24.577627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:24.578422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:24.633089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] Creating event network-vif-deleted:8b348454-2c39-435a-9610-025e662f22fb for instance 324b4dd1-e8b2-4729-a15f-c93d7147352d on n-h1-859358-1 Sep 27 02:04:24.664435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-27374bcc-a1f3-4e53-a343-e1b6da3e53d8 req-a96f0cbc-d48a-4b97-b43f-109c8a403362 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134028 Sep 27 02:04:24.671596 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3019/5990] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:04:24.845904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:24.846529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:24.867348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:24.873820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:24.878039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:24.881087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:24.884388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:24.889732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:24.924908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:24.925687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:24.943136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:24.943635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:24.944073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:24.944789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:24.945287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:24.966762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:25.033982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:25.034476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:25.034917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:25.035367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lazy-loading 'fault' on Instance uuid 324b4dd1-e8b2-4729-a15f-c93d7147352d {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:04:25.157007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:25.230718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d1be1d7-9308-4da7-a245-5f1ce626a6ac tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 200 len: 1454 microversion: 2.1 time: 0.388367 Sep 27 02:04:25.231302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2972/5991] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:24 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 1454 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:25.406351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad499eb-1909-4b81-98cc-28b82d0d0269", "tag": "4bce0eb9-336e-4afc-8dd2-144f56e0955a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:25.434185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:25.434677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:25.435114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:25.488102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] Creating event network-changed:4bce0eb9-336e-4afc-8dd2-144f56e0955a for instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 on n-h1-859358-1 Sep 27 02:04:25.497325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-03ef3e9d-33c7-4ccf-8a4a-960f5b3c6931 req-0ac0ec06-e6dd-4a1d-8f46-1edd0428ab2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097070 Sep 27 02:04:25.508715 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2973/5992] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:04:25.898811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:25.907705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59bdf46d-0120-4ed5-ae1f-56f5f05edc68 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.988759 Sep 27 02:04:25.926217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3020/5993] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:24 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:26.262145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:26.263193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: 324b4dd1-e8b2-4729-a15f-c93d7147352d] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:26.280863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:26.287158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.290746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.291516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.292537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.293870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.299485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.343319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] HTTP exception thrown: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Request method failure captured: Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d HTTP/1.1 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlnylziY88a4L1yYctDXmckOMtH-2WefN9wDbkeNq8dnE6bctaXkj1GMjdPo5GPJRcrek9uUOG7VVgYXvKBDJu1iR3RzJC98E__DUDs2CCFVjAGjQo244cScuhn2-HWoOcxtGc30_cFurSXQWS3W2EL7oeEGMGImJLn6I_NfKYSEqUY Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f5fee7a40e64444db8bcdb2cc02c7a8b Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestServerMultinode-1406001434 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f5fee7a40e64444db8bcdb2cc02c7a8b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestServerMultinode-1406001434 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f5fee7a40e64444db8bcdb2cc02c7a8b Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestServerMultinode-1406001434 Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestServerMultinode-1406001434-project-admin Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ef68840953b2453fbd62afce3e8b7f8d Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestServerMultinode-1406001434-project-admin Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '324b4dd1-e8b2-4729-a15f-c93d7147352d'} Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:04:26.345574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. Sep 27 02:04:26.351095 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:26.351819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Returning 404 to user: Instance 324b4dd1-e8b2-4729-a15f-c93d7147352d could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:04:26.354572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9504ed0e-2939-43c0-87b0-c7f093982b44 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d" status: 404 len: 111 microversion: 2.1 time: 0.098733 Sep 27 02:04:26.358180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2974/5994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:26 2022] GET /compute/v2.1/servers/324b4dd1-e8b2-4729-a15f-c93d7147352d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:04:26.366870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:26.367545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:26.379647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:26.407077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.407948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.410486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.418841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.420338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.425207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.527104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:04:26.655401 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9ea2b73-1f9a-4274-ab04-fba9e14ad89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 204 len: 0 microversion: 2.1 time: 0.292430 Sep 27 02:04:26.656837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3021/5995] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:04:26 2022] DELETE /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 02:04:26.671208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:26.671908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:26.680795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.681465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.682022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.682753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.683356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.684188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.924151 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3c27c9c-e032-4733-8a9a-c8a126a3d8ee tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1654 microversion: 2.1 time: 0.259530 Sep 27 02:04:26.924552 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2975/5996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:26 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1654 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:26.949503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:26.956459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:26.982466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.983227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.983377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:26.984587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:26.984587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:26.985143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:27.322522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:27.333869 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c65be985-ae3b-4163-9a2c-b7dab5b59409 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.396386 Sep 27 02:04:27.346083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3022/5997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:26 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:27.952373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:27.953910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:27.962989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:27.973954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:27.978512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:27.979081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:27.979973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:27.980565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:27.981122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:28.308354 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc647460-b837-4952-9fd9-43f022a7dca3 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1654 microversion: 2.1 time: 0.359770 Sep 27 02:04:28.313062 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2976/5998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:27 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1654 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:28.365658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:28.366986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:28.380288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:28.382319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:28.385180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:28.386428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:28.388427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:28.389136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:28.673163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:28.700325 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bccf03d-7da7-42b9-a008-76478b40edd4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.338879 Sep 27 02:04:28.701768 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3023/5999] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:28 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:29.347637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:29.348403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:29.366316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:29.366917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:29.367456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:29.368828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:29.369450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:29.370117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:29.372955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:29.729960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:29.731454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:29.744916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:29.745441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:29.745888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:29.748854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:29.749405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:29.751966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:29.864439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c26a1cf-926d-49b0-8018-849da2002654 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1654 microversion: 2.1 time: 0.520318 Sep 27 02:04:29.880702 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2977/6000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:29 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1654 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:30.186847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:30.200230 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-626f7eb4-0358-408a-9b8a-bce9d186851b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.472064 Sep 27 02:04:30.201245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3024/6001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:29 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:04:30.368908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21eeeda-45ef-47fc-90e8-0b697201dc81", "name": "network-vif-deleted", "tag": "7a1d6e34-ef87-4820-95de-f6c69f899eee"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:30.407110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:30.408444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:30.408915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:30.455248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] Creating event network-vif-deleted:7a1d6e34-ef87-4820-95de-f6c69f899eee for instance b21eeeda-45ef-47fc-90e8-0b697201dc81 on n-h2-859358-1 Sep 27 02:04:30.466982 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a3606a48-8b8a-4239-9326-4a7a5db4ebb4 req-773bf8b8-d4d9-4ff7-b791-6306cd6ca6a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104852 Sep 27 02:04:30.477663 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2978/6002] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:30.541155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad499eb-1909-4b81-98cc-28b82d0d0269", "name": "network-vif-plugged", "status": "completed", "tag": "4bce0eb9-336e-4afc-8dd2-144f56e0955a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:30.569656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:30.570150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:30.570791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:30.606309 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] Creating event network-vif-plugged:4bce0eb9-336e-4afc-8dd2-144f56e0955a for instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 on n-h1-859358-1 Sep 27 02:04:30.619465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-81101331-c9f4-4ae3-9b91-c052f0bad1e9 req-74831636-0541-4077-90dc-399b7e4f2e0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085265 Sep 27 02:04:30.620623 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3025/6003] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:04:30.894121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:30.894950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:30.918967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:30.985390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:30.985906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:30.987947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:30.989026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lazy-loading 'fault' on Instance uuid b21eeeda-45ef-47fc-90e8-0b697201dc81 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:04:31.127161 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2bec084e-7d19-4ddd-9993-a633845000d9 tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 200 len: 1453 microversion: 2.1 time: 0.237682 Sep 27 02:04:31.128839 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2979/6004] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:30 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:31.241510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:31.242337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:31.258913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:31.260614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:31.262038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:31.264769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:31.266394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:31.267953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:31.679155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:31.692128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b7643b5-aa12-4702-b7aa-7a0532c91503 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1364 microversion: 2.1 time: 0.455955 Sep 27 02:04:31.693287 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3026/6005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:31 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1364 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:32.154567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:32.155192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] [instance: b21eeeda-45ef-47fc-90e8-0b697201dc81] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:32.172858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:32.193819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:32.194373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:32.204161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:32.204161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:32.207962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:32.249507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] HTTP exception thrown: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Request method failure captured: Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 HTTP/1.1 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlnylziY88a4L1yYctDXmckOMtH-2WefN9wDbkeNq8dnE6bctaXkj1GMjdPo5GPJRcrek9uUOG7VVgYXvKBDJu1iR3RzJC98E__DUDs2CCFVjAGjQo244cScuhn2-HWoOcxtGc30_cFurSXQWS3W2EL7oeEGMGImJLn6I_NfKYSEqUY Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: f5fee7a40e64444db8bcdb2cc02c7a8b Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestServerMultinode-1406001434 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f5fee7a40e64444db8bcdb2cc02c7a8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f5fee7a40e64444db8bcdb2cc02c7a8b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestServerMultinode-1406001434 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: f5fee7a40e64444db8bcdb2cc02c7a8b Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestServerMultinode-1406001434 Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestServerMultinode-1406001434-project-admin Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ef68840953b2453fbd62afce3e8b7f8d Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestServerMultinode-1406001434-project-admin Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'b21eeeda-45ef-47fc-90e8-0b697201dc81'} Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:04:32.251205 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:04:32.255871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] Returning 404 to user: Instance b21eeeda-45ef-47fc-90e8-0b697201dc81 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:04:32.259683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-acb03f76-326c-4b6e-a53d-ab3ee3ecb89c tempest-TestServerMultinode-1406001434 tempest-TestServerMultinode-1406001434-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81" status: 404 len: 111 microversion: 2.1 time: 0.102343 Sep 27 02:04:32.261312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2980/6006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:32 2022] GET /compute/v2.1/servers/b21eeeda-45ef-47fc-90e8-0b697201dc81 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:04:32.718850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:32.721097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:32.742262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:32.742803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:32.743239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:32.743952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:32.748143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:32.748667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:33.176966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:33.201271 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a90827f-2716-4219-a877-e742282209a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1553 microversion: 2.1 time: 0.486020 Sep 27 02:04:33.209800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3027/6007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:32 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1553 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:04:33.238489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:33.239069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:33.263139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:33.265048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:33.267394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:33.273701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:33.275339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:33.276014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:33.556718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50055a4d-7713-406a-aa92-044bb042303c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323190 Sep 27 02:04:33.557930 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2981/6008] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:04:33 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:37.421958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad499eb-1909-4b81-98cc-28b82d0d0269", "tag": "4bce0eb9-336e-4afc-8dd2-144f56e0955a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:37.451260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:37.454214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:37.455662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:37.482307 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] Creating event network-changed:4bce0eb9-336e-4afc-8dd2-144f56e0955a for instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 on n-h1-859358-1 Sep 27 02:04:37.489799 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2d1377b0-05d0-44fa-81b8-17de885ec248 req-3b0f377a-c1b8-4cd5-95c0-9895f0fe1135 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075188 Sep 27 02:04:37.502123 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3028/6009] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:42.392342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:42.394610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:42.421100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:42.421625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:42.422059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:42.434276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:42.434774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:42.435223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:42.595542 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-59f61d17-4e78-4f81-a6f9-f7f2af51304a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217810 Sep 27 02:04:42.596036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2982/6010] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:04:42 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:42.616195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:42.616785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:42.638788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:42.639286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:42.639724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:42.640437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:42.640885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:42.647214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:42.769009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2119477822", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:42.807601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a2b612f-8aec-4315-a516-a85f0cdf5450 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e" status: 200 len: 194 microversion: 2.1 time: 0.202765 Sep 27 02:04:42.808243 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3029/6011] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Sep 27 02:04:42 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e => generated 194 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:42.888123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] validate_networks() for None {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:04:44.299070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:04:44.300186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:04:44.300916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:04:44.301834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:04:44.302467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:04:44.319607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:44.325518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:44.326348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:44.327417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:44.335654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:44.337055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:44.398074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Getting quotas for project a3c534ea10a4475b82cd381b55b105d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:04:44.415024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Getting quotas for user 3bfeb73e58c648c8a6f1d3f067a94301 and project a3c534ea10a4475b82cd381b55b105d2. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:04:44.451597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:04:44.456513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:04:44.651561 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-01e36d49-4646-4cea-bea4-961684feda59 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.881773 Sep 27 02:04:44.653138 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2983/6012] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:04:44.665667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d6d56941-896e-4df5-bd6a-237c4e62d271 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:44.667826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d6d56941-896e-4df5-bd6a-237c4e62d271 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:45.227135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d6d56941-896e-4df5-bd6a-237c4e62d271 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:45.235842 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d6d56941-896e-4df5-bd6a-237c4e62d271 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1215 microversion: 2.1 time: 0.575260 Sep 27 02:04:45.238711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3030/6013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:44 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1215 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:46.270920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:46.271844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:46.290448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:46.291643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:46.292288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:46.293214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:46.300267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:46.300998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:46.474930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:46.491266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77e490a5-770d-48a7-9718-41a8ae352ace tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1267 microversion: 2.1 time: 0.224545 Sep 27 02:04:46.493825 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2984/6014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:46 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:46.891984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9bae910-c1b9-46b9-a095-18d702257825"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:46.894696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:46.908843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:46.909357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:46.909816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:46.910606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:46.911321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:46.911757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:47.524585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:47.525287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:47.542428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:47.543196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:47.544008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:47.546368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:47.548645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:47.550026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:47.628211 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6454cab-c217-4775-9f62-d45f22801fb6 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "POST /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735124 Sep 27 02:04:47.630979 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3031/6015] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:04:46 2022] POST /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:47.694643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:47.710658 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c51a66b3-ee62-40e9-b539-5a697e50ebe4 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1273 microversion: 2.1 time: 0.194474 Sep 27 02:04:47.711270 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2985/6016] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:47 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:48.740396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:48.743106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:48.753666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:48.758313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:48.769421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:48.770842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:48.771503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:48.772118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:48.792312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:48.950267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:48.965236 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d5ecb1b-6020-4185-8a1b-e0d06fa0075f tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1273 microversion: 2.1 time: 0.229359 Sep 27 02:04:48.968124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3032/6017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:48 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:49.996284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:49.996900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:50.018074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:50.018187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:50.018572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:50.035411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:50.035911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:50.057598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:50.574952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:50.592636 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46382e25-411b-47cc-9d5c-6685828096de tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.602133 Sep 27 02:04:50.598900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2986/6018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:49 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:51.120988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1053405211", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "263bd814-cfe3-4445-9004-3326e37c8899"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:51.293049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] validate_networks() for [('263bd814-cfe3-4445-9004-3326e37c8899', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:04:51.350352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d98c4a-8466-418b-a5ea-7a4a6d393f1a", "tag": "5709f479-e64e-428c-9d56-f9a8e520903f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:51.379031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:51.381962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:51.385184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:51.431405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] Creating event network-changed:5709f479-e64e-428c-9d56-f9a8e520903f for instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a on n-h2-859358-1 Sep 27 02:04:51.446087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2eabadc1-7306-40b7-82b3-013e71c42e8e req-4f19fedf-3a38-4735-8679-17e49efd811d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097439 Sep 27 02:04:51.447723 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2987/6019] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:51.634063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:51.634914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:51.656291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:51.656967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:51.658211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:51.659344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:51.660301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:51.661376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:52.514157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:52.525370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c8f98d5c-c5f4-4ba7-bdd3-adc0466ab608 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.895249 Sep 27 02:04:52.526192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2988/6020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:51 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:52.588265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:04:52.589526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:04:52.590286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:04:52.591101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:04:52.591635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:04:52.611740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:52.612536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:52.613521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:52.614602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:52.615293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:52.616078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:52.655884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Getting quotas for project ab33b8b778d34146aa0b4a1d63c7c8dc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:04:52.671441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Getting quotas for user 02a747159dd348b68b65af317ed11864 and project ab33b8b778d34146aa0b4a1d63c7c8dc. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:04:52.703337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:04:52.708747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:04:52.815797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6c31658-ddb3-468a-b79a-82aca928f2ea tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018499 Sep 27 02:04:52.824227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3033/6021] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:04:52.832526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75aabc8c-0d87-43f9-8050-2feb322702ff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:52.833484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75aabc8c-0d87-43f9-8050-2feb322702ff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:52.996628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75aabc8c-0d87-43f9-8050-2feb322702ff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:53.009127 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75aabc8c-0d87-43f9-8050-2feb322702ff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1215 microversion: 2.1 time: 0.179715 Sep 27 02:04:53.010532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2989/6022] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:52 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:53.559266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:53.560136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:53.591364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:53.593816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:53.594270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:53.594994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:53.609028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:53.611007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:54.042918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:54.044226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:54.073575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:54.074556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:54.075195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:54.075496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:54.078086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:54.079000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:54.079450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:54.086250 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6436018-d4f3-4d10-8666-431401d0d3d1 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.532237 Sep 27 02:04:54.093352 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3034/6023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:53 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:54.234300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:54.249050 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38441f86-c612-4aee-8f07-5bcd581bf3a5 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1219 microversion: 2.1 time: 0.211165 Sep 27 02:04:54.249700 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2990/6024] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:54 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:55.116208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:55.117825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:55.128243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:55.131344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:55.140159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:55.141248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:55.142011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:55.144931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:55.276573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:55.277560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:55.290068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:55.295754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:55.299229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:55.302148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:55.303516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:55.305431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:55.306135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:55.430520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:55.440864 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6bba5e5-6110-4c1e-8e74-e77927cc4220 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.329143 Sep 27 02:04:55.442209 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3035/6025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:55 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:55.608440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:55.620473 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26fc956a-4485-4d43-8086-50680ba8f59a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1273 microversion: 2.1 time: 0.346093 Sep 27 02:04:55.623199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2991/6026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:55 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1273 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:56.468077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:56.471503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:56.484059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:56.498080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:56.501558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:56.502374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:56.505658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:56.509301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:56.510017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:56.653684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:56.654589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:56.668332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:56.669583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:56.670393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:56.671539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:56.673199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:56.674002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:57.041913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:57.043458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:57.054615 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e60b92f-59da-4560-9396-b343bb8188be tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1273 microversion: 2.1 time: 0.406010 Sep 27 02:04:57.057452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c58578b3-0f2f-441d-b511-73a8e6ffe799 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.591863 Sep 27 02:04:57.061749 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2992/6027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:56 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:57.081949 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3036/6028] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:56 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:58.079004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:58.080642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:58.086155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:58.087466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:58.097321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:04:58.101710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:58.102481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:58.105080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:58.105358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:58.109225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:58.109962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:58.110496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:58.110962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:58.111263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:58.111735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:58.111972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:58.112299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:58.735238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:58.747153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87293d9e-281f-470c-a5bd-a7df8f6bc848 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.673367 Sep 27 02:04:58.747768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2993/6029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:58 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:04:58.754931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d98c4a-8466-418b-a5ea-7a4a6d393f1a", "name": "network-vif-plugged", "status": "completed", "tag": "5709f479-e64e-428c-9d56-f9a8e520903f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:04:58.778060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:04:58.792337 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47fe565d-7ce0-43c6-9e5b-00afd4eb9f3b tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 0.707310 Sep 27 02:04:58.802977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:58.805229 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3037/6030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:58 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:04:58.809674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:58.810136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:58.832729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] Creating event network-vif-plugged:5709f479-e64e-428c-9d56-f9a8e520903f for instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a on n-h2-859358-1 Sep 27 02:04:58.847808 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d5b9f208-0e19-442d-85af-3d651641aa5b req-cad63777-5349-44fb-a3ba-5f2f58d2a9d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098206 Sep 27 02:04:58.850158 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2994/6031] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:04:59.773970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:59.774592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:59.787479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:59.788287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:59.789507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:59.791715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:59.792371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:59.794301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:59.823702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:04:59.824414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:04:59.846116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:59.846621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:59.847069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:59.852116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:04:59.852622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:04:59.853081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:04:59.886912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=82 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:01.039519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:01.060010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b275dfd7-311c-4033-9fbb-1d188b1ed8fc tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1315 microversion: 2.1 time: 1.234794 Sep 27 02:05:01.070400 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2995/6032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:59 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:01.337704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:01.376299 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-306f6335-85bb-47c1-b3fd-b5985a9e4522 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 1.607153 Sep 27 02:05:01.381040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3038/6033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:04:59 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:02.002299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fe4228-4a8b-49a6-87c1-95c919e5160a", "tag": "4d6c5ede-9d77-4933-8aed-68988324644a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:02.037736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.040563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.041667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.079975 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] Creating event network-changed:4d6c5ede-9d77-4933-8aed-68988324644a for instance e3fe4228-4a8b-49a6-87c1-95c919e5160a on n-h1-859358-1 Sep 27 02:05:02.090626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:02.091489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:02.094557 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8ea7dc40-a85b-418c-852c-ae1f529ccecc req-65ca274b-85ba-4c40-a2a5-536487b62416 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097975 Sep 27 02:05:02.097657 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2996/6034] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:02.104377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.104863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.105296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.106023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.106475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.106903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.409063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:02.411161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:02.447310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.448599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.449160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.450100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.450680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.451508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.630022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:02.689945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:02.802835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:02.825789 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2dc8a72f-02d4-4323-b5ac-1220ed8d0c14 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1464 microversion: 2.1 time: 0.745979 Sep 27 02:05:02.828419 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3039/6035] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:02 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1464 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:02.835921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:02.836680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:02.873017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.873776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.874438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.875327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.876260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.876878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.945611 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3de2941e-7fdf-440f-a454-387ea14d62aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/ips" status: 200 len: 149 microversion: 2.1 time: 0.114135 Sep 27 02:05:02.946514 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3040/6036] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:05:02 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/ips => generated 149 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:02.954070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:02.954884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:02.965836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.966911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.967584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:02.969012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:02.994682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:02.996809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:03.009834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:03.111418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:05:03.216437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:03.226691 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98c92d14-368b-4aca-b29c-d938d0c0e15b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.825706 Sep 27 02:05:03.230309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2997/6037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:02 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:03.365070 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df361bd3-988a-4ece-8f8e-3421ca9eebc3 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "DELETE /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 204 len: 0 microversion: 2.1 time: 0.417128 Sep 27 02:05:03.366809 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3041/6038] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:05:02 2022] DELETE /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:05:03.378811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:03.379843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:03.390212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:03.392028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:03.393167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:03.395328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:03.397792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:03.422352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:04.257532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:04.260298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:04.281159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:04.281722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:04.281947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:04.282639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:04.284587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:04.285486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:04.286474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:04.299780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-408d1a3f-5383-4da5-a4fc-921c7b5342e7 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1470 microversion: 2.1 time: 0.918243 Sep 27 02:05:04.320686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2998/6039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:03 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1470 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:04.757032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:04.766603 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b9653348-b941-4c05-b4b4-336c547caf5b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.514973 Sep 27 02:05:04.779801 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3042/6040] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:04 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:05.332714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:05.333372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:05.349262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:05.349739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:05.350129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:05.351434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:05.351970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:05.362037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:05.807236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:05.808087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:05.824646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:05.827953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:05.832910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:05.834615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:05.836499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:05.842424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:06.705732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:06.723221 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2066fdbd-da00-495b-8ee3-93c6415339e0 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.927125 Sep 27 02:05:06.737538 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3043/6041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:05 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:06.749794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "534612c4-7bda-476d-b370-74a689967345"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:06.757173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:06.777185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:06.777706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:06.778150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:06.778859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:06.779543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:06.780149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.006232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:07.026206 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c89ffaf8-c34b-4917-8af3-e34a7adaa453 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1470 microversion: 2.1 time: 1.696193 Sep 27 02:05:07.028266 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 2999/6042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:05 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1470 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:07.215741 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b904ffb-32af-40bc-84df-f47c31cc6925 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476418 Sep 27 02:05:07.216978 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3044/6043] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:05:06 2022] POST /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:07.478075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:07.481224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:07.489228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.490150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.491814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.493588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.494344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.495009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.537243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a3794e8-7c10-4e66-ba58-76459b87dbe1 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063988 Sep 27 02:05:07.542649 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3000/6044] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:05:07 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:07.684805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:07.685900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:07.705777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.706534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.708538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.710614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.712454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.713002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.750277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:07.750977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:07.765452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.769025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.771623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.774617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.776603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.778632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.837483 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70e57b06-3af5-4a5c-9fd6-0c9a0a8bd14e tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e" status: 200 len: 194 microversion: 2.1 time: 0.158617 Sep 27 02:05:07.843178 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3045/6045] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Sep 27 02:05:07 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e => generated 194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:07.865575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:07.866726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:07.896973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.899609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.900071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:07.904512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:07.909248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:07.909742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:08.385728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:08.395893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-66ca5a9d-f291-4112-84bf-a7dc9291541b tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.649998 Sep 27 02:05:08.396487 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3001/6046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:07 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:08.418110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:08.418755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:08.439688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:08.440201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:08.442624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:08.445085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:08.446183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:08.446639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:08.493764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:08.497208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lazy-loading 'services' on Instance uuid 89a10b68-2026-45f4-8a92-b9cb02ffba01 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:08.602419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:08.602921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:08.609278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:08.609890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lazy-loading 'fault' on Instance uuid 63d98c4a-8466-418b-a5ea-7a4a6d393f1a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:08.732311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bfeb73e58c648c8a6f1d3f067a94301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c534ea10a4475b82cd381b55b105d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:08.743342 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac87511f-e65a-413c-8e81-17c105493ca9 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 200 len: 1305 microversion: 2.1 time: 0.344252 Sep 27 02:05:08.753161 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3002/6047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:08 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 1305 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:08.766798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d98c4a-8466-418b-a5ea-7a4a6d393f1a", "name": "network-vif-deleted", "tag": "5709f479-e64e-428c-9d56-f9a8e520903f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:08.804780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:08.805283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:08.816689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:08.870276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] Creating event network-vif-deleted:5709f479-e64e-428c-9d56-f9a8e520903f for instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a on n-h2-859358-1 Sep 27 02:05:08.911324 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2c9372f6-cd79-46df-ab13-811a0607c41d req-172c5ee2-8ed3-4141-886e-cdb9cf3930e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152162 Sep 27 02:05:08.915813 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3003/6048] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:08.924475 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-784967ed-8393-47a6-befd-bacd2b367b42 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e" status: 202 len: 0 microversion: 2.1 time: 1.073877 Sep 27 02:05:08.927004 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3046/6049] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:05:07 2022] DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/ec568010-0c72-4af4-8d63-0ac9f0e3db6e => generated 0 bytes in 1077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:05:09.425389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:09.426111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:09.438250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:09.442502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:09.443193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:09.444174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:09.444819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:09.450300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:09.672965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a2bd0a95-9f53-434f-a68e-27287bdd01cc tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: .version_select at 0x7f24d54fcf70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-275768716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPmE+VBb3YcFoTZi50ArfeUEIu+6I68WI2vdad65FYaCLELyIMYaeEvffSUZ07U7okZYBY+PB06SDixazm1M2FnJ1lZKnMEcaUCpn2stYI1h3TG24FUwIlb+VLqBHM5jA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:09.689388 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:05:09.689608 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a (ip 10.222.0.52) !!! Sep 27 02:05:09.709158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a2bd0a95-9f53-434f-a68e-27287bdd01cc tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:09.724481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a2bd0a95-9f53-434f-a68e-27287bdd01cc tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:09.782825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a2bd0a95-9f53-434f-a68e-27287bdd01cc tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.114433 Sep 27 02:05:09.783901 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3047/6050] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:05:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:09.791747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:09.791747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] [instance: 63d98c4a-8466-418b-a5ea-7a4a6d393f1a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:09.810063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:09.810678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:09.811223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:09.812770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:09.818822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:09.819711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:09.820530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:09.827470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-907cf2ba-9b60-4aeb-bab3-832e7fbf2c3d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.407196 Sep 27 02:05:09.828065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3004/6051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:09 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:09.852608 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] HTTP exception thrown: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Request method failure captured: Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a HTTP/1.1 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlo2kAqInGeBu1SmBUkuI231YHezJUQHdBi3O0ASoC4mW4HxBhhDCtKbPK5BWYa8xIacOt96WZgu4oND6lJHgEbMYuUfGBy1dlXihS1h9AcUWEyW24sh9sHOgI__yveJGzTwgnpuVxdnRvUYd0oBVYtstPyEIBmz2XHiuJ4IPa0rpfw Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a3c534ea10a4475b82cd381b55b105d2 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesNegativeTest-1356907449 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3c534ea10a4475b82cd381b55b105d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a3c534ea10a4475b82cd381b55b105d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a3c534ea10a4475b82cd381b55b105d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a3c534ea10a4475b82cd381b55b105d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesNegativeTest-1356907449 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a3c534ea10a4475b82cd381b55b105d2 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesNegativeTest-1356907449 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesNegativeTest-1356907449-project Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 3bfeb73e58c648c8a6f1d3f067a94301 Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesNegativeTest-1356907449-project Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '63d98c4a-8466-418b-a5ea-7a4a6d393f1a'} Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:09.854850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. Sep 27 02:05:09.859654 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:09.861893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] Returning 404 to user: Instance 63d98c4a-8466-418b-a5ea-7a4a6d393f1a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:05:09.871205 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13720d81-c6d6-497d-9966-bf2f59f72567 tempest-VolumesNegativeTest-1356907449 tempest-VolumesNegativeTest-1356907449-project] 10.222.0.52 "GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a" status: 404 len: 111 microversion: 2.1 time: 0.085546 Sep 27 02:05:09.873240 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3048/6052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:09 2022] GET /compute/v2.1/servers/63d98c4a-8466-418b-a5ea-7a4a6d393f1a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:05:10.858526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:10.859853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:10.880499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:10.881214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:10.882086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:10.885173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:10.885905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:10.886515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:11.396837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:11.406935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dcc56eb2-28b7-4dfe-84c4-312464e72aa7 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.554069 Sep 27 02:05:11.410657 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3005/6053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:10 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:11.451241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe4228-4a8b-49a6-87c1-95c919e5160a", "name": "network-vif-plugged", "status": "completed", "tag": "4d6c5ede-9d77-4933-8aed-68988324644a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:11.480350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:11.480950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:11.481509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:11.514269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] Creating event network-vif-plugged:4d6c5ede-9d77-4933-8aed-68988324644a for instance e3fe4228-4a8b-49a6-87c1-95c919e5160a on n-h1-859358-1 Sep 27 02:05:11.519730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-fbeafe5a-0983-45d8-af49-3bf6ce750e7f req-d564d14d-3629-4419-985a-3a6402ec7af9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071917 Sep 27 02:05:11.520415 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3049/6054] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:12.025660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1294374699", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8a395502-0902-430e-9c39-99a91cdd6a28"}], "key_name": "tempest-TestNetworkBasicOps-275768716", "security_groups": [{"name": "tempest-secgroup-smoke-889949533"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:12.215947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] validate_networks() for [('8a395502-0902-430e-9c39-99a91cdd6a28', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:05:12.435413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:12.444779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:12.460591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:12.464008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:12.465171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:12.468160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:12.473870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:12.474795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:12.735319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:12.744512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12678cfa-cfae-4742-a494-d42d76f40b0e tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1315 microversion: 2.1 time: 0.313905 Sep 27 02:05:12.749432 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3050/6055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:12 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:12.867862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:05:12.868826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:05:12.869871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:05:12.870981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:05:12.871638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:05:12.904534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:12.907552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:12.910481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:12.914249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:12.916239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:12.918431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:12.951612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:12.967399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:12.985920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:05:12.988687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:05:13.064197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ca27f24-1ffd-47ae-8342-a51a28382091 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.043244 Sep 27 02:05:13.066977 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3006/6056] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:05:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:05:13.078627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-090f23db-835b-47ca-a552-401ad0f91110 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:13.079531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-090f23db-835b-47ca-a552-401ad0f91110 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:13.170836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-090f23db-835b-47ca-a552-401ad0f91110 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:13.179482 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-090f23db-835b-47ca-a552-401ad0f91110 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1248 microversion: 2.1 time: 0.104836 Sep 27 02:05:13.193743 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3051/6057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:13 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:13.768873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:13.769529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:13.779279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:13.779769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:13.780202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:13.780909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:13.781386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:13.782039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:14.075845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:14.088627 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c9ee8989-5454-4c2c-9259-82683c25a6f6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1502 microversion: 2.1 time: 0.323431 Sep 27 02:05:14.090582 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3007/6058] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:13 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:14.117278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:14.118035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:14.140070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:14.147957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:14.150239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:14.158164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:14.159018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:14.159629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:14.210663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:14.212385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:14.223395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:14.226670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:14.228112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:14.233762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:14.234487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:14.235188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:14.381063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:14.400075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc28ab08-d774-438f-ad59-53c4e3c14c8e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1300 microversion: 2.1 time: 0.196500 Sep 27 02:05:14.404300 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3008/6059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:14 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:15.007202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:15.029977 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a274c3b-ccad-4e48-9172-c36808f5a3ac tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1502 microversion: 2.1 time: 0.920075 Sep 27 02:05:15.035239 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3052/6060] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:14 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1502 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:15.060263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:15.060809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:15.074604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.075104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.075892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.076451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.076722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.088950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.152533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lazy-loading 'flavor' on Instance uuid e3fe4228-4a8b-49a6-87c1-95c919e5160a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:15.254329 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-381c0253-d29b-4f42-b3b8-0f56315da122 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action" status: 202 len: 0 microversion: 2.1 time: 0.196863 Sep 27 02:05:15.258406 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3009/6061] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:05:15 2022] POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:05:15.264381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:15.265730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:15.276617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.277322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.277795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.278880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.281627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.282916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.432343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:15.433124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:15.454850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.458752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.459259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.465682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:15.466180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:15.466633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:15.617266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:15.629243 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-943ff160-66e2-4ce5-8d33-492508c11d7f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1306 microversion: 2.1 time: 0.205669 Sep 27 02:05:15.630391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3010/6062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:15 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:15.739781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:15.750778 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-052307df-c6dd-45d2-a74c-746b48717ecf tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1510 microversion: 2.1 time: 0.490542 Sep 27 02:05:15.753197 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3053/6063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:15 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1510 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:16.655647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:16.656485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:16.670327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:16.670949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:16.671541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:16.675286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:16.675963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:16.676517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:16.788407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:16.789089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:16.798109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:16.798764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:16.799844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:16.800706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:16.801187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:16.801659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:16.975607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:16.977985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:16.995238 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77cbc169-624d-40d6-93d2-043b90bb1ddd tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.343780 Sep 27 02:05:16.995832 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3011/6064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:16 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:17.077943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:17.091233 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7fbd4748-29f0-4376-9891-0a7c944457cc tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1493 microversion: 2.1 time: 0.319387 Sep 27 02:05:17.094401 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3054/6065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:16 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1493 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:17.116486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:17.117494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:17.125575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:17.126433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:17.127190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:17.128165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:17.128861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:17.129572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:17.223561 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97983146-f72c-46ad-bf67-93ddce028bff tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action" status: 202 len: 0 microversion: 2.1 time: 0.111114 Sep 27 02:05:17.224732 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3012/6066] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:05:17 2022] POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:05:17.234051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:17.234817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:17.248165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:17.248883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:17.249778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:17.272325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:17.272828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:17.273210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:17.504633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:17.513031 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58e01e58-8dac-4d49-97c5-f7459e94e936 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1499 microversion: 2.1 time: 0.284060 Sep 27 02:05:17.514095 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3055/6067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:17 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1499 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:18.020949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:18.021653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:18.029069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:18.029835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:18.030278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:18.031199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:18.031672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:18.032111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:18.465958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:18.483528 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ffe01a4e-519b-4ced-8b43-656763483332 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.466771 Sep 27 02:05:18.484704 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3013/6068] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:18 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:18.534770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994d61de-667b-4f67-a4ac-8827b98bae31", "tag": "b5a47c97-a6f3-4adf-bbdd-1ad11276d18b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:18.535773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:18.536646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:18.546589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:18.547398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:18.548089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:18.555678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:18.556419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:18.557077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:18.557992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:18.558613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:18.559209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:18.561538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] Creating event network-changed:b5a47c97-a6f3-4adf-bbdd-1ad11276d18b for instance 994d61de-667b-4f67-a4ac-8827b98bae31 on n-h2-859358-1 Sep 27 02:05:18.569448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-52416ccd-c650-40d8-924e-076a233c7cc2 req-6859c5ef-f3d2-4235-9516-e5dac9162c79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039899 Sep 27 02:05:18.570690 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3056/6069] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:19.065517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:19.066347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:19.075526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.076784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.077428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.078637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.079379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.079989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.090859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:19.101628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f94237c9-0d71-48ff-8c1f-4c208acde523 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1499 microversion: 2.1 time: 0.567101 Sep 27 02:05:19.102289 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3014/6070] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:18 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1499 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:19.133567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8616fee-e3c7-41fc-be93-3a6a9a96214b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/a9bae910-c1b9-46b9-a095-18d702257825" status: 200 len: 194 microversion: 2.1 time: 0.072167 Sep 27 02:05:19.140735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3057/6071] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Sep 27 02:05:19 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/a9bae910-c1b9-46b9-a095-18d702257825 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:19.145440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:19.146252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:19.153878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.154790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.155458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.157003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.157766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.159049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.507337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:19.507880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:19.515262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.515745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.516189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.523454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:19.524169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:19.524807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:19.603346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lazy-loading 'services' on Instance uuid 89a10b68-2026-45f4-8a92-b9cb02ffba01 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:19.840131 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-318916f7-13b7-4228-ba50-ede9b06db5eb tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/a9bae910-c1b9-46b9-a095-18d702257825" status: 202 len: 0 microversion: 2.1 time: 0.694471 Sep 27 02:05:19.841169 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3015/6072] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:05:19 2022] DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments/a9bae910-c1b9-46b9-a095-18d702257825 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:05:19.914114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:19.930061 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-226156cf-ceba-49d8-82e8-6a015cd1f0ed tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.425549 Sep 27 02:05:19.933208 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3058/6073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:19 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:20.142345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:20.142966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:20.157513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.158152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.158608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.159407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.159879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.160313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.484366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:20.492789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-500b8e71-0c3a-4524-99d3-75d07b07d50d tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1502 microversion: 2.1 time: 0.357303 Sep 27 02:05:20.502031 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3016/6074] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:20 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:20.521684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:20.522623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:20.532263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.532771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.534748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.535480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.536194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.536641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.592807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lazy-loading 'flavor' on Instance uuid e3fe4228-4a8b-49a6-87c1-95c919e5160a {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:20.761082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-590662ad-adfc-46c7-8bb3-cb1703dcffb4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action" status: 202 len: 0 microversion: 2.1 time: 0.244207 Sep 27 02:05:20.765009 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3059/6075] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:05:20 2022] POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:05:20.772258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:20.772909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:20.784591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.785185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.785661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.788815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.789516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.790129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.958737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:20.961567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:20.970096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.970883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.971616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:20.972889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:20.973656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:20.974366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:21.059169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:21.068110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dfb89c25-42e3-4a8c-8ca6-6e9da94322aa tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1510 microversion: 2.1 time: 0.301443 Sep 27 02:05:21.075225 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3017/6076] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:20 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:21.326253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:21.340061 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a37a2d8-07c5-46bd-852e-cccd24dbba08 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.386067 Sep 27 02:05:21.341500 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3060/6077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:20 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:22.105301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:22.106470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:22.116601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.117091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.124050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.126758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.127362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.127913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.376597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:22.378831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:22.404949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.405935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.407058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.408065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.408788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.409476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.563050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:22.572507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e6c0e84-744c-4456-b5fb-649cd8482150 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1493 microversion: 2.1 time: 0.475742 Sep 27 02:05:22.574775 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3018/6078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:22 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1493 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:22.604186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:22.610167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:22.627135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.627630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.630816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.631807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.632465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.633754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.799963 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-43b770ae-1eaa-4a7b-a7aa-2f2e4480d9c8 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action" status: 202 len: 0 microversion: 2.1 time: 0.199156 Sep 27 02:05:22.803781 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3019/6079] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:05:22 2022] POST /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:05:22.821844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:22.822720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:22.844245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.847804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.848264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.851232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:22.851727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:22.852169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:22.940079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:22.978286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:23.041867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:23.053034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8cb7eee-5bdf-4af9-9343-20f31785d388 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.684052 Sep 27 02:05:23.055878 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3061/6080] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:22 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:23.443154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:23.452920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7dc220e9-e6b6-46a7-a74b-d801b427ad62 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1499 microversion: 2.1 time: 0.640650 Sep 27 02:05:23.473638 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3020/6081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:22 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1499 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:24.079624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:24.080977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:24.094951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:24.117046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:24.117647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:24.118097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:24.119152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:24.121271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:24.121745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:24.477932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:24.478556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:24.499213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:24.499727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:24.500192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:24.500912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:24.501406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:24.502062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:24.620969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:24.633410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce88f43e-0337-4ebe-bbbb-2cc2c69f2013 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.558668 Sep 27 02:05:24.635344 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3062/6082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:24 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:24.746188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:24.772804 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d70b3549-73c8-47e0-8912-085dcf8107ee tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1499 microversion: 2.1 time: 0.295920 Sep 27 02:05:24.774330 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3021/6083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:24 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1499 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:25.658000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:25.658776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:25.671850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:25.674446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:25.675011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:25.676818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:25.676818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:25.676818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:25.797642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:25.798418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:25.812661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:25.815132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:25.817300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:25.818396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:25.821860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:25.823176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:26.048926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:26.059141 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ce7a57a-22bb-4908-8285-f185d2620174 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.404953 Sep 27 02:05:26.073759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3063/6084] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:25 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:26.457665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:26.475270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c390bc5-0d0f-4699-bb45-a9c577623434 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1502 microversion: 2.1 time: 0.681946 Sep 27 02:05:26.476147 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3022/6085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:25 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1502 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:26.505393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:26.506305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:26.520494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:26.521471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:26.522479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:26.523440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:26.524123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:26.524811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:26.582752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:05:26.616414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:26.750837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:26.808810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-174780ea-c90a-4be3-9e13-7efbe8eef1fe tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 204 len: 0 microversion: 2.1 time: 0.306957 Sep 27 02:05:26.809837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3064/6086] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:05:26 2022] DELETE /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:05:26.818062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:26.819920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:26.832116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:26.836114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:26.837085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:26.838131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:26.839892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:26.842319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:27.083508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:27.084695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:27.101439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:27.101934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:27.102371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:27.103080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:27.103878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:27.104000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:27.255226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:27.265524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-340db2ad-1633-48c0-ae87-d40534cfb3d4 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1508 microversion: 2.1 time: 0.451256 Sep 27 02:05:27.275442 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3023/6087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:26 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:27.588511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:27.611607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fe64208-237b-4d1f-8dbd-d34c8e4e7788 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.530184 Sep 27 02:05:27.612325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3065/6088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:27 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:28.157638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994d61de-667b-4f67-a4ac-8827b98bae31", "name": "network-vif-plugged", "status": "completed", "tag": "b5a47c97-a6f3-4adf-bbdd-1ad11276d18b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:28.179225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:28.181928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:28.182697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:28.212989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] Creating event network-vif-plugged:b5a47c97-a6f3-4adf-bbdd-1ad11276d18b for instance 994d61de-667b-4f67-a4ac-8827b98bae31 on n-h2-859358-1 Sep 27 02:05:28.223853 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0f276596-1605-4782-aa11-29ca231d9310 req-6b92de15-4d4d-405b-a10a-4e0d978a8d3d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071233 Sep 27 02:05:28.225484 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3024/6089] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:28.300503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:28.301425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:28.316838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:28.319924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:28.320692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:28.321723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:28.324148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:28.325027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:28.637938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:28.638669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:28.640998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:28.655429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:28.656548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:28.657182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:28.658798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:28.659627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:28.660532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:29.064063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:29.077657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6bcb0755-da40-4050-9fce-17854719325a tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1508 microversion: 2.1 time: 0.780213 Sep 27 02:05:29.082901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:29.097052 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3066/6090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:28 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1508 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:29.104957 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83f3e749-9fff-4025-bfad-4f630320b4f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.472076 Sep 27 02:05:29.118302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3025/6091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:28 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:29.367250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d41e682-e8d0-4bd8-80b3-4798efa6b5b4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: .version_select at 0x7f24d548c1f0>, body: {"keypair": {"name": "tempest-keypair-1027004928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfXj4e8NfrPViozVDnN+wAS3RDAAWezIb2NuhUMVC8Lyz/PbUfM+WYS4/eIEpoBl2BgJorhqEjoF5PhuIRvYC2iyE5u7cg2dBCZxeHJB1blUCr+ArvB3F71YFCtqJ5agw=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:29.417911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1d41e682-e8d0-4bd8-80b3-4798efa6b5b4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:29.435759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1d41e682-e8d0-4bd8-80b3-4798efa6b5b4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:29.497151 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d41e682-e8d0-4bd8-80b3-4798efa6b5b4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134582 Sep 27 02:05:29.497821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3067/6092] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:05:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:30.106007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:30.107153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:30.117276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:30.125919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:30.131919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:30.132475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:30.133184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:30.133323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:30.134013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:30.134639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:30.148947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:30.149819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:30.150508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:30.164713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:30.166997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:30.185130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:30.186005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:30.402031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a747159dd348b68b65af317ed11864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b8b778d34146aa0b4a1d63c7c8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:30.416070 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b89205ce-8a15-4d58-bc01-f6057ac621c6 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 200 len: 1466 microversion: 2.1 time: 0.311986 Sep 27 02:05:30.416872 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3026/6093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:30 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 1466 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:30.521264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fe4228-4a8b-49a6-87c1-95c919e5160a", "name": "network-vif-deleted", "tag": "4d6c5ede-9d77-4933-8aed-68988324644a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:30.539089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:30.542731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:30.546217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:30.569281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] Creating event network-vif-deleted:4d6c5ede-9d77-4933-8aed-68988324644a for instance e3fe4228-4a8b-49a6-87c1-95c919e5160a on n-h1-859358-1 Sep 27 02:05:30.583287 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-eed6a340-d7a7-48a8-bdb1-f019d099baab req-cf2d2047-2d9c-4129-ab6d-80489278113f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065721 Sep 27 02:05:30.586509 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3027/6094] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 27 02:05:30.602740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:30.618095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5952cb98-2caf-4098-8e19-7184e474a2c1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1373 microversion: 2.1 time: 0.491092 Sep 27 02:05:30.622053 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3068/6095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:30 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1373 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:31.445162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:31.446341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] [instance: e3fe4228-4a8b-49a6-87c1-95c919e5160a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:31.468616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:31.472758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:31.474298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:31.477019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:31.477858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:31.480035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:31.525532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] HTTP exception thrown: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Request method failure captured: Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a HTTP/1.1 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlo-3BbY3gSXp10q5jnwfGx_3_ghU8y4z5RejzPA7LH85DSbYXPJugk7ZEDVYT2I27iVo8f_bUT4gaJHYlhOzRT9F12j81uOB5BLaU1RVaIIF1j8rzN9dacCjNO3i0HnqA9W6ml3hQdj9YzXuk2OwsWWjBtKen3-tqoKPzPAYni7iCc Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: ab33b8b778d34146aa0b4a1d63c7c8dc Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestServerAdvancedOps-1840607732 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab33b8b778d34146aa0b4a1d63c7c8dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ab33b8b778d34146aa0b4a1d63c7c8dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab33b8b778d34146aa0b4a1d63c7c8dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ab33b8b778d34146aa0b4a1d63c7c8dc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestServerAdvancedOps-1840607732 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: ab33b8b778d34146aa0b4a1d63c7c8dc Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestServerAdvancedOps-1840607732 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestServerAdvancedOps-1840607732-project Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 02a747159dd348b68b65af317ed11864 Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestServerAdvancedOps-1840607732-project Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'e3fe4228-4a8b-49a6-87c1-95c919e5160a'} Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:31.533623 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. Sep 27 02:05:31.541802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:31.544410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] Returning 404 to user: Instance e3fe4228-4a8b-49a6-87c1-95c919e5160a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:05:31.546110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d62f450-84ae-457f-b302-ec4fa5cbddc1 tempest-TestServerAdvancedOps-1840607732 tempest-TestServerAdvancedOps-1840607732-project] 10.222.0.52 "GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a" status: 404 len: 111 microversion: 2.1 time: 0.109770 Sep 27 02:05:31.549517 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3028/6096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:31 2022] GET /compute/v2.1/servers/e3fe4228-4a8b-49a6-87c1-95c919e5160a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:05:31.646434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:31.648213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:31.662814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:31.674208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:31.674665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:31.675634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:31.676266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:31.676860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:32.014104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:32.030422 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a4468fb-756f-4293-8cd2-176f2b1dc429 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1544 microversion: 2.1 time: 0.389213 Sep 27 02:05:32.034072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3069/6097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:31 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1544 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:32.062591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:32.063613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:32.070072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:32.070896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:32.071594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:32.072552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:32.073247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:32.073977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:32.354165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:32.372649 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aadde3c1-f1f2-406c-830e-9a4eb9fff27d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1544 microversion: 2.1 time: 0.315567 Sep 27 02:05:32.387099 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3029/6098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:32 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1544 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:32.575405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-573799166", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63819575-c2e2-431a-81ef-d6223fc06634"}], "security_groups": [{"name": "tempest-securitygroup--560098775"}], "key_name": "tempest-keypair-1027004928", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:32.948890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] validate_networks() for [('63819575-c2e2-431a-81ef-d6223fc06634', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:05:33.161463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38a3feb0-5d7c-4050-8505-72007967d3f3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Action: 'create', calling method: .version_select at 0x7f24d5be25e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-985313061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1WfPoRSQxtc03Su3ZFkbAizFBt9wfN/KBPCm5vMZ74LrhgqIANljCSIGHmRXspZk28WMPec784tLVoDewgWlu5xErXq2q3t2BbrjVKTf346xYKpH1oTge6iiRp81E5Ew=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:33.203438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-38a3feb0-5d7c-4050-8505-72007967d3f3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for project e300ecd9998a49f3951f954295121621. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:33.219044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-38a3feb0-5d7c-4050-8505-72007967d3f3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for user ee2c3780d3ce4664b69977261002fb2e and project e300ecd9998a49f3951f954295121621. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:33.258083 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38a3feb0-5d7c-4050-8505-72007967d3f3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.554866 Sep 27 02:05:33.258911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3030/6099] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:05:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:33.267342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:33.270430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:33.282305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.283709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.284777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.287879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.289820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.290805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.357524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-279b6939-e43f-4322-a607-1614b51e7c37 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097570 Sep 27 02:05:33.365741 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3031/6100] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:05:33 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:05:33.572455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:33.575890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:33.590586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.591361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.592046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.593166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.593863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.594517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.672253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7ee4c6b4-d1e1-4f25-9ca1-9887dced9ee9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109946 Sep 27 02:05:33.680819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3032/6101] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:05:33 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:05:33.794187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:33.794911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:33.802915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.803659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.804260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.805907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:33.806542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:33.807139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:33.863495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:05:34.020288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:05:34.020883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:05:34.021291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:05:34.021955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:05:34.022786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:05:34.041468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:34.042510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:34.043333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:34.044287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:34.044931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:34.045591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:34.072211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8190ba98-ce5d-4a7f-826e-7099f4b81c70 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 204 len: 0 microversion: 2.1 time: 0.282482 Sep 27 02:05:34.072891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3033/6102] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:05:33 2022] DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:05:34.087672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:34.090904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:34.091572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:34.097485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:34.104110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:34.104614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:34.105055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:34.105807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:34.106263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:34.110907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:34.112108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:05:34.114647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:05:34.192470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-95c6e10d-7dd8-4348-b32f-057b98bd1459 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.621953 Sep 27 02:05:34.195411 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3070/6103] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:05:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:05:34.205585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ed592c27-ac42-4ed5-974f-b0ab0bc35eb3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:34.206200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ed592c27-ac42-4ed5-974f-b0ab0bc35eb3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:34.338862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ed592c27-ac42-4ed5-974f-b0ab0bc35eb3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:34.349295 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ed592c27-ac42-4ed5-974f-b0ab0bc35eb3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1241 microversion: 2.1 time: 0.147695 Sep 27 02:05:34.354464 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3071/6104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:34 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:05:35.084890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:35.097211 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aff7ead0-21be-4df9-9a2b-09c98a4d998a tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1671 microversion: 2.1 time: 1.018159 Sep 27 02:05:35.099030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3034/6105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:34 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1671 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:35.376217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:35.376999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:35.429223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:35.433777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:35.436000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:35.437458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:35.441027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:35.445607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:35.642077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:35.662093 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7791fba-5a06-4165-b1eb-69d1832571ae tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1293 microversion: 2.1 time: 0.290086 Sep 27 02:05:35.663418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3072/6106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:35 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:36.124033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:36.125201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:36.133884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:36.136207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:36.136807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:36.137551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:36.138149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:36.138718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:36.686090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:36.687227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:36.702683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:36.702683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:36.702683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:36.703049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:36.703515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:36.704001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:36.986440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:36.999116 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e38b36e5-73e6-4f24-8e99-bc8f7eff22bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1299 microversion: 2.1 time: 0.316229 Sep 27 02:05:37.000985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3073/6107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:36 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:37.052952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:37.072204 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa81d7a0-b643-405d-a369-428702c722d2 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1671 microversion: 2.1 time: 0.951272 Sep 27 02:05:37.073486 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3035/6108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:36 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1671 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:38.023913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:38.025239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:38.040220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:38.040965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:38.041579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:38.045257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:38.046093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:38.046884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:38.098229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:38.099155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:38.119749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:38.123404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:38.124574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:38.127639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:38.135030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:38.136766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:38.261595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:38.282907 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fc5916d-8576-4746-9c97-7fa8f22cf7f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1299 microversion: 2.1 time: 0.263664 Sep 27 02:05:38.297367 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3074/6109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:38 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:38.822468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994d61de-667b-4f67-a4ac-8827b98bae31", "tag": "b5a47c97-a6f3-4adf-bbdd-1ad11276d18b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:38.854680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:38.855162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:38.855597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:38.900229 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] Creating event network-changed:b5a47c97-a6f3-4adf-bbdd-1ad11276d18b for instance 994d61de-667b-4f67-a4ac-8827b98bae31 on n-h2-859358-1 Sep 27 02:05:38.910484 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1b9e7461-caf0-4689-b3b2-30b8b2099259 req-2f94cc74-8a0f-4be8-be82-3ec8e44b222a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092343 Sep 27 02:05:38.914363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3075/6110] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:39.307467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:39.311093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:39.323694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:39.324188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:39.324626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:39.325362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:39.325825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:39.326244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:39.443210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:39.454258 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f66cc793-6481-4a58-9c25-8912596c7a11 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1671 microversion: 2.1 time: 1.361384 Sep 27 02:05:39.459790 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3036/6111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:38 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1671 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:40.050267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:40.063278 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce3a40d2-7dea-4e2e-bb99-c5f8e1a7eba4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.760097 Sep 27 02:05:40.081069 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3076/6112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:39 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:40.485405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:40.486141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:40.497123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:40.500771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:40.510091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:40.518209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:40.518807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:40.519327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:40.611711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:40.612450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:40.617746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:40.618521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lazy-loading 'fault' on Instance uuid 89a10b68-2026-45f4-8a92-b9cb02ffba01 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:05:40.903620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67774f0eba764daaac0a50d3d6082a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e74e9a2b3d476c98bac6781bac6411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:40.914946 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-085a72c1-390c-44d4-8c0e-13c65f0febf9 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 200 len: 1326 microversion: 2.1 time: 0.433451 Sep 27 02:05:40.932827 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3037/6113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:40 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 1326 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:41.030491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a10b68-2026-45f4-8a92-b9cb02ffba01", "name": "network-vif-deleted", "tag": "eebda79b-5b29-4487-9862-fe4c8d83f116"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:41.061089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:41.061811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:41.062540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:41.091005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:41.092108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:41.100249 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] Creating event network-vif-deleted:eebda79b-5b29-4487-9862-fe4c8d83f116 for instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 on n-h2-859358-1 Sep 27 02:05:41.106590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:41.107219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:41.107771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:41.112257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:41.122303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:41.124305 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b4501b5c-17a7-40b1-86c3-0c054928b067 req-7d1be851-a110-44d3-a163-7b3d251c814d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101288 Sep 27 02:05:41.124838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:41.132618 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3077/6114] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:41.950670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:41.951575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:41.959699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:41.960538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:41.961187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:41.962205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:41.962876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:41.963516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:42.002715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 HTTP/1.1 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '89a10b68-2026-45f4-8a92-b9cb02ffba01'} Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:42.004774 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:42.007981 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:42.010292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:05:42.011424 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-758dcb18-529b-4487-9d68-4b2a6eee2359 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 404 len: 111 microversion: 2.1 time: 0.069065 Sep 27 02:05:42.012561 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3078/6115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:41 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:05:42.032000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5ec6f4d-3aff-4081-a387-10de5081b43b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '.version_select at 0x7f24d4f3ec10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:42.081006 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5ec6f4d-3aff-4081-a387-10de5081b43b tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838029343" status: 202 len: 0 microversion: 2.1 time: 0.063981 Sep 27 02:05:42.084588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3079/6116] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 02:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838029343 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:05:42.721696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:42.733195 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f36e4b5c-a62f-4350-94a5-4f490aa2f6fc tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 1.646457 Sep 27 02:05:42.748699 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3038/6117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:41 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:43.768796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:43.769381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:43.804172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:43.805019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:43.805721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:43.806674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:43.807334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:43.807984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:44.068893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:44.282469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:44.295679 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9414de8a-1d7b-4ecd-b14f-6ea6fcc2e2fa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.528636 Sep 27 02:05:44.301543 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3080/6118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:43 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:44.376773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a133c259-48ad-49a2-8ebe-62a569ffcb60", "tag": "39250d2d-ebca-4cf8-b81c-1c1571c8be7e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:44.389249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:44.416814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:44.417708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:44.418316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:44.440307 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] Creating event network-changed:39250d2d-ebca-4cf8-b81c-1c1571c8be7e for instance a133c259-48ad-49a2-8ebe-62a569ffcb60 on n-h1-859358-1 Sep 27 02:05:44.452547 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-78553fe5-d081-4af4-be51-8e0590bd4144 req-f19eb054-7bae-4e56-b708-371c9fd91d1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082517 Sep 27 02:05:44.453668 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3039/6119] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:45.330782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:45.332119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:45.335089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:45.343863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:45.346629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:45.347479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:45.348445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:45.351416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:45.352161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:46.082829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:46.091424 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5790dc3d-3f34-4864-a4b8-b89f913efd18 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.767376 Sep 27 02:05:46.106574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3081/6120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:45 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:46.936259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1653345711-access_point-1915545141", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "1ebb965e-026c-4ea9-bc9f-82160c90173e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-985313061", "security_groups": [{"name": "tempest-secgroup_access--411577446"}, {"name": "tempest-secgroup_general--1841519997"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:47.119838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:47.120472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:47.138846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:47.140732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:47.143219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:47.144840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:47.145744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:47.148093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:47.419985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] validate_networks() for [('1ebb965e-026c-4ea9-bc9f-82160c90173e', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:05:47.777900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:47.793641 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92df2c47-913f-46e9-96bf-85cd415f43f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.678401 Sep 27 02:05:47.812675 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3082/6121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:47 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:48.275373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:05:48.276443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:05:48.277095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:05:48.277960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:05:48.278554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:05:48.289490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:48.290212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:48.290853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:48.291794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:48.292477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:48.293101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:48.314510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for project e300ecd9998a49f3951f954295121621. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:05:48.322890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for user ee2c3780d3ce4664b69977261002fb2e and project e300ecd9998a49f3951f954295121621. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:05:48.337545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:05:48.340201 n-d-859358-1 devstack@n-api.service[128778]: WARNING nova.utils [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1653345711-access_point-1915545141 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1653345711-ac Sep 27 02:05:48.341296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:05:48.429129 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d68a01a6-becd-49b9-a665-4e7fdb0287c2 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.498311 Sep 27 02:05:48.430030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3040/6122] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:05:46 2022] POST /compute/v2.1/servers => generated 457 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:05:48.441046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcd4351e-7a53-41ae-9744-ab06eb5a610e tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:48.441703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcd4351e-7a53-41ae-9744-ab06eb5a610e tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:48.661137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcd4351e-7a53-41ae-9744-ab06eb5a610e tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:48.668910 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcd4351e-7a53-41ae-9744-ab06eb5a610e tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1294 microversion: 2.1 time: 0.231591 Sep 27 02:05:48.672028 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3083/6123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:48 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1294 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:48.818857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:48.819490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:48.835764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:48.836310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:48.839438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:48.840199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:48.840673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:48.841097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:49.148331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:49.160916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f4d1d60-f0f6-4172-97c0-d1d12a72692a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.345582 Sep 27 02:05:49.181234 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3041/6124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:48 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:49.693043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:49.693867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:49.708092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:49.708831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:49.709480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:49.710470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:49.711232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:49.711803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:49.789814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:49.811830 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1a8a1242-5fb7-4066-855d-4768936e62a4 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1290 microversion: 2.1 time: 0.121710 Sep 27 02:05:49.835857 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3084/6125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:49 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:50.185866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:50.186644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:50.289654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:50.296016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:50.297856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:50.313994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:50.313994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:50.313994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:50.548858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:50.570115 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-26c32302-f6a2-4744-a1a3-5bf613f8305a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.389898 Sep 27 02:05:50.573992 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3042/6126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:50 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:50.843839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:50.844860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:50.861040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:50.861603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:50.866008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:50.882598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:50.883101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:50.883555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:51.085707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:51.099164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd8b8c6a-dda2-4b27-baa4-fa4a6a0629be tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1354 microversion: 2.1 time: 0.261792 Sep 27 02:05:51.103642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3085/6127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:50 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1354 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:51.601438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:51.602615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:51.615723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:51.616410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:51.616643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:51.621163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:51.622568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:51.623035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:51.981846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:51.990598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6766314f-ba97-415c-874d-ec5cd733c28c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.393728 Sep 27 02:05:51.995918 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3043/6128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:51 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:52.127734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:52.128862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:52.146875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:52.148945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:52.149918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:52.154083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:52.154783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:52.155402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:52.415326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:52.418007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:52.427895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cb5b36b-2dd6-4c67-8556-508cef6897bb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1352 microversion: 2.1 time: 0.305568 Sep 27 02:05:52.443865 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3086/6129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:52 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1352 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:52.834838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a133c259-48ad-49a2-8ebe-62a569ffcb60", "name": "network-vif-plugged", "status": "completed", "tag": "39250d2d-ebca-4cf8-b81c-1c1571c8be7e"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:52.866859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:52.867848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:52.869321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:52.901834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] Creating event network-vif-plugged:39250d2d-ebca-4cf8-b81c-1c1571c8be7e for instance a133c259-48ad-49a2-8ebe-62a569ffcb60 on n-h1-859358-1 Sep 27 02:05:52.916666 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-effb6324-054e-45ff-845e-aa3a10409be9 req-55face54-a6f6-4f33-a003-c3fa712b5092 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083844 Sep 27 02:05:52.919662 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3044/6130] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:53.023674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:53.024535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:53.045161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:53.046631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:53.048392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:53.049359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:53.050466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:53.052908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:53.307489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:53.316128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65ddb7a5-8e3f-4bf2-bf91-ec9d65e19e13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1366 microversion: 2.1 time: 0.300132 Sep 27 02:05:53.321379 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3087/6131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:53 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:53.470111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:53.471010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:53.479593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:53.480804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:53.481445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:53.483589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:53.484211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:53.485369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:53.514017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:53.952473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:53.962999 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53bf4fe0-fb6f-4111-b355-4602742056eb tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.497123 Sep 27 02:05:53.991120 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3045/6132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:53 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:54.342459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:54.343887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:54.357097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:54.359648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec062662-9fcd-4175-803e-3c2299a33e2a", "tag": "b8943f97-0a0b-4482-8b6b-eb62050e028a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:54.361274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:54.362585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:54.365256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:54.366590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:54.367228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:54.377125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:54.377885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:54.378534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:54.405655 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] Creating event network-changed:b8943f97-0a0b-4482-8b6b-eb62050e028a for instance ec062662-9fcd-4175-803e-3c2299a33e2a on n-h2-859358-1 Sep 27 02:05:54.420011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-59314b36-d104-4aef-9d83-ab13e86277c6 req-38ae0b95-82ae-4c33-a0b0-bce7f2d49c2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064153 Sep 27 02:05:54.421263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3046/6133] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:54.697111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:54.707375 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ec4279c-3b32-4b37-bddf-21ceea3d4b96 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1555 microversion: 2.1 time: 0.367926 Sep 27 02:05:54.709811 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3088/6134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:54 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1555 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:54.735244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:54.736700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:54.795257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:54.798690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:54.801075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:54.807943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:54.810977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:54.811635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:54.981424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a9b2f44-a5dc-4496-aad7-85527d779718 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251527 Sep 27 02:05:54.982098 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3047/6135] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:05:54 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:05:54.996748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:54.997398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:55.004335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.005095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.005452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.006163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.006729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.007155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.264367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:55.272888 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-201f4fb5-54e2-4a2b-a8eb-5a3680415bef tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.280996 Sep 27 02:05:55.273865 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3089/6136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:54 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:55.792854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:55.797767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:55.804277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.804976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.805615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.806469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.807092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.807665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.824758 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 HTTP/1.1 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '89a10b68-2026-45f4-8a92-b9cb02ffba01'} Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:05:55.826727 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.830630 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.831987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:05:55.833684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d160ca43-629d-4531-a6b0-f9cc89b30d58 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 404 len: 111 microversion: 2.1 time: 0.044221 Sep 27 02:05:55.834807 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3048/6137] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:05:55 2022] DELETE /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:05:55.842991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:55.843624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: 89a10b68-2026-45f4-8a92-b9cb02ffba01] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:55.851179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.851661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.852435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.853557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:55.854250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:55.854836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:55.870003 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 HTTP/1.1 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '89a10b68-2026-45f4-8a92-b9cb02ffba01'} Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.871888 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. Sep 27 02:05:55.875400 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:05:55.877067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance 89a10b68-2026-45f4-8a92-b9cb02ffba01 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:05:55.879253 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-347aae39-976a-44e8-86f7-39c0e0b61344 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01" status: 404 len: 111 microversion: 2.1 time: 0.040518 Sep 27 02:05:55.880540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3090/6138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:55 2022] GET /compute/v2.1/servers/89a10b68-2026-45f4-8a92-b9cb02ffba01 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:05:56.297531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:56.298150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:56.308249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:56.316160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:56.317004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:56.318347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:56.319040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:56.319674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:56.850743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:56.859664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-09a383e4-d391-414f-90ad-35292d9f6fb7 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.566649 Sep 27 02:05:56.865544 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3049/6139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:56 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:57.353839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a133c259-48ad-49a2-8ebe-62a569ffcb60", "tag": "39250d2d-ebca-4cf8-b81c-1c1571c8be7e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:05:57.363789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:57.376613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:57.378127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:57.381004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:57.412109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] Creating event network-changed:39250d2d-ebca-4cf8-b81c-1c1571c8be7e for instance a133c259-48ad-49a2-8ebe-62a569ffcb60 on n-h1-859358-1 Sep 27 02:05:57.432734 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a53a2811-40ab-4912-8f11-d5a97eacad72 req-3b4fe224-8f7a-483e-a490-5b3161736069 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082338 Sep 27 02:05:57.433440 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3091/6140] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:05:57.892717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:57.893362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:57.915020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:57.915523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:57.915958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:57.916687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:57.917139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:57.917593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:58.306516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:58.331469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:58.379885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:58.394157 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efa08548-3692-4e44-b3ac-cbb344b82a4c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.505697 Sep 27 02:05:58.395576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3050/6141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:57 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:05:59.423840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:05:59.425109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:05:59.430822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:05:59.478803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:59.479652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:59.480255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:59.481463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:05:59.482092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:05:59.492448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:05:59.731287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:05:59.745284 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4ffced4-bb1b-40a1-9642-ecb130d384c8 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.326570 Sep 27 02:05:59.746570 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3092/6142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:05:59 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:00.337393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:00.338452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:00.352165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:00.355043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.355603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.357518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:00.358322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.359320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.359917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:00.382918 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 HTTP/1.1 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ab6420aa-6f9e-4be5-8398-0f23c2d02bb6'} Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:00.384596 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:00.387693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac19d10c-ca59-44af-9b52-9d2f388ca190 tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 404 len: 111 microversion: 2.1 time: 0.054432 Sep 27 02:06:00.388834 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3051/6143] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:06:00 2022] DELETE /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:06:00.396780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:00.397508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] [instance: ab6420aa-6f9e-4be5-8398-0f23c2d02bb6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:00.405818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.406329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.406831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:00.408162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.408633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.409233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:00.426176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] HTTP exception thrown: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Request method failure captured: Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 HTTP/1.1 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMljTpZcs3pa_1WnL4xicmqt9IzkwKzzMy6sHvKzFep4-fJ6v1oz-HSEYXMQviyPsuN6PeYRjCHWs225OPOkft5viveHmshVsXPmaspf35ksTw5WMQ4KNW84-ojgo6D7skc6DJdnit1De0nJuL7CQVQTafL7R_KyXmEwCH--gO51L4HI Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e74e9a2b3d476c98bac6781bac6411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e74e9a2b3d476c98bac6781bac6411", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c4e74e9a2b3d476c98bac6781bac6411 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeTestJSON-548449355 Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 67774f0eba764daaac0a50d3d6082a2a Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeTestJSON-548449355-project Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ab6420aa-6f9e-4be5-8398-0f23c2d02bb6'} Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.427949 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] Returning 404 to user: Instance ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ac1e8b5-2542-41c2-bc59-fcd140bf923d tempest-AttachVolumeTestJSON-548449355 tempest-AttachVolumeTestJSON-548449355-project] 10.222.0.52 "GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6" status: 404 len: 111 microversion: 2.1 time: 0.037657 Sep 27 02:06:00.432304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3093/6144] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:00 2022] GET /compute/v2.1/servers/ab6420aa-6f9e-4be5-8398-0f23c2d02bb6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:06:00.771082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:00.771720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:00.778262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.778967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.779562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:00.780435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:00.781075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:00.781690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:01.086499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:01.098225 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97f86baa-6a0e-448a-8012-5bf3dfd9cab9 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.332813 Sep 27 02:06:01.113454 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3052/6145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:00 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:02.018332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec062662-9fcd-4175-803e-3c2299a33e2a", "name": "network-vif-plugged", "status": "completed", "tag": "b8943f97-0a0b-4482-8b6b-eb62050e028a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:02.037972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:02.038758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:02.039582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:02.056943 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] Creating event network-vif-plugged:b8943f97-0a0b-4482-8b6b-eb62050e028a for instance ec062662-9fcd-4175-803e-3c2299a33e2a on n-h2-859358-1 Sep 27 02:06:02.064164 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-84bf0142-b080-43ce-ab2c-909ff0300fbc req-d75682d5-4111-487f-b0e4-8c23f6869ad5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052652 Sep 27 02:06:02.065279 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3094/6146] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:02.125978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:02.127240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:02.141257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:02.149103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:02.149567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:02.150328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:02.150852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:02.151343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:02.883889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:02.895476 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9441ef83-664c-40e6-8f44-9fff0404975a tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.776484 Sep 27 02:06:02.910485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3053/6147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:02 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:03.920924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:03.921618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:03.932364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:03.932866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:03.933313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:03.934053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:03.934517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:03.934958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:04.184580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:04.205182 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03d7cc26-fd40-4e8d-9959-9d6825eeab3b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1471 microversion: 2.1 time: 0.287943 Sep 27 02:06:04.210010 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3095/6148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:03 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:05.235740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:05.236364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:05.246011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.246907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.247637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:05.248572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.249226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.250347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:05.557129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:05.569122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac7b66e8-99f8-4ef3-948b-cdee6c65f558 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1642 microversion: 2.1 time: 0.336787 Sep 27 02:06:05.581653 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3054/6149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:05 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1642 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:05.599059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:05.599590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:05.620786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.621492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.622078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:05.623132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.623929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.624619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:05.898958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:05.918160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4d07a01-8057-439e-b349-97bcbafe34e1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1642 microversion: 2.1 time: 0.325957 Sep 27 02:06:05.918830 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3096/6150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:05 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1642 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:05.947965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:05.948868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:05.956377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.957219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.958168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:05.959951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:05.961010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:05.964639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:06.547681 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bfec6ed1-ef6b-4b71-a4bd-bdb55b34517c tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1793 microversion: 2.1 time: 0.606460 Sep 27 02:06:06.563418 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3055/6151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:05 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1793 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:07.043019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:07.049316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:07.060003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:07.060574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:07.061256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:07.074873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:07.075976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:07.077950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:07.173898 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7c83d65-3d02-4009-b3ea-8482c442f189 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31/action" status: 200 len: 24520 microversion: 2.1 time: 0.135036 Sep 27 02:06:07.179877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3097/6152] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:06:07 2022] POST /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31/action => generated 24520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:06:08.963955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec062662-9fcd-4175-803e-3c2299a33e2a", "tag": "b8943f97-0a0b-4482-8b6b-eb62050e028a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:08.983770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:08.991727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:08.992377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:09.058683 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] Creating event network-changed:b8943f97-0a0b-4482-8b6b-eb62050e028a for instance ec062662-9fcd-4175-803e-3c2299a33e2a on n-h2-859358-1 Sep 27 02:06:09.072113 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1e62fea0-a55f-45a1-ab15-00c738cd169f req-eed37801-01af-4b41-897a-0236dc99d9b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111682 Sep 27 02:06:09.074243 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3056/6153] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:09.838273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85006d98-9030-41b1-ab28-a0c3bb839185 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d65c5e50>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:09.949531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85006d98-9030-41b1-ab28-a0c3bb839185 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/807ea972-9620-411d-bc67-c543d13e93d8" status: 200 len: 351 microversion: 2.1 time: 0.115710 Sep 27 02:06:09.950109 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3098/6154] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 02:06:09 2022] GET /compute/v2.1/os-volumes/807ea972-9620-411d-bc67-c543d13e93d8 => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:12.679531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2292bf95-fd75-4adb-aa71-df83269ad7e2 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d6519040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:12.737876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2292bf95-fd75-4adb-aa71-df83269ad7e2 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/98dc851c-f95f-432c-a6f7-3f6ee088096d" status: 200 len: 350 microversion: 2.1 time: 0.062470 Sep 27 02:06:12.742918 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3057/6155] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 02:06:12 2022] GET /compute/v2.1/os-volumes/98dc851c-f95f-432c-a6f7-3f6ee088096d => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.149888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-837c0be2-139b-4c5e-ac05-f669199b875c tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d69e7820>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.205173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-837c0be2-139b-4c5e-ac05-f669199b875c tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ad8d84cf-ebd2-49e1-a190-5c7742cb1546" status: 200 len: 351 microversion: 2.1 time: 0.060925 Sep 27 02:06:14.206001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3099/6156] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes/ad8d84cf-ebd2-49e1-a190-5c7742cb1546 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.220025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce26c675-3dd5-407a-b57e-40d565a75b22 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d624de50>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.308971 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce26c675-3dd5-407a-b57e-40d565a75b22 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093145 Sep 27 02:06:14.309772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3058/6157] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:06:14.325027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36bb2d81-faeb-4383-9d18-e053484ddb03 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d6dbeaf0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.418334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36bb2d81-faeb-4383-9d18-e053484ddb03 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097578 Sep 27 02:06:14.421418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3100/6158] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.435766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9fd481b-2c6a-44ce-b4ed-7420b2d213f6 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24da544f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.524487 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9fd481b-2c6a-44ce-b4ed-7420b2d213f6 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093416 Sep 27 02:06:14.525064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3059/6159] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:14.538881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3da04aa-1a16-4acb-aebf-c319afe43bc6 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24da54ac10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.628226 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3da04aa-1a16-4acb-aebf-c319afe43bc6 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093454 Sep 27 02:06:14.629733 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3101/6160] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.643235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a27798cf-48d8-4d13-ba33-6e604f1cbb8b tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24da736280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.738978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a27798cf-48d8-4d13-ba33-6e604f1cbb8b tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099513 Sep 27 02:06:14.739764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3060/6161] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.760478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c99bd232-192c-4231-b9c6-4571b8b29725 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d554cf70>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.853526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c99bd232-192c-4231-b9c6-4571b8b29725 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099347 Sep 27 02:06:14.854291 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3102/6162] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:14.869632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efffc98c-5d24-41f7-b6c8-953be723d948 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24d61d2c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:14.963325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efffc98c-5d24-41f7-b6c8-953be723d948 tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097565 Sep 27 02:06:14.963909 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3061/6163] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:14.979464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-42d62d58-dafa-4d1a-8840-ce7f1b540dbd tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] Calling method '.version_select at 0x7f24da540160>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:15.070388 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-42d62d58-dafa-4d1a-8840-ce7f1b540dbd tempest-VolumesTestJSON-1381853010 tempest-VolumesTestJSON-1381853010-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094817 Sep 27 02:06:15.071032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3103/6164] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 02:06:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:24.420885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=11 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:24.422001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=51 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:24.544572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a935669b-2570-48d6-a3ce-1c07f02e14e0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Action: 'create', calling method: .version_select at 0x7f24d6931b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-595958067", "metadata": {"Type": "work"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a935669b-2570-48d6-a3ce-1c07f02e14e0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 121 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-595958067", "metadata": {"Type": "work"}}} Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-595958067', 'metadata': {'Type': 'work'}}}} Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '#$%' Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 02:06:24.567680 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a935669b-2570-48d6-a3ce-1c07f02e14e0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.571820 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a935669b-2570-48d6-a3ce-1c07f02e14e0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.153579 Sep 27 02:06:24.575057 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3062/6165] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 27 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:06:24.584378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59edccab-d19d-45ea-9e95-a506c4e2665b tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Action: 'create', calling method: .version_select at 0x7f24d6dbed30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588546844", "metadata": {"Type": "work"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59edccab-d19d-45ea-9e95-a506c4e2665b tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 120 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1588546844", "metadata": {"Type": "work"}}} Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1588546844', 'metadata': {'Type': 'work'}}}} Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise error Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi '0' Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 02:06:24.593256 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 02:06:24.598461 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.601170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59edccab-d19d-45ea-9e95-a506c4e2665b tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.602203 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59edccab-d19d-45ea-9e95-a506c4e2665b tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024601 Sep 27 02:06:24.602868 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3104/6166] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 27 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:06:24.613575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1fa63d3-6037-4a02-a4b0-a5a3e5279748 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Action: 'create', calling method: .version_select at 0x7f24d624d4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2011878361", "metadata": {"Type": "work"}}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1fa63d3-6037-4a02-a4b0-a5a3e5279748 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 119 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2011878361", "metadata": {"Type": "work"}}} Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2011878361', 'metadata': {'Type': 'work'}}}} Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 02:06:24.618461 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1fa63d3-6037-4a02-a4b0-a5a3e5279748 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1fa63d3-6037-4a02-a4b0-a5a3e5279748 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011827 Sep 27 02:06:24.622961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3063/6167] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Sep 27 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:06:24.628942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=13 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:24.629727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=49 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:24.633726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd272a55-f621-46b2-98c1-e6efa320c591 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Calling method '.version_select at 0x7f24d621c9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:24.675856 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-dd272a55-f621-46b2-98c1-e6efa320c591 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] HTTP exception thrown: Volume tempest-invalid-154789765 could not be found. Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd272a55-f621-46b2-98c1-e6efa320c591 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-154789765 HTTP/1.1 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: exception: Volume tempest-invalid-154789765 could not be found. Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'tempest-invalid-154789765'} Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-154789765 could not be found. (HTTP 404) (Request-ID: req-737fcfea-0343-4907-bb1a-f3dd9021935c) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.677866 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-154789765 could not be found. Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-154789765 could not be found. Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-154789765 could not be found. Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd272a55-f621-46b2-98c1-e6efa320c591 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 404 to user: Volume tempest-invalid-154789765 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd272a55-f621-46b2-98c1-e6efa320c591 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-154789765" status: 404 len: 98 microversion: 2.1 time: 0.053231 Sep 27 02:06:24.681895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3105/6168] 10.222.0.52 () {58 vars in 1215 bytes} [Tue Sep 27 02:06:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-154789765 => generated 98 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 27 02:06:24.689423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-450c0b4e-1737-404d-9124-ef4896d857cb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004124 Sep 27 02:06:24.690289 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3064/6169] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Sep 27 02:06:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 02:06:24.700111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03552db9-5806-4fc2-9722-0085d912c5da tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004337 Sep 27 02:06:24.700695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3106/6170] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Sep 27 02:06:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 02:06:24.711639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db407661-bfed-44a3-8282-1de33cfffcdb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Calling method '.version_select at 0x7f24d55ffdc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:24.750911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-db407661-bfed-44a3-8282-1de33cfffcdb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] HTTP exception thrown: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db407661-bfed-44a3-8282-1de33cfffcdb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/os-volumes/8465f527-4bdd-4a8a-808e-94c257e4fc06 HTTP/1.1 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: method: Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: exception: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8465f527-4bdd-4a8a-808e-94c257e4fc06'} Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. (HTTP 404) (Request-ID: req-76c2b8c5-a2e7-4be5-acf8-dc879edb5ed2) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 02:06:24.753058 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db407661-bfed-44a3-8282-1de33cfffcdb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 404 to user: Volume 8465f527-4bdd-4a8a-808e-94c257e4fc06 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db407661-bfed-44a3-8282-1de33cfffcdb tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8465f527-4bdd-4a8a-808e-94c257e4fc06" status: 404 len: 109 microversion: 2.1 time: 0.049451 Sep 27 02:06:24.757229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3065/6171] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:06:24 2022] DELETE /compute/v2.1/os-volumes/8465f527-4bdd-4a8a-808e-94c257e4fc06 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:06:24.769171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8db117d0-f13c-4533-8d35-7a9258f183a0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Calling method '.version_select at 0x7f24d554cb80>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:24.800705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-8db117d0-f13c-4533-8d35-7a9258f183a0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] HTTP exception thrown: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8db117d0-f13c-4533-8d35-7a9258f183a0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Request method failure captured: Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/os-volumes/e8918048-47cb-4946-af63-10c9077d5e3f HTTP/1.1 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlqgqsILcF-vkJC4F2wI6qbOv2HmxZvQs9meLkbGbu0tT6j3NGaX-WvLBHEV-ltv9Ai14Yqxaan_3OwpF_aAU6j4bli21zMtT6ceSscJ4V5_QYnDtJueGsgduK0JhztmlawXwQ3MIMfvvec1MI3X4MUwOnXeO4oOU4kro1qEUjB5BTE Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c550738f1f5848b9a1d8923523060332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c550738f1f5848b9a1d8923523060332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c550738f1f5848b9a1d8923523060332", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c550738f1f5848b9a1d8923523060332 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesNegativeTest-2057175033 Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: eed8fe0fb01a42ee9c9c0cf2d6a1c3db Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesNegativeTest-2057175033-project Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: method: Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: exception: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'e8918048-47cb-4946-af63-10c9077d5e3f'} Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. (HTTP 404) (Request-ID: req-5f18339f-a8f2-4c5d-8f64-5fcf6c03048b) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 02:06:24.802791 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8db117d0-f13c-4533-8d35-7a9258f183a0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] Returning 404 to user: Volume e8918048-47cb-4946-af63-10c9077d5e3f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8db117d0-f13c-4533-8d35-7a9258f183a0 tempest-VolumesNegativeTest-2057175033 tempest-VolumesNegativeTest-2057175033-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e8918048-47cb-4946-af63-10c9077d5e3f" status: 404 len: 109 microversion: 2.1 time: 0.043825 Sep 27 02:06:24.815026 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3107/6172] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Sep 27 02:06:24 2022] GET /compute/v2.1/os-volumes/e8918048-47cb-4946-af63-10c9077d5e3f => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:06:31.500290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:31.502367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:31.514883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.515464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.515960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.516848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.517313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.517743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.544098 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bbbdf112-5a82-4707-845b-e7c3585ee164 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/ips" status: 200 len: 148 microversion: 2.1 time: 0.050302 Sep 27 02:06:31.544738 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3066/6173] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:06:31 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:31.559406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "534612c4-7bda-476d-b370-74a689967345"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:31.562350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:31.570421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.571215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.572309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.573094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.573652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.574143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.694882 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/os-volume_attachments HTTP/1.1 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 74 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: {"volumeAttachment": {"volumeId": "534612c4-7bda-476d-b370-74a689967345"}} Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'a133c259-48ad-49a2-8ebe-62a569ffcb60', 'body': {'volumeAttachment': {'volumeId': '534612c4-7bda-476d-b370-74a689967345'}}} Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:06:31.696950 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 Sep 27 02:06:31.701938 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:31.703636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 400 to user: Invalid volume: volume 534612c4-7bda-476d-b370-74a689967345 is already attached to instances: 5ad499eb-1909-4b81-98cc-28b82d0d0269 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:31.705013 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3acbb87-3ec9-4b6d-a391-b6b3bd7dea28 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152343 Sep 27 02:06:31.707139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3108/6174] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:06:31 2022] POST /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:06:31.717110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:31.718108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:31.725056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.725614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.726377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.727463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.728175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.728860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.759673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:06:31.897110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61daeced-c265-4d2d-bad0-42b56a2e8566 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 204 len: 0 microversion: 2.1 time: 0.185217 Sep 27 02:06:31.897932 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3067/6175] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:06:31 2022] DELETE /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:06:31.906816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:31.907762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:31.916069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.916872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.917321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:31.918160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:31.918782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:31.919369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:32.240661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:32.240661 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af1de469-c029-4aa6-9fe1-3bec83b37f9c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1679 microversion: 2.1 time: 0.215018 Sep 27 02:06:32.240661 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3109/6176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:31 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:33.156828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:33.174166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:33.174166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:33.174166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:33.175562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:33.176511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:33.177147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:33.177761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:33.467525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:33.479511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-079748f5-bdef-4fbf-b40e-27852709eeed tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1679 microversion: 2.1 time: 0.327010 Sep 27 02:06:33.480640 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3068/6177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:33 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1679 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:34.467807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a133c259-48ad-49a2-8ebe-62a569ffcb60", "name": "network-vif-deleted", "tag": "39250d2d-ebca-4cf8-b81c-1c1571c8be7e"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:34.488943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:34.489466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:34.489905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:34.504987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:34.505855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:34.536455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:34.537198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:34.538342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:34.539609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] Creating event network-vif-deleted:39250d2d-ebca-4cf8-b81c-1c1571c8be7e for instance a133c259-48ad-49a2-8ebe-62a569ffcb60 on n-h1-859358-1 Sep 27 02:06:34.541548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:34.542450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:34.544629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:34.546252 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0ba6bb17-37a5-4ca7-b0db-df7758ca078a req-de699dda-666b-44a0-9264-d1488fb6a0df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083758 Sep 27 02:06:34.547726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3110/6178] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:34.690101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:34.702873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3d55a1b2-fdc5-4fe7-8816-5c859b302e97 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 200 len: 1326 microversion: 2.1 time: 0.200978 Sep 27 02:06:34.708302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3069/6179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:34 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 1326 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:06:35.736262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:35.736984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:35.743780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:35.744382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:35.744801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:35.746197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:35.746658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:35.747079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:35.769722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 HTTP/1.1 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a133c259-48ad-49a2-8ebe-62a569ffcb60'} Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:35.771502 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc554a1f-fad2-4c55-a6e0-3af98693c063 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 404 len: 111 microversion: 2.1 time: 0.044749 Sep 27 02:06:35.775705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3111/6180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:35 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:06:35.783298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31c177aa-6029-4ab1-b995-a6e25273b099 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '.version_select at 0x7f24d5330700>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:35.834145 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31c177aa-6029-4ab1-b995-a6e25273b099 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027004928" status: 202 len: 0 microversion: 2.1 time: 0.055753 Sep 27 02:06:35.835107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3070/6181] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 02:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027004928 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:06:36.944134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:36.945287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:36.963698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:36.964516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:36.965268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:36.967012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:36.967533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:36.968489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:37.108561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lazy-loading 'services' on Instance uuid 5ad499eb-1909-4b81-98cc-28b82d0d0269 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:06:37.199075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5861273c-e475-4c84-a55b-9e8d165ae5bb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments/534612c4-7bda-476d-b370-74a689967345" status: 202 len: 0 microversion: 2.1 time: 0.260801 Sep 27 02:06:37.199852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3112/6182] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:06:36 2022] DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments/534612c4-7bda-476d-b370-74a689967345 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:06:37.209498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:37.213036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:37.220357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:37.222119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:37.222564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:37.223273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:37.223795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:37.224227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:37.263043 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e52c66ac-b422-4c90-bcad-c1db5807d6d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058429 Sep 27 02:06:37.263784 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3071/6183] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:37 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:38.281497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:38.284806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:38.293023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:38.293853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:38.296218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:38.297595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:38.298346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:38.299075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:38.342839 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a173333b-84c4-41a6-8cea-e979b745c5f7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069558 Sep 27 02:06:38.348811 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3113/6184] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:38 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:39.356957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:39.359614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:39.372294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:39.376142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:39.376600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:39.377322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:39.384019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:39.384555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:39.481046 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5399c11-e2f8-424f-8fc4-e74a4b63a95c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124804 Sep 27 02:06:39.481046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3072/6185] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:39 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:40.496064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:40.498322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:40.505599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:40.506061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:40.506502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:40.507697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:40.508426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:40.509074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:40.559459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c66542c4-4316-4537-87ec-7ef9e8624c23 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068318 Sep 27 02:06:40.560417 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3114/6186] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:40 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:41.577135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:41.582168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:41.590681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:41.591470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:41.592317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:41.593255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:41.593947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:41.594722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:41.665429 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3f18c244-c611-4c7f-9d89-8fa262b697cd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094877 Sep 27 02:06:41.667739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3073/6187] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:41 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:42.693361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:42.698760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:42.742344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:42.743407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:42.744887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:42.746196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:42.747017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:42.747991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:42.811368 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1830bdd-8f35-4f3d-9fa2-4126ca5e7e07 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131779 Sep 27 02:06:42.812208 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3115/6188] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:42 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:43.531752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5de5b42d-cd12-4cf0-ba0f-634b58a9f555 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: .version_select at 0x7f24d6139af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-565698893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI52VeYHC4Ubgz+g6fo6DIrTaMyoGvlegruSDq2ft+bgLCLH8XYcw/0EdMmSctyeetWY+KkCMW176iIxB+GStt78OtnQwLGx5yOvlK0PXT0iviWjbfMk9FuKZfv3D0V4tw=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:43.557243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5de5b42d-cd12-4cf0-ba0f-634b58a9f555 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:06:43.567949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5de5b42d-cd12-4cf0-ba0f-634b58a9f555 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:06:43.601895 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5de5b42d-cd12-4cf0-ba0f-634b58a9f555 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.075484 Sep 27 02:06:43.602749 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3074/6189] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:06:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:43.825403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:43.827881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:43.856494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:43.857029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:43.862824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:43.863609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:43.864073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:43.864505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:43.938338 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0ca0596e-e74d-4342-a656-7efd11cf4d0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117904 Sep 27 02:06:43.939023 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3116/6190] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:06:43 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:06:44.047614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:44.048946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:44.061865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:44.062553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:44.063001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:44.065527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:44.065995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:44.066419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:44.120882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:06:44.368298 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ce31c69-bc31-488e-825b-f2d968741831 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 204 len: 0 microversion: 2.1 time: 0.326515 Sep 27 02:06:44.369891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3075/6191] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:06:44 2022] DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:06:44.378064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:44.378696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:44.392499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:44.393052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:44.393501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:44.394389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:44.395017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:44.395605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:44.806167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:44.816887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4e2b1691-b348-4ce4-9b8e-c87a1a22d992 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1678 microversion: 2.1 time: 0.443192 Sep 27 02:06:44.819928 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3117/6192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:44 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1678 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:45.845753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:45.847267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:45.866336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:45.867867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:45.876192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:45.880508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:45.883320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:45.884414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:46.117686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1565006807", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "bf6fdf22-c122-4ea8-b0c8-1c28cb29b2ba"}], "key_name": "tempest-TestNetworkBasicOps-565698893", "security_groups": [{"name": "tempest-secgroup-smoke-751327331"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:46.340184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] validate_networks() for [('bf6fdf22-c122-4ea8-b0c8-1c28cb29b2ba', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:06:46.378969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:46.397935 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0453ed4-2bf1-4636-a382-e2c812618a9e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1678 microversion: 2.1 time: 0.557133 Sep 27 02:06:46.409374 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3076/6193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:45 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1678 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:47.226091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:06:47.226602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:06:47.227103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:06:47.227521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:06:47.227937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:06:47.295918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:47.296433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:47.300262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:47.301595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:47.302709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:47.309911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:47.362584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:06:47.371095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:06:47.389329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:06:47.392776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:06:47.426085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:47.426761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:47.450551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:47.452351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:47.456030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:47.479360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:47.480690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:47.486466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:47.562516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53372ef1-6f10-4ef8-b520-35df25c30fb7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.447313 Sep 27 02:06:47.566493 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3118/6194] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:06:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:06:47.582253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1509dd2-b2b8-4ee7-b9b9-1c8069659ce6 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:47.585582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1509dd2-b2b8-4ee7-b9b9-1c8069659ce6 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:47.741511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1509dd2-b2b8-4ee7-b9b9-1c8069659ce6 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:47.752248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:47.770802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64c47119-ce0c-49e8-8771-25f9f9dc4a71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1611 microversion: 2.1 time: 0.351687 Sep 27 02:06:47.785509 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1509dd2-b2b8-4ee7-b9b9-1c8069659ce6 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1248 microversion: 2.1 time: 0.190759 Sep 27 02:06:47.785509 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3119/6195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:47 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:47.785778 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3077/6196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:47 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1611 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:48.474710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad499eb-1909-4b81-98cc-28b82d0d0269", "name": "network-vif-deleted", "tag": "4bce0eb9-336e-4afc-8dd2-144f56e0955a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:48.508841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:48.509804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:48.510532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:48.558799 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] Creating event network-vif-deleted:4bce0eb9-336e-4afc-8dd2-144f56e0955a for instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 on n-h1-859358-1 Sep 27 02:06:48.578149 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-847111a7-f7e7-4e5e-b0cb-7964247d53a0 req-b94fecbd-46c9-4615-a241-7e902ffc9063 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118454 Sep 27 02:06:48.580146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3120/6197] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:48.811915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:48.813136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:48.813813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:48.818673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:48.852116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:48.852635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:48.853099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:48.863231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:48.865059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:48.865699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:48.868427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:48.868949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:48.873976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:48.875228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:48.875732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:48.876188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:49.008995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:49.011728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:49.012218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:49.012696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lazy-loading 'fault' on Instance uuid 5ad499eb-1909-4b81-98cc-28b82d0d0269 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:06:49.098646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:49.110648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a3d0a6bb-4efb-4809-8128-50ad17210aeb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1244 microversion: 2.1 time: 0.313518 Sep 27 02:06:49.112713 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3078/6198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:48 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1244 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:49.137474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:49.153039 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05f11ae2-0dfa-4c2f-9845-62b9cab3c03a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 200 len: 1329 microversion: 2.1 time: 0.356490 Sep 27 02:06:49.155150 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3121/6199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:48 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 1329 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:50.144608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:50.145241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:50.163574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:50.164088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:50.164527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:50.170568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:50.171086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:50.171517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:50.183324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:50.184488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:50.199785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:50.201617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:50.202442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:50.204306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:50.210915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:50.213209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:50.253595 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 HTTP/1.1 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '5ad499eb-1909-4b81-98cc-28b82d0d0269'} Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:06:50.257850 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:06:50.262388 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:06:50.263947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:06:50.264992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24e8773e-0175-40a0-90f5-701a7b3f3ef7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 404 len: 111 microversion: 2.1 time: 0.088202 Sep 27 02:06:50.268511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3122/6200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:50 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:06:50.279340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c624e56-3cc9-4755-8209-fcbff33812fd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '.version_select at 0x7f24d69e7670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:50.328023 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c624e56-3cc9-4755-8209-fcbff33812fd tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510131669" status: 202 len: 0 microversion: 2.1 time: 0.052296 Sep 27 02:06:50.330027 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3123/6201] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 02:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510131669 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:06:50.435177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:50.452596 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6efeffc-0a2b-4be4-a560-9cd1deeccd9b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1318 microversion: 2.1 time: 0.316808 Sep 27 02:06:50.472468 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3079/6202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:50 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:51.480900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:51.483633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:51.502011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:51.502897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:51.503365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:51.504301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:51.504944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:51.505411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:52.006541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:52.006926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6cbc1703-1a93-4792-a69b-53a41b3740a7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: .version_select at 0x7f24d5964e50>, body: {"keypair": {"name": "tempest-keypair-2141673704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJACYL+yRBEdWFILuKS+tx8NI9ntYMlqPi7yDOsPh4vuu6FUcIt9p+Xro/HdcmBbK+YyVKJa8MI6MuhtwvlyJ5n8Y4/hbGdHKxuskH2RvxztOU7IOv3Ih0O5aO65D7VZpQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:52.018007 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66733ed0-263e-458a-98ac-f2f5245f233b tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.541925 Sep 27 02:06:52.021311 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3124/6203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:51 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:52.027228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6cbc1703-1a93-4792-a69b-53a41b3740a7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:06:52.034299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6cbc1703-1a93-4792-a69b-53a41b3740a7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:06:52.078014 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6cbc1703-1a93-4792-a69b-53a41b3740a7 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075508 Sep 27 02:06:52.079261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3080/6204] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:06:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:06:53.052440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:53.053854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:53.070449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:53.071238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:53.072077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:53.073255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:53.073946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:53.074578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:53.190375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac01bafa-0ecf-41f6-905c-038244d776bd", "tag": "bca6cd87-cd7e-4323-9d3c-28006cc96e45"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:53.221160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:53.221952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:53.227135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:53.256379 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] Creating event network-changed:bca6cd87-cd7e-4323-9d3c-28006cc96e45 for instance ac01bafa-0ecf-41f6-905c-038244d776bd on n-h1-859358-1 Sep 27 02:06:53.266913 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1bbf3266-2acf-4d57-a128-417b8857875e req-f80ab01c-dc68-42cf-b5c4-0c33f11d8bab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080039 Sep 27 02:06:53.268904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3081/6205] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:53.700386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:53.718422 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06a92366-3dcb-4083-9de2-048fd63386d5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.671606 Sep 27 02:06:53.719307 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3125/6206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:53 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:54.759834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:54.760562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:54.774466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:54.812947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:54.822804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:54.829734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:54.830561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:54.839561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:54.840532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:54.849848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1750941986", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63819575-c2e2-431a-81ef-d6223fc06634"}], "security_groups": [{"name": "tempest-securitygroup--652648456"}], "key_name": "tempest-keypair-2141673704", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:54.860803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:54.866281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:55.079940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] validate_networks() for [('63819575-c2e2-431a-81ef-d6223fc06634', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:06:55.659039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:55.667759 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-defde65e-f115-4811-893a-6d9c1cee912d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.919374 Sep 27 02:06:55.668455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3082/6207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:54 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:55.779294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:06:55.780359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:06:55.781138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:06:55.781926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:06:55.782536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:06:55.802697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:55.803196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:55.803637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:55.804397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:55.805024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:55.805495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:55.837848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:06:55.853519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:06:55.862113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:06:55.877572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:06:55.881093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:06:55.942576 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8732950b-d501-4f9a-90c4-fdd5c5e78682 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.097762 Sep 27 02:06:55.943701 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3126/6208] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:06:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:06:55.957840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-af938708-6a40-4017-b588-1b5292a3fd59 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:55.958477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-af938708-6a40-4017-b588-1b5292a3fd59 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:56.021859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-af938708-6a40-4017-b588-1b5292a3fd59 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:56.031234 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-af938708-6a40-4017-b588-1b5292a3fd59 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1242 microversion: 2.1 time: 0.079031 Sep 27 02:06:56.046934 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3083/6209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:55 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:56.696795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:56.697815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:56.707032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:56.707548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:56.707992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:56.708703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:56.712596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:56.713246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:57.060904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:57.060904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:57.088803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:57.089311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:57.089778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:57.090494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:57.091175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:57.091800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:57.187415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:57.197424 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f38a80a6-e286-44ba-baca-cab4f6d77b40 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1294 microversion: 2.1 time: 0.144885 Sep 27 02:06:57.211174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3084/6210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:57 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:57.399132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:57.415499 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce1e8043-9d9c-442c-94d7-34685861b0de tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.727643 Sep 27 02:06:57.418145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3127/6211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:56 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:58.221469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:58.222103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:58.237761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:58.238257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:58.246585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:58.247397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:58.247969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:58.248328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:58.411951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:58.433989 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a4c92024-1ed7-483d-9e4e-588eb9cf77b9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1300 microversion: 2.1 time: 0.215973 Sep 27 02:06:58.437222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3085/6212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:58 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1300 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:58.457692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:58.458311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:58.479337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:58.479851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:58.480297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:58.481028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:58.481531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:58.481966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:58.838976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:58.857109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7eb23396-380c-4276-9b5e-247fab57267f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.406091 Sep 27 02:06:58.871285 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3128/6213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:58 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:58.969386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac01bafa-0ecf-41f6-905c-038244d776bd", "name": "network-vif-plugged", "status": "completed", "tag": "bca6cd87-cd7e-4323-9d3c-28006cc96e45"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:06:58.999394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:58.999905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:59.000349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:59.052279 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] Creating event network-vif-plugged:bca6cd87-cd7e-4323-9d3c-28006cc96e45 for instance ac01bafa-0ecf-41f6-905c-038244d776bd on n-h1-859358-1 Sep 27 02:06:59.068724 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-da8af57b-d4b5-497e-868a-ff82155fc1d7 req-e8e30a40-08f6-4d72-a3d5-3bbdc004781a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101611 Sep 27 02:06:59.071773 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3086/6214] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:06:59.465689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:59.467625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:59.478397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:59.478884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:59.479320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:59.480026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:59.485465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:59.485941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:59.711140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:06:59.719345 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3957615-47b0-44f7-9252-c54b22f91244 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.259665 Sep 27 02:06:59.721078 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3129/6215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:59 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:06:59.898069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:06:59.900420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:06:59.914673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:59.920810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:59.921878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:06:59.925002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:06:59.925891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:06:59.926883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:00.187161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:00.198809 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7eb9fc59-894d-44e0-8ef0-dde26755636a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1373 microversion: 2.1 time: 0.316062 Sep 27 02:07:00.200159 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3087/6216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:06:59 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1373 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:00.500607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9dbf1b-d34c-42a4-922d-161daa2d323b", "tag": "efe1b25e-d73c-421a-a29c-a2cb3afa1dbd"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:00.525353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:00.527188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:00.527859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:00.565633 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] Creating event network-changed:efe1b25e-d73c-421a-a29c-a2cb3afa1dbd for instance aa9dbf1b-d34c-42a4-922d-161daa2d323b on n-h2-859358-1 Sep 27 02:07:00.573324 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-343d15c1-72d5-424e-9753-a89a8c20070c req-7f59188d-7b15-4b24-bd83-c5c83e14b76d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078122 Sep 27 02:07:00.578039 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3130/6217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:00.757057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:00.758741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:00.771717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:00.772244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:00.772950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:00.775977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:00.777628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:00.779276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:01.087578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:01.099693 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-905a3efb-42a1-403a-a6f8-69e49750c3de tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.360143 Sep 27 02:07:01.100538 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3088/6218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:00 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:01.224250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:01.224966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:01.235004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:01.235542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:01.235943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:01.236970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:01.240684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:01.244361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:01.434159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:01.447874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afc4c689-0171-4ce3-a48c-96dc0d21b81c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1546 microversion: 2.1 time: 0.229040 Sep 27 02:07:01.448752 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3131/6219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:01 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:01.475707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:01.476346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:01.484575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:01.485082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:01.485575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:01.487032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:01.487651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:01.488517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:01.737022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:01.745569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d60347f3-1fc1-4436-93ae-5f13bb6bb24c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1546 microversion: 2.1 time: 0.274522 Sep 27 02:07:01.746455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3089/6220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:01 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:02.123199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:02.123901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:02.136626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:02.137216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:02.137855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:02.138597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:02.139067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:02.139508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:02.385603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:02.412587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bbabe42-c4e4-4d81-a004-faede62da161 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.293896 Sep 27 02:07:02.413512 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3132/6221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:02 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:03.442630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:03.443437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:03.456401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:03.456903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:03.457381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:03.466450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:03.466932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:03.467400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:04.362719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:04.374999 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8436f768-5494-4b28-ac2d-87ce1fa0712a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.937190 Sep 27 02:07:04.379206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3090/6222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:03 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:05.399604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:05.400342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:05.411693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:05.412191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:05.412631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:05.413811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:05.414272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:05.415148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:05.660450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:05.669587 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc991636-f026-4406-9f4b-95354c323155 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.273856 Sep 27 02:07:05.691860 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3133/6223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:05 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:06.696257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:06.698652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:06.704401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:06.727447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:06.732494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:06.733198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:06.735295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:06.735961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:06.736757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:07.394469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:07.404017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7e25e3c-0bf5-4872-bc5f-4718e7a2a7c0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.714826 Sep 27 02:07:07.428930 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3091/6224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:06 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:08.436649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:08.437932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:08.441912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:08.451105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:08.478840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:08.479558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:08.482697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:08.483631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:08.484253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:08.490006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:08.661490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:08.669575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18f26eb5-796a-4af9-bb5d-d01412259f81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.236991 Sep 27 02:07:08.670159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3134/6225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:08 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:08.925261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9dbf1b-d34c-42a4-922d-161daa2d323b", "name": "network-vif-plugged", "status": "completed", "tag": "efe1b25e-d73c-421a-a29c-a2cb3afa1dbd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:08.955667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:08.961041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:08.961819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:08.994336 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] Creating event network-vif-plugged:efe1b25e-d73c-421a-a29c-a2cb3afa1dbd for instance aa9dbf1b-d34c-42a4-922d-161daa2d323b on n-h2-859358-1 Sep 27 02:07:09.033220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c1f62113-b6f3-4d5d-875c-91b937a55782 req-f6e631b2-11ca-4cbd-92e3-c7809a1310b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097502 Sep 27 02:07:09.034310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3092/6226] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:09.692716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:09.693960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:09.702653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:09.703393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:09.703998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:09.705452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:09.706268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:09.706857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:09.987392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:10.016094 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a11dbed-bfdf-4a7a-890a-ed3f8fbf0352 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1367 microversion: 2.1 time: 0.327560 Sep 27 02:07:10.018164 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3135/6227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:09 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:11.042859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:11.044220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:11.060912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:11.061984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:11.064688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:11.067923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:11.070167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:11.071716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:11.349487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:11.359639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4780bff3-f315-4394-8cbb-087cf35c013b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1556 microversion: 2.1 time: 0.322833 Sep 27 02:07:11.360351 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3093/6228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:11 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1556 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:11.388753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:11.389570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:11.403330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:11.409378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:11.410313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:11.413125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:11.413913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:11.414629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:11.570308 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e3fadaed-e640-4f56-9510-2203ba7af134 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185774 Sep 27 02:07:11.577900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3136/6229] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:07:11 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:13.722090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa9dbf1b-d34c-42a4-922d-161daa2d323b", "tag": "efe1b25e-d73c-421a-a29c-a2cb3afa1dbd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:13.744009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:13.744489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:13.744926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:13.772788 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] Creating event network-changed:efe1b25e-d73c-421a-a29c-a2cb3afa1dbd for instance aa9dbf1b-d34c-42a4-922d-161daa2d323b on n-h2-859358-1 Sep 27 02:07:13.784175 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5cd816b8-1af0-4beb-9441-fdc68455cf98 req-6326fdbf-56a2-4a74-b137-84e2743a55e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068347 Sep 27 02:07:13.787689 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3094/6230] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:07:23.769550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:23.770845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=55 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:23.776418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-69663071", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "31812ea0-efa0-4b53-b20c-657f6ffa7fda"}], "key_name": "tempest-TestSecurityGroupsBasicOps-985313061", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ec062662-9fcd-4175-803e-3c2299a33e2a"]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:23.881148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] validate_networks() for [('31812ea0-efa0-4b53-b20c-657f6ffa7fda', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:07:24.670967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:07:24.671668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:07:24.672394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:07:24.674116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:07:24.675502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:07:24.691852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:24.692708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:24.694051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:24.695859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:24.697671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:24.698617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:24.730722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for project e300ecd9998a49f3951f954295121621. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:07:24.740368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Getting quotas for user ee2c3780d3ce4664b69977261002fb2e and project e300ecd9998a49f3951f954295121621. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:07:24.759100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:07:24.762267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:07:24.855337 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c3ae55e-b719-4aea-9750-dbfb2f6511aa tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.088555 Sep 27 02:07:24.862789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3137/6231] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:07:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:07:24.875176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1896e498-6131-47d3-920c-a9d69218b446 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:24.876550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1896e498-6131-47d3-920c-a9d69218b446 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:24.894929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=27 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:24.899164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=59 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:25.089763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1896e498-6131-47d3-920c-a9d69218b446 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:25.098091 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1896e498-6131-47d3-920c-a9d69218b446 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1239 microversion: 2.1 time: 0.233616 Sep 27 02:07:25.109849 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3095/6232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:24 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1239 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:26.132103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:26.133370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:26.157527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:26.164096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:26.165519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:26.166467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:26.169932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:26.172058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:26.351264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:26.362216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a60fcefc-7ecd-49b0-9cb5-a91e2fa164e6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1291 microversion: 2.1 time: 0.243766 Sep 27 02:07:26.365171 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3138/6233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:26 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1291 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:27.389258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:27.390622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:27.410993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:27.411767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:27.413063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:27.415126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:27.416698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:27.418057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:27.547021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:27.558219 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39dfa26d-8d01-4d6c-a02a-381e53978e01 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.173847 Sep 27 02:07:27.573405 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3096/6234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:27 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:28.589355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:28.590111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:28.614392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:28.621162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:28.624530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:28.625475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:28.626025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:28.626738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:28.970255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:28.997396 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ea3e8eb-93de-494a-b04f-0ca35a0e2451 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.412948 Sep 27 02:07:28.998040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3139/6235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:28 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:30.020820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:30.022253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:30.038506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.039887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.043160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.044157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.044787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.046056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.367353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:30.376223 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24fac2ef-1c96-4fbf-bfec-9b0ff9256581 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.359282 Sep 27 02:07:30.392039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3097/6236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:30 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:30.424603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8524f6a7-e42c-41bc-bb86-eb14dc4697d8", "tag": "9a42824c-645e-493c-9f57-d0f521f0c539"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:30.441930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.442197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.446248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.464830 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] Creating event network-changed:9a42824c-645e-493c-9f57-d0f521f0c539 for instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 on n-h1-859358-1 Sep 27 02:07:30.484903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-07c3f9eb-d194-44db-9b73-8e65f847b0ae req-ce33b993-a759-48ec-9de3-2eb8b9eb9f27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063656 Sep 27 02:07:30.485915 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3140/6237] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:30.739070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:30.739930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:30.751542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.753485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.755357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.756276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.760167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.760828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.806445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:07:30.921721 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b036055-3fa7-467f-ba53-1f7bad477082 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 204 len: 0 microversion: 2.1 time: 0.186963 Sep 27 02:07:30.932359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:30.933069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:30.934831 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3098/6238] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:07:30 2022] DELETE /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:07:30.940759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.941594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.942263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:30.943199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:30.943862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:30.944499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:31.245083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:31.259528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ae86c08-c94c-41bb-8c92-fda3a7328bee tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1552 microversion: 2.1 time: 0.330832 Sep 27 02:07:31.278107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3141/6239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:30 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1552 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:31.405962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:31.408262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:31.416585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:31.417353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:31.417999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:31.419007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:31.419666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:31.421648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:31.536864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:31.547485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4e43282-b0ba-48c2-8a8e-ffd30a735562 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.145772 Sep 27 02:07:31.550075 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3099/6240] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:31 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:32.285840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:32.287137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:32.295398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:32.296191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:32.296863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:32.298359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:32.299007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:32.299652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:32.577204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:32.577894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:32.597840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:32.604424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:32.605293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:32.607533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:32.609239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:32.612499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:32.802165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:32.810635 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-526611b0-5c5f-4fe5-bef1-7b8c19993c56 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1552 microversion: 2.1 time: 0.530225 Sep 27 02:07:32.811224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3142/6241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:32 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1552 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:32.831198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:32.843030 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecd0c52d-76ac-4854-a978-d47bd67ccca5 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.274827 Sep 27 02:07:32.851796 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3100/6242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:32 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:33.757543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac01bafa-0ecf-41f6-905c-038244d776bd", "name": "network-vif-deleted", "tag": "bca6cd87-cd7e-4323-9d3c-28006cc96e45"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:33.778702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.779193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.784916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.811966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] Creating event network-vif-deleted:bca6cd87-cd7e-4323-9d3c-28006cc96e45 for instance ac01bafa-0ecf-41f6-905c-038244d776bd on n-h1-859358-1 Sep 27 02:07:33.817976 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a792f005-8b51-4089-8ee9-82e25609d48b req-0665db43-d6b5-45dd-b0b4-b88bee5b7431 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214518 Sep 27 02:07:33.818960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3143/6243] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:33.834887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:33.835858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:33.857324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.857867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.858316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.859052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.859519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.860574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.872705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:33.874019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:33.881894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.883010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.883865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.884892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.885641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.886312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.962906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:33.966030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:33.967317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:33.969538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lazy-loading 'fault' on Instance uuid ac01bafa-0ecf-41f6-905c-038244d776bd {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:07:34.059477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:34.068730 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d700cc31-35b7-4651-8e2b-e7489132ef2e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 200 len: 1338 microversion: 2.1 time: 0.238105 Sep 27 02:07:34.069505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3101/6244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:33 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 1338 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:34.284295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:34.300028 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8389356b-11fc-4c69-84f0-809f2be61d99 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.432334 Sep 27 02:07:34.300628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3144/6245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:33 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:35.095952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:35.097129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: ac01bafa-0ecf-41f6-905c-038244d776bd] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:35.101824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:35.105774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:35.106456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:35.107084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:35.108404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:35.109018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:35.110177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:35.128113 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] HTTP exception thrown: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Request method failure captured: Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd HTTP/1.1 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlpE7LrJ6PVwrcfnaDim7vzXkr6bXd3H894UHjlb29OoehmBOFgxvLBDPooRmDpE_4pfoe_pHYtYSMe9XiydOqgMbwuLhmk1Plr7vvdwjmyC6Zm_khU-7W1gQ8VdTkmgqtl6YvFX75NCmJpFBuOkBhnVlJa8jyW9T97yiF-kF8Seolo Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c531cd458ade466c8e652c872bd2b9e9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: fc961c6429014fb3af4d50754a591af0 Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ac01bafa-0ecf-41f6-905c-038244d776bd'} Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:35.130078 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Returning 404 to user: Instance ac01bafa-0ecf-41f6-905c-038244d776bd could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:07:35.134930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7440bd0a-8ce9-4c82-ab0d-6f136502b8a0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd" status: 404 len: 111 microversion: 2.1 time: 0.042953 Sep 27 02:07:35.136785 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3102/6246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:35 2022] GET /compute/v2.1/servers/ac01bafa-0ecf-41f6-905c-038244d776bd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:07:35.327986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:35.329778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:35.337696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:35.339026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:35.341499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:35.342234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:35.342925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:35.344223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:35.346178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:35.346846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:35.532909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:35.550736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3f32bb7-9f49-4390-aae6-d9aac677ee91 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.230417 Sep 27 02:07:35.551332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3145/6247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:35 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:35.565679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8666127-0d4d-4ed2-b7be-44fd006961b1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '.version_select at 0x7f24d7c473a0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:35.598715 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8666127-0d4d-4ed2-b7be-44fd006961b1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-565698893" status: 202 len: 0 microversion: 2.1 time: 0.038398 Sep 27 02:07:35.599342 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3103/6248] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 27 02:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-565698893 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:07:36.576599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:36.577976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:36.589035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:36.591252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:36.594304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:36.595514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:36.597062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:36.597774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:36.780106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:36.791512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5773e2c0-1c92-44b4-9538-7920bf92a8fe tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.218652 Sep 27 02:07:36.794838 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3146/6249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:36 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:37.824877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:37.826464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:37.841314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:37.842243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:37.842917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:37.844560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:37.850293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:37.851141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:38.002200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:38.021592 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7bd43a0d-d98b-4a6d-965e-c400c0878cda tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.191242 Sep 27 02:07:38.022576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3104/6250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:37 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:38.774518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:38.775529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:38.781846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "994d61de-667b-4f67-a4ac-8827b98bae31", "tag": "b5a47c97-a6f3-4adf-bbdd-1ad11276d18b"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:38.785446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:38.788329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:38.788948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:38.798254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:38.798903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:38.799505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:38.805136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:38.805663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:38.806095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:38.827526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] Creating event network-changed:b5a47c97-a6f3-4adf-bbdd-1ad11276d18b for instance 994d61de-667b-4f67-a4ac-8827b98bae31 on n-h2-859358-1 Sep 27 02:07:38.838057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7298c195-f55d-4f71-8a1c-90ca596935de req-b824d923-416c-4c6b-8b95-d25628013479 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060047 Sep 27 02:07:38.842720 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3105/6251] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:38.864945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:07:39.066078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:39.068090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:39.081031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:39.081565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:39.082005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:39.082779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:39.083173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:39.092670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:39.096976 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c0147424-f305-41f5-a855-7f0ab3869c76 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 204 len: 0 microversion: 2.1 time: 0.326442 Sep 27 02:07:39.101368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3147/6252] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:07:38 2022] DELETE /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:07:39.113287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:39.114045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:39.136294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:39.286642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:39.299837 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed743262-8fa2-4566-9323-cde96ce18237 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.251045 Sep 27 02:07:39.313359 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3106/6253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:39 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:39.375392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:39.385129 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-efe41154-81f3-491b-b14e-41c6b885e1cf tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1667 microversion: 2.1 time: 0.282454 Sep 27 02:07:39.386673 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3148/6254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:39 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1667 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:39.695441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8524f6a7-e42c-41bc-bb86-eb14dc4697d8", "name": "network-vif-plugged", "status": "completed", "tag": "9a42824c-645e-493c-9f57-d0f521f0c539"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:39.715665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:39.718925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:39.719436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:39.756597 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] Creating event network-vif-plugged:9a42824c-645e-493c-9f57-d0f521f0c539 for instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 on n-h1-859358-1 Sep 27 02:07:39.770722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-91873b1b-c9db-4e3f-9fcc-dffaa133cefe req-d6a2f84e-c78f-4130-af12-5fc27c301e2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080218 Sep 27 02:07:39.773089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3107/6255] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:40.336134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:40.337242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:40.359839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:40.362040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:40.364337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:40.366174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:40.367348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:40.368514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:40.413095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:40.414474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:40.425741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:40.426477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:40.427069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:40.428007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:40.432039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:40.432704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:40.606025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:40.621818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9b0d17a-8c48-44a7-854b-1f193e0582cf tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1297 microversion: 2.1 time: 0.291554 Sep 27 02:07:40.622347 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3149/6256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:40 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1297 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:41.089243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:41.104472 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-beb830a0-45c4-4b83-b809-d5ec6ba5908d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1667 microversion: 2.1 time: 0.695980 Sep 27 02:07:41.105544 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3108/6257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:40 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1667 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:41.645448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:41.646108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:41.657902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:41.659109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:41.659664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:41.660742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:41.661309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:41.661891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:41.804552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:41.815694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c9fcf0e-0442-4465-b25e-c6079b01fe82 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1469 microversion: 2.1 time: 0.174393 Sep 27 02:07:41.816518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3150/6258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:41 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:41.843954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:41.847572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:41.865604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:41.869842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:41.869993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:41.870616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:41.871262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:41.871940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.018591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "994d61de-667b-4f67-a4ac-8827b98bae31", "name": "network-vif-deleted", "tag": "b5a47c97-a6f3-4adf-bbdd-1ad11276d18b"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:42.040549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.042809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.043407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.061276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] Creating event network-vif-deleted:b5a47c97-a6f3-4adf-bbdd-1ad11276d18b for instance 994d61de-667b-4f67-a4ac-8827b98bae31 on n-h2-859358-1 Sep 27 02:07:42.076476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:42.080608 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1f74cc46-dd5e-4fe4-b17a-e55c4f0426b6 req-2f34f4ed-17a6-4d01-ad82-ae91e6b633ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072951 Sep 27 02:07:42.083453 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3151/6259] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:42.090520 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9a27913-2b77-4734-b9e5-da0289ad03e3 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1469 microversion: 2.1 time: 0.251593 Sep 27 02:07:42.091127 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3109/6260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:41 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:42.114562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:42.115490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:42.128378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.128878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.129536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.130609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.131404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.131999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.133895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:42.136603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:42.145227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.145802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.146552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.147470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.147937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.148367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.218128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.246495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.247190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.248593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lazy-loading 'fault' on Instance uuid 994d61de-667b-4f67-a4ac-8827b98bae31 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:07:42.374436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23e868c9-ed6f-489b-b19c-8e9c75264821 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1620 microversion: 2.1 time: 0.263640 Sep 27 02:07:42.393008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3152/6261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:42 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1620 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:42.393433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:42.400462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:42.402979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:42.407040 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e04217fa-6ff5-4c20-8b72-75c2eec76fc1 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 200 len: 1338 microversion: 2.1 time: 0.278735 Sep 27 02:07:42.418922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3110/6262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:42 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 1338 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:42.419594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.423313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.423849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.426452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:42.426957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:42.427407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:42.973949 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c2cb99f-e475-4931-be6d-934a5eb65290 tempest-TestSecurityGroupsBasicOps-1381368016 tempest-TestSecurityGroupsBasicOps-1381368016-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1912 microversion: 2.1 time: 0.579628 Sep 27 02:07:42.975693 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3153/6263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:42 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1912 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:43.104510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:43.105608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:43.115415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.117430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.118181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.121627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.122324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.123271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.155641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:07:43.212640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:43.271527 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9387bc23-314f-45fd-929b-513df616f415 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 204 len: 0 microversion: 2.1 time: 0.170627 Sep 27 02:07:43.275794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3111/6264] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:07:43 2022] DELETE /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:07:43.292319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:43.297003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:43.317740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.318610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.319324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.320265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.320985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.321767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.346696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:43.430295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:43.442120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:43.444610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 994d61de-667b-4f67-a4ac-8827b98bae31] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:43.451527 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ddab0ce-4c90-4626-a86c-7f194e8ea381 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1475 microversion: 2.1 time: 0.170655 Sep 27 02:07:43.456707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.457451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.458064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.459091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:43.459837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:43.460422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:43.474255 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3154/6265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:43 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1475 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:07:43.492911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] HTTP exception thrown: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Request method failure captured: Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 HTTP/1.1 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlpE7LrJ6PVwrcfnaDim7vzXkr6bXd3H894UHjlb29OoehmBOFgxvLBDPooRmDpE_4pfoe_pHYtYSMe9XiydOqgMbwuLhmk1Plr7vvdwjmyC6Zm_khU-7W1gQ8VdTkmgqtl6YvFX75NCmJpFBuOkBhnVlJa8jyW9T97yiF-kF8Seolo Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c531cd458ade466c8e652c872bd2b9e9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: fc961c6429014fb3af4d50754a591af0 Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '994d61de-667b-4f67-a4ac-8827b98bae31'} Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:43.494868 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Returning 404 to user: Instance 994d61de-667b-4f67-a4ac-8827b98bae31 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e1d3779-f7a1-4432-a953-92e6a5aa99ff tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31" status: 404 len: 111 microversion: 2.1 time: 0.062406 Sep 27 02:07:43.499252 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3112/6266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:43 2022] GET /compute/v2.1/servers/994d61de-667b-4f67-a4ac-8827b98bae31 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:07:43.816846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3627c23d-0a76-4593-917c-97efd052cbfb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '.version_select at 0x7f24d5ec88b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:43.903693 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3627c23d-0a76-4593-917c-97efd052cbfb tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-275768716" status: 202 len: 0 microversion: 2.1 time: 0.091166 Sep 27 02:07:43.904904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3155/6267] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 27 02:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-275768716 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:07:44.484564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:44.485185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:44.493764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:44.494452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:44.495057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:44.495951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:44.496655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:44.497361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:45.143122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:45.154986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fcb6052-ad85-4919-8001-7c21084746ce tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1475 microversion: 2.1 time: 0.677834 Sep 27 02:07:45.155590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3113/6268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:44 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1475 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:46.180748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:46.181706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:46.207295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:46.210303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:46.211021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:46.213699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:46.214282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:46.215419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:46.315430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8524f6a7-e42c-41bc-bb86-eb14dc4697d8", "name": "network-vif-deleted", "tag": "9a42824c-645e-493c-9f57-d0f521f0c539"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:46.341202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:46.344443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:46.345613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:46.391408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] Creating event network-vif-deleted:9a42824c-645e-493c-9f57-d0f521f0c539 for instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 on n-h1-859358-1 Sep 27 02:07:46.406852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1e32c156-bbe7-41cc-8a55-a414bd1b24c1 req-1b0b26ed-ff82-4f21-b028-e1d736710d36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096030 Sep 27 02:07:46.407804 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3114/6269] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:46.464057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:46.495491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70d3e531-6ea7-411d-9698-a99595d49c00 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 200 len: 1475 microversion: 2.1 time: 0.320147 Sep 27 02:07:46.504398 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3156/6270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:46 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 1475 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:47.532190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:47.532899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: 8524f6a7-e42c-41bc-bb86-eb14dc4697d8] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:47.539787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:47.540531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:47.541127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:47.542029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:47.542637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:47.543249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:47.578402 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] HTTP exception thrown: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Request method failure captured: Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 HTTP/1.1 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlpqA2C0tggjs1zAsiq4Ebj3mVpfnJ5RlSn31LZn6-Bdn7cTotEISHiykdUdJlzTAG_ew5qmMV10ozqqAo57mR3mOJLe8jm2iR-aMN29dXPMrSri4ZdZVCP_1wjnD3fh2r6Qs-WWLNjLZ0qiZabqPxrE3e3nhLEdUJcbGsMDLbu6fpI Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: e300ecd9998a49f3951f954295121621 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e300ecd9998a49f3951f954295121621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e300ecd9998a49f3951f954295121621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e300ecd9998a49f3951f954295121621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e300ecd9998a49f3951f954295121621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: e300ecd9998a49f3951f954295121621 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestSecurityGroupsBasicOps-1653345711-project Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ee2c3780d3ce4664b69977261002fb2e Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1653345711-project Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8524f6a7-e42c-41bc-bb86-eb14dc4697d8'} Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:07:47.583825 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. Sep 27 02:07:47.590115 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:07:47.592497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Returning 404 to user: Instance 8524f6a7-e42c-41bc-bb86-eb14dc4697d8 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:07:47.593859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70604e41-d83f-4a06-aec7-edb272ae40d1 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8" status: 404 len: 111 microversion: 2.1 time: 0.066600 Sep 27 02:07:47.595779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3115/6271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:47 2022] GET /compute/v2.1/servers/8524f6a7-e42c-41bc-bb86-eb14dc4697d8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:07:55.836158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec062662-9fcd-4175-803e-3c2299a33e2a", "tag": "b8943f97-0a0b-4482-8b6b-eb62050e028a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:07:55.838972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:55.839664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:55.857181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:55.858799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:55.859293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:55.859742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:55.860473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:55.860983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:55.861393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:55.869635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:07:55.871539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:55.872028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:55.872609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:55.928129 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] Creating event network-changed:b8943f97-0a0b-4482-8b6b-eb62050e028a for instance ec062662-9fcd-4175-803e-3c2299a33e2a on n-h2-859358-1 Sep 27 02:07:55.940879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7c1467f1-949d-4922-8445-a9b78e87586e req-c9df108a-2fcd-4846-b630-8ac423527344 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108093 Sep 27 02:07:55.945158 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3116/6272] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:07:55.957083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:07:56.161435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da55cbd8-c78c-4434-ad6d-8376c86d0826 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 204 len: 0 microversion: 2.1 time: 0.332506 Sep 27 02:07:56.165241 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3157/6273] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:07:55 2022] DELETE /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:07:56.171040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:56.172284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:56.189773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:56.190267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:56.190704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:56.191622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:56.192236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:56.192827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:57.193263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:57.209700 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5baada27-27e0-476d-95f5-3a808eca465c tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1767 microversion: 2.1 time: 1.042680 Sep 27 02:07:57.220814 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3117/6274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:56 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1767 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:58.238114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:58.239585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:58.261723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:58.265437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:58.269799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:58.272080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:58.274329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:58.282026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:58.767481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:07:58.777610 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10bb04c3-36fc-476c-b43f-51a58598e655 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1767 microversion: 2.1 time: 0.544273 Sep 27 02:07:58.797755 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3158/6275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:58 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1767 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:07:59.805559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:07:59.806189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:07:59.817093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:59.817636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:59.818082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:07:59.818811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:07:59.819270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:07:59.819703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:00.879727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec062662-9fcd-4175-803e-3c2299a33e2a", "name": "network-vif-deleted", "tag": "b8943f97-0a0b-4482-8b6b-eb62050e028a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:00.915059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:00.915848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:00.916559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:00.943347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] Creating event network-vif-deleted:b8943f97-0a0b-4482-8b6b-eb62050e028a for instance ec062662-9fcd-4175-803e-3c2299a33e2a on n-h2-859358-1 Sep 27 02:08:00.960010 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b0d6de42-0ac1-4a3d-9717-455647ddaab9 req-cafc4f95-e2a4-4081-b558-e98005d01482 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080766 Sep 27 02:08:00.961545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3159/6276] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:08:01.197552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2c3780d3ce4664b69977261002fb2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e300ecd9998a49f3951f954295121621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:01.217388 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aa93b758-e92b-4b01-97d1-a59fab0233c6 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 200 len: 1648 microversion: 2.1 time: 1.416394 Sep 27 02:08:01.219036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3118/6277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:07:59 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 1648 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:02.244661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:02.245418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] [instance: ec062662-9fcd-4175-803e-3c2299a33e2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:02.263386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:02.264197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:02.265595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:02.266804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:02.267430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:02.268013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:02.299178 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] HTTP exception thrown: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Request method failure captured: Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a HTTP/1.1 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlpqA2C0tggjs1zAsiq4Ebj3mVpfnJ5RlSn31LZn6-Bdn7cTotEISHiykdUdJlzTAG_ew5qmMV10ozqqAo57mR3mOJLe8jm2iR-aMN29dXPMrSri4ZdZVCP_1wjnD3fh2r6Qs-WWLNjLZ0qiZabqPxrE3e3nhLEdUJcbGsMDLbu6fpI Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: e300ecd9998a49f3951f954295121621 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e300ecd9998a49f3951f954295121621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e300ecd9998a49f3951f954295121621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e300ecd9998a49f3951f954295121621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e300ecd9998a49f3951f954295121621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: e300ecd9998a49f3951f954295121621 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1653345711 Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestSecurityGroupsBasicOps-1653345711-project Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ee2c3780d3ce4664b69977261002fb2e Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1653345711-project Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ec062662-9fcd-4175-803e-3c2299a33e2a'} Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:02.300939 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Returning 404 to user: Instance ec062662-9fcd-4175-803e-3c2299a33e2a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40da6058-aa47-4cfd-94db-bf93e1c28674 tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a" status: 404 len: 111 microversion: 2.1 time: 0.062065 Sep 27 02:08:02.306356 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3160/6278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:02 2022] GET /compute/v2.1/servers/ec062662-9fcd-4175-803e-3c2299a33e2a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:08:07.083668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33bc79a9-76d2-4f21-b2d8-b83680782bc9 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: .version_select at 0x7f24d50b2280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-849604409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7QW3o/xMToXSE8PZeJL88+oBkZzH1ArmA2q4gUjPQmeFxf1raa28YpbbZ3zaLyTsKVRmuVlgOWHxmm7u/FDhLLnbRphQoxhPdK/mVZONtL9D1dih4cSq4jxjCqyKzoiA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:07.133862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-33bc79a9-76d2-4f21-b2d8-b83680782bc9 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:08:07.156316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-33bc79a9-76d2-4f21-b2d8-b83680782bc9 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:08:07.216777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33bc79a9-76d2-4f21-b2d8-b83680782bc9 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.137549 Sep 27 02:08:07.219694 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3119/6279] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:08:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:11.492169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fc55fc4-86f8-4d9d-84f1-ad23b097f16b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] Calling method '.version_select at 0x7f24d66f2d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:11.542706 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fc55fc4-86f8-4d9d-84f1-ad23b097f16b tempest-TestSecurityGroupsBasicOps-1653345711 tempest-TestSecurityGroupsBasicOps-1653345711-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-985313061" status: 202 len: 0 microversion: 2.1 time: 0.055129 Sep 27 02:08:11.543905 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3161/6280] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:08:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-985313061 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:08:11.865808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1839356143", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "73a662e6-528d-42e8-938c-c94b1433ed7c"}], "key_name": "tempest-TestNetworkBasicOps-849604409", "security_groups": [{"name": "tempest-secgroup-smoke-1768020976"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:11.891882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:12.142946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] validate_networks() for [('73a662e6-528d-42e8-938c-c94b1433ed7c', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:08:12.916437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:08:12.917000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:08:12.917352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:08:12.917929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:08:12.918357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:08:12.942319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:12.942823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:12.948830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:12.950332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:12.952473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:12.952732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:13.004730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:08:13.021313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Getting quotas for user fc961c6429014fb3af4d50754a591af0 and project c531cd458ade466c8e652c872bd2b9e9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:08:13.058559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:08:13.063659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:08:13.195141 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1550d17d-8b2d-4611-8698-534edb7fde23 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.335163 Sep 27 02:08:13.213207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fa0b660-d447-4093-9a08-f16504e9a6c5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:13.216917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fa0b660-d447-4093-9a08-f16504e9a6c5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:13.226156 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3120/6281] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:08:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:08:13.242792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:13.338902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fa0b660-d447-4093-9a08-f16504e9a6c5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:13.349158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fa0b660-d447-4093-9a08-f16504e9a6c5 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1248 microversion: 2.1 time: 0.141618 Sep 27 02:08:13.366803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3162/6282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:13 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1248 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:14.376635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:14.378055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:14.393943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:14.395219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:14.400772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:14.403384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:14.405712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:14.406881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:14.573591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:14.588447 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7e165124-5eb6-4301-b7b2-c491d71dd668 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1252 microversion: 2.1 time: 0.211519 Sep 27 02:08:14.589933 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3121/6283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:14 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1252 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:15.615494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:15.616640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:15.629654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:15.630498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:15.636324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:15.637367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:15.638057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:15.638708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:15.816175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:15.829147 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31d86449-f0ee-442c-8f42-f755019dd59f tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1306 microversion: 2.1 time: 0.216727 Sep 27 02:08:15.832225 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3163/6284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:15 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:16.860725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:16.862197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:16.875346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:16.876977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:16.878498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:16.880257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:16.883029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:16.883479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:17.234545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:17.242906 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afab44b5-fb7b-45b6-a1b6-d10c16373bf2 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.387675 Sep 27 02:08:17.244302 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3122/6285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:16 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:18.272166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:18.273602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:18.281330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:18.281853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:18.282466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:18.284948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:18.285731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:18.286636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:18.439932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6e4b5c-533e-4253-ba10-be73929baf2a", "tag": "a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:18.469581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:18.475901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:18.476571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:18.504950 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] Creating event network-changed:a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5 for instance 1d6e4b5c-533e-4253-ba10-be73929baf2a on n-h1-859358-1 Sep 27 02:08:18.511684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f4c3e220-9bbe-474c-bac5-7455532e9ba6 req-07830f30-4e56-423a-aecc-cfd13688d58c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075649 Sep 27 02:08:18.512391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3123/6286] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:18.642216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:18.671490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-047764d7-3965-4640-8222-8b5e3106425e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.403847 Sep 27 02:08:18.672098 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3164/6287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:18 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:18.882433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:18.883322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:18.897043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:18.897512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:18.899461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:18.901135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:18.902255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:18.903259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:18.969376 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-30a28275-adf3-40a0-bfd2-f9c8ea610488 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/ips" status: 200 len: 148 microversion: 2.1 time: 0.093753 Sep 27 02:08:18.972045 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3124/6288] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:08:18 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/ips => generated 148 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:19.706620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:19.707905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:19.719166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:19.720285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:19.720919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:19.722869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:19.723922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:19.724668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:20.115287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:20.125107 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dd34f3c-7d5b-43bf-91b4-2a50f2f43c4d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.430472 Sep 27 02:08:20.127742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3165/6289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:19 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:21.151986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:21.152794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:21.167625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:21.168120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:21.168569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:21.169314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:21.174277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:21.174750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:21.496877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:21.515060 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-487d20e6-7dc8-45f2-892a-68b3bb89026c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.367278 Sep 27 02:08:21.516479 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3125/6290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:21 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:21.758514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac723aa-0644-4d3a-be31-a1e60c4ad77e"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:21.763073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:21.770350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:21.770837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:21.771271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:21.771970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:21.774880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:21.775343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:22.148123 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa40337e-f3fc-4090-b762-3eea46e3f471 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392413 Sep 27 02:08:22.166648 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3166/6291] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:08:21 2022] POST /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:08:22.540755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:22.541402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:22.559423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:22.561531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:22.570968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:22.573070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:22.574536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:22.576855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:22.886284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:22.896775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1731125-ba94-4196-9edc-34f5c907e4b0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.360284 Sep 27 02:08:22.900385 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3126/6292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:22 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:23.924092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:23.924823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:23.936269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:23.949990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:23.953719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:23.955490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:23.957624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:23.958363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:23.959901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:24.626678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:24.644127 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-39b28bb0-1cab-4816-8620-2453fa300f05 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.725468 Sep 27 02:08:24.651423 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3167/6293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:23 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:08:25.694381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:25.696448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:25.724793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:25.726170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:25.735487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:25.736331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:25.736976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:25.746213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:25.746985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:25.747625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:26.168906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:26.180187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c506b11-e108-4980-96dd-36b0d2031247 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 0.504764 Sep 27 02:08:26.182358 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3127/6294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:25 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:27.208830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:27.209477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:27.221399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:27.226774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:27.227307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:27.227735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:27.228455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:27.234411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:27.235652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:27.491022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6e4b5c-533e-4253-ba10-be73929baf2a", "name": "network-vif-plugged", "status": "completed", "tag": "a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:27.521874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:27.525279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:27.533207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:27.533941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:27.568051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] Creating event network-vif-plugged:a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5 for instance 1d6e4b5c-533e-4253-ba10-be73929baf2a on n-h1-859358-1 Sep 27 02:08:27.590909 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3489a097-126d-4066-9513-8b8af46e7a36 req-1fa50fbb-2345-4edc-a2cf-a0286b22d962 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094444 Sep 27 02:08:27.593169 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3128/6295] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:08:28.293444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:28.321496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52c8a4d3-b94f-4fb9-9eec-462cceae3348 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1374 microversion: 2.1 time: 1.116366 Sep 27 02:08:28.322441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3168/6296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:27 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1374 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:08:29.350144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:29.351470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:29.363938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:29.372340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:29.373922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:29.383287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:29.383823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:29.384292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:30.340936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:30.353838 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a9564f6-a262-472e-90e7-629dc26ca6f0 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1547 microversion: 2.1 time: 1.008816 Sep 27 02:08:30.356084 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3129/6297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:29 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1547 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:30.378925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:30.379550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:30.393398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:30.393903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:30.394349 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:30.403816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:30.404376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:30.404839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:30.697974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:30.710522 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9044b10e-ea05-4809-8fc5-5290953fbc2c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1547 microversion: 2.1 time: 0.335775 Sep 27 02:08:30.711492 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3169/6298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:30 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1547 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:35.382914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6e4b5c-533e-4253-ba10-be73929baf2a", "tag": "a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:35.398475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:35.399166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:35.399831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:35.416647 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] Creating event network-changed:a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5 for instance 1d6e4b5c-533e-4253-ba10-be73929baf2a on n-h1-859358-1 Sep 27 02:08:35.424685 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-03cabbed-1c9d-4886-be73-44b25c30ed44 req-b1f724b7-1c26-4d49-8934-fba9853659d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045870 Sep 27 02:08:35.426591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3130/6299] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:38.081991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac723aa-0644-4d3a-be31-a1e60c4ad77e"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:38.095840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:38.104373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.104994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.105556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.106386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.106981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.107483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.217554 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments HTTP/1.1 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 74 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: {"volumeAttachment": {"volumeId": "0ac723aa-0644-4d3a-be31-a1e60c4ad77e"}} Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: exception: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'aa9dbf1b-d34c-42a4-922d-161daa2d323b', 'body': {'volumeAttachment': {'volumeId': '0ac723aa-0644-4d3a-be31-a1e60c4ad77e'}}} Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:08:38.219145 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 400 to user: Invalid volume: volume 0ac723aa-0644-4d3a-be31-a1e60c4ad77e is already attached to instances: aa9dbf1b-d34c-42a4-922d-161daa2d323b {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-eeca02bf-affa-4a30-8463-5188ddac9279 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154525 Sep 27 02:08:38.223604 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3170/6300] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:08:38 2022] POST /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 174 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:08:38.294383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:38.295107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:38.306924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.307832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.308680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.309700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.310195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.310656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.421405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lazy-loading 'services' on Instance uuid aa9dbf1b-d34c-42a4-922d-161daa2d323b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:08:38.509763 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a789a24-736e-48d6-9160-8a867bca2c3f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments/0ac723aa-0644-4d3a-be31-a1e60c4ad77e" status: 202 len: 0 microversion: 2.1 time: 0.219998 Sep 27 02:08:38.511173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3131/6301] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:08:38 2022] DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments/0ac723aa-0644-4d3a-be31-a1e60c4ad77e => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:08:38.522733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:38.525266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:38.533568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.534405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.535382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.536491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:38.537320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:38.537830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:38.577277 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fa80513-f0d9-43df-b011-0bbbb3ba980c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060562 Sep 27 02:08:38.578366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3171/6302] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:38 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:08:39.592706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:39.595304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:39.605255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:39.606566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:39.607140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:39.607791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:39.608435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:39.609030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:39.651182 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e3b8e64-aa88-441f-9efd-f492485431b5 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064340 Sep 27 02:08:39.652400 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3132/6303] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:39 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:40.665174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:40.667479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:40.688013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:40.688513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:40.688963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:40.689705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:40.703094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:40.704046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:40.779617 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72ab435c-cedc-47d5-8e6f-e0b3d13ed3aa tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116954 Sep 27 02:08:40.780685 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3172/6304] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:40 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:41.792602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:41.796256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:41.814575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:41.815409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:41.816135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:41.817106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:41.817824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:41.824539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:41.877119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a54512d9-342e-4078-ae34-97fdc3a96a7c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088523 Sep 27 02:08:41.882803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3133/6305] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:41 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:42.890190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:42.892498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:42.912704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:42.913813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:42.914427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:42.915324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:42.917936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:42.918622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:42.975722 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-04053cdc-41a6-4ec8-9f4e-c23f291d8a16 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089658 Sep 27 02:08:42.976899 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3173/6306] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:42 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:43.990378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:43.994212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:44.007163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:44.011318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:44.011948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:44.020585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:44.022804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:44.023443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:44.065456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:44.104197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7426f6af-0b35-4c9b-bf3f-432d2c67a4d2 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115930 Sep 27 02:08:44.108532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3134/6307] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:43 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:45.119910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:45.122309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:45.137441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:45.138607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:45.143921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:45.144910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:45.145554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:45.146095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:45.203450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:45.225882 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f8aef30-cc99-4bd5-b748-4f3fd948a81a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110407 Sep 27 02:08:45.226737 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3174/6308] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:45 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:46.242449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:46.245505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:46.270180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.270698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.271140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:46.275934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.276585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.278209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:46.363165 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-812ae726-c8de-4597-a505-6da020a44235 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127309 Sep 27 02:08:46.365107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3135/6309] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:08:46 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:08:46.440371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:46.441995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:46.449829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.451863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.452568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:46.453559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.454250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.454925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:46.543161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:08:46.752725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9390aedc-7509-4608-b163-e5bc886ce009 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 204 len: 0 microversion: 2.1 time: 0.315742 Sep 27 02:08:46.753681 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3175/6310] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:08:46 2022] DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:08:46.762331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:46.763748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:46.776835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.779127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.780486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:46.781629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:46.783850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:46.785915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:47.118679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:47.127227 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-393a3cb1-3c75-40fa-97bc-bba94faa00fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1680 microversion: 2.1 time: 0.369123 Sep 27 02:08:47.130373 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3136/6311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:46 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1680 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:48.159213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:48.160172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:48.172924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:48.174883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:48.176206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:48.179068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:48.181791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:48.182572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:48.567873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:48.582095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4db567e-32cc-4d13-a4ca-fdc3ddac90a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1680 microversion: 2.1 time: 0.429377 Sep 27 02:08:48.588054 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3176/6312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:48 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1680 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:49.612296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:49.612818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:49.627752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:49.628511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:49.629109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:49.630039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:49.630649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:49.631222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:50.673578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:50.688861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eda51e9d-9900-4c08-919d-989b035aad4c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1680 microversion: 2.1 time: 1.080791 Sep 27 02:08:50.694906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3137/6313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:49 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1680 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:51.719007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:51.719912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:51.738087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:51.740435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:51.745331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:51.746545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:51.747859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:51.748548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:52.119735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:08:52.128231 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b893ceca-78a0-4d84-bacf-6e4ad5cd9297 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 200 len: 1613 microversion: 2.1 time: 0.413251 Sep 27 02:08:52.142097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3177/6314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:51 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 1613 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:08:52.752593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa9dbf1b-d34c-42a4-922d-161daa2d323b", "name": "network-vif-deleted", "tag": "efe1b25e-d73c-421a-a29c-a2cb3afa1dbd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:52.781548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:52.782035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:52.782467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:52.822261 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] Creating event network-vif-deleted:efe1b25e-d73c-421a-a29c-a2cb3afa1dbd for instance aa9dbf1b-d34c-42a4-922d-161daa2d323b on n-h2-859358-1 Sep 27 02:08:52.838017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-97384f8c-643f-4b11-81db-921a1a020635 req-ff114064-9444-45ea-8678-3b31c1d6df84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485491 Sep 27 02:08:52.840627 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3138/6315] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:53.170270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:53.171557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:53.180804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:53.181646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:53.182461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:53.183372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:53.184040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:53.184865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:53.202505 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b HTTP/1.1 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'aa9dbf1b-d34c-42a4-922d-161daa2d323b'} Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:08:53.204239 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63c57f2e-9a78-4f11-8c16-99a4f8b61329 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 404 len: 111 microversion: 2.1 time: 0.040194 Sep 27 02:08:53.209875 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3178/6316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:53 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:08:53.218236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67d578d5-dd1a-493b-963d-b33613cf9618 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '.version_select at 0x7f24d5604c10>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:53.281922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67d578d5-dd1a-493b-963d-b33613cf9618 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141673704" status: 202 len: 0 microversion: 2.1 time: 0.069985 Sep 27 02:08:53.283274 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3139/6317] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 02:08:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141673704 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:08:53.982079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:53.984335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:08:54.001063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:54.001595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:54.002753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:54.003146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:54.003756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:54.004336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:54.085423 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc2696e1-5435-4603-a816-98e90e4b702e tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a/action" status: 200 len: 24565 microversion: 2.1 time: 0.107061 Sep 27 02:08:54.086534 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3179/6318] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:08:53 2022] POST /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a/action => generated 24565 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:08:54.802976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a8bf26c-8860-4601-981f-c57fb483c0d8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: .version_select at 0x7f24d6519160>, body: {"keypair": {"name": "tempest-keypair-2060625630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhTqJWTetfamLl7w7oCK5m9Hq0UWBL51WfDKxtFDoFV8rDKN8lewcBSrd+FchaHzGOSWvs8v5wX0NUHcoI1aYpsPQl/5/uFD2wtIi36Bz3t+nwoOK0wMrysElf30T2Hjg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:54.845992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6a8bf26c-8860-4601-981f-c57fb483c0d8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:08:54.859461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6a8bf26c-8860-4601-981f-c57fb483c0d8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:08:54.930011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a8bf26c-8860-4601-981f-c57fb483c0d8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131858 Sep 27 02:08:54.932635 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3140/6319] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:08:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:08:58.445014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377126566", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63819575-c2e2-431a-81ef-d6223fc06634"}], "security_groups": [{"name": "tempest-securitygroup--613738053"}], "key_name": "tempest-keypair-2060625630", "user_data": "}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:08:58.505013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:08:58.774841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] validate_networks() for [('63819575-c2e2-431a-81ef-d6223fc06634', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:08:59.676725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:08:59.677725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:08:59.678588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:08:59.679081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:08:59.679501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:08:59.712012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:59.712503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:59.712942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:59.715506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:08:59.715974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:08:59.716409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:08:59.790266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:08:59.816862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Getting quotas for user 5171df5b87db4e469fecb5ea9e9d6366 and project 4bd0489331474700acea6cd4c1a24b21. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:08:59.851846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:08:59.860105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:08:59.966564 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d1cb054-9bdb-42c3-ba61-3fbf8d79e2a6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.527721 Sep 27 02:08:59.974263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3180/6320] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:08:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:08:59.982329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6cc8959-d969-4871-84ab-45c26346f6f0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:08:59.983116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6cc8959-d969-4871-84ab-45c26346f6f0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:00.003336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:00.589583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6cc8959-d969-4871-84ab-45c26346f6f0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:00.611169 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6cc8959-d969-4871-84ab-45c26346f6f0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1241 microversion: 2.1 time: 0.635721 Sep 27 02:09:00.619036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3141/6321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:08:59 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1241 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:00.761798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:00.769730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:00.803015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:00.805579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:00.806762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:00.811142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:00.813529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:00.814037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:00.921430 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db740a7f-2282-42dd-a867-9f1be9b0c69d tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "POST /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a/action" status: 200 len: 32637 microversion: 2.1 time: 0.163381 Sep 27 02:09:00.925983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3181/6322] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:09:00 2022] POST /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a/action => generated 32637 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:09:01.645245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:01.645914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:01.663229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:01.667098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:01.672343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:01.673224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:01.673746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:01.678020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:01.747374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-368707256", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "69583cd0-3787-49d4-bc7b-b1ab93b310aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:01.900108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:09:01.966073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:01.977727 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d9eb15f-d45c-4364-b43b-f7376a513743 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1293 microversion: 2.1 time: 0.344273 Sep 27 02:09:01.985787 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3142/6323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:01 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:03.013982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:03.015894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:03.028851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:03.031958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:03.032656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:03.035813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:03.040912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:03.041786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:03.246712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:03.258227 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e78c42de-b5c1-46b7-9a38-c7015271a71b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1299 microversion: 2.1 time: 0.249605 Sep 27 02:09:03.270879 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3143/6324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:03 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:03.603383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:09:03.605126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:09:03.605972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:09:03.606636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:09:03.607262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:09:03.632371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:03.633301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:03.634099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:03.635149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:03.635851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:03.636495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:03.662885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:09:03.669980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:09:03.778485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:09:03.785578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69583cd0-3787-49d4-bc7b-b1ab93b310aa',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:09:04.054238 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94ab0440-fe03-4e5b-a670-8d9bff04aa64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.311249 Sep 27 02:09:04.062539 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3182/6325] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:09:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:09:04.070871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95992a0b-bf9e-4cd8-9152-1e88515479b1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:04.071262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95992a0b-bf9e-4cd8-9152-1e88515479b1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:04.170410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95992a0b-bf9e-4cd8-9152-1e88515479b1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:04.180457 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95992a0b-bf9e-4cd8-9152-1e88515479b1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1056 microversion: 2.1 time: 0.116369 Sep 27 02:09:04.181810 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3144/6326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:04 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1056 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:04.284173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:04.286093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:04.309960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:04.310582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:04.311241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:04.313604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:04.314748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:04.316245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:04.743542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:04.760408 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63868275-1c11-4e29-87a2-e59c7d8ebd32 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.480884 Sep 27 02:09:04.766327 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3183/6327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:04 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:05.193474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:05.200735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:05.210640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:05.211348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:05.213879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.217372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.222189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.222962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.223433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.223940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.236346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.237258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.237888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.239645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.240334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.241067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.288689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:09:05.398490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:05.431051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ad6ce34-be58-497e-80c3-b4602f8e9bab tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1098 microversion: 2.1 time: 0.229558 Sep 27 02:09:05.452846 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3184/6328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:05 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1098 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:05.489996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d90dea72-dd03-4cf1-92c6-a7a41c5d02e7 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 204 len: 0 microversion: 2.1 time: 0.300412 Sep 27 02:09:05.491278 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3145/6329] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:09:05 2022] DELETE /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:09:05.499284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deccc935-cef1-4feb-8ea2-72ee46fb37f3", "tag": "75b83638-5677-49fe-aa22-23e8819ff947"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:05.505900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6e4b5c-533e-4253-ba10-be73929baf2a", "tag": "a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:05.528905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.534811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.535331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.548154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.550499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.552535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.558161 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] Creating event network-changed:75b83638-5677-49fe-aa22-23e8819ff947 for instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 on n-h2-859358-1 Sep 27 02:09:05.572315 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-55db50fa-470b-440f-a9c2-5e29b68cbdfc req-9e0fc888-b743-4a29-a420-75de9b68ffbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079201 Sep 27 02:09:05.573061 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3146/6330] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:05.582955 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] Creating event network-changed:a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5 for instance 1d6e4b5c-533e-4253-ba10-be73929baf2a on n-h1-859358-1 Sep 27 02:09:05.584538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:05.590594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:05.597264 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6abf8b3f-d08b-435e-8a86-2b853498aa12 req-13806847-c4c8-432d-b6d1-5936b50d70c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142705 Sep 27 02:09:05.597928 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3185/6331] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:05.607546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.608335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.608978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.609936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.610590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.611211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.788997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:05.790129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:05.801896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.802394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.803026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.806327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:05.806806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:05.810799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:05.935728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:05.946517 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7984e10-5301-4211-aca9-0ebd91489138 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1672 microversion: 2.1 time: 0.368118 Sep 27 02:09:05.948332 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3147/6332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:05 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1672 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:06.304822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:06.314730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfd84838-e040-4b56-922f-34a372c75e2b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.530195 Sep 27 02:09:06.318770 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3186/6333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:05 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:06.479544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:06.480225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:06.498569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:06.499070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:06.512677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:06.513970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:06.514610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:06.514904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:06.665443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:06.678473 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2002fee4-5145-4a71-9454-276f22650974 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1172 microversion: 2.1 time: 0.200798 Sep 27 02:09:06.691052 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3148/6334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:06 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1172 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:06.975509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:06.976133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:06.984338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:06.984834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:06.985278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:06.986021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:06.986481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:06.986912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:07.236791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:07.252811 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15a96348-f03b-410d-9464-dc73cf80ed1a tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1672 microversion: 2.1 time: 0.281955 Sep 27 02:09:07.257848 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3187/6335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:06 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1672 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:07.342681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:07.343547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:07.361776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:07.362276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:07.362720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:07.363446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:07.363893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:07.364323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:07.714302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:07.717318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:07.745660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:07.747791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:07.750262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:07.751195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:07.751815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:07.752424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:07.850219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:07.864712 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af701e98-6295-4e25-a187-e64f52d69f70 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1172 microversion: 2.1 time: 0.153122 Sep 27 02:09:07.867422 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3188/6336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:07 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1172 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:07.878999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:07.895771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70bcaac7-3498-4669-bc95-6de464d0664b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.557393 Sep 27 02:09:07.898637 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3149/6337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:07 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:08.280594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:08.287152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6e4b5c-533e-4253-ba10-be73929baf2a", "name": "network-vif-deleted", "tag": "a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:08.290155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:08.322260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:08.322757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:08.325536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:08.327772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:08.328238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:08.328672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:08.333284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:08.334024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:08.335163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:08.365114 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] Creating event network-vif-deleted:a6cee8e0-bfe8-46c6-ae1b-3dc6e34f27c5 for instance 1d6e4b5c-533e-4253-ba10-be73929baf2a on n-h1-859358-1 Sep 27 02:09:08.395902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2faf6613-d049-4700-b313-26cdaa9417ab req-76906650-b36c-41fd-8208-6d8851f2d1d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112567 Sep 27 02:09:08.396520 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3150/6338] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:09:08.673619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc961c6429014fb3af4d50754a591af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c531cd458ade466c8e652c872bd2b9e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:08.680332 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1554b968-98d4-495b-94cd-09d2d7b59ab4 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 200 len: 1333 microversion: 2.1 time: 0.403652 Sep 27 02:09:08.681942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3189/6339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:08 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 1333 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:08.896014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:08.900805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:08.927177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:08.929008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:08.929706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:08.931760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:08.936957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:08.937778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:09.257081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:09.257755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:09.274078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:09.276728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:09.277407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:09.278342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:09.280880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:09.282382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:09.634531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:09.643857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbf1bf74-61b5-4568-80ff-eeacedf97452 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.723570 Sep 27 02:09:09.647065 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3190/6340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:08 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:09.703385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:09.704210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] [instance: 1d6e4b5c-533e-4253-ba10-be73929baf2a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:09.716252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:09.722183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:09.723816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:09.729665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:09.730898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:09.732315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:09.809261 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] HTTP exception thrown: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Request method failure captured: Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a HTTP/1.1 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlpE7LrJ6PVwrcfnaDim7vzXkr6bXd3H894UHjlb29OoehmBOFgxvLBDPooRmDpE_4pfoe_pHYtYSMe9XiydOqgMbwuLhmk1Plr7vvdwjmyC6Zm_khU-7W1gQ8VdTkmgqtl6YvFX75NCmJpFBuOkBhnVlJa8jyW9T97yiF-kF8Seolo Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c531cd458ade466c8e652c872bd2b9e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c531cd458ade466c8e652c872bd2b9e9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: c531cd458ade466c8e652c872bd2b9e9 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkBasicOps-1527125675 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: fc961c6429014fb3af4d50754a591af0 Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkBasicOps-1527125675-project Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '1d6e4b5c-533e-4253-ba10-be73929baf2a'} Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:09.811306 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. Sep 27 02:09:09.815354 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:09.817181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Returning 404 to user: Instance 1d6e4b5c-533e-4253-ba10-be73929baf2a could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:09:09.818289 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-728efc1d-8b3a-4d6c-ab62-1de18dfce98c tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a" status: 404 len: 111 microversion: 2.1 time: 0.119061 Sep 27 02:09:09.819419 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3191/6341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:09 2022] GET /compute/v2.1/servers/1d6e4b5c-533e-4253-ba10-be73929baf2a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:09:09.927007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:09.940572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-672d8254-ced2-4496-a7dd-5687f4c65302 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1214 microversion: 2.1 time: 1.045907 Sep 27 02:09:09.946881 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3151/6342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:08 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1214 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:10.326954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70db0398-6237-4c39-83be-1c0fc05cd903 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] Calling method '.version_select at 0x7f24d6ce2700>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:10.385115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70db0398-6237-4c39-83be-1c0fc05cd903 tempest-TestNetworkBasicOps-1527125675 tempest-TestNetworkBasicOps-1527125675-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-849604409" status: 202 len: 0 microversion: 2.1 time: 0.063614 Sep 27 02:09:10.385577 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3192/6343] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 27 02:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-849604409 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:09:10.669257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:10.670217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:10.681779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:10.682555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:10.683150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:10.684526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:10.688885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:10.689604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:10.972682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:10.973278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:10.989074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:10.989615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:10.990062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:10.991257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:10.991899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:10.992483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:11.151786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:11.163214 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6471a9e7-5c73-413e-819a-d950fbc943fb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.496261 Sep 27 02:09:11.164387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3152/6344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:10 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:11.367406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:11.375971 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6c3917d-445d-49c5-bb15-d9882254bf27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1214 microversion: 2.1 time: 0.407910 Sep 27 02:09:11.392519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3193/6345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:10 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:11.901425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0dfd02-e99a-41a3-b471-767dc4acd5f6", "tag": "5ddc516d-6634-412a-8282-499f525b1952"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:11.921273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:11.924163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:11.924735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:11.956217 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] Creating event network-changed:5ddc516d-6634-412a-8282-499f525b1952 for instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 on n-h2-859358-1 Sep 27 02:09:11.966321 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3c694d54-79b5-4ced-8c45-cfd2077bd7b5 req-d4087031-de3e-4570-9247-a99551edab89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068784 Sep 27 02:09:11.967494 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3153/6346] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:12.190998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:12.191877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:12.220431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:12.221183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:12.221805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:12.222739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:12.223480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:12.224227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:12.227688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:12.403368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:12.404256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:12.421429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:12.422089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:12.422669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:12.423466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:12.424171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:12.424850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:12.559556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:12.571228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bbe16d4d-22be-4b50-9700-8f231f90503e tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.384061 Sep 27 02:09:12.576164 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3194/6347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:12 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:12.855857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:12.870810 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e84bcac3-5d22-4f5c-802c-846d3933236f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1214 microversion: 2.1 time: 0.471615 Sep 27 02:09:12.895309 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3154/6348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:12 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1214 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:13.447545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deccc935-cef1-4feb-8ea2-72ee46fb37f3", "name": "network-vif-plugged", "status": "completed", "tag": "75b83638-5677-49fe-aa22-23e8819ff947"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:13.463559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:13.465210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:13.465872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:13.493601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] Creating event network-vif-plugged:75b83638-5677-49fe-aa22-23e8819ff947 for instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 on n-h2-859358-1 Sep 27 02:09:13.513862 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4d76adde-de86-44b3-b175-4e86dfa68429 req-f6e85ddd-e32f-4c9f-b74f-d5cc9074eab6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275712 Sep 27 02:09:13.515821 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3195/6349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:13.612629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:13.613444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:13.624103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:13.624764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:13.625486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:13.636266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:13.641781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:13.642844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:13.898849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:13.902795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:13.925092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:13.926681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:13.931934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:13.939476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:13.946096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:13.947096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:13.947742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:13.961705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:14.179254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:14.348863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:14.374564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:14.383194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8ad2dc6c-9094-4b56-90f7-98bb59292a81 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.775837 Sep 27 02:09:14.384124 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3155/6350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:13 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:14.473472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:14.505853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2ff94aa-d498-4352-b137-3fa03a9c3dbb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1214 microversion: 2.1 time: 0.607150 Sep 27 02:09:14.508051 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3196/6351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:13 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1214 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:15.408110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:15.409668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:15.424692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:15.430084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:15.430786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:15.432242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:15.432935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:15.433657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:15.531402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:15.532111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:15.542068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:15.542543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:15.546523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:15.549807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:15.550537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:15.551210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:15.830533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:15.865610 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5418a5b0-bcc7-4d84-9ee4-dd50769b8f5a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1214 microversion: 2.1 time: 0.323585 Sep 27 02:09:15.870440 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3197/6352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:15 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1214 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:16.097298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:16.111928 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1539917b-1d28-4f98-ac67-762cca3b4cad tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1366 microversion: 2.1 time: 0.708295 Sep 27 02:09:16.113772 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3156/6353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:15 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1366 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:16.899860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:16.900489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:16.909939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:16.910720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:16.911435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:16.912494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:16.913204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:16.914088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:17.089555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:17.110622 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74284452-748c-451b-9d28-10e75939c20a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.206587 Sep 27 02:09:17.110622 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3198/6354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:16 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:17.138894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:17.140188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:17.148614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:17.150051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:17.151481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:17.153045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:17.153865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:17.154519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:17.470640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:17.488145 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-033e659c-9bf4-406e-a4ca-dc43dc3f0a0c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1556 microversion: 2.1 time: 0.353490 Sep 27 02:09:17.489083 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3157/6355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:17 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1556 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:17.510982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:17.512131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:17.518703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:17.519499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:17.520284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:17.521188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:17.521840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:17.522432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:17.664534 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc7b6a56-951f-4748-87bb-98fb539a63a3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157675 Sep 27 02:09:17.666659 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3199/6356] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:09:17 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:18.127025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:18.127668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:18.136782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:18.137287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:18.141767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:18.142528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:18.153588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:18.153588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:18.822853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:18.844932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd8b97d6-caf9-4bec-b081-f5ff4287c387 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.720290 Sep 27 02:09:18.851780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3158/6357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:18 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:19.877000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:19.877581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:19.890460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:19.890999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:19.892930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:19.894622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:19.898712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:19.899691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:20.213189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:20.231436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8e9bc097-8832-4581-8baf-3eeb9c2843e1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.358862 Sep 27 02:09:20.237178 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3200/6358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:19 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:20.381766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deccc935-cef1-4feb-8ea2-72ee46fb37f3", "tag": "75b83638-5677-49fe-aa22-23e8819ff947"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:20.405243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:20.405829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:20.406293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:20.442314 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] Creating event network-changed:75b83638-5677-49fe-aa22-23e8819ff947 for instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 on n-h2-859358-1 Sep 27 02:09:20.459272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7d67c3df-8443-4fac-988f-100fc98cb746 req-9d640d5a-5b58-4326-b9a4-ff92b7900543 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081549 Sep 27 02:09:20.459922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3159/6359] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:21.258742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:21.260807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:21.305446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:21.305950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:21.313782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:21.319805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:21.323192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:21.328732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:21.887135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:21.910462 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc716fee-2122-4027-be07-f92f8bd85207 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.655851 Sep 27 02:09:21.912577 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3201/6360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:21 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:22.936971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:22.937880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:22.954166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:22.955251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:22.957315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:22.959997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:22.960922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:22.961707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:23.258119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:23.283052 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e826618-7d68-4444-a6a3-257583bbe134 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.349549 Sep 27 02:09:23.287579 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3160/6361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:22 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:24.311626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:24.312818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:24.320350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:24.320874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:24.321523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:24.322425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:24.322882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:24.324774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:24.543811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:24.553819 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bdcf5a3a-c27c-427d-b5e6-9ce12c315815 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.247312 Sep 27 02:09:24.554621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3202/6362] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:24 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:25.127539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0dfd02-e99a-41a3-b471-767dc4acd5f6", "name": "network-vif-plugged", "status": "completed", "tag": "5ddc516d-6634-412a-8282-499f525b1952"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:25.142591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:25.143333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:25.143949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:25.164491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] Creating event network-vif-plugged:5ddc516d-6634-412a-8282-499f525b1952 for instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 on n-h2-859358-1 Sep 27 02:09:25.182240 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fc64a11e-dcff-42ea-a0c8-f7653fb17cc7 req-4bf7b1ba-2f70-4a69-bc7d-e19ec616ad72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057778 Sep 27 02:09:25.183525 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3161/6363] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:25.577087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:25.577743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:25.585800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:25.586506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:25.587127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:25.588020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:25.588690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:25.589871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:25.941131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:25.955353 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c23fbac6-3053-4a16-be45-db6a59e0c714 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.381860 Sep 27 02:09:25.958064 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3203/6364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:25 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:26.986450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:26.987187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:27.002180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:27.002681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:27.003122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:27.003841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:27.004295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:27.004719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:27.700596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:27.709058 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca62fc2c-1c1f-42ff-ab09-0950b7bd3f3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1202 microversion: 2.1 time: 0.731140 Sep 27 02:09:27.739730 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3162/6365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:26 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1202 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:28.748268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:28.748885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:28.751983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:28.759137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:28.759630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:28.760485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:28.762031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:28.762663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:28.763100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:28.932432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:28.943003 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ae2a4d02-6f61-4728-9da3-297715662213 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1389 microversion: 2.1 time: 0.199458 Sep 27 02:09:28.943595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3204/6366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:28 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1389 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:28.966618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:28.967922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:28.975204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:28.975997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:28.976434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:28.977455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:28.978074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:28.978645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.153837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:29.175659 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c70379c0-77a5-4c11-a125-a73be3c3e43c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1389 microversion: 2.1 time: 0.212812 Sep 27 02:09:29.176956 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3163/6367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:28 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1389 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:29.206631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:29.207272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:29.217218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.220075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.221169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.222128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.222873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.223314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.368422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:29.378058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5bf0e38d-e295-4ffb-9776-e37cf94037b0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1389 microversion: 2.1 time: 0.181666 Sep 27 02:09:29.379256 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3205/6368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:29 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:29.404199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:29.404995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:29.411344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.411830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.412268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.412967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.413443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.413866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.441595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:09:29.530379 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afe46432-7f26-4960-9af0-5bdccef185d1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 204 len: 0 microversion: 2.1 time: 0.133290 Sep 27 02:09:29.535991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3164/6369] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:09:29 2022] DELETE /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:09:29.541794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:29.543405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:29.552337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.553077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.553707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.559204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:29.560093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:29.560698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:29.734424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:29.742699 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bdebd966-e2b5-4ec5-99bc-689525ffc740 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1395 microversion: 2.1 time: 0.205584 Sep 27 02:09:29.743399 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3206/6370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:29 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1395 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:30.771436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:30.774026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:30.783539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:30.786469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:30.787520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:30.788149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:30.789070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:30.789772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:30.790253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:31.014599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:31.023636 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86bcacd5-92aa-4e57-8b2e-62f4c3ec3a28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1395 microversion: 2.1 time: 0.260733 Sep 27 02:09:31.024655 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3165/6371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:30 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1395 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:32.048688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:32.050117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:32.056766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:32.058051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:32.058841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:32.060104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:32.060725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:32.061316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:32.172735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:32.185272 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6864f276-3e38-442e-8abf-2f69bfc92812 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1353 microversion: 2.1 time: 0.140853 Sep 27 02:09:32.185910 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3207/6372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:32 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:32.265860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0dfd02-e99a-41a3-b471-767dc4acd5f6", "name": "network-vif-deleted", "tag": "5ddc516d-6634-412a-8282-499f525b1952"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:32.277633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:32.278414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:32.279029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:32.294343 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] Creating event network-vif-deleted:5ddc516d-6634-412a-8282-499f525b1952 for instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 on n-h2-859358-1 Sep 27 02:09:32.300667 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-61a3ab87-2204-4862-9d54-710c8fd71c31 req-a1ab0394-cb67-4362-9c38-c2e53f8b7958 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Sep 27 02:09:32.301824 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3166/6373] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:33.210974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:33.211594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:33.221625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:33.222352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:33.223059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:33.223926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:33.224714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:33.225299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:33.300050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:33.312246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44f61e3a-2ff0-4b45-8ae4-59ee8b08d7a9 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1187 microversion: 2.1 time: 0.105646 Sep 27 02:09:33.313384 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3208/6374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:33 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:34.337958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:34.338736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:34.345944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:34.346449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:34.347001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:34.348569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:34.359790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:34.360740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:34.476426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:34.487717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5279b312-20b4-4371-9ecb-33c568c2d455 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1187 microversion: 2.1 time: 0.155258 Sep 27 02:09:34.488676 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3167/6375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:34 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:35.513126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:35.514017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:35.521528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:35.522078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:35.522641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:35.523443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:35.524002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:35.524532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:35.594584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:35.602968 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35f799e0-107e-45ce-92c0-184c0e75dce3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1187 microversion: 2.1 time: 0.093810 Sep 27 02:09:35.604892 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3209/6376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:35 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:36.627448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:36.628778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:36.637461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:36.638104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:36.638557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:36.639417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:36.639887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:36.640477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:36.726880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:36.737281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dce02988-989c-4213-8d04-99ddb11df24f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 200 len: 1187 microversion: 2.1 time: 0.113734 Sep 27 02:09:36.749367 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3168/6377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:36 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 1187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:37.764227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:37.765047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: dd0dfd02-e99a-41a3-b471-767dc4acd5f6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:37.771977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:37.772465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:37.772902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:37.773616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:37.774068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:37.774525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:37.788782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 HTTP/1.1 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'dd0dfd02-e99a-41a3-b471-767dc4acd5f6'} Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:09:37.790503 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance dd0dfd02-e99a-41a3-b471-767dc4acd5f6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:09:37.795824 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52a2ba7d-9984-4e97-898d-bf47c698a311 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6" status: 404 len: 111 microversion: 2.1 time: 0.032249 Sep 27 02:09:37.804293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3210/6378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:37 2022] GET /compute/v2.1/servers/dd0dfd02-e99a-41a3-b471-767dc4acd5f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:09:43.352341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-333835713", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "54493855-15cb-406c-a745-679cb41f29c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:43.417040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:09:43.830743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:09:43.831275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:09:43.831752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:09:43.832162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:09:43.832577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:09:43.844215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:43.844935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:43.845415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:43.846335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:43.846785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:43.847377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:43.868084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:09:43.874026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:09:43.934818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:09:43.937157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54493855-15cb-406c-a745-679cb41f29c4',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:09:44.083348 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56e0ac68-de44-45f7-a6df-4fb50aafd9b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735374 Sep 27 02:09:44.084960 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3169/6379] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:09:44.096714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73637821-508f-4639-ac00-5a5580b7993e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:44.097529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73637821-508f-4639-ac00-5a5580b7993e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:44.190056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73637821-508f-4639-ac00-5a5580b7993e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:44.211949 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73637821-508f-4639-ac00-5a5580b7993e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1056 microversion: 2.1 time: 0.111604 Sep 27 02:09:44.213272 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3211/6380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:44 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1056 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:45.245468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:45.262694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:45.286582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:45.295280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:45.296745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:45.298165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:45.300839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:45.302847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:45.501486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:45.522390 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-22f089b8-54cd-4fb3-ad62-bd126599a7ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1162 microversion: 2.1 time: 0.285642 Sep 27 02:09:45.524519 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3170/6381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:45 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1162 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:46.550420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:46.551159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:46.563008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:46.563709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:46.564315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:46.565223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:46.565869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:46.566468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:46.571759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=92 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:46.768424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:46.781424 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc35e78a-800a-4d57-9c6b-af6f21e86994 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1214 microversion: 2.1 time: 0.235759 Sep 27 02:09:46.782333 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3212/6382] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:46 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:47.486678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e97473-f2cd-4caa-9500-ee92fd72624a", "tag": "c021755e-f6a1-47b8-9f45-f038514a4553"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:09:47.532805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:47.533440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:47.534292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:47.577861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:47.580892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] Creating event network-changed:c021755e-f6a1-47b8-9f45-f038514a4553 for instance 23e97473-f2cd-4caa-9500-ee92fd72624a on n-h1-859358-1 Sep 27 02:09:47.606857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-73a36ee0-616b-4600-b16f-322970af017f req-bc217e0f-9981-4afe-b4e9-755f61d0ac44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126416 Sep 27 02:09:47.609802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3171/6383] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:09:47.805859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:47.806479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:47.819375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:47.819899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:47.820357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:47.821114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:47.821589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:47.822219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:48.009769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:48.021032 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c30da400-cf91-407c-8aa7-602fabac8c93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1214 microversion: 2.1 time: 0.218887 Sep 27 02:09:48.021679 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3213/6384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:47 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:49.049182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:49.051696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:49.064724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:49.065373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:49.066074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:49.067640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:49.068177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:49.068860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:49.241851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:49.252858 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f7f03fd7-de97-4016-ba40-051e5285a287 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1214 microversion: 2.1 time: 0.211958 Sep 27 02:09:49.254267 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3172/6385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:49 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:50.275728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:50.276347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:50.283022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:50.283656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:50.283969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:50.284928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:50.285412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:50.290059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:50.498273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:50.509001 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d6d1b68-566b-4623-ab4f-7832aa650169 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1214 microversion: 2.1 time: 0.237180 Sep 27 02:09:50.524030 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3214/6386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:50 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:51.532100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:51.532744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:51.545840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:51.546608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:51.547053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:51.547774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:51.548344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:51.549064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:51.716114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:51.724932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12073c05-e74e-475a-9849-ce6bbf316980 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.196773 Sep 27 02:09:51.725766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3173/6387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:51 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:52.763656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:52.764827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:52.771776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:52.772502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:52.773092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:52.773995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:52.774621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:52.775199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:52.935720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:52.944091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ebca2b1-d817-4aab-ab74-0789f05a7783 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.185488 Sep 27 02:09:52.944866 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3215/6388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:52 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:53.968328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:53.969317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:53.972274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:53.972981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:53.979573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:53.980335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:53.980951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:53.981861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:53.982481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:53.983207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:54.138284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:54.146684 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-451b06d6-6ba9-4ad2-b1e2-54434493c925 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.182244 Sep 27 02:09:54.147919 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3174/6389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:53 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:55.173775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:55.174621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:55.180227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:09:55.183348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:55.183837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:55.184270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:55.184973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:55.185646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:55.186073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:55.342000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:55.351683 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5fe3be39-887a-4dea-bfa9-306458f68cd3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.183816 Sep 27 02:09:55.356334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3216/6390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:55 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:09:56.375553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:56.382351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:56.389887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:56.390383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:56.390953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:56.391819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:56.392291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:56.392725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:56.560516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:56.569695 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0f02c1d1-e92e-4242-a8bd-4976fe3ce9c1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.197907 Sep 27 02:09:56.570311 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3175/6391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:56 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:57.598180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:57.598949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:57.606210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:57.606710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:57.607155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:57.607872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:57.608336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:57.608774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:57.762825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:57.773153 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13033499-d8c6-48f2-b6cf-4f84295fa5c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.178665 Sep 27 02:09:57.774294 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3217/6392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:57 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:09:58.796894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:09:58.797576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:09:58.817086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:58.817604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:58.818238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:58.818952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:09:58.819409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:09:58.819839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:09:58.987374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:09:59.000038 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-69d2c187-9934-4a31-9087-e6bc3f96ba7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.207739 Sep 27 02:09:59.001781 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3176/6393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:09:58 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:00.024909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:00.029130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:00.036040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=30 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:00.044852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:00.045639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:00.046085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:00.046877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:00.047334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:00.047778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:00.206850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:00.215698 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-21c30545-fbcf-447d-9c91-36180243ac3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.195498 Sep 27 02:10:00.216536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3218/6394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:00 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:01.239266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:01.240472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:01.243223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:01.255113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:01.255792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:01.256414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:01.257300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:01.257932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:01.258513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:01.417507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:01.434286 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9430b8a0-c35f-4c89-aeac-6920b2ca3fd0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.198838 Sep 27 02:10:01.436357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3177/6395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:01 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:01.594344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e97473-f2cd-4caa-9500-ee92fd72624a", "name": "network-vif-plugged", "status": "completed", "tag": "c021755e-f6a1-47b8-9f45-f038514a4553"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:01.612098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:01.612587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:01.613027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:01.625327 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] Creating event network-vif-plugged:c021755e-f6a1-47b8-9f45-f038514a4553 for instance 23e97473-f2cd-4caa-9500-ee92fd72624a on n-h1-859358-1 Sep 27 02:10:01.631216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0b0179ff-e3a4-4d59-8e4c-067c89c6e538 req-0cfd061e-babf-42b7-97da-b94ce910de54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040486 Sep 27 02:10:01.632304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3219/6396] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:02.463068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:02.465151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:02.473218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:02.474234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:02.474891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:02.475818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:02.476345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:02.477030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:02.610888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:02.619743 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd547ee3-08d8-452b-b846-791e7539f74f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1202 microversion: 2.1 time: 0.163229 Sep 27 02:10:02.620326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3178/6397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:02 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:03.643868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:03.645414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:03.662537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:03.663022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:03.663469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:03.664194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:03.664830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:03.665560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:03.839202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:03.848539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d280099b-07c5-431d-960d-bb9f7075c62d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1390 microversion: 2.1 time: 0.209878 Sep 27 02:10:03.851944 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3220/6398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:03 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:03.875647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:03.876673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:03.888236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:03.888794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:03.889194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:03.889907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:03.890402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:03.890858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.052824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:04.062427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a8ae793-a5fa-4a6d-b402-cdd75a37819a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1390 microversion: 2.1 time: 0.191323 Sep 27 02:10:04.072337 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3179/6399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:03 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1390 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:04.086603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:04.087221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:04.095576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.096323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.096875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.097907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.098343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.098990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.294200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:04.304391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-58958bbd-9579-4529-b04b-75a3793f6b54 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1390 microversion: 2.1 time: 0.221665 Sep 27 02:10:04.305010 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3221/6400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:04 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:04.329863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:04.330386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:04.337222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.337903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.338393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.339154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.339735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.340117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.378408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:10:04.518472 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8433bfa-545f-4e68-b4a2-361e64d3ed25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 204 len: 0 microversion: 2.1 time: 0.192366 Sep 27 02:10:04.519067 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3180/6401] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:10:04 2022] DELETE /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:10:04.529170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:04.533500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:04.549185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.549721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.550892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.551883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:04.552796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:04.553432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:04.720894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:04.732449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ace6519a-5b84-4acd-9719-98b45b9bd12f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1396 microversion: 2.1 time: 0.208684 Sep 27 02:10:04.733494 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3222/6402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:04 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1396 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:05.756812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:05.758203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:05.774852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:05.774852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:05.775264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:05.776043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:05.776519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:05.777376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:06.008633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:06.021844 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1aed4257-604c-4e5f-a8e4-155f131900f7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1396 microversion: 2.1 time: 0.268678 Sep 27 02:10:06.022715 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3181/6403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:05 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1396 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:06.552888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e97473-f2cd-4caa-9500-ee92fd72624a", "name": "network-vif-deleted", "tag": "c021755e-f6a1-47b8-9f45-f038514a4553"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:06.576832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:06.577801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:06.578432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:06.614276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] Creating event network-vif-deleted:c021755e-f6a1-47b8-9f45-f038514a4553 for instance 23e97473-f2cd-4caa-9500-ee92fd72624a on n-h1-859358-1 Sep 27 02:10:06.625640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-17a84d27-7d1a-4dda-89ec-f97a6113b84a req-c8e01549-c141-4448-8717-0c3f2d9c5242 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076409 Sep 27 02:10:06.633161 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3223/6404] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:07.048947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:07.050171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:07.057905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:07.058529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:07.058942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:07.059788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:07.060373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:07.060851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:07.125918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:07.134266 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bb7d58cf-385c-4ffd-9302-88db6e601474 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1187 microversion: 2.1 time: 0.089263 Sep 27 02:10:07.134933 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3182/6405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:07 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:07.374352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1328191865", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "61b6697b-cccb-4ebf-b3f8-b99be955a376"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:07.431107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] validate_networks() for [('61b6697b-cccb-4ebf-b3f8-b99be955a376', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:10:07.796214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:10:07.796817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:10:07.797097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:10:07.797541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:10:07.797954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:10:07.807396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:07.807887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:07.808369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:07.809107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:07.809695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:07.810133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:07.829881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Getting quotas for project 69774c9a99ef47c6a3ade7dbce689a5e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:10:07.834563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Getting quotas for user ef1d6154768c4804bb10cbd2da3a702a and project 69774c9a99ef47c6a3ade7dbce689a5e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:10:07.848532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:10:07.851389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:10:07.902187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f041fbfc-23b7-47a1-8844-9eebc0b37566 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531865 Sep 27 02:10:07.903147 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3224/6406] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:10:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:10:07.914577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a7a7e1f-7970-4bd4-b169-f6fe8a9b8e47 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:07.915400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a7a7e1f-7970-4bd4-b169-f6fe8a9b8e47 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:07.991803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a7a7e1f-7970-4bd4-b169-f6fe8a9b8e47 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:07.999849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a7a7e1f-7970-4bd4-b169-f6fe8a9b8e47 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1219 microversion: 2.1 time: 0.089080 Sep 27 02:10:08.000450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3183/6407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:07 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:08.157495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:08.158216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:08.167242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:08.168274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:08.168274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:08.168716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:08.169153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:08.169608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:08.238818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:08.258058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32791ec7-8292-438f-8b64-744f306f8965 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1187 microversion: 2.1 time: 0.104416 Sep 27 02:10:08.259768 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3225/6408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:08 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:09.023669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:09.025737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:09.033652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:09.034846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:09.035653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:09.036598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:09.037180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:09.037732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:09.108041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:09.116840 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-685171a3-d908-47a1-b55c-e8ba8ce20b6f tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1271 microversion: 2.1 time: 0.097300 Sep 27 02:10:09.117645 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3184/6409] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:09 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:09.282125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:09.282682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:09.290137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:09.298951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:09.299583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:09.300471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:09.303861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:09.304677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:09.379364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:09.390822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ee71b64-0fe9-4e88-ae24-51b01a38e682 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1187 microversion: 2.1 time: 0.112445 Sep 27 02:10:09.392159 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3226/6410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:09 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:10.143827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:10.145561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:10.154430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:10.155705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:10.156481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:10.158254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:10.159172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:10.159843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:10.398495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:10.412705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e09a2463-8b63-4e32-820a-0a6d81748e02 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.273575 Sep 27 02:10:10.414492 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3185/6411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:10 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:10.426359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:10.427191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:10.441818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:10.454005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:10.454631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:10.455494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:10.456067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:10.456600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:10.543230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:10.553511 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51520b8f-9b77-4557-bdc1-99baafcd2a08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1187 microversion: 2.1 time: 0.142246 Sep 27 02:10:10.554769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3227/6412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:10 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:10:11.317020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe", "tag": "5cd7b872-b188-483d-b495-1f82bbfb6092"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:11.335012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.335547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.336103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.350930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] Creating event network-changed:5cd7b872-b188-483d-b495-1f82bbfb6092 for instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe on n-h2-859358-1 Sep 27 02:10:11.362994 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0598fd96-0bcb-441a-b8f0-c6a85559eae4 req-01503fd1-11d5-47be-83c5-790fc401e214 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050447 Sep 27 02:10:11.363808 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3186/6413] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:11.443109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:11.444636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:11.456910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.457567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.462848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.464589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.466671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.467359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.578929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:11.580366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:11.591834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.592622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.596850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.597816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.598590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.599182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.663167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:11.663786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:11.664398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:11.665023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lazy-loading 'fault' on Instance uuid 23e97473-f2cd-4caa-9500-ee92fd72624a {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:10:11.676398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:11.689934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1a6eb41-d3a5-4c4c-91bd-6fd79f700f3e tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.252733 Sep 27 02:10:11.691433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3228/6414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:11 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:11.773659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:11.781704 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9067c405-09b0-4276-9f9c-e1ff09ecd65c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 200 len: 1192 microversion: 2.1 time: 0.208586 Sep 27 02:10:11.808084 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3187/6415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:11 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 1192 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:10:12.715289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:12.715905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:12.723053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:12.723630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:12.724097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:12.724844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:12.725352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:12.725822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:12.808663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:12.809373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 23e97473-f2cd-4caa-9500-ee92fd72624a] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:12.817224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:12.817753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:12.818376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:12.819143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:12.819609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:12.820238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:12.827519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:12.839934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a HTTP/1.1 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '23e97473-f2cd-4caa-9500-ee92fd72624a'} Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:10:12.841964 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 23e97473-f2cd-4caa-9500-ee92fd72624a could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b95ef0fa-d849-4870-b7b6-5ae76c86a465 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a" status: 404 len: 111 microversion: 2.1 time: 0.039850 Sep 27 02:10:12.847216 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3188/6416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:12 2022] GET /compute/v2.1/servers/23e97473-f2cd-4caa-9500-ee92fd72624a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:10:12.872699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:12.880545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90825c02-dd11-48bb-9dd1-cfd614f442b6 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.169356 Sep 27 02:10:12.881124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3229/6417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:12 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:13.906435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:13.907176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:13.915352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:13.915878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:13.916507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:13.917390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:13.917859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:13.918287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:14.107826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:14.116178 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-934c70e6-30dc-42fe-9dde-ea02b05698c0 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.214101 Sep 27 02:10:14.116768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3189/6418] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:13 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:15.139927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:15.140532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:15.148314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:15.148803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:15.149942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:15.150670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:15.151478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:15.151931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:15.310565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:15.313013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:15.324648 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7bcaad4-357c-4313-bdd1-4953f157a6d9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.188736 Sep 27 02:10:15.330237 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3230/6419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:15 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:16.349103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:16.349763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:16.361041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:16.364713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:16.366340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:16.367284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:16.367744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:16.369252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:16.540122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:16.550103 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-730d3655-c54c-4adf-838d-45b5275068f9 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.206368 Sep 27 02:10:16.561940 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3190/6420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:16 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:17.346631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe", "name": "network-vif-plugged", "status": "completed", "tag": "5cd7b872-b188-483d-b495-1f82bbfb6092"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:17.362076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:17.363276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:17.363983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:17.383359 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] Creating event network-vif-plugged:5cd7b872-b188-483d-b495-1f82bbfb6092 for instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe on n-h2-859358-1 Sep 27 02:10:17.390749 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-54b9613e-72e1-4c02-a772-b93773147a77 req-ecbc1ce7-d4ce-4669-83f3-1e525d5ec8b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047884 Sep 27 02:10:17.391481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3231/6421] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:17.574702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:17.575511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:17.582421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:17.582904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:17.583387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:17.584419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:17.585046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:17.585685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:17.772820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:17.781608 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e314bd66-a443-4ad2-b519-fd4eb291c5b8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.210890 Sep 27 02:10:17.794029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3191/6422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:17 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:18.803456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:18.806659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:18.815853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:18.817782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:18.836606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:18.837309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:18.837802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:18.838732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:18.839364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:18.839805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:19.089286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:19.127177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53a9a7a2-a96a-4a1c-9918-f89cde801ac5 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1319 microversion: 2.1 time: 0.324510 Sep 27 02:10:19.127819 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3232/6423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:18 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:20.152953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:20.154497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:20.156351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:20.163866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:20.164864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:20.165496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:20.166388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:20.167017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:20.167455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:20.317942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:20.328156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20e7e3aa-4ceb-4b5b-b8bf-f3933b8a9dea tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1508 microversion: 2.1 time: 0.180191 Sep 27 02:10:20.339123 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3192/6424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:20 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:25.684567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:25.685150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:25.692596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:25.693078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:25.693782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:25.694740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:25.695350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:25.696552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:25.729654 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-133d2e82-ec80-4517-9d3e-a3dab22597ab tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.049680 Sep 27 02:10:25.730250 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3233/6425] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Sep 27 02:10:25 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:10:28.242640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddd33a5c-1d4d-4aca-9159-4530a7d5c49e"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:28.245548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:28.257056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:28.257586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:28.258201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:28.259178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:28.259744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:28.260183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:28.586861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97dd199e-7f19-41ed-bbc9-6ff1f9f41bb8 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "POST /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347614 Sep 27 02:10:28.587835 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3193/6426] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:10:28 2022] POST /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:41.145097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:41.145776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:41.153273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:41.154522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=13 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:41.156492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:41.157291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:41.158027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:41.159218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:41.159847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:41.160571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:41.296351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lazy-loading 'services' on Instance uuid deccc935-cef1-4feb-8ea2-72ee46fb37f3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:10:41.391085 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e055ed6f-e60b-456b-acd6-0db081bd03ce tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments/ddd33a5c-1d4d-4aca-9159-4530a7d5c49e" status: 202 len: 0 microversion: 2.1 time: 0.249756 Sep 27 02:10:41.392090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3234/6427] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:10:41 2022] DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments/ddd33a5c-1d4d-4aca-9159-4530a7d5c49e => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:10:41.402468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:41.404868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:41.416104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:41.417480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:41.419052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:41.420046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:41.420491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:41.421212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:41.421696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:41.422129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:41.495797 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93f49f60-ea0d-415e-9e7f-141714b97332 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098731 Sep 27 02:10:41.498184 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3194/6428] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:41 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:42.513461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:42.516460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:42.531050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:42.538392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:42.539660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:42.540586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:42.541309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:42.542842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:42.591340 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70de6e4b-224b-43ad-83d0-30983834109a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084393 Sep 27 02:10:42.597602 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3235/6429] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:42 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:43.562188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1481980717", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e1fc8cd8-abfd-4017-a357-266dfbeb6352", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:43.609132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:43.618079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:43.626786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:43.627490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:43.628247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:43.629391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:43.630415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:43.630867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:43.676115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-421f851d-9b6f-4616-b1e4-600177592102 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074148 Sep 27 02:10:43.677413 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3236/6430] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:43 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:10:43.695631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:10:44.295917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:10:44.296913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:10:44.297667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:10:44.298561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:10:44.299872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:10:44.311954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:44.312754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:44.313453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:44.314468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:44.315168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:44.315804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:44.337483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:10:44.344523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:10:44.360374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:10:44.363310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e1fc8cd8-abfd-4017-a357-266dfbeb6352',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:10:44.469022 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24609de9-f187-44bc-bea8-e30979d0becb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914700 Sep 27 02:10:44.472279 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3195/6431] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:10:44.484053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2fbb6d65-3cc3-490a-8484-346fa5cfcd51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:44.484684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2fbb6d65-3cc3-490a-8484-346fa5cfcd51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:44.564695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2fbb6d65-3cc3-490a-8484-346fa5cfcd51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:44.572702 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2fbb6d65-3cc3-490a-8484-346fa5cfcd51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1057 microversion: 2.1 time: 0.092625 Sep 27 02:10:44.573405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3237/6432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:44 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1057 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:10:44.690664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:44.701709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:44.725025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:44.725696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:44.726438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:44.727385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:44.728066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:44.728743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:44.784598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-232dff5c-ebaa-4781-914f-8f312ed20eff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099037 Sep 27 02:10:44.786063 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3196/6433] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:44 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:45.598387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:45.599621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:45.608127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:45.608602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:45.609033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:45.609762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:45.610217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:45.610775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:45.677403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:45.685859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abc99125-7908-48bb-94e4-6842e89872aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1109 microversion: 2.1 time: 0.091738 Sep 27 02:10:45.686456 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3238/6434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:45 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1109 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:45.799166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:45.801603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:45.813386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:45.813882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:45.814627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:45.815340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:45.815798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:45.816222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:45.880142 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c9eeefd-f6c8-408a-9b11-e6ac644864d9 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085673 Sep 27 02:10:45.880860 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3197/6435] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:45 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:46.485379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c97e25fe-b08c-4ac9-adf3-c06eee7dc529", "device": "/dev/sdb"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:46.489369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:46.497376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:46.498201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:46.499580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:46.500464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:46.501084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:46.501861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:46.709271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:46.710089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:46.738626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:46.739129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:46.739569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:46.740316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:46.744501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:46.746329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:46.950994 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7ce5007-1169-4fcd-841e-1bf083007d6b tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "POST /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469498 Sep 27 02:10:46.951925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3239/6436] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:10:46 2022] POST /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:46.991801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:47.008529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:47.038146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:47.041552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:47.042010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:47.042741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:47.043422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:47.044190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:47.093287 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ee7e039-1fa7-4340-aadb-34494831f56a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139771 Sep 27 02:10:47.099844 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3240/6437] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:46 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:47.246217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:47.258093 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8a1bb122-dab1-450c-8a66-80dcf3e9ea6f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.552880 Sep 27 02:10:47.262417 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3198/6438] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:46 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:10:48.112597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:48.116056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:48.136606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db06232-ad60-4a79-b86d-3d10279be149", "tag": "044f27a2-c443-4519-814e-b74996e82abe"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:48.156301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.156901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.159919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.160895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.161758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.165189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.170380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.175400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.179830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.211540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] Creating event network-changed:044f27a2-c443-4519-814e-b74996e82abe for instance 2db06232-ad60-4a79-b86d-3d10279be149 on n-h1-859358-1 Sep 27 02:10:48.233271 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-10656dec-5de7-457b-8d5b-a52db5d545e2 req-6bafc64c-17d8-4c64-ad6b-9b9c84fe050a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101485 Sep 27 02:10:48.233937 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3199/6439] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:10:48.255198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab9b88b0-8866-4c22-83f8-e05017c23c5b tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151633 Sep 27 02:10:48.261877 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3241/6440] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:10:48 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:10:48.290928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:48.292308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:48.303098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.303590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.305882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.306805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.307429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.309568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.334130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:48.334626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:48.341940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.348019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.348843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.349868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.350925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.352111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.404488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:10:48.522344 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-656e31fd-ae0c-4917-b70e-59983a693837 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 204 len: 0 microversion: 2.1 time: 0.191643 Sep 27 02:10:48.523474 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3242/6441] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:10:48 2022] DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:10:48.537214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:48.537957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:48.558743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.559232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.559882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.568829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:48.571613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:48.572832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:48.643012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:48.658482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04dd568f-89ce-4dec-9ba8-8436e44df180 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.369837 Sep 27 02:10:48.660225 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3200/6442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:48 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:48.851091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:48.861601 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-684870d2-7285-4f89-8f9b-c572571570ff tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1681 microversion: 2.1 time: 0.332993 Sep 27 02:10:48.866328 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3243/6443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:48 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1681 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:49.684461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:49.685268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:49.696541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:49.698572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:49.701077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:49.702190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:49.705786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:49.706600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:49.905046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:49.911315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:49.925130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:49.925965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:49.926791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:49.927715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:49.938706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:49.939305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:50.040312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:50.049011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e313447-a4a5-4ae4-9c41-19d0bfec4526 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.369161 Sep 27 02:10:50.068524 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3201/6444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:49 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:50.433614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:50.444312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d6dc20b-00a2-4943-aa77-f7715d8f026c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1681 microversion: 2.1 time: 0.550254 Sep 27 02:10:50.445691 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3244/6445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:49 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1681 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:51.076833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:51.078357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:51.091003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:51.095566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:51.096993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:51.098011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:51.101992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:51.104305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:51.450071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:51.458612 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fca77208-718b-44e5-90bc-c4e82769605c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.386072 Sep 27 02:10:51.473953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:51.474580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:51.476482 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3202/6446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:51 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:51.481636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:51.482590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:51.483232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:51.484094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:51.484578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:51.485065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:51.879684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:51.903954 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcc833de-dd6c-4ae9-aaa1-90a434f909d0 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1614 microversion: 2.1 time: 0.437723 Sep 27 02:10:51.904798 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3245/6447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:51 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1614 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:52.484241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:52.484864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:52.502061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:52.502914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:52.508610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:52.512314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:52.513016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:52.516497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:52.564489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deccc935-cef1-4feb-8ea2-72ee46fb37f3", "name": "network-vif-deleted", "tag": "75b83638-5677-49fe-aa22-23e8819ff947"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:10:52.592676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:52.602828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:52.604407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:52.668085 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] Creating event network-vif-deleted:75b83638-5677-49fe-aa22-23e8819ff947 for instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 on n-h2-859358-1 Sep 27 02:10:52.688296 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b31d7e03-e0ab-4917-ab22-132e35d68a70 req-6538cc55-4174-4d8c-8be1-ab36a030dc10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126270 Sep 27 02:10:52.698063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3246/6448] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:10:52.922191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:52.930383 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23c07ad7-dd09-4e81-90c8-fc424921e248 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.450050 Sep 27 02:10:52.950689 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3203/6449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:52 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:52.958188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:52.959151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:52.973879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:52.974480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:52.975518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:52.975813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:52.995877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:52.998639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:53.100222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:53.101509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:53.102268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:53.103687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lazy-loading 'fault' on Instance uuid deccc935-cef1-4feb-8ea2-72ee46fb37f3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:10:53.187892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5171df5b87db4e469fecb5ea9e9d6366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd0489331474700acea6cd4c1a24b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:53.196980 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-44b3b64f-8336-4727-b5aa-042494b4b6f6 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 200 len: 1331 microversion: 2.1 time: 0.243187 Sep 27 02:10:53.225374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3247/6450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:52 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 1331 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:53.961027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:53.964086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:53.992263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:53.993120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:53.993819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:53.994674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:53.995186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:53.995835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:54.239892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:54.241136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:54.262525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:54.263047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:54.263497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:54.264225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:54.267346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:54.272767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:54.284643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:54.297288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:54.315073 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b40b314d-b6ae-4779-b7ca-572c1051fc85 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.351985 Sep 27 02:10:54.315073 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3204/6451] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:53 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:54.350951 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 HTTP/1.1 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'deccc935-cef1-4feb-8ea2-72ee46fb37f3'} Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:10:54.352916 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:10:54.357206 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:10:54.366643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:10:54.367400 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f508a96d-89ec-4869-b607-e16ace5a7f13 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 404 len: 111 microversion: 2.1 time: 0.132321 Sep 27 02:10:54.368535 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3248/6452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:54 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:10:54.377197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f0057148-68ae-49ee-91d0-71b31fe871eb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '.version_select at 0x7f24d50b2ca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:54.387777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:54.390513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:54.441956 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f0057148-68ae-49ee-91d0-71b31fe871eb tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060625630" status: 202 len: 0 microversion: 2.1 time: 0.068486 Sep 27 02:10:54.450231 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3205/6453] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 02:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060625630 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:10:55.338330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:55.339096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:55.340770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:10:55.362455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:55.362915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:55.369370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:55.370154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:55.370639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:55.371067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:56.639708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:56.668175 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9e00c35-0a70-47b1-9b7d-98984a9228e8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 1.334103 Sep 27 02:10:56.721477 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3249/6454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:55 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:57.713694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:57.714554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:57.734582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:57.735092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:57.735537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:57.736286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:57.747391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:57.749607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:58.052646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:58.084724 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aedb7095-12d8-4622-b469-70c71971d735 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.373747 Sep 27 02:10:58.090026 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3206/6455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:57 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:10:59.117262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:10:59.118295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:10:59.137864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:59.138547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:59.139160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:59.144473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:10:59.145246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:10:59.145922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:10:59.632519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:10:59.644233 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-623240f7-1594-4e19-a78b-6376d12e5a27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.533350 Sep 27 02:10:59.660829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3250/6456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:10:59 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:00.671044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:00.672760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:00.685767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:00.686566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:00.687475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:00.688554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:00.689731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:00.690588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:00.952292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:00.966067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e04d847f-1c64-4a12-8420-4901171f33af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.301875 Sep 27 02:11:00.974364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3207/6457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:00 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:01.063341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:01.064433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:01.073642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:01.074748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:01.075348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:01.076346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:01.077222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:01.077997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:01.093859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 HTTP/1.1 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'deccc935-cef1-4feb-8ea2-72ee46fb37f3'} Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:01.109161 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.114996 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.119630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:01.120957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2edd34c3-f16c-42c3-abfc-ae5981d441b3 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 404 len: 111 microversion: 2.1 time: 0.061914 Sep 27 02:11:01.122790 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3251/6458] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:01 2022] DELETE /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:01.132028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:01.133241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: deccc935-cef1-4feb-8ea2-72ee46fb37f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:01.142215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:01.142981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:01.143595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:01.144491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:01.145107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:01.145861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:01.165793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 HTTP/1.1 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'deccc935-cef1-4feb-8ea2-72ee46fb37f3'} Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:01.167699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. Sep 27 02:11:01.172492 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:01.173454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance deccc935-cef1-4feb-8ea2-72ee46fb37f3 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:01.175111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-957309bb-8043-4192-8c40-c4fb17144e71 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3" status: 404 len: 111 microversion: 2.1 time: 0.048467 Sep 27 02:11:01.175823 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3208/6459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:01 2022] GET /compute/v2.1/servers/deccc935-cef1-4feb-8ea2-72ee46fb37f3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:02.003407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:02.004333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:02.019422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:02.020742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:02.024114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:02.026321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:02.027101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:02.028972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:02.312333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:02.324730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ca32d97-c0cd-495a-bbd7-a2adcb999c23 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.326544 Sep 27 02:11:02.341374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3252/6460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:01 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:03.355879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:03.357712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:03.373480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:03.374298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:03.375127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:03.375929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:03.376423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:03.376908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:04.082591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:04.093577 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f3e98036-27c4-4fb5-af7a-18e057bdb995 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.740353 Sep 27 02:11:04.095802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3209/6461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:03 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:05.122730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:05.123675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:05.137411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:05.139183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:05.141297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:05.142442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:05.144451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:05.147001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:05.439967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:05.470512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5c92520b-bcac-4914-881c-baa62ad94523 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.348627 Sep 27 02:11:05.471400 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3253/6462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:05 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:06.397767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-371eb4c3-f27e-4280-9c7f-1b9ef072236a tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1527725057", "availability_zone": "foo_zone"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:06.403610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.aggregate [None req-371eb4c3-f27e-4280-9c7f-1b9ef072236a tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Generated uuid d0df8ef9-2943-4e86-a965-3e5edac40a49 for aggregate {{(pid=128778) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 27 02:11:06.452091 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-371eb4c3-f27e-4280-9c7f-1b9ef072236a tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.252683 Sep 27 02:11:06.452954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3210/6463] 10.222.0.52 () {60 vars in 1164 bytes} [Tue Sep 27 02:11:06 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:06.464750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e280c505-f76f-45f8-9c0c-776cec359cf5 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:06.497202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:06.498240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:06.516932 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e280c505-f76f-45f8-9c0c-776cec359cf5 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.055308 Sep 27 02:11:06.518053 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3254/6464] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 02:11:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:06.523692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:06.525027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:06.525515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:06.526248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:06.526880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:06.527470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:06.540385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:06.550316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:06.550804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:06.551893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:06.552729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:06.553199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:06.554105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:06.586198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9299a8f9-9a87-4aa4-8437-24a1e884a3b7 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059466 Sep 27 02:11:06.593937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3255/6465] 10.222.0.52 () {58 vars in 1176 bytes} [Tue Sep 27 02:11:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:06.599865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c2e5afb-cc98-4228-9d73-7f5d938e9eb4 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:06.608962 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c2e5afb-cc98-4228-9d73-7f5d938e9eb4 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013244 Sep 27 02:11:06.610206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3256/6466] 10.222.0.52 () {58 vars in 1143 bytes} [Tue Sep 27 02:11:06 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:06.622560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-206461ff-db81-4920-b278-eb644c608da6 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:06.637847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206461ff-db81-4920-b278-eb644c608da6 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:06.638433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206461ff-db81-4920-b278-eb644c608da6 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:06.638867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-206461ff-db81-4920-b278-eb644c608da6 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:06.777728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:06.792047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1709ae4f-1af2-4410-bc15-f7556831af55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.300388 Sep 27 02:11:06.793948 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3211/6467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:06 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:07.051503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.052018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:07.059097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-206461ff-db81-4920-b278-eb644c608da6 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.440144 Sep 27 02:11:07.063313 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3257/6468] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 02:11:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:07.065811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.066316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.066756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.071862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.072351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.077645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.078860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3438f22a-ab80-4e0b-9443-3c433d43fa22 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.098423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b HTTP/1.1 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aa9dbf1b-d34c-42a4-922d-161daa2d323b'} Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:07.101894 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.108317 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.110122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:07.111807 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-654109e9-caf3-4c0e-a42c-87cf3516cad4 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 404 len: 111 microversion: 2.1 time: 0.064579 Sep 27 02:11:07.113067 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3212/6469] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:07 2022] DELETE /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:11:07.115095 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3438f22a-ab80-4e0b-9443-3c433d43fa22 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.045864 Sep 27 02:11:07.116655 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3258/6470] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 02:11:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:07.126587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.127419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: aa9dbf1b-d34c-42a4-922d-161daa2d323b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:07.130801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ca1a2d3-2129-443a-a6e1-a9b94bf79776 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1036297969", "availability_zone": "foo_zone"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:07.137391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.138175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.138935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.140076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.141054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.141788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.175812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b HTTP/1.1 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aa9dbf1b-d34c-42a4-922d-161daa2d323b'} Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.179087 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. Sep 27 02:11:07.184075 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.196911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance aa9dbf1b-d34c-42a4-922d-161daa2d323b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:07.198832 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cf2d9e8-9e12-4235-a3ef-8fb90ab4bd8f tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b" status: 404 len: 111 microversion: 2.1 time: 0.080306 Sep 27 02:11:07.200625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3213/6471] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:07 2022] GET /compute/v2.1/servers/aa9dbf1b-d34c-42a4-922d-161daa2d323b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:07.214155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.214803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:07.238037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.238784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.239234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.245497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.246002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.246473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.266423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 HTTP/1.1 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a133c259-48ad-49a2-8ebe-62a569ffcb60'} Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:07.281564 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ff08f0b-6abd-47ab-ac54-8ed4866d523a tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 404 len: 111 microversion: 2.1 time: 0.076296 Sep 27 02:11:07.287230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3214/6472] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:07 2022] DELETE /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:07.302741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.304849 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ca1a2d3-2129-443a-a6e1-a9b94bf79776 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.178008 Sep 27 02:11:07.305698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: a133c259-48ad-49a2-8ebe-62a569ffcb60] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:07.314803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.315810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.316483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.318164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.318284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3259/6473] 10.222.0.52 () {60 vars in 1173 bytes} [Tue Sep 27 02:11:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:07.319047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.319766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.323021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f62affa-0868-4ab0-9fff-b994057c328c tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:07.338966 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 HTTP/1.1 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a133c259-48ad-49a2-8ebe-62a569ffcb60'} Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:07.342531 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. Sep 27 02:11:07.348858 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:07.351383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance a133c259-48ad-49a2-8ebe-62a569ffcb60 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:07.352280 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fe594ec-a9ef-4a0a-912a-f57c884a3393 tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60" status: 404 len: 111 microversion: 2.1 time: 0.063558 Sep 27 02:11:07.352863 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3215/6474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:07 2022] GET /compute/v2.1/servers/a133c259-48ad-49a2-8ebe-62a569ffcb60 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:07.405218 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f62affa-0868-4ab0-9fff-b994057c328c tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.085512 Sep 27 02:11:07.415722 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3260/6475] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 02:11:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:07.418313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3309d45d-8ff0-4bff-a236-4f8c28c82b9b tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.429474 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3309d45d-8ff0-4bff-a236-4f8c28c82b9b tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.015133 Sep 27 02:11:07.433937 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3216/6476] 10.222.0.52 () {58 vars in 1152 bytes} [Tue Sep 27 02:11:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:07.442670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5b94351f-dc7f-4997-959f-8acbb53ed93e tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-859358-1"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:07.472282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b94351f-dc7f-4997-959f-8acbb53ed93e tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.474356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b94351f-dc7f-4997-959f-8acbb53ed93e tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.478156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5b94351f-dc7f-4997-959f-8acbb53ed93e tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.733854 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5b94351f-dc7f-4997-959f-8acbb53ed93e tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.293689 Sep 27 02:11:07.734588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3261/6477] 10.222.0.52 () {60 vars in 1194 bytes} [Tue Sep 27 02:11:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:07.745925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5fe6faa3-7bcb-478c-96e8-0777d6960102 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.791035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5fe6faa3-7bcb-478c-96e8-0777d6960102 tempest-TestAggregatesBasicOps-1781858581 tempest-TestAggregatesBasicOps-1781858581-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.048630 Sep 27 02:11:07.797887 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3217/6478] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Sep 27 02:11:07 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 27 02:11:07.816463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:07.818010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:07.822982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:07.828982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.830197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.830812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:07.831990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:07.832620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:07.833429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:08.179368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:08.193079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bdead3eb-7b4e-42da-8a68-8d266b88b041 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.377221 Sep 27 02:11:08.218011 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3262/6479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:07 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:09.224694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:09.226056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:09.234890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:09.235671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:09.236284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:09.237464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:09.238113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:09.238850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:09.433451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:09.445917 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae322f63-441c-47c6-8299-cb5bf0190881 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.224719 Sep 27 02:11:09.462258 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3218/6480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:09 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:10.476023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:10.476683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:10.491420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:10.491955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:10.501461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:10.502380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:10.502871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:10.503316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:10.738692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:10.748545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d5354cd4-c156-4040-bd62-bd56782df289 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.279239 Sep 27 02:11:10.750310 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3263/6481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:10 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:11.774156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:11.775734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:11.790361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:11.794837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:11.797860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:11.798539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:11.799944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:11.801888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:11.805620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:11.836248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=99 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:12.137464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:12.165463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc86756c-7b9f-40d5-901d-fb310a9b9bb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1169 microversion: 2.1 time: 0.394914 Sep 27 02:11:12.168762 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3219/6482] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:11 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1169 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:13.083689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:13.084213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:13.091138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.091623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.092057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.092750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.093202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.093675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.108364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 HTTP/1.1 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '5ad499eb-1909-4b81-98cc-28b82d0d0269'} Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:13.110305 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.114578 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.116472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:13.117544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bab54fe1-24e5-4dd5-a864-61e5e13ca02c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 404 len: 111 microversion: 2.1 time: 0.037813 Sep 27 02:11:13.118283 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3264/6483] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:13 2022] DELETE /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:13.126689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:13.127319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] [instance: 5ad499eb-1909-4b81-98cc-28b82d0d0269] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:13.134114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.134605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.135047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.135795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.136211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.136907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.151398 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] HTTP exception thrown: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Request method failure captured: Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 HTTP/1.1 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMloYmwXUw4fGpPzrpQe8BRBn7ashQP9R366Ms9Kw_3PWO9SR9P7WN5WOYDhiJp76MGBiqi-yWTrCPkRHVJu1a16OQiu61aCjDxjZsULotIXQSI4cGPSM_9YQZHao5R6FZTZisQf1yVLs_-jb4l-V-_EqoXsGWl8DBY3nc_VEZrAnfDU Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4bd0489331474700acea6cd4c1a24b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4bd0489331474700acea6cd4c1a24b21", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4bd0489331474700acea6cd4c1a24b21 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2005598842 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 5171df5b87db4e469fecb5ea9e9d6366 Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-AttachVolumeNegativeTest-2005598842-project Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '5ad499eb-1909-4b81-98cc-28b82d0d0269'} Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:13.153009 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] Returning 404 to user: Instance 5ad499eb-1909-4b81-98cc-28b82d0d0269 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7cfdd471-462d-49d5-9045-4722a0ca6c2c tempest-AttachVolumeNegativeTest-2005598842 tempest-AttachVolumeNegativeTest-2005598842-project] 10.222.0.52 "GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269" status: 404 len: 111 microversion: 2.1 time: 0.031902 Sep 27 02:11:13.159771 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3220/6484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:13 2022] GET /compute/v2.1/servers/5ad499eb-1909-4b81-98cc-28b82d0d0269 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:11:13.190559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:13.191541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:13.210039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.210770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.211884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.212846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:13.213803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:13.214436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:13.628293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:13.641088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e7040e13-8788-46bc-ae4d-a25bc8c19fcb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.454720 Sep 27 02:11:13.641729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3265/6485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:13 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:14.665131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:14.665902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:14.681396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:14.682005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:14.682525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:14.683339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:14.686776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:14.687331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:14.970958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:14.981107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-866b6d91-dd20-4d24-99d6-e353a00bd771 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.320429 Sep 27 02:11:14.981734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3221/6486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:14 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:16.003370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:16.004672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:16.016953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:16.017821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:16.020020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:16.021762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:16.024216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:16.025391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:16.320771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:16.331006 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-06ccf789-19f0-4a76-9d71-4894495001d3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.331788 Sep 27 02:11:16.331615 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3266/6487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:15 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:17.362827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:17.365304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:17.381293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:17.384603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:17.385067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:17.385840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:17.386370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:17.386809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:17.813760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:17.847825 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7b3cde15-982e-438b-b740-2cb2c841e512 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.487618 Sep 27 02:11:17.850207 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3222/6488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:17 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:18.877053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:18.877737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:18.879642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:18.889148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:18.894129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:18.894585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:18.902121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:18.902462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:18.902917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:19.079702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:19.089903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-274261d3-0c00-47e7-8a54-87e9063d7312 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.217557 Sep 27 02:11:19.091087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3267/6489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:18 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:20.114259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:20.115043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:20.123377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:20.123867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:20.124302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:20.125002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:20.125514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:20.125890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:20.285678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:20.296177 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-279b2dd4-03a2-4573-a544-05adb0f8cdee tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.186552 Sep 27 02:11:20.296766 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3223/6490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:20 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:20.432564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:20.433780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:20.442740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:20.443832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:20.444482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:20.445416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:20.445748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:20.446189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:20.541535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lazy-loading 'services' on Instance uuid c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:11:20.631414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-94c5998b-b9ff-4662-ac2f-bef496c35820 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe/os-volume_attachments/c97e25fe-b08c-4ac9-adf3-c06eee7dc529" status: 202 len: 0 microversion: 2.1 time: 0.202436 Sep 27 02:11:20.632244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3268/6491] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:11:20 2022] DELETE /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe/os-volume_attachments/c97e25fe-b08c-4ac9-adf3-c06eee7dc529 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:11:21.323693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:21.325087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:21.337497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:21.338548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:21.339451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:21.341142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:21.342113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:21.343225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:21.659560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:21.671183 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf887df1-6810-45d3-90d2-6dce5d43c8b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.355462 Sep 27 02:11:21.673547 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3224/6492] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:21 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:22.698284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:22.699024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:22.706912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:22.707408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:22.708257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:22.709617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:22.710591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:22.711129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:22.970112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:22.979109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41fe3e7a-766c-4463-bb88-286745bf5bc5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.288090 Sep 27 02:11:22.984210 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3269/6493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:22 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:24.011977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:24.011977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:24.026518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:24.029909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:24.030591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:24.032095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:24.032731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:24.034639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:24.313329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:24.338133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80070be6-b7d5-4b2b-9240-df1f73c74c0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.334851 Sep 27 02:11:24.339904 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3225/6494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:24 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:24.827137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db06232-ad60-4a79-b86d-3d10279be149", "name": "network-vif-plugged", "status": "completed", "tag": "044f27a2-c443-4519-814e-b74996e82abe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:24.864471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:24.866280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:24.866744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:24.887736 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] Creating event network-vif-plugged:044f27a2-c443-4519-814e-b74996e82abe for instance 2db06232-ad60-4a79-b86d-3d10279be149 on n-h1-859358-1 Sep 27 02:11:24.905734 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-11e78fc1-d3e8-44b8-a091-7ccc764a57e4 req-bbde8ad4-7d63-451a-a578-ed814f90eaa4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085325 Sep 27 02:11:24.925364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3270/6495] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:25.362935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:25.363624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:25.377871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:25.380698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:25.381396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:25.382490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:25.383481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:25.384130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:25.628024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:25.641126 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-81f6de6d-05d4-4e6f-a13e-c9ff8e930b27 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1203 microversion: 2.1 time: 0.282051 Sep 27 02:11:25.643587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3226/6496] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:25 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1203 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:26.670568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:26.671796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:26.688413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:26.689476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:26.690305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:26.691249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:26.691851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:26.692434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:26.697929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:26.897002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:26.921126 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ece66682-f1cf-4483-b7b9-4a480a726845 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1390 microversion: 2.1 time: 0.243022 Sep 27 02:11:26.921997 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3271/6497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:26 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1390 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:26.951813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:26.952984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:26.964049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:26.964548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:26.964991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:26.965738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:26.966186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:26.967782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.194142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:27.205221 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25b200e9-d0e1-4dd1-ab13-8862a9a95138 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1390 microversion: 2.1 time: 0.258218 Sep 27 02:11:27.206486 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3227/6498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:26 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1390 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:27.229044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:27.230396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:27.238717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.239234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.240605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.241358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.241810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.242373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.355039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:27.355545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:27.372302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.374743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.375589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.376328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.377116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.377736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.418942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:11:27.487496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:27.497975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec3e21ca-505a-4ff0-ad6a-62056b6836a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1390 microversion: 2.1 time: 0.273849 Sep 27 02:11:27.499151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3272/6499] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:27 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:27.637911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e42cddf-e84d-412a-a5fc-b5a94a8aca58 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 204 len: 0 microversion: 2.1 time: 0.286574 Sep 27 02:11:27.639587 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3228/6500] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:27 2022] DELETE /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 02:11:27.649687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:27.650316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:27.654233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:27.655114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:27.667244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.667781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.668231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.668972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.669616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.670071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.671543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.672027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.672521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.673522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.674030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.675982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.732072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:11:27.870482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5466bcec-51d8-4167-928f-e61fab0904a4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 204 len: 0 microversion: 2.1 time: 0.220434 Sep 27 02:11:27.875340 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3229/6501] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:27 2022] DELETE /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:11:27.887883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:27.888703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:27.902136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.902697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.903199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.903918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:27.904373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:27.904511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:27.904857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:27.917491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d54525c7-a5da-4e31-a2f5-1670ea051432 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1514 microversion: 2.1 time: 0.272583 Sep 27 02:11:27.931954 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3273/6502] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:27 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:28.187504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:28.204722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d503c790-61e6-4d9a-a933-1f3b59a79910 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1396 microversion: 2.1 time: 0.327411 Sep 27 02:11:28.205488 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3230/6503] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:27 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1396 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:28.953681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:28.955843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:28.973217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:28.974231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:28.975632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:28.976671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:28.977532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:28.978263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:29.229036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:29.229700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:29.248884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:29.249403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:29.250631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:29.251602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:29.252311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:29.252819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:29.317641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:29.329799 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1fc6faee-1d6f-41c3-9f49-cbd150eb0ae7 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1514 microversion: 2.1 time: 0.384388 Sep 27 02:11:29.331386 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3274/6504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:28 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:30.355839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:30.357158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:30.382600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:30.383346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:30.383906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:30.384824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:30.385593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:30.386273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:30.390857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:30.409768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-384a9041-133e-4243-9a0f-2c2860c00d20 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1396 microversion: 2.1 time: 1.185747 Sep 27 02:11:30.432844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3231/6505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:29 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1396 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:30.765254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:30.774958 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3c17638-c091-4651-a7cd-1aae736a0300 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1514 microversion: 2.1 time: 0.423342 Sep 27 02:11:30.794903 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3275/6506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:30 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1514 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:31.449513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:31.450150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:31.456761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:31.472511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:31.473910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:31.475099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:31.476057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:31.477610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:31.803950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:31.806324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:31.825095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:31.825741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:31.827300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:31.828236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:31.829622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:31.830551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:31.877591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:31.899436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5dcb406-a992-45e2-9943-fffdefa15beb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1354 microversion: 2.1 time: 0.457503 Sep 27 02:11:31.900688 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3232/6507] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:31 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1354 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:31.971119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db06232-ad60-4a79-b86d-3d10279be149", "name": "network-vif-deleted", "tag": "044f27a2-c443-4519-814e-b74996e82abe"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:32.004290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:32.008122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:32.008833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:32.022523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:32.039118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:32.060786 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d777cc2-4d92-45b6-86fa-19507ef532a8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1472 microversion: 2.1 time: 0.255170 Sep 27 02:11:32.061757 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3276/6508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:31 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:32.065971 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] Creating event network-vif-deleted:044f27a2-c443-4519-814e-b74996e82abe for instance 2db06232-ad60-4a79-b86d-3d10279be149 on n-h1-859358-1 Sep 27 02:11:32.085247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d4d9832b-28be-4fa2-9682-2447a6649a00 req-6da2f4ff-1b21-4a9c-a302-da602a5788c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118541 Sep 27 02:11:32.086598 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3233/6509] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:32.928747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:32.930007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:32.950472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:32.951529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:32.952156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:32.957278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:32.957989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:32.958636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:33.090564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:33.091290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:33.111508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:33.116397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:33.116934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:33.117822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:33.118303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:33.118742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:33.160132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:33.181435 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dae24db-6835-43f5-ae4f-daa91e8b1cdb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.253188 Sep 27 02:11:33.183913 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3277/6510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:32 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:33.222820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:33.225208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:33.227892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:33.228552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lazy-loading 'fault' on Instance uuid c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:11:33.347812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:33.358042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae21497e-16e3-4d89-99da-35a88b6a9fe2 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 200 len: 1309 microversion: 2.1 time: 0.273284 Sep 27 02:11:33.369363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3234/6511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:33 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:34.173850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe", "name": "network-vif-deleted", "tag": "5cd7b872-b188-483d-b495-1f82bbfb6092"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:34.194952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:34.195787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:34.196415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:34.211616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:34.212626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:34.233096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:34.233633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:34.234077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:34.234829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:34.237012 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] Creating event network-vif-deleted:5cd7b872-b188-483d-b495-1f82bbfb6092 for instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe on n-h2-859358-1 Sep 27 02:11:34.239750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:34.240836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:34.252381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ca123553-325e-4e66-b093-2021da75006b req-79a3a43e-ce47-4c20-90bc-62acb4d627c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082717 Sep 27 02:11:34.263571 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3278/6512] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:34.383026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:34.385167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:34.393252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:34.394059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:34.394750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:34.396457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:34.397132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:34.397818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:34.401936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:34.417999 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] HTTP exception thrown: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Request method failure captured: Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe HTTP/1.1 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMls4eAzTkZ_Kknt1UClK_SIzsydTZ_PkVTCjEvUSTDKOLmwC5RjTiv1D0Yh6nrcG9YtvlHOBjrxLzgxRN5lFFzJ_pGFx9S8VIdHbjHmp0SdVCaeKOSh0GIPqkrjaYOz0WB1MgK84Jab_2YJfiZ_NHiD6naR0oz36vppAcx2-arveB7k Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 69774c9a99ef47c6a3ade7dbce689a5e Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69774c9a99ef47c6a3ade7dbce689a5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 69774c9a99ef47c6a3ade7dbce689a5e Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesSnapshotTestJSON-1608790482-project Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ef1d6154768c4804bb10cbd2da3a702a Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesSnapshotTestJSON-1608790482-project Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe'} Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:34.420294 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. Sep 27 02:11:34.424709 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:34.425293 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc1a94ed-d723-40b1-b188-b7f3c054c869 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.215132 Sep 27 02:11:34.426459 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3235/6513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:34 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:34.442249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Returning 404 to user: Instance c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:34.444486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-328b93e0-3328-4ee7-a6eb-5ef05b01bf17 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe" status: 404 len: 111 microversion: 2.1 time: 0.066062 Sep 27 02:11:34.446276 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3279/6514] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:34 2022] GET /compute/v2.1/servers/c65b23bb-5180-4c5a-99ba-6e4a9cbb7cbe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:35.143578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e9a71d9-02f1-4fde-9023-3b5efaef3e62 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Action: 'create', calling method: .version_select at 0x7f24d5636ca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1525071897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAitSLRjTxXxsctJOTpwfrd1GAlAyHJxFgS+pyveOHJoWWRpJ4GRW2OSLwUlkpjnfqDBsMEsb6WAgqXaEIRC8D6kaYdkwN3lQlN2VEyQ4115XjwJb87CuQh8Y/Cp4OXJIg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:35.162037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6e9a71d9-02f1-4fde-9023-3b5efaef3e62 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:11:35.175725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-6e9a71d9-02f1-4fde-9023-3b5efaef3e62 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for user 174f679ff06546f9a6aaee37dedae58a and project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:11:35.229119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e9a71d9-02f1-4fde-9023-3b5efaef3e62 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.430562 Sep 27 02:11:35.231956 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3236/6515] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:11:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:35.451887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:35.453466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:35.475966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:35.476720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:35.479098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:35.482571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:35.484035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:35.485050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:35.640471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:35.652356 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15bb065c-dcbe-45a1-8c69-fdc0244c1d7e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.207436 Sep 27 02:11:35.666752 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3280/6516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:35 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:36.679917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:36.680749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:36.699264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:36.704996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:36.708952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:36.710156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:36.711654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:36.712323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:36.852695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:36.865427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88b23ca9-82ea-40cf-afc2-c9a7cc21dd03 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.189792 Sep 27 02:11:36.873199 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3237/6517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:36 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:37.299583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1548228560", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1525071897", "security_groups": [{"name": "tempest-secgroup-smoke-2032534749"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "aaad0e72-3586-4265-a0e1-e1b7bb9d0487"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:37.439325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] validate_networks() for [('aaad0e72-3586-4265-a0e1-e1b7bb9d0487', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:11:37.895191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:37.896446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:37.910419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:37.910918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:37.911390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:37.912108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:37.912562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:37.912988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:37.981892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=41 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:38.000513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:11:38.064499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for user 174f679ff06546f9a6aaee37dedae58a and project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: dict_keys(['metadata_items']) {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:11:38.113791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:11:38.116019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:11:38.116759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:11:38.117184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:11:38.117767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:11:38.141965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:38.143541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:38.144416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:38.145770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:38.149374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:38.149925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:38.162350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:38.183156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aedc1691-c5d6-4393-a32a-862faffdcd4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.291810 Sep 27 02:11:38.184278 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3238/6518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:37 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:38.196004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:11:38.219814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Getting quotas for user 174f679ff06546f9a6aaee37dedae58a and project 6228b2f92f7f44378499df5cf5a3cd6f. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:11:38.235373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:11:38.238047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:11:38.293473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a0163c79-5a9c-4326-8a6d-f06952af92f8 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998080 Sep 27 02:11:38.294946 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3281/6519] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:11:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:11:38.306818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b3fb0a2-7320-4a81-aafa-2c0e3d812cc0 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:38.307648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b3fb0a2-7320-4a81-aafa-2c0e3d812cc0 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:38.407332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b3fb0a2-7320-4a81-aafa-2c0e3d812cc0 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:38.416128 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b3fb0a2-7320-4a81-aafa-2c0e3d812cc0 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1303 microversion: 2.1 time: 0.113858 Sep 27 02:11:38.419515 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3239/6520] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:38 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:39.218517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:39.219606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:39.230247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:39.231596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:39.232487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:39.233679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:39.234739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:39.235564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:39.339520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:39.364858 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a6372d09-6e5d-4d02-95e3-7db8cb7c64e3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 200 len: 1188 microversion: 2.1 time: 0.158572 Sep 27 02:11:39.382106 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3282/6521] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:39 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:39.449132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:39.450006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:39.475517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:39.481417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:39.484747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:39.488477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:39.491951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:39.495146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:39.658997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:39.669016 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84e32202-cb5a-4946-96f5-6ad1c82182fb tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1299 microversion: 2.1 time: 0.231284 Sep 27 02:11:39.673211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3240/6522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:39 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:40.387629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:40.390393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:40.426683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:40.429610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:40.432287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:40.434441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:40.435758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:40.436451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:40.488088 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 HTTP/1.1 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2db06232-ad60-4a79-b86d-3d10279be149'} Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:40.513060 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c70d1c43-a05a-4994-a0c8-a72918c95760 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 404 len: 111 microversion: 2.1 time: 0.130892 Sep 27 02:11:40.520479 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3283/6523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:40 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:40.695192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:40.696448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:40.710430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:40.714136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:40.714902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:40.715864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:40.716538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:40.717867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:40.895261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:40.909131 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-90e76b34-0d31-4072-92ca-f25025babbcc tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1361 microversion: 2.1 time: 0.218505 Sep 27 02:11:40.910072 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3241/6524] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:40 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:41.937460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:41.938438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:41.958996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:41.959817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:41.960424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:41.961304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:41.961955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:41.962624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:42.242206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:42.252128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fce20dd-f7fe-446e-ba92-fc6302d77d0e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.318545 Sep 27 02:11:42.253071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3284/6525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:41 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:42.639243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a10ebbf9-0c75-4e00-8d80-3abaae153105", "tag": "da1767f8-1294-446e-bb35-306c90b82025"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:42.649642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:42.680971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:42.687891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:42.687891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:42.716311 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] Creating event network-changed:da1767f8-1294-446e-bb35-306c90b82025 for instance a10ebbf9-0c75-4e00-8d80-3abaae153105 on n-h2-859358-1 Sep 27 02:11:42.729901 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-38cce28a-1aff-4d60-9c6c-3bf613fc9705 req-e0e6781c-b7e1-40c1-8992-5f2c48eb715a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095418 Sep 27 02:11:42.730520 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3242/6526] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:43.284536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:43.285880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:43.302723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.303527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.304147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:43.305566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.306331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.307297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:43.888031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:43.888623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:43.898228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.898711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.899146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:43.899856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.900308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.900736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:43.932875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:43.941213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66a180d5-4bb0-4092-ba6b-41374ff2876e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.668442 Sep 27 02:11:43.941846 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3285/6527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:43 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:43.958240 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 HTTP/1.1 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '2db06232-ad60-4a79-b86d-3d10279be149'} Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:43.960137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:43.964816 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:11:43.969473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:43.970480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93eefafe-09d7-4a71-b6b5-9a1939cc2e0b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 404 len: 111 microversion: 2.1 time: 0.088250 Sep 27 02:11:43.971405 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3243/6528] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:11:43 2022] DELETE /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:11:43.981498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:43.982727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 2db06232-ad60-4a79-b86d-3d10279be149] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:43.989089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.990215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.990654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:43.991410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:43.991925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:43.992356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:44.009694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 HTTP/1.1 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '2db06232-ad60-4a79-b86d-3d10279be149'} Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:11:44.011331 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 2db06232-ad60-4a79-b86d-3d10279be149 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2e20bf77-e67c-45f7-8d1b-1b2412438f8d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149" status: 404 len: 111 microversion: 2.1 time: 0.036480 Sep 27 02:11:44.019317 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3286/6529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:43 2022] GET /compute/v2.1/servers/2db06232-ad60-4a79-b86d-3d10279be149 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:11:44.964180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:44.965647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:44.973250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:44.974649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:44.975678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:44.977331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:44.978057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:44.979455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:45.149948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:45.163454 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05249b5e-a05b-486b-8f2f-2f2e4aadf62b tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.203068 Sep 27 02:11:45.163959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3244/6530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:44 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:45.206218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-661987125", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "61b6697b-cccb-4ebf-b3f8-b99be955a376"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:45.264236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] validate_networks() for [('61b6697b-cccb-4ebf-b3f8-b99be955a376', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:11:45.777620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:11:45.778485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:11:45.779527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:11:45.781016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:11:45.781735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:11:45.805554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:45.806259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:45.806813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:45.808688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:45.809606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:45.811875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:45.839287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Getting quotas for project 69774c9a99ef47c6a3ade7dbce689a5e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:11:45.845896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Getting quotas for user ef1d6154768c4804bb10cbd2da3a702a and project 69774c9a99ef47c6a3ade7dbce689a5e. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:11:45.862733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:11:45.865756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:11:45.915718 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8c1bd8d-1f12-4b47-a228-9ccfa0a605a4 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713296 Sep 27 02:11:45.917104 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3287/6531] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:11:45.928056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34f11aca-b9c7-4e60-a529-36761c11c857 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:45.929051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34f11aca-b9c7-4e60-a529-36761c11c857 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:46.190716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:46.191346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:46.205599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:46.206313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:46.207440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:46.209303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:46.209798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:46.210806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:46.326695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34f11aca-b9c7-4e60-a529-36761c11c857 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:46.352944 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34f11aca-b9c7-4e60-a529-36761c11c857 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1218 microversion: 2.1 time: 0.425467 Sep 27 02:11:46.353836 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3245/6532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:45 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1218 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:46.508530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:46.520349 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76bbfc7f-9fcc-40ba-a315-12fe886301e4 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.335015 Sep 27 02:11:46.521481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3288/6533] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:46 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:47.376177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:47.377571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:47.388413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:47.391248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:47.391708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:47.398682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:47.399228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:47.399684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:47.544770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:47.545425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:47.547553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:47.552480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:47.553803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:47.554442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:47.555335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:47.555966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:47.556571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:47.560878 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b48a9c33-cff6-4188-9a31-7f3146248e56 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1276 microversion: 2.1 time: 0.187062 Sep 27 02:11:47.562062 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3246/6534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:47 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1276 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:47.720210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:47.733731 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b21648d-4191-4b8b-aa5d-9096464b8958 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.192668 Sep 27 02:11:47.749466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3289/6535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:47 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:48.588972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:48.590243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:48.598204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:48.599613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:48.600222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:48.601286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:48.601928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:48.602521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:48.757691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:48.758219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:48.764804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:48.765289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:48.769903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:48.771198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:48.771668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:48.772106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:48.827933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:48.841921 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-129aface-49b8-41d4-9a46-cc191022a172 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.257194 Sep 27 02:11:48.842801 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3247/6536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:48 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:48.966425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:48.975201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e068cca-d345-46a2-bc26-7a2a6348e3e4", "tag": "fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:48.975596 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f06fae62-9fd5-4f09-a4a9-b4e8d9626a0c tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.221836 Sep 27 02:11:48.985399 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3290/6537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:48 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:48.987739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:48.988519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:48.990245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:49.008980 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] Creating event network-changed:fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4 for instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 on n-h1-859358-1 Sep 27 02:11:49.014132 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4eaa9b3f-ce4c-4e1d-b56d-c8be189adcbf req-02fdad76-ee44-47c2-93ac-b2b3700f933e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045328 Sep 27 02:11:49.015370 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3248/6538] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:11:49.868071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:49.868931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:49.878963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:49.881608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:49.882285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:49.883987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:49.887250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:49.887930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:49.893034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10ebbf9-0c75-4e00-8d80-3abaae153105", "name": "network-vif-plugged", "status": "completed", "tag": "da1767f8-1294-446e-bb35-306c90b82025"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:49.908452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:49.909271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:49.910097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:49.923703 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] Creating event network-vif-plugged:da1767f8-1294-446e-bb35-306c90b82025 for instance a10ebbf9-0c75-4e00-8d80-3abaae153105 on n-h2-859358-1 Sep 27 02:11:49.929904 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-86b5f5b4-0b9a-4caf-839d-bbd5616f7a54 req-f935874c-4746-4179-85cf-70b9ed35b22d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043372 Sep 27 02:11:49.931415 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3249/6539] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:50.002767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:50.003728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:50.023157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:50.023757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:50.024307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:50.026593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:50.028227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:50.029530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:50.185140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:50.188112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=100 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:50.201405 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d2d5260c-768e-49fd-9261-e325f3645522 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.336998 Sep 27 02:11:50.216694 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3291/6540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:49 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:50.344698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:50.356640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ded05f4c-b027-4fdb-9d95-5c82997d808e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.358078 Sep 27 02:11:50.357498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3250/6541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:49 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:51.224356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:51.224976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:51.234385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:51.235295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:51.235893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:51.236758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:51.237391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:51.238125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:51.380111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:51.381277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:51.391765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:51.392547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:51.393191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:51.394039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:51.394586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:51.395486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:51.404064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:51.419031 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cba97a8-3dd4-4b2c-a41f-0bf09726610d tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.198810 Sep 27 02:11:51.434215 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3292/6542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:51 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:51.570395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:51.578860 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8dd8ea76-9e52-4cc6-9ac2-562021cbad21 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1429 microversion: 2.1 time: 0.202678 Sep 27 02:11:51.579896 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3251/6543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:51 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1429 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:52.445247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:52.446663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:52.457090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.458771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.461694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:52.462613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.463184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.464935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:52.602246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:52.603511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:52.610469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.611215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.611979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:52.612759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.613450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.614606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:52.628314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:52.649224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3ad7367f-387f-4c84-b3af-48dcb3d4db04 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.209337 Sep 27 02:11:52.667662 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3293/6544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:52 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:52.788830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:52.797178 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d9d8faf-1739-43a7-aff8-4a4d6984266d tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1610 microversion: 2.1 time: 0.198693 Sep 27 02:11:52.798098 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3252/6545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:52 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1610 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:52.824951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:52.826198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:52.836515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.837011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.837671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:52.839180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:52.840012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:52.840945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:53.075328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:53.083383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70acc703-8588-4b3b-a920-d8d0e42a2ae6 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1610 microversion: 2.1 time: 0.266119 Sep 27 02:11:53.084229 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3294/6546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:52 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1610 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:11:53.107604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:53.108224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:53.118540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:53.119299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:53.120002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:53.121195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:53.122368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:53.122806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:53.349278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:53.357893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9715cc2d-8721-40cd-a9b4-8a13dc7705cd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1610 microversion: 2.1 time: 0.254215 Sep 27 02:11:53.358478 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3253/6547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:53 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1610 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:53.675368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:53.676661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:53.692693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:53.693633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:53.694304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:53.695179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:53.695803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:53.696394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:53.881395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:53.894092 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8db9e0e9-977c-41bd-ad1a-4b600026bf64 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.221499 Sep 27 02:11:53.894779 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3295/6548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:53 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:54.144114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e068cca-d345-46a2-bc26-7a2a6348e3e4", "name": "network-vif-plugged", "status": "completed", "tag": "fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:54.156688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:54.157179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:54.163838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:54.186300 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] Creating event network-vif-plugged:fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4 for instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 on n-h1-859358-1 Sep 27 02:11:54.193093 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2ff6c9a7-c7a4-4f6e-876c-1ba050a4c359 req-5508a470-fe95-4b19-a371-ecaf40f24612 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051992 Sep 27 02:11:54.194386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3254/6549] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:54.917948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:54.918576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:54.927726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:54.928533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:54.928684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:54.929395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:54.930300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:54.930906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:55.088241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:55.099735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-faabadd1-e93f-4301-a9bf-02c49c2a6541 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1318 microversion: 2.1 time: 0.183514 Sep 27 02:11:55.100528 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3296/6550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:54 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:55.789499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a10ebbf9-0c75-4e00-8d80-3abaae153105", "tag": "da1767f8-1294-446e-bb35-306c90b82025"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:55.804328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:55.804809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:55.805245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:55.819064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] Creating event network-changed:da1767f8-1294-446e-bb35-306c90b82025 for instance a10ebbf9-0c75-4e00-8d80-3abaae153105 on n-h2-859358-1 Sep 27 02:11:55.824311 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a276fff3-3f51-4863-8a1a-516fbb240eff req-64f636ce-9c27-4489-a867-d365a30c248a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041270 Sep 27 02:11:55.827846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3255/6551] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:11:56.125150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:11:56.125970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:56.128362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:56.129225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:56.151013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:56.153202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:56.155598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:56.159083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:56.159974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:56.161801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:56.824804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:11:56.837553 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-755bde14-018a-4acc-8ff8-d61497feebf1 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1507 microversion: 2.1 time: 0.717675 Sep 27 02:11:56.838419 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3297/6552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:11:56 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1507 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:11:56.857885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:56.863456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b11ccec-e928-49c0-b02c-e851d886b1ac", "device": "/dev/sdb"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:11:56.866580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:11:56.881994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:56.882482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:56.882922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:56.883625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:11:56.884075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:11:56.884496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:11:57.411533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:11:57.598110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed8d28de-22ea-4f35-9fb6-f1895073fb5a tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "POST /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740495 Sep 27 02:11:57.599082 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3256/6553] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:11:56 2022] POST /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:12:09.801763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-715369603", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2a2f20d5-9b31-4d47-9a77-9f2b5cef8445", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:09.826007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:09.829863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=37 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:09.927930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:12:10.520065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:12:10.520491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:12:10.520970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:12:10.521403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:12:10.521819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:12:10.531412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:10.531898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:10.532547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:10.533564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:10.534379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:10.534634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:10.552770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:12:10.558185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:12:10.621101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:12:10.623093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a2f20d5-9b31-4d47-9a77-9f2b5cef8445',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:12:10.774646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54a94a2a-f359-4510-87ef-9361cb3b0aaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977516 Sep 27 02:12:10.775642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3298/6554] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:12:10.790609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8ca8f0b-bf98-42aa-8bbf-e6fa808c8e3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:10.791386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8ca8f0b-bf98-42aa-8bbf-e6fa808c8e3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:10.803638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=31 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:10.804593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:10.914518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e8ca8f0b-bf98-42aa-8bbf-e6fa808c8e3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:10.929158 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8ca8f0b-bf98-42aa-8bbf-e6fa808c8e3a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1070 microversion: 2.1 time: 0.142937 Sep 27 02:12:10.931568 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3257/6555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:10 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1070 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:11.952221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:11.953480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:11.970338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:11.977568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:11.978210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:11.979071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:11.979725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:11.980138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:12.054238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:12.063254 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8587bb33-5671-47d7-aeee-def03d7607b3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1168 microversion: 2.1 time: 0.114848 Sep 27 02:12:12.063860 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3299/6556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:11 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1168 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:13.089189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:13.102016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:13.128710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:13.129638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:13.130308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:13.134835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:13.135590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:13.136374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:13.283541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:13.312754 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8d82e55f-12d5-45a1-8ff3-307942de06c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1186 microversion: 2.1 time: 0.228173 Sep 27 02:12:13.314337 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3258/6557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:13 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1186 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:14.340616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:14.341245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:14.353496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:14.354003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:14.354451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:14.355264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:14.355620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:14.356054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:14.562768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:14.577027 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-811457ce-83c3-4429-b91f-f4cef561358b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1228 microversion: 2.1 time: 0.240134 Sep 27 02:12:14.584820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3300/6558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:14 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1228 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:14.922967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12970530-b764-47d4-b00d-fcaa03b0d50b", "tag": "6b14ca1a-412f-4197-aebf-c3b0aca2a6fe"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:14.945698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:14.946433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:14.947155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:14.966045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] Creating event network-changed:6b14ca1a-412f-4197-aebf-c3b0aca2a6fe for instance 12970530-b764-47d4-b00d-fcaa03b0d50b on n-h2-859358-1 Sep 27 02:12:14.977897 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2fbea98b-a271-46ff-82b7-328ede73ab47 req-178c32c6-9f58-4e97-827b-c5e9a8aa2663 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058545 Sep 27 02:12:14.979844 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3259/6559] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:12:15.601532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:15.602768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:15.622408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:15.623148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:15.623832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:15.624866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:15.625550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:15.626149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:16.367308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:16.377134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db930671-0bb2-485c-8556-b7d1c586d126 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1228 microversion: 2.1 time: 0.780663 Sep 27 02:12:16.389854 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3301/6560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:15 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1228 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:17.405769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:17.406773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:17.419593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:17.420413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:17.421457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:17.422471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:17.423348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:17.423944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:17.643626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:17.655931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-325bca49-f6cf-4731-96fe-87055b559fbf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1228 microversion: 2.1 time: 0.253046 Sep 27 02:12:17.656990 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3260/6561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:17 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1228 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:18.684051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:18.685320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:18.693243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:18.694074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:18.694695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:18.695586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:18.696211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:18.697561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:18.899467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:18.907590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f7bcf96-fc9e-41e5-8366-0549f2e0e253 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1228 microversion: 2.1 time: 0.227686 Sep 27 02:12:18.908638 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3302/6562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:18 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1228 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:19.930833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:19.931450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:19.938070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:19.938550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:19.939002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:19.939825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:19.940286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:19.941239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:20.603766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:20.611563 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c878aa56-576e-45df-9711-89f86b717421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.684837 Sep 27 02:12:20.612151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3261/6563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:19 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:20.915228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:20.915825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:20.918589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:20.919404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:20.924980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:20.925489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:20.925927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:20.926628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:20.927083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:20.927506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:21.012909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lazy-loading 'services' on Instance uuid 8e068cca-d345-46a2-bc26-7a2a6348e3e4 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:12:21.103975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9570ae25-4343-42fe-b411-48f42a933e48 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4/os-volume_attachments/9b11ccec-e928-49c0-b02c-e851d886b1ac" status: 202 len: 0 microversion: 2.1 time: 0.192568 Sep 27 02:12:21.104714 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3303/6564] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:12:20 2022] DELETE /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4/os-volume_attachments/9b11ccec-e928-49c0-b02c-e851d886b1ac => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:12:21.635518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:21.636222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:21.638371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:21.644599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:21.645304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:21.645765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:21.646490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:21.646948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:21.647370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:21.846727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:21.855208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d125f6d8-706b-4230-9ead-8cec5e03eab1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.223526 Sep 27 02:12:21.856004 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3262/6565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:21 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:22.882335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:22.883815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:22.891121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:22.891619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:22.892058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:22.892765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:22.893224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:22.893756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:23.050677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:23.059376 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-423b499d-8982-48c0-a072-b429f5fa5cdc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.182874 Sep 27 02:12:23.068999 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3304/6566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:22 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:24.083950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:24.084568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:24.091836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:24.092355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:24.092779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:24.093517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:24.094161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:24.094592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:24.325969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:24.336123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61b0c860-e489-4c50-9a54-094d3bc1c13d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.257206 Sep 27 02:12:24.337576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3263/6567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:24 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:25.360178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:25.361027 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:25.378849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:25.381845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:25.381845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:25.389760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:25.390496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:25.391239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:25.542652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:25.551259 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72085eee-ad51-4fe1-80d4-55c14906940f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.195173 Sep 27 02:12:25.551855 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3305/6568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:25 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:26.513515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:26.514234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:26.521658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.522146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.522579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.523280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.523730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.524207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.554521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:12:26.574361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:26.574978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:26.583341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.583828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.584458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.585163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.585832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.586437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.640308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13332b5b-fd41-413c-8d49-3186a8fd0a35 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 204 len: 0 microversion: 2.1 time: 0.130508 Sep 27 02:12:26.641664 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3264/6569] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:12:26 2022] DELETE /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:12:26.652905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:26.653912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:26.661596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.662322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.662758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.663464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:26.663915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:26.664342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:26.736431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:26.745056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee43e680-295a-47f9-ae7e-96fa40fc9cb1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.174710 Sep 27 02:12:26.745666 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3306/6570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:26 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:12:26.905603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:26.914314 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e7873b5-1a9a-4253-afd1-be16579f710c tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1513 microversion: 2.1 time: 0.267582 Sep 27 02:12:26.914929 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3265/6571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:26 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:27.767596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:27.768215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:27.774887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:27.775726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:27.776461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:27.777426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:27.778157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:27.778800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:27.920372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:27.945385 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd9ff941-5101-4664-9ddc-2e30a51afdcc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.167144 Sep 27 02:12:27.945385 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3307/6572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:27 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:27.951569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:27.952399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:27.961410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:27.962551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:27.963445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:27.964290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:27.964760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:27.965260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:28.180420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:28.188410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d82ee18-9cda-48aa-930a-96b9fee2cfb8 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1513 microversion: 2.1 time: 0.241643 Sep 27 02:12:28.189446 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3266/6573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:27 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:28.953946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:28.954571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:28.962646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:28.963140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:28.963587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:28.964294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:28.964820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:28.965216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.005293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e068cca-d345-46a2-bc26-7a2a6348e3e4", "name": "network-vif-deleted", "tag": "fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:29.018384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:29.019879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:29.020681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.039444 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] Creating event network-vif-deleted:fdbe4f7d-03e9-4b8b-ba63-fe2259967ca4 for instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 on n-h1-859358-1 Sep 27 02:12:29.048846 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d440df50-2ab3-4245-94ac-b56efa398e76 req-3e3abf69-8737-4930-b5c4-c1ff4fcb79e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044591 Sep 27 02:12:29.049874 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3267/6574] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:12:29.126656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:29.135843 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4edf9cc-a5a1-4d0c-b39f-cb17af1ef83f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.185748 Sep 27 02:12:29.151433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3308/6575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:28 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:29.212993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:29.213745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:29.219917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:29.220396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:29.220835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.221557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:29.222036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:29.222460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.255032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:29.255512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:29.255957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.256414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lazy-loading 'fault' on Instance uuid 8e068cca-d345-46a2-bc26-7a2a6348e3e4 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:12:29.306346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1d6154768c4804bb10cbd2da3a702a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69774c9a99ef47c6a3ade7dbce689a5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:29.314066 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-deffd294-4abb-4de6-b456-56c978749786 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 200 len: 1308 microversion: 2.1 time: 0.105492 Sep 27 02:12:29.314639 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3268/6576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:29 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:29.938268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12970530-b764-47d4-b00d-fcaa03b0d50b", "name": "network-vif-plugged", "status": "completed", "tag": "6b14ca1a-412f-4197-aebf-c3b0aca2a6fe"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:29.949291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:29.949822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:29.950259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:29.963993 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] Creating event network-vif-plugged:6b14ca1a-412f-4197-aebf-c3b0aca2a6fe for instance 12970530-b764-47d4-b00d-fcaa03b0d50b on n-h2-859358-1 Sep 27 02:12:29.969081 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-5c351c57-fab8-426d-ab37-c13f5881e404 req-c39e776f-c2b8-4932-b56b-f5ca385d587b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035155 Sep 27 02:12:29.969734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3309/6577] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:12:30.161079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:30.161808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:30.168816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:30.169454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:30.169990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:30.170771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:30.171228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:30.171652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:30.338575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:30.339311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] [instance: 8e068cca-d345-46a2-bc26-7a2a6348e3e4] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:30.345456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:30.345935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:30.346368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:30.347052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:30.347505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:30.347927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:30.364151 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] HTTP exception thrown: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Request method failure captured: Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 HTTP/1.1 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMls4eAzTkZ_Kknt1UClK_SIzsydTZ_PkVTCjEvUSTDKOLmwC5RjTiv1D0Yh6nrcG9YtvlHOBjrxLzgxRN5lFFzJ_pGFx9S8VIdHbjHmp0SdVCaeKOSh0GIPqkrjaYOz0WB1MgK84Jab_2YJfiZ_NHiD6naR0oz36vppAcx2-arveB7k Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 69774c9a99ef47c6a3ade7dbce689a5e Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69774c9a99ef47c6a3ade7dbce689a5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69774c9a99ef47c6a3ade7dbce689a5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 69774c9a99ef47c6a3ade7dbce689a5e Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1608790482 Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-VolumesSnapshotTestJSON-1608790482-project Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ef1d6154768c4804bb10cbd2da3a702a Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-VolumesSnapshotTestJSON-1608790482-project Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '8e068cca-d345-46a2-bc26-7a2a6348e3e4'} Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:12:30.365927 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] Returning 404 to user: Instance 8e068cca-d345-46a2-bc26-7a2a6348e3e4 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-675c6db9-eadb-40f3-bee5-c333c1cd2158 tempest-VolumesSnapshotTestJSON-1608790482 tempest-VolumesSnapshotTestJSON-1608790482-project] 10.222.0.52 "GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4" status: 404 len: 111 microversion: 2.1 time: 0.033248 Sep 27 02:12:30.374526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3310/6578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:30 2022] GET /compute/v2.1/servers/8e068cca-d345-46a2-bc26-7a2a6348e3e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:12:30.403245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:30.411556 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7a926233-76e5-4657-aec2-586965957e8e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.255386 Sep 27 02:12:30.412768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3269/6579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:30 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:31.436288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:31.437089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:31.444423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:31.444926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:31.445384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:31.446328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:31.446798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:31.447240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:31.589014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:31.598094 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9852e78-c3f2-49de-b7c2-2b33d471d62c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1216 microversion: 2.1 time: 0.165872 Sep 27 02:12:31.598700 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3311/6580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:31 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:32.620311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:32.620918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:32.641926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:32.642501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:32.642974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:32.643696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:32.644158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:32.644594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:32.881980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:32.894562 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d21a85e-6793-4219-83c0-fc710a09b16e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1403 microversion: 2.1 time: 0.278032 Sep 27 02:12:32.896757 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3270/6581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:32 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1403 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:32.920191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:32.921561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:32.942778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:32.945758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:32.946479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:32.947439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:32.950649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:32.951330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:33.182082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:33.201207 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cef23e36-c758-4357-800c-70605fb7fb28 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1403 microversion: 2.1 time: 0.281249 Sep 27 02:12:33.203152 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3312/6582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:32 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1403 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:33.226864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1489014537"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:33.229210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:33.245957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:33.246456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:33.250079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:33.252215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:33.253705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:33.255535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:33.413524 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Attempting to quiesce instance before volume snapshot. Sep 27 02:12:33.495722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 27 02:12:33.572897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Creating snapshot from volume 2a2f20d5-9b31-4d47-9a77-9f2b5cef8445. {{(pid=128778) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 27 02:12:33.744699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:34.632042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8638f0f-73d4-462c-a1eb-7c0a094dc3c2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b/action" status: 202 len: 0 microversion: 2.1 time: 1.410312 Sep 27 02:12:34.633588 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3271/6583] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:12:33 2022] POST /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b/action => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 02:12:35.874538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-779901645", "imageRef": "cc2a9761-e565-4a2d-9ceb-b1c22e80d633", "flavorRef": "452", "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:35.935708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:12:36.427308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:12:36.428098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:12:36.428829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:12:36.429611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:12:36.430476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:12:36.442299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:36.442867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:36.443404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:36.444379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:36.444910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:36.445611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:36.472964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:12:36.478760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:12:36.493715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:12:36.496539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9dbdf1c3-e42a-432e-b392-6ed4eba876ac',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:12:36.610078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cf7fffc-36e1-4f7d-b752-0922aee1716e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739159 Sep 27 02:12:36.612967 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3313/6584] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:12:36.624797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0498f354-da4d-4f18-bb5a-2a66684f6330 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:36.626177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0498f354-da4d-4f18-bb5a-2a66684f6330 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:36.693009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0498f354-da4d-4f18-bb5a-2a66684f6330 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:36.703549 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0498f354-da4d-4f18-bb5a-2a66684f6330 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1229 microversion: 2.1 time: 0.083423 Sep 27 02:12:36.704679 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3272/6585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:36 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:37.738544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:37.738544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:37.747307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:37.747814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:37.748256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:37.750560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:37.751042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:37.755021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:37.864474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:37.877063 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b80686e-caed-4963-ada9-65b9e1122ade tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1281 microversion: 2.1 time: 0.150864 Sep 27 02:12:37.879837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3314/6586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:37 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:38.916951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:38.918202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:38.926026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:38.926896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:38.927530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:38.928413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:38.929046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:38.929678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:39.046832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:39.058445 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1fa8ef6b-5dc8-4562-825a-b3a23f601d12 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1299 microversion: 2.1 time: 0.159991 Sep 27 02:12:39.071182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3273/6587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:38 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:40.086007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:40.087246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:40.098025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:40.114645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:40.116037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:40.116726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:40.117722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:40.118193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:40.118634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:40.137437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:40.669625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:40.682154 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a38b7982-1b32-41b1-92cc-7a81c7a6f265 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.601852 Sep 27 02:12:40.683141 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3315/6588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:40 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:41.180428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92027a77-e947-4574-ade9-20dfe039a338", "tag": "866af494-f18b-4d50-9140-0926d8871f37"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:12:41.221063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:41.233218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:41.234155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:41.235082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:41.258388 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] Creating event network-changed:866af494-f18b-4d50-9140-0926d8871f37 for instance 92027a77-e947-4574-ade9-20dfe039a338 on n-h1-859358-1 Sep 27 02:12:41.268810 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-90e21f81-5685-455d-bff6-13068d5e3c0b req-0f74fbdf-9acf-4a5c-b03b-e7799eeacb40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092782 Sep 27 02:12:41.271847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3274/6589] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:12:41.711597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:41.712855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:41.724845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:41.725747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:41.730828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:41.738510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:41.743523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:41.744407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:42.053054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:42.063634 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-207e3045-dffa-4018-93e3-0c68c39c61ac tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.356252 Sep 27 02:12:42.064219 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3316/6590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:41 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:43.092519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:43.097675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:43.122855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:43.123496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:43.124032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:43.128740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:43.133920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:43.135773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:43.610572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:43.629317 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0d0b8f99-73be-4886-b232-9e0a32d42f30 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.539371 Sep 27 02:12:43.637065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3275/6591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:43 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:44.660343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:44.661666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:44.673224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:44.673991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:44.676864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:44.677536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:44.677895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:44.678607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:44.904404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:44.914900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ffc40bb-5758-4b64-9d2f-ebd481aeef25 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.261129 Sep 27 02:12:44.915544 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3317/6592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:44 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:45.944957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:45.945879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:45.958296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:45.960344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:45.961680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:45.963621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:45.964658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:45.965296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:46.219989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:46.230318 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b3ff587-d4de-45b7-a37f-1bb9f3ff9f1b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.290648 Sep 27 02:12:46.231136 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3276/6593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:45 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:47.256447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:47.257240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:47.262014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:47.262390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:47.277939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:47.278451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:47.278883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:47.279949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:47.280815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:47.283510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:47.568841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:47.593437 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f81345d3-dcac-4602-9dd5-b7258cdcd376 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.330732 Sep 27 02:12:47.601755 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3318/6594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:47 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:12:48.628860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:48.629942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:48.631796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:12:48.644711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:48.645181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:48.645662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:48.646395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:48.653267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:48.653770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:49.056865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:49.074134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33511616-1681-45ca-a2f4-930543b66f88 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.446150 Sep 27 02:12:49.076629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3277/6595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:48 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:12:50.099334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:50.099949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:50.120076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:50.120540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:50.121487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:50.129712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:50.131649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:50.132839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:50.417152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:50.436944 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-443fba46-d40c-40e3-a906-51fa9b2ea99d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.337341 Sep 27 02:12:50.437956 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3319/6596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:50 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:51.481362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:51.485892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:51.501700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:51.508860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:51.509377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:51.516732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:51.517565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:51.518217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:51.735989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:51.746420 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4bea7ebe-2eac-407e-84dd-b887cfc8b914 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.285555 Sep 27 02:12:51.759794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3278/6597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:51 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:52.775202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:52.776579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:52.786679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:52.787502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:52.788169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:52.789144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:52.790222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:52.793992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:53.025399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:53.036015 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0fbc88a4-c40c-4538-9703-31f12188b0fa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.266214 Sep 27 02:12:53.062617 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3320/6598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:52 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:54.071180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:54.078572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:54.090163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:54.091358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:54.092347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:54.093622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:54.095139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:54.095971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:54.336475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:54.350867 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-355bc11d-4ba8-424a-985f-8e5d8fe53d4f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.285866 Sep 27 02:12:54.353855 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3279/6599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:54 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:55.382623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:55.382623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:55.390021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:55.390790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:55.391314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:55.392638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:55.393235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:55.393738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:55.582186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:55.592894 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4bfcc54-4d32-4ccd-8d20-95930317a77c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.218253 Sep 27 02:12:55.607721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3321/6600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:55 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:56.616959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:56.617631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:56.632312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:56.632848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:56.633312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:56.634095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:56.634572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:56.635011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:56.933876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:56.952362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3524920-fff5-4324-a408-0925bf060177 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1341 microversion: 2.1 time: 0.339486 Sep 27 02:12:56.954222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3280/6601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:56 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1341 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:57.978519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:57.979155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:57.993615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:57.994992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:57.998255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:57.999078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:57.999551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:57.999989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:58.231247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:58.242967 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-635f6522-b9c2-43ae-8ec4-142d7135d9f2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.269891 Sep 27 02:12:58.243563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3322/6602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:57 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:12:59.270555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:12:59.274655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:12:59.285717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:59.286780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:59.287462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:59.288310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:12:59.288803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:12:59.289522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:12:59.466671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:12:59.480351 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f61e29fa-1506-4989-a846-d2e767c71d90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.214242 Sep 27 02:12:59.494239 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3281/6603] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:12:59 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:00.508941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:00.509722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:00.518101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:00.518984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:00.519664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:00.520762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:00.521426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:00.522093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:00.697391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:00.706413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-886d9739-776a-49dd-a251-b96500be67cb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.201851 Sep 27 02:13:00.707017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3323/6604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:00 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:01.737904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:01.740135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:01.754262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:01.754793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:01.755167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:01.755973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:01.756446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:01.757026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:01.976068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:01.984848 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23053145-e44a-4f25-9953-fdc430f598a0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.253008 Sep 27 02:13:01.994376 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3282/6605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:01 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:03.021207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:03.026364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:03.039345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:03.039843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:03.040287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:03.044632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:03.045330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:03.045576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:03.225753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:03.235392 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7616674-ccdf-4d06-8fa6-9986c3b5e3cd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.226846 Sep 27 02:13:03.251203 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3324/6606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:03 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:03.567597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:03.568156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:03.589854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:03.590669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:03.591258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:03.591836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:03.592308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:03.592746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:03.631865 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b111c13f-31f3-4224-b4f7-29c3925a5abe tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.068345 Sep 27 02:13:03.637187 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3283/6607] 10.222.0.52 () {58 vars in 1293 bytes} [Tue Sep 27 02:13:03 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105/os-server-password => generated 116 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:13:04.261199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:04.261971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:04.270054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:04.270596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:04.271125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:04.271906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:04.272303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:04.272776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:04.452620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:04.465557 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24dba94c-5488-4aff-b1a2-0057bf02b3aa tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.208291 Sep 27 02:13:04.484142 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3325/6608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:04 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:05.492390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:05.493627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:05.500995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:05.502052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:05.502500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:05.503272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:05.503693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:05.504129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:05.531228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=61 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:13:05.669038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:05.679715 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1b63eda-b860-48d8-8264-ad0abd522f96 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.191128 Sep 27 02:13:05.680320 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3284/6609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:05 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:06.713006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:06.715887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:06.727614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:06.728121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:06.728564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:06.729310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:06.729786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:06.730934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:06.925217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:06.936927 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0da25e35-5c9c-4d54-8905-2301f4fa4c64 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.236502 Sep 27 02:13:06.940816 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3326/6610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:06 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:07.963505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:07.964141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:07.976336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:07.976753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:07.977308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:07.977945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:07.981032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:07.981714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:08.213391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:08.222575 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f65f17a1-7257-4a28-87b6-d6b33874b385 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.263012 Sep 27 02:13:08.223287 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3285/6611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:07 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:08.612490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92027a77-e947-4574-ade9-20dfe039a338", "name": "network-vif-plugged", "status": "completed", "tag": "866af494-f18b-4d50-9140-0926d8871f37"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:13:08.627877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:08.628977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:08.630355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:08.665829 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] Creating event network-vif-plugged:866af494-f18b-4d50-9140-0926d8871f37 for instance 92027a77-e947-4574-ade9-20dfe039a338 on n-h1-859358-1 Sep 27 02:13:08.673962 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-acb00760-6acd-4672-9738-38728b915062 req-04297700-060a-4e14-94d8-7d1dfcf80828 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064799 Sep 27 02:13:08.675329 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3327/6612] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:13:09.247585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:09.248177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:09.255411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:09.255925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:09.256389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:09.257134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:09.257631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:09.258083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:09.412817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:09.424333 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e4ad0af-3bab-4d7a-a60e-b60ac6486991 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1375 microversion: 2.1 time: 0.180604 Sep 27 02:13:09.425094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3286/6613] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:09 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:10.473798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:10.474530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:10.492046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=26 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:13:10.497433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:10.497884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:10.502026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:10.502930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:10.504292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:10.504797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:10.544497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=74 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:13:10.698995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:10.710413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d7e2253-de6a-4c73-b22f-42ef9d6ff0fb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1562 microversion: 2.1 time: 0.263601 Sep 27 02:13:10.711836 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3328/6614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:10 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:10.736978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:10.737661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:10.746284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:10.747241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:10.748081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:10.749148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:10.749947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:10.750751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:10.923794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:10.932254 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4280a440-07f9-455f-a1dc-61dcf8135bfd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1562 microversion: 2.1 time: 0.199909 Sep 27 02:13:10.932831 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3287/6615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:10 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1562 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:11.016269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:11.017429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:11.023384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:11.023868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:11.024304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:11.024993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:11.025473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:11.025901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:11.055265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:13:11.156689 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56d20884-e779-4ee5-870a-6f5229f1fec3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 204 len: 0 microversion: 2.1 time: 0.143975 Sep 27 02:13:11.157925 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3329/6616] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:13:11 2022] DELETE /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:13:11.166653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:11.167291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:11.179384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:11.180510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:11.181041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:11.181885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:11.182427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:11.182939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:11.379260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:11.390083 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b512b0d3-becf-4e55-9f5a-f9f396c82b7f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1568 microversion: 2.1 time: 0.227240 Sep 27 02:13:11.391949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3288/6617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:11 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:12.417650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:12.418584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:12.427601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:12.428354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:12.428905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:12.429780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:12.430438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:12.431112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:12.981117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:12.990721 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19aaf32c-fcd3-41d3-9140-144c9918f0f4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1568 microversion: 2.1 time: 0.579290 Sep 27 02:13:13.006153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3330/6618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:12 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1568 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:13:13.299674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92027a77-e947-4574-ade9-20dfe039a338", "name": "network-vif-deleted", "tag": "866af494-f18b-4d50-9140-0926d8871f37"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:13:13.306912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=30 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:13:13.319487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:13.321182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:13.323025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:13.349969 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] Creating event network-vif-deleted:866af494-f18b-4d50-9140-0926d8871f37 for instance 92027a77-e947-4574-ade9-20dfe039a338 on n-h1-859358-1 Sep 27 02:13:13.357831 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-256b6806-3319-494a-b347-d540b8cc8f09 req-551d25fb-2367-49f5-872f-f499899b8348 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062086 Sep 27 02:13:13.363946 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3289/6619] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:13:14.028177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:14.028805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:14.043623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:14.044684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:14.045314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:14.046267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:14.047240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:14.052656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:14.203689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:14.212599 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fc88534-0c3b-4d05-991d-d3cfcb81dfd2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1360 microversion: 2.1 time: 0.188248 Sep 27 02:13:14.217509 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3331/6620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:14 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1360 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:15.241672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:15.242465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:15.249644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:15.250152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:15.250611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:15.251864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:15.252336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:15.252780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:15.331473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:15.342614 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b73d28e-839c-4c44-bd6a-f87c4cb88970 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1360 microversion: 2.1 time: 0.103308 Sep 27 02:13:15.343225 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3290/6621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:15 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1360 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:16.366545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:16.367266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:16.379201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:16.383455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:16.384059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:16.384944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:16.386276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:16.386821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:16.478819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:16.487822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16b79ade-545c-4f32-aeab-75d96c31f45c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1360 microversion: 2.1 time: 0.125886 Sep 27 02:13:16.488696 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3332/6622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:16 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1360 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:17.513909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:17.516360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:17.527025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:17.527775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:17.528395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:17.529290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:17.530695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:17.534577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:17.614303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:17.625370 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aea9cc58-b80a-4aab-9678-2de607af1056 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1360 microversion: 2.1 time: 0.118009 Sep 27 02:13:17.625992 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3291/6623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:17 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1360 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:18.648167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:18.648875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:18.656962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:18.657477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:18.658169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:18.658897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:18.659362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:18.659746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:18.700494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:18.701266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:18.701805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:18.702301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lazy-loading 'fault' on Instance uuid 92027a77-e947-4574-ade9-20dfe039a338 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:13:18.748978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:18.758669 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7a50446-ef82-4b10-a648-42fc40e600f6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 200 len: 1365 microversion: 2.1 time: 0.114389 Sep 27 02:13:18.773927 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3333/6624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:18 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:13:19.784790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:19.786246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:19.793377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:19.794758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:19.795673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:19.796716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:19.798025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:19.798865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:19.818800 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 HTTP/1.1 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '92027a77-e947-4574-ade9-20dfe039a338'} Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:19.820989 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:19.827936 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:19.831015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:19.832190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-362b7b84-1174-46b3-97e1-e82b7efd5f50 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 404 len: 111 microversion: 2.1 time: 0.052831 Sep 27 02:13:19.833189 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3292/6625] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:19 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:13:26.552594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:26.553252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:26.572226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:26.573723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:26.574282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:26.575123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:26.580719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:26.581377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:26.635037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:13:26.768061 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1801eb66-9ead-4409-8201-c6e2e639660f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 204 len: 0 microversion: 2.1 time: 0.220463 Sep 27 02:13:26.769046 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3334/6626] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:13:26 2022] DELETE /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:13:26.777300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:26.778069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:26.793604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:26.795342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:26.795815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:26.796548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:26.797010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:26.802018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:26.988808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:26.998013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5c8aad7-aa38-4da8-9bd0-edc57c7ca22c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1409 microversion: 2.1 time: 0.224746 Sep 27 02:13:27.009908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3293/6627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:26 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1409 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:28.023297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:28.024671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:28.033374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:28.034145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:28.034744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:28.035651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:28.036286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:28.036875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:28.654498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:28.663889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-02cfca53-ecc8-4c6a-9a35-9c698d06ce55 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1409 microversion: 2.1 time: 0.644994 Sep 27 02:13:28.665032 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3335/6628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:28 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1409 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:29.179593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12970530-b764-47d4-b00d-fcaa03b0d50b", "name": "network-vif-deleted", "tag": "6b14ca1a-412f-4197-aebf-c3b0aca2a6fe"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:13:29.196629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:29.197479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:29.198137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:29.221998 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] Creating event network-vif-deleted:6b14ca1a-412f-4197-aebf-c3b0aca2a6fe for instance 12970530-b764-47d4-b00d-fcaa03b0d50b on n-h2-859358-1 Sep 27 02:13:29.228455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2a08e98a-c24b-4272-9637-86700750d2aa req-ae90bed6-b4f3-42d4-ac44-7f7fe0ae953a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056834 Sep 27 02:13:29.229059 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3294/6629] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:13:29.688796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:29.690076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:29.698084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:29.699047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:29.699810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:29.700747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:29.701463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:29.702120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:29.779670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:29.799210 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cc1dc3f-2c82-4cde-88e2-9644149169ed tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1201 microversion: 2.1 time: 0.115485 Sep 27 02:13:29.800093 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3336/6630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:29 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:30.827244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:30.827981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:30.840513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:30.849186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:30.850019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:30.852580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:30.853253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:30.853903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:31.017346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:31.042451 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a64ceea-f42a-4a03-b987-2372b288ef16 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1201 microversion: 2.1 time: 0.219416 Sep 27 02:13:31.043763 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3295/6631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:30 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1201 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:32.068238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:32.069902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:32.088763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:32.096495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:32.097991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:32.098938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:32.100718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:32.103374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:32.216827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:32.225694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56b106df-9f03-4c82-90f1-fbfec68ddbb2 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1201 microversion: 2.1 time: 0.163024 Sep 27 02:13:32.226228 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3337/6632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:32 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:33.248157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:33.248795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:33.256327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:33.257141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:33.257790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:33.258670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:33.259306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:33.259939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:33.367960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:33.378176 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f908cec-b67e-47fc-9540-2dc50d366273 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1201 microversion: 2.1 time: 0.133916 Sep 27 02:13:33.379436 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3296/6633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:33 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:34.402723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:34.403185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:34.417523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:34.420828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:34.421398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:34.422284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:34.422823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:34.426044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:34.553415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:13:34.562339 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-369f22c8-d8ac-4690-9dd9-74d665f4de5e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 200 len: 1201 microversion: 2.1 time: 0.164233 Sep 27 02:13:34.564360 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3338/6634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:34 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 1201 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:13:35.592262 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:35.592966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:35.621101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:35.627509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:35.628302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:35.634389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:35.635191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:35.635879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:35.642472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=66 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:13:35.678905 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b HTTP/1.1 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '12970530-b764-47d4-b00d-fcaa03b0d50b'} Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:35.680659 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-24fc8862-4668-4545-b32b-c8a3b8734784 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 404 len: 111 microversion: 2.1 time: 0.093994 Sep 27 02:13:35.687236 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3297/6635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:35 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:13:38.980540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:38.981136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:38.989087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:38.989852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:38.990582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:38.991173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:38.991822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:38.992415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.010217 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 HTTP/1.1 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '92027a77-e947-4574-ade9-20dfe039a338'} Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:39.012237 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.017583 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.019631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:39.020751 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36cfbe4a-f618-4408-a306-ca8b0999fc3b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 404 len: 111 microversion: 2.1 time: 0.046419 Sep 27 02:13:39.021613 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3339/6636] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:13:38 2022] DELETE /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:13:39.030171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:39.030820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 92027a77-e947-4574-ade9-20dfe039a338] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:39.038827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.039706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.040340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.041242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.042142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.042811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.071950 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 HTTP/1.1 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '92027a77-e947-4574-ade9-20dfe039a338'} Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.073898 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. Sep 27 02:13:39.079437 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.081360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 92027a77-e947-4574-ade9-20dfe039a338 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:39.082507 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-41254336-f7a7-41d6-bd90-8f6bc760a52d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338" status: 404 len: 111 microversion: 2.1 time: 0.056536 Sep 27 02:13:39.083635 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3298/6637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:39 2022] GET /compute/v2.1/servers/92027a77-e947-4574-ade9-20dfe039a338 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:13:39.895666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:39.896399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:39.902669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.903150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.903977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.904686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.905701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.906379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.921275 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b HTTP/1.1 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '12970530-b764-47d4-b00d-fcaa03b0d50b'} Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:39.924040 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.929547 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.931386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:39.932458 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f58109a2-fc0f-43f6-85f3-1e2368778421 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 404 len: 111 microversion: 2.1 time: 0.040703 Sep 27 02:13:39.933231 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3340/6638] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:13:39 2022] DELETE /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:13:39.943296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:13:39.944205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 12970530-b764-47d4-b00d-fcaa03b0d50b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:13:39.950881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.951665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.952210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.953050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:13:39.953629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:13:39.954178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:13:39.977086 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b HTTP/1.1 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '12970530-b764-47d4-b00d-fcaa03b0d50b'} Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:13:39.982267 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 12970530-b764-47d4-b00d-fcaa03b0d50b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:13:39.988137 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c362de9-8097-442f-b8d7-a0b6846d03bb tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b" status: 404 len: 111 microversion: 2.1 time: 0.047842 Sep 27 02:13:39.993229 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3299/6639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:13:39 2022] GET /compute/v2.1/servers/12970530-b764-47d4-b00d-fcaa03b0d50b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:13:40.095713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-32eabc87-1312-41c0-aceb-8a658bfea546 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: .version_select at 0x7f24d5490790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1001753805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGswWc1NCsMyCECOH/66S2vDcJx16SCX1HrMGdZ1e4fL0WaPS6qqCpsBt05JVt21zOi3EpG4t0ePq16hTXNG6ps30paCiIcwbfSU37c8S7Ue+wPAh2tEsCbbye0Zfe/t0A=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:13:40.117014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-32eabc87-1312-41c0-aceb-8a658bfea546 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:13:40.123001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-32eabc87-1312-41c0-aceb-8a658bfea546 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:13:40.150532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-32eabc87-1312-41c0-aceb-8a658bfea546 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.060908 Sep 27 02:13:40.151235 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3341/6640] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:13:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:14:03.762318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-17224227", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1001753805", "security_groups": [{"name": "tempest-secgroup-smoke-302545111"}], "block_device_mapping_v2": [{"uuid": "d72b0a82-3484-4848-8afe-3bf050d85c76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:14:03.772693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=21 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:03.773369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:03.894488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:14:04.432763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:14:04.433008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:14:04.433523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:14:04.433947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:14:04.434366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:14:04.443139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:04.443630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:04.444077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:04.444810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:04.445274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:04.445742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:04.469206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:14:04.474831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:14:04.549788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:14:04.551938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d72b0a82-3484-4848-8afe-3bf050d85c76',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:14:04.685400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04f70bbf-55ff-495e-bee2-01e3126da3d4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926996 Sep 27 02:14:04.686222 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3300/6641] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:14:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:14:04.699356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52fbc8da-6704-4f75-9602-91779bbdeb0e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:04.702239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52fbc8da-6704-4f75-9602-91779bbdeb0e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:04.709266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:04.710014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:04.710982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:04.793568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52fbc8da-6704-4f75-9602-91779bbdeb0e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:04.805590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52fbc8da-6704-4f75-9602-91779bbdeb0e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1093 microversion: 2.1 time: 0.112136 Sep 27 02:14:04.806326 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3342/6642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:04 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1093 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:05.829816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:05.831043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:05.838621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:05.839409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:05.840036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:05.840753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:05.841222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:05.841694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:05.941990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:05.950012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b94f059-e17e-4c2a-81fd-c04a44256fb6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1199 microversion: 2.1 time: 0.125445 Sep 27 02:14:05.950803 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3301/6643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:05 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:06.977229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:06.983335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:07.014036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:07.014591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:07.015331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:07.016371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:07.016845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:07.017287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:07.190222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:07.199073 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c1d8b5b4-605a-4e8f-a07b-5aa2373d0723 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1276 microversion: 2.1 time: 0.229000 Sep 27 02:14:07.200519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3343/6644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:06 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:08.149054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fff30e-de7f-4066-b8fc-a9e9aca7bab9", "tag": "acd22973-c4c5-4906-8955-3029039c0d2d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:14:08.160908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:08.161423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:08.162485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:08.182661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] Creating event network-changed:acd22973-c4c5-4906-8955-3029039c0d2d for instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 on n-h1-859358-1 Sep 27 02:14:08.188997 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-85ea74d2-64df-46c3-9257-516a86cd95ec req-90d94b43-d265-4c4e-9e65-58ecb9c31aa4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246894 Sep 27 02:14:08.190333 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3302/6645] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:14:08.225081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:08.225632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:08.232963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:08.233634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:08.234236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:08.235147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:08.235697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:08.236497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:08.419461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:08.428891 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40f39156-05bf-448e-8c2e-c30337025e19 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1276 microversion: 2.1 time: 0.210544 Sep 27 02:14:08.431875 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3344/6646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:08 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:09.462822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:09.464522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:09.474358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:09.475184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:09.475729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:09.476656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:09.477398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:09.477925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:09.617715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:09.625908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cc50b35b-b06b-4776-a5bb-bfb7391cbed4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1276 microversion: 2.1 time: 0.167337 Sep 27 02:14:09.626607 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3303/6647] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:09 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:10.648623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:10.649234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:10.656870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:10.657358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:10.657802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:10.658515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:10.659224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:10.659674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:10.791310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:10.804579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52b3c044-2353-4662-bccd-e22ad026bc0a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1276 microversion: 2.1 time: 0.159848 Sep 27 02:14:10.805428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3345/6648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:10 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:14:11.829472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:11.830146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:11.837178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:11.837714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:11.838170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:11.838882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:11.839352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:11.839797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:11.983002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:11.990846 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d226dcdb-f16d-48aa-b018-53aa132f673a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.165415 Sep 27 02:14:11.991431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3304/6649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:11 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:13.013930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:13.014555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:13.021043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:13.021566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:13.022009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:13.022726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:13.023169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:13.023604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:13.156779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:13.165034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d958566f-de43-41f5-9833-06fa2414e347 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.155226 Sep 27 02:14:13.165654 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3346/6650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:13 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:14:14.188968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:14.189620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:14.196363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:14.196864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:14.197320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:14.198058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:14.198533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:14.198980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:14.331383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:14.339329 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce35a31b-9f3f-4f36-80d1-dfa015f2e052 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.155069 Sep 27 02:14:14.339912 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3305/6651] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:14 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:15.361696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:15.362312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:15.365034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:15.370578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:15.371054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:15.371484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:15.372171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:15.372622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:15.373049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:15.510417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:15.519316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b18e219-d60d-4cac-8a7c-0a170d81767c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.161448 Sep 27 02:14:15.519900 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3347/6652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:15 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:16.541807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:16.542364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:16.544299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:16.544962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:14:16.552116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:16.552627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:16.553078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:16.553810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:16.554279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:16.554716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:16.688562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:16.696580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-93beab20-eefc-4771-986e-54076b6a68a5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.158788 Sep 27 02:14:16.710402 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3306/6653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:16 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:17.721638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:17.722187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:17.729207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:17.729725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:17.730163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:17.730858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:17.731311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:17.731743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:17.864972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:17.872938 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-83305eb2-a841-40d2-9602-ed229265f49f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.155811 Sep 27 02:14:17.873731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3348/6654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:17 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:18.897896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:18.899552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:18.909468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:18.910226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:18.910885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:18.911696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:18.914303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:18.915131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:19.072608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:19.081177 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5dba2f32-ac10-4161-96ae-46418d8f899e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.189362 Sep 27 02:14:19.081811 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3307/6655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:18 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:20.105610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:20.106236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:20.115939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:20.116422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:20.116877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:20.117598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:20.118117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:20.118489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:20.270332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:20.278429 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe6f5ba7-64ba-4070-9a24-6066dd1a3b9f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.177908 Sep 27 02:14:20.279151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3349/6656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:20 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:20.899147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fff30e-de7f-4066-b8fc-a9e9aca7bab9", "name": "network-vif-plugged", "status": "completed", "tag": "acd22973-c4c5-4906-8955-3029039c0d2d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:14:20.909683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:20.910179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:20.910624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:20.921574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] Creating event network-vif-plugged:acd22973-c4c5-4906-8955-3029039c0d2d for instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 on n-h1-859358-1 Sep 27 02:14:20.927281 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-07ac9f0e-0864-4c33-8344-043d5b0b7ea8 req-2f3ce87b-e682-4969-bd7b-5a9a6b9f4967 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104016 Sep 27 02:14:20.927959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3308/6657] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:14:21.300772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:21.301643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:21.308487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:21.308960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:21.309410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:21.310099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:21.310551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:21.310979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:21.452463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:21.461640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53c6f192-f156-4d2d-ac52-e7c8eb734e78 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1264 microversion: 2.1 time: 0.164747 Sep 27 02:14:21.462539 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3350/6658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:21 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:22.485534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:22.486266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:22.492530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:22.493050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:22.493515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:22.494221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:22.494694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:22.495779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:22.632204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:22.640419 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60855c84-7077-462b-839c-aaa0b5da99b6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1451 microversion: 2.1 time: 0.160094 Sep 27 02:14:22.641625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3309/6659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:22 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:14:22.663566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:14:22.664179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:14:22.671101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:22.671531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:22.672000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:22.672690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:22.673142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:22.673592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:22.808645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:14:22.817210 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6bd016a-f706-408c-909b-b490c5c25ac7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1451 microversion: 2.1 time: 0.157744 Sep 27 02:14:22.833428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3351/6660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:14:22 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:14:24.962990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fff30e-de7f-4066-b8fc-a9e9aca7bab9", "tag": "acd22973-c4c5-4906-8955-3029039c0d2d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:14:24.974475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:14:24.975000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:14:24.975670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:14:24.992861 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] Creating event network-changed:acd22973-c4c5-4906-8955-3029039c0d2d for instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 on n-h1-859358-1 Sep 27 02:14:24.997984 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9ffc85d0-67ae-4e51-8d45-bbf8f56ea4ff req-31d65cb5-d8da-4f00-9d40-17d0eaf530e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118846 Sep 27 02:14:24.998634 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3310/6661] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:15:59.243815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=22 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:15:59.244607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=54 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:15:59.245935 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:15:59.246186 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 27 02:15:59.248081 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:15:59.248218 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 27 02:15:59.418271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-00750fec-785d-4833-9c9e-09080af5623e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: .version_select at 0x7f24d5523790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1962143547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE3xZxgT/ZWN/grLEyWI7Se1tyaKFWaL5Hz/3JLTQsJcLMEzRP+F1lXvHpznrEd7sv9heeCB26gO+Ju8ZIa9D0KNP189cIFjsE10DY3IEPSnrnLeBcb3BWItZC41LuLBg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:15:59.434558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-00750fec-785d-4833-9c9e-09080af5623e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:15:59.439597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-00750fec-785d-4833-9c9e-09080af5623e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:15:59.474257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-00750fec-785d-4833-9c9e-09080af5623e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.232002 Sep 27 02:15:59.474990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3352/6662] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:15:59 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:05.506048 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:16:05.507696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:05.508866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=50 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:05.514837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-280191593", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "74d302a2-f6d9-4fcc-bf8c-438007681b77"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1962143547", "security_groups": [{"name": "tempest-secgroup-smoke-2007211940"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:05.643546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] validate_networks() for [('74d302a2-f6d9-4fcc-bf8c-438007681b77', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:16:06.046920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:16:06.047359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:16:06.048339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:16:06.048757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:16:06.049186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:16:06.060214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:06.060747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:06.061195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:06.062062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:06.062423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:06.063897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:06.084713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:16:06.090476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:16:06.104993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:16:06.107502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:16:06.173101 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6a045ee-e27f-4bd8-857e-faea86f5aa2d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.672370 Sep 27 02:16:06.174194 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3311/6663] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:16:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:16:06.187151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8b602bc0-227a-4c65-a99d-6ac85b37a7cf tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:06.193505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8b602bc0-227a-4c65-a99d-6ac85b37a7cf tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:06.264956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8b602bc0-227a-4c65-a99d-6ac85b37a7cf tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:06.274439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8b602bc0-227a-4c65-a99d-6ac85b37a7cf tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1266 microversion: 2.1 time: 0.092365 Sep 27 02:16:06.275150 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3353/6664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:06 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:07.302097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:07.303475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:07.314338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:07.315306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:07.316190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:07.317510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:07.318431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:07.319147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:07.326940 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 33536. Sep 27 02:16:07.493200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:07.519057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1df3aef9-9b36-4fc4-a665-a037cc1bf8e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1326 microversion: 2.1 time: 0.220759 Sep 27 02:16:07.520303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3312/6665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:07 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1326 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:08.551018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:08.551636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:08.558701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:08.559188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:08.559630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:08.560340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:08.560801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:08.561235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:08.701112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:08.709400 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-177fd60c-18f0-4ebb-b9fe-0708348f9c73 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.164037 Sep 27 02:16:08.709978 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3354/6666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:08 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:09.003418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:09.015086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:09.015577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:09.016225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:09.029111 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] Creating event network-changed:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h2-859358-1 Sep 27 02:16:09.034412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c64e23a9-b1b0-48f4-a217-8dd72d493e34 req-cd8ae637-f15b-46ba-915b-bed75aa7c449 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036075 Sep 27 02:16:09.035784 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3313/6667] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:09.733853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:09.734471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:09.741958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:09.742444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:09.742885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:09.743577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:09.744035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:09.744464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:09.875683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:09.884251 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-536cce9a-39ba-4721-8eea-5ea71185248f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.154353 Sep 27 02:16:09.884823 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3355/6668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:09 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:10.908144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:10.908872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:10.915289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:10.915786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:10.916266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:10.917004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:10.917502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:10.917942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:11.047441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:11.055253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0a7c3127-da64-4753-91f4-f91a40b3c38d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.152208 Sep 27 02:16:11.055814 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3314/6669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:10 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:12.077988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:12.078601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:12.086233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:12.086714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:12.087492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:12.087823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:12.088274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:12.088699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:12.227181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:12.234902 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e34d676-1c95-4a63-b1f9-5a8e999c76f1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.160844 Sep 27 02:16:12.235482 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3356/6670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:12 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:16:13.257878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:13.258423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:13.265037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:13.265578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:13.266029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:13.267291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:13.267760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:13.268202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:13.674094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:13.681782 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5fe50e0-11b6-4c6b-9d02-5c261f2ef250 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.427875 Sep 27 02:16:13.682357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3315/6671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:13 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:14.704763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:14.705397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:14.712118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:14.712605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:14.713041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:14.713770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:14.714222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:14.714704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:14.842495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "name": "network-vif-plugged", "status": "completed", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:14.852241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:14.853987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:14.854579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:14.855100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:14.862195 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7a3b854d-fa15-49f9-a418-3e922bb917d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.161778 Sep 27 02:16:14.862763 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3357/6672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:14 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:14.867751 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] Creating event network-vif-plugged:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h2-859358-1 Sep 27 02:16:14.879594 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8ba50a01-bb8a-4cf3-bca1-abd819234bf7 req-a2b578e4-dd67-45d2-9697-525df09a3e24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Sep 27 02:16:14.880286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3316/6673] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:15.886579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:15.887195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:15.894108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:15.894597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:15.895035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:15.895728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:15.896184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:15.896616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:16.029128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:16.037816 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48bf099f-9c37-42a6-8c13-376ec86ac53f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1392 microversion: 2.1 time: 0.155127 Sep 27 02:16:16.038472 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3358/6674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:15 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:17.059358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:17.060137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:17.065920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:17.066655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:17.073842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:17.074337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:17.074811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:17.075521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:17.075988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:17.076427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:17.208901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:17.216691 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-80a5d99c-d2c4-4a9c-b1d4-6f54be82bb4c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1565 microversion: 2.1 time: 0.159155 Sep 27 02:16:17.217263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3317/6675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:17 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:17.238708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:17.239327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:17.241134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:17.247323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:17.247745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:17.248177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:17.248865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:17.249316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:17.249763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:17.384721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:17.392518 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99a3cc4f-8b3f-4f3f-8273-688332a03b35 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1565 microversion: 2.1 time: 0.158108 Sep 27 02:16:17.393096 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3359/6676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:17 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:18.968342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:18.968974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:18.972051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:18.976069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:18.976773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:18.977226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:18.977971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:18.978617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:18.979238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:18.986628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:18.987390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:18.987905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:19.000138 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] Creating event network-changed:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h2-859358-1 Sep 27 02:16:19.005391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-43da43e8-48b4-46ac-a6ba-fc7c82cc14f0 req-84d6e7fe-6b7d-43bf-912b-d99d5d0d17e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038686 Sep 27 02:16:19.006721 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3360/6677] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:19.193305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:19.202386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-14aaaa52-cccd-482f-85fb-283ba545ea68 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1565 microversion: 2.1 time: 0.238075 Sep 27 02:16:19.203296 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3318/6678] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:18 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1565 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:20.469404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:20.470501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:20.477030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:20.477542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:20.477982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:20.478672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:20.479127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:20.479554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:20.504313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:16:20.578237 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4418eb70-8b11-4bfb-890a-7f5788b7640a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 204 len: 0 microversion: 2.1 time: 0.113660 Sep 27 02:16:20.578668 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3361/6679] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:16:20 2022] DELETE /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:16:20.587288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:20.587948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:20.595472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:20.595957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:20.596401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:20.597096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:20.597591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:20.598027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:20.732302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:20.740914 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9ded17eb-7f3a-4911-a94a-0a465b6d886b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1575 microversion: 2.1 time: 0.157382 Sep 27 02:16:20.741519 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3319/6680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:20 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:21.764835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:21.765503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:21.772957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:21.773479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:21.773918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:21.774612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:21.775069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:21.775494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:21.912514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:21.920508 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a4ebbbfb-ab3d-49ed-aa96-929158465e29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1575 microversion: 2.1 time: 0.160227 Sep 27 02:16:21.921084 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3362/6681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:21 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:22.929409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fff30e-de7f-4066-b8fc-a9e9aca7bab9", "name": "network-vif-deleted", "tag": "acd22973-c4c5-4906-8955-3029039c0d2d"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:22.940283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:22.941113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:22.941816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:22.945300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:22.946127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:22.954542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:22.955143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:22.955705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:22.956484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:22.956624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] Creating event network-vif-deleted:acd22973-c4c5-4906-8955-3029039c0d2d for instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 on n-h1-859358-1 Sep 27 02:16:22.957377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:22.958052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:22.961878 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a746b2a0-534f-493d-86c7-22206191ac44 req-9cdb3198-e453-4509-8c96-ef26de06c0db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036162 Sep 27 02:16:22.963005 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3320/6682] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:23.038450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:23.046896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea321ff5-a8bd-403b-ba7a-c49c47a647e6 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1224 microversion: 2.1 time: 0.105669 Sep 27 02:16:23.048566 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3363/6683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:22 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:16:24.071550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:24.072365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:24.079732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:24.080237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:24.080707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:24.081465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:24.082117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:24.082735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:24.148381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:24.156389 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1c733a4-e12d-45dc-bb22-a8762aba41a7 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1224 microversion: 2.1 time: 0.089930 Sep 27 02:16:24.156959 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3321/6684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:24 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:25.180065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:25.180686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:25.187592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:25.188072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:25.190174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:25.190174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:25.190174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:25.190512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:25.252010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:25.259859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac4a1053-77a1-454f-894b-8e1d5cd741cc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1224 microversion: 2.1 time: 0.083745 Sep 27 02:16:25.260434 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3364/6685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:25 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:26.281911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:26.282685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:26.289875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:26.290454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:26.290977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:26.291757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:26.292306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:26.292822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:26.357777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:26.366289 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c28f3b6-3471-4e53-b1fd-9e87851e74f0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1224 microversion: 2.1 time: 0.088320 Sep 27 02:16:26.367107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3322/6686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:26 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:27.389888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:27.390501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:27.397431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:27.397912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:27.398344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:27.399044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:27.399526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:27.399940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:27.432010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:27.432484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:27.432916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:27.433375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lazy-loading 'fault' on Instance uuid 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:16:27.475856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:27.482975 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-950aac67-36e7-4936-970b-c928fcc2c0c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 200 len: 1183 microversion: 2.1 time: 0.097009 Sep 27 02:16:27.483731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3365/6687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:27 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 1183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:16:28.507549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:28.508181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:28.515176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:28.515677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:28.516126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:28.517317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:28.517811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:28.518251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:28.531436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 HTTP/1.1 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '99fff30e-de7f-4066-b8fc-a9e9aca7bab9'} Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:16:28.533768 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eea36496-365a-49a9-b1b1-c7e64ede626d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 404 len: 111 microversion: 2.1 time: 0.031664 Sep 27 02:16:28.539781 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3323/6688] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:28 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:16:28.635303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-391377504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1001753805", "security_groups": [{"name": "tempest-secgroup-smoke-302545111"}], "block_device_mapping_v2": [{"uuid": "d72b0a82-3484-4848-8afe-3bf050d85c76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:28.751842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:16:29.203242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:16:29.203669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:16:29.204198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:16:29.204611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:16:29.205023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:16:29.213802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:29.214281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:29.214709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:29.215428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:29.215896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:29.216300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:29.232673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:16:29.238454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:16:29.295746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:16:29.298575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d72b0a82-3484-4848-8afe-3bf050d85c76',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:16:29.388596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:29.427276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cce4d0d-47e7-4f8c-81fa-82161ccbf513 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.795813 Sep 27 02:16:29.427931 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3366/6689] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:16:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:16:29.439673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06e675bf-8d9a-4644-91c3-a402321d1e08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:29.440301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06e675bf-8d9a-4644-91c3-a402321d1e08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:29.497361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-06e675bf-8d9a-4644-91c3-a402321d1e08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:29.508766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06e675bf-8d9a-4644-91c3-a402321d1e08 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1094 microversion: 2.1 time: 0.073594 Sep 27 02:16:29.509379 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3324/6690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:29 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:30.532577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-713ff775-327e-48bb-a829-c693757a7033 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:30.533188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-713ff775-327e-48bb-a829-c693757a7033 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:30.589308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-713ff775-327e-48bb-a829-c693757a7033 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:30.596482 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-713ff775-327e-48bb-a829-c693757a7033 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1094 microversion: 2.1 time: 0.068651 Sep 27 02:16:30.597063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3367/6691] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:30 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:31.619350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3b7d315-5776-4d9f-95a3-06932f4a24b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:31.619969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3b7d315-5776-4d9f-95a3-06932f4a24b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:31.673289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3b7d315-5776-4d9f-95a3-06932f4a24b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:31.680734 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3b7d315-5776-4d9f-95a3-06932f4a24b8 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1094 microversion: 2.1 time: 0.065271 Sep 27 02:16:31.681292 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3325/6692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:31 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:32.703685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:32.704442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:32.712841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:32.713329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:32.713883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:32.714610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:32.715078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:32.715530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:32.721104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:32.782707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:32.791632 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd7a8a38-1d8c-4120-bcd3-682ca7ede814 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1210 microversion: 2.1 time: 0.091799 Sep 27 02:16:32.792444 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3368/6693] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:32 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:33.788100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3515242-51dc-476c-941d-0da4370283e5", "tag": "2b6ee460-9580-460c-9bea-7c270339cda1"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:33.812860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:33.813550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:33.814094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:33.818715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:33.820022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:33.828869 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] Creating event network-changed:2b6ee460-9580-460c-9bea-7c270339cda1 for instance c3515242-51dc-476c-941d-0da4370283e5 on n-h1-859358-1 Sep 27 02:16:33.830473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:33.832060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:33.832745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:33.834057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:33.834853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:33.835509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:33.835978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d7f52e0d-bdaf-481a-9f2e-e2474ecc5b4d req-cf48db0d-d87c-450c-87b7-dbea8278eb8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055295 Sep 27 02:16:33.837069 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3326/6694] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:34.003675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:34.012652 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1c8cc15e-93ef-4263-82a0-a3ee5af536c5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1277 microversion: 2.1 time: 0.200285 Sep 27 02:16:34.013455 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3369/6695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:33 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:35.037255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:35.038019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:35.045805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:35.046309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:35.046757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:35.047477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:35.047950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:35.048390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:35.180138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:35.188109 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d7e7f016-6fc1-4408-941c-2b468b2e2619 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1277 microversion: 2.1 time: 0.155626 Sep 27 02:16:35.188780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3327/6696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:35 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:36.210730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:36.211466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:36.218174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:36.218654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:36.219084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:36.219770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:36.220221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:36.220645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:36.357052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:36.367329 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-435d6ded-fa89-4b56-94cb-7f980a8c2fe5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1277 microversion: 2.1 time: 0.160343 Sep 27 02:16:36.375139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3370/6697] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:36 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:37.390511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:37.391146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:37.393861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:37.399823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:37.400438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:37.400889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:37.401640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:37.402113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:37.402555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:37.407406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=67 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:37.537480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:37.545559 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-721e6694-abcb-4417-af55-2a35680e6f93 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1277 microversion: 2.1 time: 0.159099 Sep 27 02:16:37.546145 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3328/6698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:37 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:38.569566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:38.570167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:38.577385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:38.577873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:38.578444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:38.579199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:38.579681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:38.580105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:38.712937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:38.720753 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2b13758-ff1d-45ce-a5e6-e7e9ed65d654 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.155712 Sep 27 02:16:38.721344 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3371/6699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:38 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:39.744142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:39.744686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:39.751526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:39.752018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:39.752460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:39.753179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:39.753663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:39.754099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:39.882365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:39.890296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5e32699b-550d-427d-b563-7539e500d0bd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.150131 Sep 27 02:16:39.890908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3329/6700] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:39 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:40.913778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:40.914399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:40.916496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:40.918008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:40.923720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:40.924201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:40.925279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:40.925999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:40.926453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:40.926880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:41.059528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:41.067682 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc8350b7-da6d-417a-8aa5-8e2a4114943e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.157903 Sep 27 02:16:41.068254 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3372/6701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:40 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:42.090574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:42.091201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:42.093974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:16:42.099341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:42.099839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:42.100283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:42.100982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:42.101477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:42.101919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:42.235664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:42.244094 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b2a13f38-0367-40f3-ad5e-2fb19bbd107f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.157424 Sep 27 02:16:42.244675 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3330/6702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:42 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:43.266517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:43.267081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:43.274056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:43.274528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:43.274960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:43.275672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:43.276122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:43.276572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:43.406986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:43.415570 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9db32913-6d8f-4761-b230-62c8a3b67572 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.153202 Sep 27 02:16:43.416148 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3373/6703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:43 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:44.438299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:44.438934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:44.445449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:44.445953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:44.446403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:44.447106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:44.447574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:44.448020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:44.586073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:44.595265 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b892009-1b11-4f75-879c-eff2036a5cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.160964 Sep 27 02:16:44.595847 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3331/6704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:44 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:45.620174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:45.620796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:45.628423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:45.629041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:45.629508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:45.630459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:45.630911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:45.631339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:45.767467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:45.775307 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5e8b993-9ff7-48ef-84b9-76f638abfa97 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.160741 Sep 27 02:16:45.775881 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3374/6705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:45 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:46.797629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:46.798260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:46.805127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:46.805653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:46.806108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:46.806808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:46.807278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:46.807719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:46.941844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:46.949590 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-178bf866-d618-4cab-accd-bf7ca03a8621 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.155951 Sep 27 02:16:46.950155 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3332/6706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:46 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:47.619386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3515242-51dc-476c-941d-0da4370283e5", "name": "network-vif-plugged", "status": "completed", "tag": "2b6ee460-9580-460c-9bea-7c270339cda1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:47.632461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:47.632939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:47.633382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:47.644739 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] Creating event network-vif-plugged:2b6ee460-9580-460c-9bea-7c270339cda1 for instance c3515242-51dc-476c-941d-0da4370283e5 on n-h1-859358-1 Sep 27 02:16:47.649748 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-69690c2e-4022-4dbb-9998-121ae99a0ead req-909436eb-75b6-4282-b0fa-5f9958792d43 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Sep 27 02:16:47.650532 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3375/6707] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:47.973318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:47.974181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:47.980843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:47.981363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:47.981833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:47.982545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:47.983020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:47.983465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:48.115907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:48.123719 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2acfcd2d-e20e-4d64-bdb1-32b03fcaa4c4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1265 microversion: 2.1 time: 0.154969 Sep 27 02:16:48.124292 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3333/6708] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:47 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:49.147447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:49.148153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:49.154387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:49.154865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:49.155296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:49.155977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:49.156429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:49.156849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:49.288821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:49.296794 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-618bb749-eeaf-4698-a860-8c505ab2c025 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1453 microversion: 2.1 time: 0.154492 Sep 27 02:16:49.297397 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3376/6709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:49 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:49.319070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:16:49.319616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:49.326530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:49.327030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:49.327509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:49.328218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:49.328686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:49.329130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:49.461363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:16:49.469225 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c17513f-d5a3-4fdc-b7fd-50794621eaaf tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1453 microversion: 2.1 time: 0.154100 Sep 27 02:16:49.469891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3334/6710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:16:49 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:16:51.080120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3515242-51dc-476c-941d-0da4370283e5", "tag": "2b6ee460-9580-460c-9bea-7c270339cda1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:51.091473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:51.091948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:51.092380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:51.104580 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] Creating event network-changed:2b6ee460-9580-460c-9bea-7c270339cda1 for instance c3515242-51dc-476c-941d-0da4370283e5 on n-h1-859358-1 Sep 27 02:16:51.110506 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-37cd67cd-9edf-4249-85c5-f8460e95ebb3 req-707b6018-4476-427c-88a1-1e3403ba9765 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Sep 27 02:16:51.111174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3377/6711] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:16:52.550979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:16:52.553212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:16:52.560320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:52.560817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:52.561270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:52.562015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:16:52.562485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:16:52.562929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:16:52.631018 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a6bea4a-0aa2-4649-af0c-f677fc24b425 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action" status: 200 len: 24566 microversion: 2.1 time: 0.083844 Sep 27 02:16:52.631588 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3335/6712] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:16:52 2022] POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action => generated 24566 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:17:07.236115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:07.236857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=51 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:07.348879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:07.349549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:07.355816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:07.356296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:07.356730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:07.357438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:07.357917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:07.358342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:07.384775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:17:07.462448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c894fc67-97ff-4dc0-8dfa-33eba9cb6984 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 204 len: 0 microversion: 2.1 time: 0.231556 Sep 27 02:17:07.463330 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3378/6713] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:17:07 2022] DELETE /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:17:07.472588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:07.473312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:07.476376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=15 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:07.477220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=45 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:07.483473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:07.483958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:07.484408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:07.485114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:07.485618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:07.486061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:07.685572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:07.693316 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0cee2e5c-1503-4225-b65e-a7fed1e901bd tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1735 microversion: 2.1 time: 0.225047 Sep 27 02:17:07.693978 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3336/6714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:07 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:17:08.717520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:08.718281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:08.725504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:08.725994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:08.726434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:08.727140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:08.727675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:08.728107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:08.926278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:08.935465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0488181d-13d8-4bfd-9a77-11bd5c17e23e tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1735 microversion: 2.1 time: 0.222464 Sep 27 02:17:08.936047 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3379/6715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:08 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:09.365088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10ebbf9-0c75-4e00-8d80-3abaae153105", "name": "network-vif-deleted", "tag": "da1767f8-1294-446e-bb35-306c90b82025"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:09.377591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:09.378092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:09.378840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:09.396171 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] Creating event network-vif-deleted:da1767f8-1294-446e-bb35-306c90b82025 for instance a10ebbf9-0c75-4e00-8d80-3abaae153105 on n-h2-859358-1 Sep 27 02:17:09.402448 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-cd35fa8e-8373-40dc-a9c4-727eebe84328 req-51f209b0-b3e4-40c1-9867-5b3bc245ed13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044621 Sep 27 02:17:09.403065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3337/6716] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:17:09.960581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:09.961212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:09.968617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:09.969278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:09.969831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:09.970707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:09.971173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:09.971753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:10.021224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:10.021801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:10.022446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:10.022902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lazy-loading 'fault' on Instance uuid a10ebbf9-0c75-4e00-8d80-3abaae153105 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:17:10.069869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174f679ff06546f9a6aaee37dedae58a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6228b2f92f7f44378499df5cf5a3cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:10.077908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-539400b7-5276-44a2-a600-f693e60cdf67 tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 200 len: 1389 microversion: 2.1 time: 0.121410 Sep 27 02:17:10.093513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3380/6717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:09 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 1389 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:11.101673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:11.102422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:11.109985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.110487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.110939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.111743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.112455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.112859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.127135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] HTTP exception thrown: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Request method failure captured: Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 HTTP/1.1 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlvOIciSsHn24alAeLWrgIcyjKQ-PUJISrV8HnMWEgfWKn-ndacVqM6vPdjeb-A5qVOQbxRq91PcCuLhDt_EZ5b9gv6T9vEDDY0v5BCaWMwlt1ANGp9A5bwIMIvbG2DyBIT7MEdxAv-hzrXqofnzig6q3G_9DVLhHaOQBNCZAvDFywc Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6228b2f92f7f44378499df5cf5a3cd6f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 174f679ff06546f9a6aaee37dedae58a Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a10ebbf9-0c75-4e00-8d80-3abaae153105'} Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.128803 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Returning 404 to user: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ea576fd-8d6a-42c7-8bf3-19e48c6665fa tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 404 len: 111 microversion: 2.1 time: 0.032977 Sep 27 02:17:11.136347 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3338/6718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:11 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:17:11.590822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:11.591535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:11.599355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.600405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.600854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.601623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.602134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.602571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.616733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] HTTP exception thrown: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Request method failure captured: Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 HTTP/1.1 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlvOIciSsHn24alAeLWrgIcyjKQ-PUJISrV8HnMWEgfWKn-ndacVqM6vPdjeb-A5qVOQbxRq91PcCuLhDt_EZ5b9gv6T9vEDDY0v5BCaWMwlt1ANGp9A5bwIMIvbG2DyBIT7MEdxAv-hzrXqofnzig6q3G_9DVLhHaOQBNCZAvDFywc Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6228b2f92f7f44378499df5cf5a3cd6f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 174f679ff06546f9a6aaee37dedae58a Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a10ebbf9-0c75-4e00-8d80-3abaae153105'} Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:17:11.618475 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Returning 404 to user: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d357328-3b68-4d0a-88fe-465c6bfeac8f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 404 len: 111 microversion: 2.1 time: 0.034378 Sep 27 02:17:11.626920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3381/6719] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:17:11 2022] DELETE /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:17:11.628530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:11.629191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] [instance: a10ebbf9-0c75-4e00-8d80-3abaae153105] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:11.635394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.635894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.636344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.637049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:11.637552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:11.637997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:11.651648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] HTTP exception thrown: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Request method failure captured: Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 HTTP/1.1 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlvOIciSsHn24alAeLWrgIcyjKQ-PUJISrV8HnMWEgfWKn-ndacVqM6vPdjeb-A5qVOQbxRq91PcCuLhDt_EZ5b9gv6T9vEDDY0v5BCaWMwlt1ANGp9A5bwIMIvbG2DyBIT7MEdxAv-hzrXqofnzig6q3G_9DVLhHaOQBNCZAvDFywc Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6228b2f92f7f44378499df5cf5a3cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6228b2f92f7f44378499df5cf5a3cd6f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 6228b2f92f7f44378499df5cf5a3cd6f Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestServerBasicOps-1579777281 Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 174f679ff06546f9a6aaee37dedae58a Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestServerBasicOps-1579777281-project Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a10ebbf9-0c75-4e00-8d80-3abaae153105'} Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.653169 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Returning 404 to user: Instance a10ebbf9-0c75-4e00-8d80-3abaae153105 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35729cf4-80cd-47e5-89c8-69ae3ff355ef tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105" status: 404 len: 111 microversion: 2.1 time: 0.029868 Sep 27 02:17:11.658900 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3339/6720] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:11 2022] GET /compute/v2.1/servers/a10ebbf9-0c75-4e00-8d80-3abaae153105 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:17:11.832404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4fa45900-dbe6-4ef5-8480-b499cfb1d86f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] Calling method '.version_select at 0x7f24da56c8b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:11.856284 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4fa45900-dbe6-4ef5-8480-b499cfb1d86f tempest-TestServerBasicOps-1579777281 tempest-TestServerBasicOps-1579777281-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1525071897" status: 202 len: 0 microversion: 2.1 time: 0.027745 Sep 27 02:17:11.856958 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3382/6721] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Sep 27 02:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1525071897 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:17:23.073055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:23.073706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:23.076389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:23.077078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:23.082663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.083165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.083616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.084329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.084799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.085252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.314573 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d6a4f44c-d842-4eb2-8001-5b835fccbb40 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1835 microversion: 2.1 time: 0.245188 Sep 27 02:17:23.315305 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3340/6722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:23 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1835 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:23.336495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:23.337164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:17:23.341382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:23.342183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:23.350627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.351274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.351889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.352685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.353140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.353602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.484908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:23.493264 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f16aeb7-9e76-40f4-887f-5ddddcb969e9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1684 microversion: 2.1 time: 0.159324 Sep 27 02:17:23.493868 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3383/6723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:23 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:23.592006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:23.594258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:23.600298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.600798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.601251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.602538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.603006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.603445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.670213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e91a23b0-0212-4585-8c94-79ba6ae3c99f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action" status: 200 len: 32639 microversion: 2.1 time: 0.082097 Sep 27 02:17:23.670833 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3341/6724] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:17:23 2022] POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action => generated 32639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:17:23.856732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:23.857230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:23.863296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.863775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.864277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.864963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:23.865439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:23.865866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:23.907695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e738ee2b22ca44e39cccd29afd41ca73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc6739f3a364919a282ec585e5e677f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:23.908295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] flavor_id is None. Assuming migration. {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 27 02:17:23.908731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:17:24.206381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-104c53d8-bb75-4876-b8c0-a50359a9c27e tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action" status: 202 len: 0 microversion: 2.1 time: 0.354152 Sep 27 02:17:24.207200 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3384/6725] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:17:23 2022] POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:17:24.216501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:24.217315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:24.225330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:24.225869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:24.226318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:24.227031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:24.227531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:24.227972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:24.362500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:24.370482 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6433804-7173-4a85-a3bf-0fc02ab19237 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1693 microversion: 2.1 time: 0.158626 Sep 27 02:17:24.371070 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3342/6726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:24 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:25.396243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:25.396857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:25.403676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:25.404163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:25.404599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:25.405285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:25.405759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:25.406188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:25.535866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:25.544342 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96cc9b37-44c3-49a1-850d-b450e60dcc6c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1693 microversion: 2.1 time: 0.153319 Sep 27 02:17:25.544911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3385/6727] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:25 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:26.568045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:26.568683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:26.578472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:26.578976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:26.579433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:26.580144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:26.580619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:26.581067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:26.713672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:26.721635 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0d0649b5-30c6-416e-8853-363ed2742588 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.157387 Sep 27 02:17:26.722154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3343/6728] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:26 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:27.746766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:27.747300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:27.754435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:27.754916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:27.755378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:27.756066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:27.756519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:27.756944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:27.895622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:27.903365 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8df75232-996c-4186-9d5c-ec5fe722fe28 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.161197 Sep 27 02:17:27.903938 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3386/6729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:27 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:28.926221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:28.926850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:28.934248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:28.934745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:28.935199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:28.935904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:28.936376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:28.936821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:29.065294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:29.073609 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4418f0f-474f-4367-8b5c-a385ebe8f210 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.151347 Sep 27 02:17:29.074183 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3344/6730] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:28 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:30.096799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:30.097445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:30.104321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:30.104804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:30.105243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:30.105965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:30.106422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:30.106852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:30.235494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:30.243308 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5e765973-1252-4333-9e06-f107ccbf0eff tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.150524 Sep 27 02:17:30.243887 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3387/6731] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:30 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:31.266469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:31.267097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:31.274568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:31.275067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:31.275520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:31.276226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:31.276697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:31.277140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:31.416010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:31.423979 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3992a8f9-1222-44a8-874a-a453f82c9162 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.161398 Sep 27 02:17:31.424555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3345/6732] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:31 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:32.447174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:32.447784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:32.454629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:32.455126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:32.455570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:32.456264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:32.456722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:32.457147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:32.588724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:32.596333 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-956b809d-aa5c-4c36-98a5-dfee9e0c273e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.153122 Sep 27 02:17:32.596902 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3388/6733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:32 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:33.620336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:33.620965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:33.627964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:33.628461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:33.628911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:33.629644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:33.630117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:33.630560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:33.760626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:33.768417 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44256942-0f19-4678-abd6-4f5a7d61037d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.152489 Sep 27 02:17:33.768988 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3346/6734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:33 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:34.791760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:34.792381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:34.799386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:34.799860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:34.800287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:34.800967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:34.801442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:34.801865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:34.939724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:34.948020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37e021a2-6144-4e4f-aaf2-5e6bbc1d81b8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.160814 Sep 27 02:17:34.948595 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3389/6735] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:34 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:35.972397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:35.973029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:35.980620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:35.981123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:35.981607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:35.982327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:35.982801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:35.983245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:36.168404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:36.176301 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a3c210a6-8fce-41a3-bcc0-7cf013f6a962 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.207797 Sep 27 02:17:36.176938 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3347/6736] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:35 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:37.199744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:37.200355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:37.207012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:37.207491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:37.207933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:37.208623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:37.209082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:37.209551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:37.341157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:37.348887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4adb2522-2c9c-4469-ab75-9772e20c61a7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1698 microversion: 2.1 time: 0.153091 Sep 27 02:17:37.349478 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3390/6737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:37 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:38.374620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:38.376211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:38.386375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:38.387103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:38.387564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:38.388890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:38.389402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:38.390047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:38.643635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:38.653303 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eafd9195-2239-45b6-ae10-b726a746df21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1697 microversion: 2.1 time: 0.283621 Sep 27 02:17:38.653956 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3348/6738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:38 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1697 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:38.943715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "name": "network-vif-unplugged", "status": "completed", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:38.958176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:38.958660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:38.959090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:38.974659 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Creating event network-vif-unplugged:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h1-859358-1 Sep 27 02:17:38.980752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:17:38.994965 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aedefb95-8a41-4851-a458-5590a4692150 req-5ae27613-551b-42cd-b236-cca6cd6a5858 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055146 Sep 27 02:17:38.995663 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3391/6739] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:17:39.678300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:39.678956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:39.686385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:39.686882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:39.687374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:39.688101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:39.688500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:39.688938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:39.917097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:39.924927 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d2561e39-086b-4573-ae04-faf510e888fc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1697 microversion: 2.1 time: 0.250715 Sep 27 02:17:39.925534 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3349/6740] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:39 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1697 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:40.950381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:40.951104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:40.959865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:40.960354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:40.961283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:40.962031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:40.962626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:40.962954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:41.010187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:41.022157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:41.022765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:41.023952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:41.038188 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Creating event network-changed:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h1-859358-1 Sep 27 02:17:41.046015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:17:41.059882 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f8726b55-f22d-47ee-9b21-e7a288f020f7 req-dd195406-8421-472e-8cb2-529409007f4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053867 Sep 27 02:17:41.060693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3350/6741] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:17:41.106886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:41.115455 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72348ac4-9ee9-4c67-98b5-ccff3a3e5d65 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1695 microversion: 2.1 time: 0.170032 Sep 27 02:17:41.116111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3392/6742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:40 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:42.140297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:42.141060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:42.150640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.151158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.151612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.152336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.153025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.153498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.290440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:42.298610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-737d0e6d-db73-49f3-bd1c-7f44a5e1af5b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1692 microversion: 2.1 time: 0.162715 Sep 27 02:17:42.299191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3351/6743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:42 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:42.321687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:42.322262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:42.329054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.329607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.330050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.330754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.331215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.331650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.390491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7f663c0-af07-49b1-a771-77cc2b2d4773 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action" status: 204 len: 0 microversion: 2.1 time: 0.073039 Sep 27 02:17:42.391074 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3393/6744] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:17:42 2022] POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:17:42.399876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:42.400611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:42.406717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.407294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.407817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.408540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:42.409005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:42.409477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:42.657895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:42.665676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b2c71e8-a117-44d4-b056-316eb8c55dee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1692 microversion: 2.1 time: 0.270222 Sep 27 02:17:42.666263 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3352/6745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:42 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1692 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:43.689559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:43.690399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:43.698218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:43.698702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:43.699144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:43.699839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:43.700298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:43.700730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:43.841638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:43.851336 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2c8e9d1-d687-4afc-8c8e-1f153ffe0d38 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1692 microversion: 2.1 time: 0.166069 Sep 27 02:17:43.852043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3394/6746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:43 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:17:43.889829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "name": "network-vif-plugged", "status": "completed", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:17:43.901919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:43.902422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:43.903012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:43.916469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Creating event network-vif-plugged:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h1-859358-1 Sep 27 02:17:43.922854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:17:43.934197 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-521a7654-e051-4fbf-98b4-4d47ca3017f1 req-3b16dff5-7da0-42c3-8bd9-06109d275f3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048585 Sep 27 02:17:43.935076 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3353/6747] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:17:44.874979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:17:44.875780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:17:44.882897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:44.883378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:44.883814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:44.884501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:17:44.884955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:17:44.885402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:17:45.016889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:17:45.025086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-252aa691-47e2-4c15-9927-fcead7e38113 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1684 microversion: 2.1 time: 0.154067 Sep 27 02:17:45.025681 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3395/6748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:17:44 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:07.206161 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:18:07.206730 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action (ip 10.222.0.52) !!! Sep 27 02:18:07.207676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=28 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:07.208427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=78 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:07.213064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:07.216323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:07.225444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:07.225936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:07.226381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:07.227083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:07.227545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:07.227982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:07.281791 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6fad0c01-128c-4827-99a0-b4ae87c2612b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action" status: 200 len: 24581 microversion: 2.1 time: 0.077490 Sep 27 02:18:07.282420 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3354/6749] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:18:07 2022] POST /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc/action => generated 24581 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:18:13.786222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:13.786848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:13.789035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=28 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:13.789729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:13.796306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:13.796794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:13.797236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:13.797964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:13.798434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:13.798866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:13.931742 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e19b582-2b1e-42dc-924f-d108d2508f0f tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1835 microversion: 2.1 time: 0.149549 Sep 27 02:18:13.932332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3396/6750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:13 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1835 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:14.786679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:14.787284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:14.793156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:14.805765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:14.806268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:14.806719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:14.807951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:14.808418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:14.808854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:14.811974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:14.812458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:14.812890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:14.826148 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] Creating event network-changed:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h1-859358-1 Sep 27 02:18:14.831570 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4ccef6d2-6bd1-47f6-9f1f-bfae8b364ce4 req-dda090cf-a8cb-4aac-827b-beea2c1c11f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Sep 27 02:18:14.832386 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3397/6751] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:14.840575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:18:14.931084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ccccadb-1b79-4b00-921d-de2440362d89 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 204 len: 0 microversion: 2.1 time: 0.148656 Sep 27 02:18:14.931859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3355/6752] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:18:14 2022] DELETE /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:18:14.941311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:14.942130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:14.949913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:14.950404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:14.950846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:14.951667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:14.952304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:14.952735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:15.095744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:15.103797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81aa9156-d29e-4b89-99a6-104dce41e351 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1690 microversion: 2.1 time: 0.166863 Sep 27 02:18:15.104423 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3398/6753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:14 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:16.128576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:16.129310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:16.136323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:16.136827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:16.137282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:16.138029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:16.138504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:16.138950 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:16.355874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:16.364105 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8990401e-5431-4e2f-bc9c-3becc628ad03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 200 len: 1690 microversion: 2.1 time: 0.239833 Sep 27 02:18:16.364853 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3356/6754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:16 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:16.847402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a74c1-ef3a-40c6-9a63-88edb6c236fc", "name": "network-vif-deleted", "tag": "e0e5ca29-cece-43be-913c-d4885ea61062"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:16.858362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:16.858837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:16.859267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:16.870840 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] Creating event network-vif-deleted:e0e5ca29-cece-43be-913c-d4885ea61062 for instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc on n-h1-859358-1 Sep 27 02:18:16.875998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-07e11591-5352-4658-a0b5-c43e0e1b1f5b req-8497e7dc-d73c-4e06-8b93-6e08b67a0c59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032314 Sep 27 02:18:16.876960 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3399/6755] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:18:17.388487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:17.389121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:17.396124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:17.396621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:17.397074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:17.397812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:17.398280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:17.398725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:17.411987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] HTTP exception thrown: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Request method failure captured: Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc HTTP/1.1 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlze1W3x_Kg2PsUwaVfmjSKuVDvreZPVDdQ-dvuxU43gMdyqZ67Gpy3CtykNqqJp1y6HxkW6XS4KTbWwt5dYTwpP7SHQQRq8ogCOR8knZrke-3-ylcbPw0RIO3qmO6A0bzS5Jgz23lRpxz3W1kXB7sy08BifSRZLrynTa7q1h15D8OA Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d98f740e2174656a766c0f768b296d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ff34fab8a91a46538c63de5dcaa09d22 Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8a3a74c1-ef3a-40c6-9a63-88edb6c236fc'} Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:18:17.413652 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Returning 404 to user: Instance 8a3a74c1-ef3a-40c6-9a63-88edb6c236fc could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0db24cb7-258c-411f-83af-3828f8c87d45 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc" status: 404 len: 111 microversion: 2.1 time: 0.030531 Sep 27 02:18:17.419574 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3357/6756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:17 2022] GET /compute/v2.1/servers/8a3a74c1-ef3a-40c6-9a63-88edb6c236fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:18:20.453826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-caa8ed48-e70e-495e-99e8-c820ed90f020 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '.version_select at 0x7f24d53d3280>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:20.486908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-caa8ed48-e70e-495e-99e8-c820ed90f020 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1962143547" status: 202 len: 0 microversion: 2.1 time: 0.038936 Sep 27 02:18:20.487845 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3400/6757] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 02:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1962143547 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:18:20.518655 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-21bac880-3b10-405b-a08f-66827cf60ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: .version_select at 0x7f24d5067dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1959095756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2qTS5BSF6u9hUT3f5IEeTJtMRaDhcaa155gpaaTOSZXjLpCX+6nOGQxVMkPd81dRQ0WuOqXmASQy4Z+gDpQatWQ8BYRrS+xU84krEARguOdQrLigls6h8AQcY+duiBQw=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:20.539039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-21bac880-3b10-405b-a08f-66827cf60ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:18:20.546043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-21bac880-3b10-405b-a08f-66827cf60ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:18:20.579000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-21bac880-3b10-405b-a08f-66827cf60ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.064117 Sep 27 02:18:20.579486 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3358/6758] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:18:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:26.361830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-314758571", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "4eac1236-76dc-4f8f-91f2-eabc557d8522"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1959095756", "security_groups": [{"name": "tempest-secgroup-smoke-1641329814"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:26.488041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] validate_networks() for [('4eac1236-76dc-4f8f-91f2-eabc557d8522', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:18:26.864484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=16 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:26.961510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:18:26.961922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:18:26.962519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:18:26.963000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:18:26.963525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:18:26.973095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:26.973669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:26.974114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:26.974840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:26.975403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:26.975705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:26.996724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:18:27.002347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:18:27.015632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:18:27.018140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:18:27.109911 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-742a8b52-3d86-4264-9cef-4621c9b35fbe tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751708 Sep 27 02:18:27.111172 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3401/6759] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:18:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:18:27.124535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b5f7c4e-74fb-478d-87d2-e8414d0902f7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:27.125161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b5f7c4e-74fb-478d-87d2-e8414d0902f7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:27.206275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b5f7c4e-74fb-478d-87d2-e8414d0902f7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:27.213678 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b5f7c4e-74fb-478d-87d2-e8414d0902f7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1266 microversion: 2.1 time: 0.094621 Sep 27 02:18:27.215003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3359/6760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:27 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:28.244230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:28.249308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:28.261557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:28.266060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:28.267133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:28.268184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:28.268930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:28.269638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:28.341912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:28.352228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dbae7545-3161-49e9-bfc5-7aa97deee24e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1326 microversion: 2.1 time: 0.119653 Sep 27 02:18:28.354271 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3402/6761] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:28 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:29.380433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:29.381869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:29.384927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:29.398149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:29.398814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:29.399518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:29.400345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:29.401474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:29.402018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:29.619017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:29.628760 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67565557-c738-42be-a6c4-56b722faf2a4 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.252316 Sep 27 02:18:29.629465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3360/6762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:29 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:30.232097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:30.248819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:30.253985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:30.254549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:30.286343 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] Creating event network-changed:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:18:30.292054 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3c023be0-ac2c-49a7-803a-dab5b6298b40 req-b7e53c48-b06c-49ef-bf19-041589a56e0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065081 Sep 27 02:18:30.293663 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3403/6763] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:30.652559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:30.653266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:30.660332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:30.661028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:30.661723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:30.662444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:30.662922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:30.663977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:30.798976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:30.806665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb357c00-ec15-47c1-9718-14a4a58bcd69 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.158550 Sep 27 02:18:30.807267 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3361/6764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:30 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:31.831496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:31.832119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:31.838812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:31.839300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:31.839734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:31.840419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:31.840868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:31.841290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:31.970303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:31.977885 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9d58fb7-3d78-4463-96a2-d5527d0d848f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.151552 Sep 27 02:18:31.978395 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3404/6765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:31 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:33.000331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:33.001015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:33.009492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:33.010074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:33.011094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:33.011828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:33.012423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:33.012931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:33.217980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:33.225932 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b57fe7e2-effe-428d-a1b9-c478f75952a5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.229741 Sep 27 02:18:33.226639 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3362/6766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:32 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:34.248891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:34.249469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:34.256843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:34.257330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:34.257793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:34.258496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:34.258955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:34.259387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:34.398252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:34.406822 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-294f44c9-8161-4a3f-a6f7-f0a5e549be90 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.162519 Sep 27 02:18:34.407428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3405/6767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:34 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:18:35.430504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:35.431074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:35.441465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:35.441981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:35.442716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:35.443455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:35.443934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:35.444382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:35.597828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:35.606845 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e8814a4-c7b4-481a-b2ae-f7c8d80ac037 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.180458 Sep 27 02:18:35.607649 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3363/6768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:35 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:35.684135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "name": "network-vif-plugged", "status": "completed", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:35.696156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:35.696156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:35.696156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:35.709725 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] Creating event network-vif-plugged:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:18:35.723339 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d29e15c1-b340-4752-b03f-a7dd6a47b4af req-f5da8e96-ce00-4c84-9e21-21fdfb33cf0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043026 Sep 27 02:18:35.724201 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3406/6769] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:36.629879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:36.630611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:36.642492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:36.642981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:36.646088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:36.646270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:36.646643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:36.647090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:36.826630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:36.835922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-89c0892f-657d-4c68-a0a6-8dd728acb240 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1392 microversion: 2.1 time: 0.209849 Sep 27 02:18:36.837090 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3364/6770] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:36 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:37.858926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:37.860873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:37.867273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:37.867988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:37.877808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:37.878293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:37.878730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:37.879420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:37.879876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:37.880453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:38.056029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:38.066486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f4262df-af16-40f4-968a-5519094be5ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1565 microversion: 2.1 time: 0.209117 Sep 27 02:18:38.077505 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3407/6771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:37 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:38.092324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:38.093915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:38.096332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:38.097571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:38.104749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:38.105833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:38.107047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:38.108684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:38.109162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:38.109753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:38.402224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:38.410096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-779e3009-99f0-45b6-885c-6ca59e06514b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1565 microversion: 2.1 time: 0.322994 Sep 27 02:18:38.410737 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3365/6772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:38 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1565 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:40.202777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:40.204949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:40.206067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:40.216943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:40.217542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:40.217992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:40.218705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:40.219166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:40.219600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:40.228586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:40.229117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:40.229666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:40.243477 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] Creating event network-changed:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:18:40.252769 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-732918c6-5c41-4356-953d-1d8998ec46b1 req-ec1ea542-f901-4f19-a2c9-91fa9ab2a52a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055334 Sep 27 02:18:40.253517 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3366/6773] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:40.395030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:40.408219 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c164e60-97a2-4b86-82a7-228a4d81ea70 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1565 microversion: 2.1 time: 0.214093 Sep 27 02:18:40.409431 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3408/6774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:40 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1565 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:41.467036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1715868934", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1001753805", "security_groups": [{"name": "tempest-secgroup-smoke-302545111"}], "block_device_mapping_v2": [{"uuid": "c1f969f1-4cb1-4de0-b794-d5cf1c915dfd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49f5552d-855a-4b1e-acd0-42b26b54b9ab"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:41.580759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] validate_networks() for [('49f5552d-855a-4b1e-acd0-42b26b54b9ab', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:18:41.952100 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:18:41.952572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:18:41.953121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:18:41.953581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:18:41.954016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:18:41.962941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:41.963921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:41.964380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:41.965119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:41.965621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:41.966062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:41.983341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:18:41.988618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Getting quotas for user b2d3eb0b01de43d0a9839a0318b605dd and project 8f84b8df9cc6488ea9cdef2c6b74af61. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:18:42.046333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:18:42.048572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1f969f1-4cb1-4de0-b794-d5cf1c915dfd',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:18:42.184698 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ae0e4ad5-986c-465d-a883-76b250b45a4a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726404 Sep 27 02:18:42.185372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3367/6775] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:18:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:18:42.196402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a203c2e-583e-4490-8d6b-edfba232b78e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:42.197016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a203c2e-583e-4490-8d6b-edfba232b78e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:42.251665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a203c2e-583e-4490-8d6b-edfba232b78e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:42.258550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a203c2e-583e-4490-8d6b-edfba232b78e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1095 microversion: 2.1 time: 0.066139 Sep 27 02:18:42.259166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3409/6776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:42 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:18:43.282585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:43.283447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:43.290540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:43.290907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:43.291504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:43.292282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:43.292870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:43.293400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:43.363066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:43.371876 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-965372f4-cab4-42ba-9e53-7bf0bb207c15 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1211 microversion: 2.1 time: 0.094378 Sep 27 02:18:43.381599 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3368/6777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:43 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:44.394312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:44.394923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:44.397917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:44.406045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:44.406905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:44.407530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:44.408410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:44.409030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:44.409650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:44.621267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:44.630293 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7759d84a-94fe-41b3-967b-b2d4884c75f3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1278 microversion: 2.1 time: 0.239762 Sep 27 02:18:44.631157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3410/6778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:44 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:18:44.655677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3449e7f-f502-44ca-bc17-a14734c3694c", "tag": "9e64af5d-d57c-4c5a-93ba-28dbd8971d4c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:44.667779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:44.668823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:44.669266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:44.683546 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] Creating event network-changed:9e64af5d-d57c-4c5a-93ba-28dbd8971d4c for instance c3449e7f-f502-44ca-bc17-a14734c3694c on n-h1-859358-1 Sep 27 02:18:44.689034 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4dddbed7-7b70-4d84-bbf9-9fbe45c5527e req-7ef89205-4e1a-4ea5-bb84-de66b5f9b0ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Sep 27 02:18:44.690204 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3369/6779] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:45.655395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:45.656337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:45.663970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:45.664568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:45.665098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:45.665913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:45.667240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:45.667746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:46.013576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:46.021550 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ffc24c74-6b4e-486d-ac50-3a6168362a1f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1278 microversion: 2.1 time: 0.370806 Sep 27 02:18:46.022132 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3411/6780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:45 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1278 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:47.046491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:47.047273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:47.053628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:47.054122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:47.054568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:47.055265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:47.055727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:47.056162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:47.202335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:47.210108 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de0e7427-f51c-49dd-9513-20baf92cfcec tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1278 microversion: 2.1 time: 0.169660 Sep 27 02:18:47.210693 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3370/6781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:47 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:48.232966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:48.233610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:48.240898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:48.241406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:48.241839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:48.242531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:48.243020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:48.243448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:48.374315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:48.382082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a8cf7b05-679e-4fcf-aee6-f72bb76dd57a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.153196 Sep 27 02:18:48.382664 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3412/6782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:48 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:49.405270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:49.405919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:49.412631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:49.413120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:49.413619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:49.414320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:49.414797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:49.415216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:49.556421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:49.565607 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-592fc329-2efa-4c6a-aa39-20298e6cf588 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.164155 Sep 27 02:18:49.566169 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3371/6783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:49 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:50.587433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:50.588078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:50.595951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:50.596432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:50.596864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:50.597581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:50.598035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:50.598457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:50.727447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:50.736027 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1dc3824b-3df7-4671-a61a-f041b703af67 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.152512 Sep 27 02:18:50.736594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3413/6784] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:50 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:51.759270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:51.759984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:51.767721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:51.768348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:51.768811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:51.769608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:51.770214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:51.770760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:51.926484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:51.936248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bfa39363-7ab2-40c2-9b63-bc8e787e42dd tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.181045 Sep 27 02:18:51.937795 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3372/6785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:51 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:18:52.962794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:52.963414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:52.966159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:52.971536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:52.972014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:52.972452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:52.973179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:52.973665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:52.974096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:53.106287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:53.114064 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9e098901-530d-4d59-9051-abe8ea458cff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.155346 Sep 27 02:18:53.114642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3414/6786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:52 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:18:54.137620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:54.138245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:54.140280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:54.141137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:54.147836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:54.148329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:54.148802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:54.149544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:54.150010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:54.150446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:54.280178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:54.288224 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9cd55bba-a4ce-4677-bb59-072579a7800b tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.155008 Sep 27 02:18:54.288788 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3373/6787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:54 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:55.310949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:55.311544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:55.318451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:55.318932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:55.319374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:55.320060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:55.320512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:55.320936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:55.448047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:55.456303 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c07d6efd-e2a6-4f2f-a695-17fd16fa8894 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.149313 Sep 27 02:18:55.456872 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3415/6788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:55 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:56.479535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:56.480166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:56.487101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:56.487599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:56.488050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:56.488762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:56.489231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:56.489701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:56.620871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:56.630251 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c845e298-0f6e-459f-a7c0-05ff5524a51a tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.154647 Sep 27 02:18:56.630831 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3374/6789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:56 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:57.653575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:57.654197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:57.661054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:57.661587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:57.662031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:57.662726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:57.663190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:57.663619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:57.666204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=73 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:18:57.799688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:57.807600 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd7b1bea-6535-464f-a33f-f4df3948915d tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.157942 Sep 27 02:18:57.808458 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3416/6790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:57 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:18:58.186238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3449e7f-f502-44ca-bc17-a14734c3694c", "name": "network-vif-plugged", "status": "completed", "tag": "9e64af5d-d57c-4c5a-93ba-28dbd8971d4c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:18:58.200383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:58.200878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:58.201322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:58.213024 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] Creating event network-vif-plugged:9e64af5d-d57c-4c5a-93ba-28dbd8971d4c for instance c3449e7f-f502-44ca-bc17-a14734c3694c on n-h1-859358-1 Sep 27 02:18:58.219902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-26fb651c-5eb2-42c2-99cd-981b2ab95bb9 req-6fc92334-4229-4c10-80fc-ea0728957a24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Sep 27 02:18:58.220558 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3375/6791] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:18:58.903552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:18:58.904210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:18:58.910757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:58.911250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:58.911690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:58.912409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:18:58.912868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:18:58.913371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:18:59.048125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:18:59.055838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-29b592e0-edfc-4618-8cad-e65f38522457 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1266 microversion: 2.1 time: 0.228828 Sep 27 02:18:59.056413 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3417/6792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:18:58 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:00.080398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:00.081123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:00.088248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:00.088746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:00.089208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:00.089932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:00.090403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:00.090845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:00.094848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=81 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:00.227146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:00.234969 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-160efc76-1a8a-48d0-aa7a-8b1e083f4ada tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1453 microversion: 2.1 time: 0.158997 Sep 27 02:19:00.235538 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3376/6793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:00 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:00.257233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:00.257906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:00.265232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:00.265774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:00.266215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:00.266910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:00.267367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:00.267797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:00.398802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:00.406684 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bfe5490-f486-4642-a18f-f141772e58dc tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1453 microversion: 2.1 time: 0.153219 Sep 27 02:19:00.407281 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3418/6794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:00 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:01.993654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3449e7f-f502-44ca-bc17-a14734c3694c", "tag": "9e64af5d-d57c-4c5a-93ba-28dbd8971d4c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:19:02.005220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:02.005831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:02.006367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:02.021325 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] Creating event network-changed:9e64af5d-d57c-4c5a-93ba-28dbd8971d4c for instance c3449e7f-f502-44ca-bc17-a14734c3694c on n-h1-859358-1 Sep 27 02:19:02.026328 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-047691df-2b6e-4611-96e4-9ce7aa6dd34d req-f4ece818-dfea-4ce0-bc7d-07b43e476d3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036716 Sep 27 02:19:02.026929 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3377/6795] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:19:13.734968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:19:13.737188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:13.739583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=17 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:13.740465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=17 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:13.748433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:13.748914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:13.749356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:13.750052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:13.750502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:13.750924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:13.817579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43f4f510-3b7a-4055-b0bf-48040082c385 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action" status: 200 len: 24570 microversion: 2.1 time: 0.086959 Sep 27 02:19:13.818236 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3419/6796] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:19:13 2022] POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action => generated 24570 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:19:44.242353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:44.243144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:44.247195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:44.247953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:44.255817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.256320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.256779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.257619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.258096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.258544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.391257 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cd0a98c3-905f-4de6-88de-5f2b6208fbfb tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1835 microversion: 2.1 time: 0.151171 Sep 27 02:19:44.391779 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3378/6797] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:44 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1835 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:44.413979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:44.414691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:44.417857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:44.418521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:19:44.426092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.426574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.427011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.427733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.428191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.428618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.566851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:44.574758 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1698a371-61ed-4632-a4b8-00286aea091b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1684 microversion: 2.1 time: 0.165193 Sep 27 02:19:44.575332 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3420/6798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:44 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:44.675233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:19:44.677465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:44.683584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.684084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.684535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.685246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:44.685797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:44.686241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:44.949166 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c21c9bcd-ecab-4ac7-98f4-ea668d343d66 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action" status: 200 len: 32639 microversion: 2.1 time: 0.278517 Sep 27 02:19:44.950005 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3379/6799] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:19:44 2022] POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action => generated 32639 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:19:45.140114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:19:45.140727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:45.147984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:45.148468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:45.148906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:45.149622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:45.150077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:45.150508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:45.178192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e738ee2b22ca44e39cccd29afd41ca73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc6739f3a364919a282ec585e5e677f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:45.178778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] flavor_id is None. Assuming migration. {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 27 02:19:45.179222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:19:45.289836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-05fc94a5-2417-4d8d-a3d0-71d109884b88 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.153366 Sep 27 02:19:45.290459 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3421/6800] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:19:45 2022] POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:19:45.299548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:45.300890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:45.308443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:45.308934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:45.309412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:45.310132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:45.310613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:45.311074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:45.487177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:45.495084 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9392a17b-3f7d-4c70-a6d0-778ff7036646 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1693 microversion: 2.1 time: 0.200158 Sep 27 02:19:45.495686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3380/6801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:45 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:19:46.520129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:46.520753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:46.528635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:46.529124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:46.529605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:46.530317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:46.530771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:46.531205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:46.661487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:46.669132 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7dcd707-caf7-4f4e-b80c-12c67c5f910b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1693 microversion: 2.1 time: 0.153477 Sep 27 02:19:46.669727 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3422/6802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:46 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:47.692435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:47.693064 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:47.701356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:47.701989 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:47.702450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:47.703148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:47.703614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:47.704050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:47.839004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:47.847603 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-039cfceb-a325-4f05-b35b-dfb92432e249 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.159202 Sep 27 02:19:47.848164 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3381/6803] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:47 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:48.871075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:48.871741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:48.879276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:48.879752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:48.880187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:48.880872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:48.881321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:48.881766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:49.018326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:49.026075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a93a89ab-1b09-432c-b9d2-f082fb63351d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.158927 Sep 27 02:19:49.026643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3423/6804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:48 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:50.049505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:50.050142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:50.057133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:50.057785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:50.058260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:50.058966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:50.059441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:50.059885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:50.194943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:50.203134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1740bca-fc65-4ea1-9fa8-06b31a22941a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.158297 Sep 27 02:19:50.203723 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3382/6805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:50 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:51.227438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:51.228061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:51.235054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:51.235569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:51.236013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:51.236746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:51.237234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:51.238383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:51.376558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:51.384561 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dad5b7da-5047-4c7e-8113-adb94888aa6e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.161028 Sep 27 02:19:51.385144 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3424/6806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:51 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:52.407700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:52.408328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:52.415149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:52.415640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:52.416082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:52.416776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:52.417238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:52.417697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:52.552000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:52.560737 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6ff2182-5ab0-4257-b3ad-1d83453203f6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.156941 Sep 27 02:19:52.561485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3383/6807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:52 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:53.584834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:53.585405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:53.592182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:53.592666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:53.593106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:53.593830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:53.594289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:53.594723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:53.722927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:53.730729 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb4e6c13-6425-4d17-971c-d470ad8bd3cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.150612 Sep 27 02:19:53.731309 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3425/6808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:53 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:54.753858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:54.754433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:54.761326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:54.761845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:54.762293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:54.763017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:54.763482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:54.763918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:54.897088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:54.904875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7315e2c9-74a4-4f94-b3ca-d0f33ac2c539 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.155007 Sep 27 02:19:54.905460 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3384/6809] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:54 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:55.932229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:55.932878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:55.940062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:55.940549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:55.940984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:55.941706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:55.942164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:55.942595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:56.077419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:56.085676 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-85c1c4a8-e4f0-47c1-92f2-c3955e15537f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.157447 Sep 27 02:19:56.086247 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3426/6810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:55 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:57.109446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:57.110127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:57.117526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:57.118021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:57.118469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:57.119165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:57.119630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:57.120071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:57.253483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:57.261208 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-993baa96-0769-4936-ba57-520e7a88c79b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.155715 Sep 27 02:19:57.261807 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3385/6811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:57 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:58.283972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:58.285238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:58.292490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:58.292982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:58.293453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:58.294169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:58.294623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:58.295047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:58.429102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:58.436946 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e13dff78-eb75-435a-b452-11a1d1a931cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.157178 Sep 27 02:19:58.437768 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3427/6812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:58 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:19:59.460909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:19:59.461577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:19:59.468780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:59.469287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:59.469768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:59.470489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:19:59.470963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:19:59.471409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:19:59.607938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:19:59.616075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8d560274-b9cc-4433-b9ef-6068a9cc1865 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1698 microversion: 2.1 time: 0.159611 Sep 27 02:19:59.616655 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3386/6813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:19:59 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:00.085905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "name": "network-vif-unplugged", "status": "completed", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:00.097824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:00.098309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:00.098849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:00.111793 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Creating event network-vif-unplugged:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h1-859358-1 Sep 27 02:20:00.117946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:20:00.130888 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-581d3561-11c4-4984-98de-eedec6fc78fd req-fef447aa-8132-4656-99f9-3abb92fbfb62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127721 Sep 27 02:20:00.131762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3428/6814] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:00.638908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:00.639705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:00.647169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:00.647678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:00.648198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:00.648920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:00.649453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:00.649893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:00.786143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:00.794350 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1544a92-5868-4b48-85f1-acfa7abfad21 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1697 microversion: 2.1 time: 0.159422 Sep 27 02:20:00.794921 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3387/6815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:00 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:01.819800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:01.820534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:01.827211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:01.827691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:01.828127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:01.828815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:01.829273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:01.829724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:01.963011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:01.971027 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf4f9b71-3ece-4886-828c-065d3613b0bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1695 microversion: 2.1 time: 0.156334 Sep 27 02:20:01.971607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3429/6816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:01 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:02.150213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:02.160598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:02.161085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:02.161562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:02.173225 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Creating event network-changed:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h1-859358-1 Sep 27 02:20:02.178996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:20:02.189931 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a841f04c-a646-4ef7-8bf5-09e08cca9798 req-a24376ea-5a38-4624-8a94-dd5e01375715 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043257 Sep 27 02:20:02.190526 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3388/6817] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:02.994705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:02.995280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:03.001995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.002594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.003028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.003720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.004167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.004592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.215747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:03.224180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-749f8e9a-29e8-4e95-a1f4-3ee6e6160db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1692 microversion: 2.1 time: 0.233696 Sep 27 02:20:03.224766 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3430/6818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:02 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1692 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:03.248671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:03.249231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:03.255331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.255822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.256266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.256964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.257482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.257920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.365676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05b29d77-485a-45ee-bab7-1d3721496ad5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.121590 Sep 27 02:20:03.366303 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3389/6819] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:20:03 2022] POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:20:03.375363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:03.375977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:03.384699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.385861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.385861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.386945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:03.387474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:03.388121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:03.614795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:03.622609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fd7ff499-721f-4108-950a-06d26ca278a2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.251321 Sep 27 02:20:03.623241 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3431/6820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:03 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:04.647621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:04.648341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:04.658292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:04.658796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:04.659246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:04.660507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:04.660976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:04.661445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:04.802031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:04.809794 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a219de3f-aa74-42d7-9561-792de2f2f62e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.167710 Sep 27 02:20:04.810374 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3390/6821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:04 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:05.833990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:05.834531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:05.841490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:05.841984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:05.842423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:05.843131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:05.843594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:05.844033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:05.981692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:05.990478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0991911-e682-4b09-90a6-fb946e11ab59 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.160630 Sep 27 02:20:05.993377 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3432/6822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:05 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:07.014981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:07.015820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:07.024461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:07.025022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:07.025809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:07.026584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:07.027297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:07.027799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:07.048027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:07.058750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:07.059520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:07.059964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:07.073491 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Creating event network-changed:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:20:07.079484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:20:07.092230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-aa368c99-4a7a-4329-8f86-8c001325e33c req-69df470c-7aa2-464f-bf2f-509bfddae972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136633 Sep 27 02:20:07.092706 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3391/6823] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:07.255308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:07.263185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6606283e-943c-4fcd-803f-4e37ef4e2e91 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.253094 Sep 27 02:20:07.264115 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3433/6824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:07 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:20:08.287960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:08.288686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:08.294941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:08.295440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:08.296147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:08.296861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:08.297357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:08.297807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:08.433976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:08.441729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c93bf506-fcb5-4f1e-a8d7-fc6380835a4e tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.158832 Sep 27 02:20:08.442465 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3392/6825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:08 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:09.468488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:09.469130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:09.476559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:09.477048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:09.477524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:09.478217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:09.478675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:09.479104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:09.609920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:09.617640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6ff9906b-64ca-4951-acd5-df3e1a8a996a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1691 microversion: 2.1 time: 0.153063 Sep 27 02:20:09.618230 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3434/6826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:09 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:10.641197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:10.641858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:10.649522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:10.649972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:10.650430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:10.651138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:10.651610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:10.652053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:10.778798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:10.781143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:20:10.787906 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4dcbfa96-1433-495c-a1b0-b1bb31f5f946 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1684 microversion: 2.1 time: 0.150592 Sep 27 02:20:10.788476 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3393/6827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:10 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:14.181777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "name": "network-vif-plugged", "status": "completed", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:14.192020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:14.192519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:14.192938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:14.196740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:20:14.204836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] Creating event network-vif-plugged:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:20:14.211104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-29b96d4c-27a0-4b3b-aa74-bd3c97d18282 req-71965fbc-5c3b-46f4-a404-86404a1c2eb5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101584 Sep 27 02:20:14.211639 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3435/6828] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:31.450636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:31.451762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:31.454549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=34 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:20:31.459206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:20:31.461056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:31.461596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:31.462421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:31.463159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:31.463716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:31.464214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:31.466760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3449e7f-f502-44ca-bc17-a14734c3694c", "tag": "9e64af5d-d57c-4c5a-93ba-28dbd8971d4c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:31.478373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:31.478962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:31.479464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:31.491953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:20:31.492564 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] Creating event network-changed:9e64af5d-d57c-4c5a-93ba-28dbd8971d4c for instance c3449e7f-f502-44ca-bc17-a14734c3694c on n-h1-859358-1 Sep 27 02:20:31.497882 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-36d7aa5a-561c-420f-a55c-461be11430b2 req-4e680355-6830-4c27-951f-9f927ad5a3d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046194 Sep 27 02:20:31.498554 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3436/6829] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:31.592122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-452e0e73-76c4-4c21-a36b-43cfa7f6004f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 204 len: 0 microversion: 2.1 time: 0.144992 Sep 27 02:20:31.592861 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3394/6830] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:20:31 2022] DELETE /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:20:31.602343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:31.603048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:31.609715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:31.610203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:31.610635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:31.611328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:31.611778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:31.612218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:31.775480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:31.783343 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c876c7a-00ef-41ed-ba91-6883ee5a84ff tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1578 microversion: 2.1 time: 0.185957 Sep 27 02:20:31.784001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3437/6831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:31 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:20:32.806726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:32.807672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:32.814835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:32.815332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:32.815851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:32.816468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:32.816958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:32.817417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:32.955081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:32.963677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f45811b4-4f4b-4dc4-a117-5ee46ead6bf1 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1578 microversion: 2.1 time: 0.161184 Sep 27 02:20:32.964262 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3395/6832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:32 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:33.516135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3449e7f-f502-44ca-bc17-a14734c3694c", "name": "network-vif-deleted", "tag": "9e64af5d-d57c-4c5a-93ba-28dbd8971d4c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:33.527100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:33.527576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:33.528007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:33.539923 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] Creating event network-vif-deleted:9e64af5d-d57c-4c5a-93ba-28dbd8971d4c for instance c3449e7f-f502-44ca-bc17-a14734c3694c on n-h1-859358-1 Sep 27 02:20:33.544652 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6f502b54-d7df-424e-8ecb-b3fed25744c7 req-45c0f73f-c3a6-4725-b999-fe1f09e9e438 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032281 Sep 27 02:20:33.545259 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3438/6833] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:33.987593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:33.988223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:33.995779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:33.996273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:33.996721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:33.997453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:33.997923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:33.998360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:34.063127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:34.071270 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a73d91d-6620-4d75-a1aa-c4e3f0736a29 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1226 microversion: 2.1 time: 0.087739 Sep 27 02:20:34.071841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3396/6834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:33 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:35.094742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:35.095480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:35.102312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:35.102786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:35.103249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:35.103941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:35.104441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:35.104903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:35.172753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:35.181091 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46c172d2-ac76-4e59-8086-9dca84b603a3 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1226 microversion: 2.1 time: 0.091450 Sep 27 02:20:35.181731 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3439/6835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:35 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:36.204244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:36.204800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:36.212466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:36.212963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:36.213438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:36.214149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:36.214616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:36.215052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:36.279772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:36.288253 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df60e164-61a0-4dd3-a070-287ed5ccea90 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1226 microversion: 2.1 time: 0.087994 Sep 27 02:20:36.288820 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3397/6836] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:36 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:37.312315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:37.313099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:37.319862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:37.320353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:37.320796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:37.321525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:37.321990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:37.322423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:37.388175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:37.397197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09f5ba13-d392-4382-bbd7-48938f04dc26 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 200 len: 1226 microversion: 2.1 time: 0.088866 Sep 27 02:20:37.397811 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3440/6837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:37 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:38.429931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:38.430603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3449e7f-f502-44ca-bc17-a14734c3694c] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:38.437134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:38.437665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:38.438118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:38.438856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:38.439330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:38.439775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:38.453559 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c HTTP/1.1 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'c3449e7f-f502-44ca-bc17-a14734c3694c'} Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:38.455282 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance c3449e7f-f502-44ca-bc17-a14734c3694c could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33e69353-05c5-4a77-9136-985a7a88ffe4 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c" status: 404 len: 111 microversion: 2.1 time: 0.030968 Sep 27 02:20:38.514226 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3398/6838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:38 2022] GET /compute/v2.1/servers/c3449e7f-f502-44ca-bc17-a14734c3694c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:20:43.013587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:43.015895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:43.023701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:43.024182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:43.024616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:43.025307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:43.025784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:43.026239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:43.098314 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7eb06418-54f7-4978-b770-0edf4744633d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action" status: 200 len: 62995 microversion: 2.1 time: 0.088533 Sep 27 02:20:43.098954 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3441/6839] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:20:43 2022] POST /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3/action => generated 62995 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:20:44.684822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:44.685379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:44.687225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3515242-51dc-476c-941d-0da4370283e5", "tag": "2b6ee460-9580-460c-9bea-7c270339cda1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:44.693287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:44.693828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:44.694275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:44.694992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:44.695457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:44.695906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:44.698953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:44.699653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:44.700251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:44.712214 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] Creating event network-changed:2b6ee460-9580-460c-9bea-7c270339cda1 for instance c3515242-51dc-476c-941d-0da4370283e5 on n-h1-859358-1 Sep 27 02:20:44.717507 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9afde05c-4d52-4a2a-b186-eabfbf28a2de req-69292018-7179-4209-9108-e730bc11ab8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034572 Sep 27 02:20:44.718631 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3442/6840] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:44.726504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:20:44.811087 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-110a8f06-cb9c-43fe-8d7a-93736f501962 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 204 len: 0 microversion: 2.1 time: 0.130233 Sep 27 02:20:44.813023 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3399/6841] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:20:44 2022] DELETE /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:20:44.822063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:44.822769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:44.829733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:44.830535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:44.831081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:44.832023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:44.833190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:44.833871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:44.972900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:44.981034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6eb07d0e-4a1a-4927-931a-4e35f75a221f tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1577 microversion: 2.1 time: 0.163613 Sep 27 02:20:44.981645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3443/6842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:44 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:46.006549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:46.007261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:46.014271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:46.014767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:46.015207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:46.015902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:46.016363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:46.016794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:46.158675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:46.166553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16d68595-2965-46bb-b6e6-1fa074ac3244 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1577 microversion: 2.1 time: 0.164755 Sep 27 02:20:46.167321 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3400/6843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:46 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:46.708804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3515242-51dc-476c-941d-0da4370283e5", "name": "network-vif-deleted", "tag": "2b6ee460-9580-460c-9bea-7c270339cda1"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:20:46.720988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:46.721427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:46.721866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:46.735058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] Creating event network-vif-deleted:2b6ee460-9580-460c-9bea-7c270339cda1 for instance c3515242-51dc-476c-941d-0da4370283e5 on n-h1-859358-1 Sep 27 02:20:46.740659 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-40a17c98-3e2c-4e0d-9a9c-1747780a5262 req-c234359b-1026-40b6-828b-79147360ab53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 Sep 27 02:20:46.741499 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3444/6844] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:20:47.189827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:47.190456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:47.197493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:47.198018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:47.198468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:47.199210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:47.199679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:47.200119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:47.266035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:47.274521 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4d30f129-76d1-4852-bd17-e7bfc075831c tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1225 microversion: 2.1 time: 0.088652 Sep 27 02:20:47.275090 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3401/6845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:47 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:48.299081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:48.299794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:48.308102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:48.308589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:48.309025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:48.309763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:48.310215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:48.310638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:48.375911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:48.383843 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c9587a2-e741-457e-9a04-354c83bf7c51 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1225 microversion: 2.1 time: 0.089464 Sep 27 02:20:48.384410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3445/6846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:48 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:49.406798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:49.407577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:49.414635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:49.415209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:49.415667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:49.416419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:49.416894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:49.417358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:49.483946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:49.492463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ea294e2f-f5b3-48f0-a6b5-66863f575d9e tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1225 microversion: 2.1 time: 0.089725 Sep 27 02:20:49.493027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3402/6847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:49 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:50.517993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:50.519020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:50.529676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:50.530389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:50.531294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:50.532264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:50.533414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:50.533841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:50.606751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3eb0b01de43d0a9839a0318b605dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f84b8df9cc6488ea9cdef2c6b74af61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:20:50.615556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a98c7b4-fd96-4931-8b09-1a3183b0e328 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 200 len: 1225 microversion: 2.1 time: 0.103173 Sep 27 02:20:50.616142 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3446/6848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:50 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:20:51.638527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:51.639161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: c3515242-51dc-476c-941d-0da4370283e5] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:51.646526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:51.647025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:51.647477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:51.648180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:51.648653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:51.649095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:51.662911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 HTTP/1.1 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'c3515242-51dc-476c-941d-0da4370283e5'} Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:51.664537 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance c3515242-51dc-476c-941d-0da4370283e5 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6ca2a7ae-6284-4032-8d3a-54487def7ef5 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5" status: 404 len: 111 microversion: 2.1 time: 0.031382 Sep 27 02:20:51.668422 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3403/6849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:51 2022] GET /compute/v2.1/servers/c3515242-51dc-476c-941d-0da4370283e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:20:52.115292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:52.115843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:52.123005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:52.123495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:52.123938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:52.124646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:52.125116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:52.125567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:52.139785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 HTTP/1.1 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '99fff30e-de7f-4066-b8fc-a9e9aca7bab9'} Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:20:52.141516 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23b86b25-3c9b-4bc1-b0ed-6ab85296c0d0 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 404 len: 111 microversion: 2.1 time: 0.032177 Sep 27 02:20:52.146730 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3447/6850] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:20:52 2022] DELETE /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:20:52.154057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:52.154757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] [instance: 99fff30e-de7f-4066-b8fc-a9e9aca7bab9] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:52.162284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:52.162908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:52.163385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:52.164114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:52.164595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:52.165045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:52.179374 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] HTTP exception thrown: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Request method failure captured: Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 HTTP/1.1 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlsu0VtCaIoXpwSWMAS9IMQtwl4lRb58CWGXGB-OEePE_Bh53C3CrYPIzl__0ecvpPuOYCOOTILP3IRiRh-5sCtNGEvTZBzoe_G2eoEvNzboGiK5Y_cfDrjgSw-wcJ-6UvFnICzD5-tFJFhIM4o-tMTXIJGWEjOnSe9KVH9TWniTfQo Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f84b8df9cc6488ea9cdef2c6b74af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f84b8df9cc6488ea9cdef2c6b74af61", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8f84b8df9cc6488ea9cdef2c6b74af61 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestVolumeBootPattern-1146759468 Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: b2d3eb0b01de43d0a9839a0318b605dd Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestVolumeBootPattern-1146759468-project Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '99fff30e-de7f-4066-b8fc-a9e9aca7bab9'} Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:20:52.181061 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Returning 404 to user: Instance 99fff30e-de7f-4066-b8fc-a9e9aca7bab9 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c80b981-551c-4e40-a646-700d3eebb858 tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9" status: 404 len: 111 microversion: 2.1 time: 0.033179 Sep 27 02:20:52.184227 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3404/6851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:52 2022] GET /compute/v2.1/servers/99fff30e-de7f-4066-b8fc-a9e9aca7bab9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:20:55.592185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-630aabb3-77b9-4521-8069-1a6d7cea93af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] Calling method '.version_select at 0x7f24da4fdc10>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:55.616478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-630aabb3-77b9-4521-8069-1a6d7cea93af tempest-TestVolumeBootPattern-1146759468 tempest-TestVolumeBootPattern-1146759468-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1001753805" status: 202 len: 0 microversion: 2.1 time: 0.028092 Sep 27 02:20:55.617072 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3448/6852] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Sep 27 02:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1001753805 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:20:59.300649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:20:59.301209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:20:59.311118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:59.311905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:59.312663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:59.313856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:20:59.314637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:20:59.315438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:20:59.542274 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2ec96aa1-a1fe-4ae0-9db3-8a55b24ef18a tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1835 microversion: 2.1 time: 0.245717 Sep 27 02:20:59.542849 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3405/6853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:20:59 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1835 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:00.928983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:00.929601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:00.930797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:00.943405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:00.944171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:00.946652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:00.947429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:00.947946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:00.948323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:00.948716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:00.949192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:00.949670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:00.963316 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] Creating event network-changed:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:21:00.969065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fe9a038a-fd22-4310-a192-08c39d012b8b req-abddda7d-1a20-4456-946f-ff523c07881e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041937 Sep 27 02:21:00.970507 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3406/6854] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:21:00.996096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:21:01.112920 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3baf2cc-e59f-4f3a-be81-85ba97423813 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 204 len: 0 microversion: 2.1 time: 0.189160 Sep 27 02:21:01.114389 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3449/6855] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:21:00 2022] DELETE /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:21:01.124522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:01.132986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:01.142491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:01.143517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:01.144350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:01.148336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:01.149204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:01.150131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:01.469553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:01.478436 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a494cb68-8bce-4460-acb8-8ed5b4c8f969 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1690 microversion: 2.1 time: 0.359457 Sep 27 02:21:01.479128 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3407/6856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:01 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1690 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:02.502992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:02.503706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:02.506650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:02.513321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:02.516762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:02.517196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:02.518112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:02.518565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:02.518982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:02.525530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:02.842893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:02.852220 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52621eaf-0155-4c07-a075-6c98be7f620b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1690 microversion: 2.1 time: 0.354260 Sep 27 02:21:02.853308 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3450/6857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:02 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1690 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:03.387826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "100abe63-423b-44e3-aaa1-3d4eb3dfe1f3", "name": "network-vif-deleted", "tag": "e393a5fd-aa8a-422f-aa87-d38bc67b1290"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:03.397180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:03.406069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:03.406558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:03.407158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:03.412095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:03.421767 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] Creating event network-vif-deleted:e393a5fd-aa8a-422f-aa87-d38bc67b1290 for instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 on n-h2-859358-1 Sep 27 02:21:03.428249 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6a5d04e5-f1f1-413a-91d5-4cbe23988b21 req-53447b61-7d08-4870-9dcb-ffa0e68ca068 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043978 Sep 27 02:21:03.429149 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3408/6858] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:21:03.877766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:03.879112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:03.886501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:03.887197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:03.888700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:03.889521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:03.889985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:03.890419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:03.923773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:03.924540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:03.924982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:03.926305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lazy-loading 'fault' on Instance uuid 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:21:03.978986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:03.987581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfee8763-dced-49ce-8547-aa1804ecd2ef tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 200 len: 1356 microversion: 2.1 time: 0.113724 Sep 27 02:21:03.988070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3451/6859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:03 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:05.013026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:05.013701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:05.021550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:05.022050 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:05.022500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:05.023209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:05.023677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:05.024118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:05.038133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] HTTP exception thrown: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Request method failure captured: Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 HTTP/1.1 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlze1W3x_Kg2PsUwaVfmjSKuVDvreZPVDdQ-dvuxU43gMdyqZ67Gpy3CtykNqqJp1y6HxkW6XS4KTbWwt5dYTwpP7SHQQRq8ogCOR8knZrke-3-ylcbPw0RIO3qmO6A0bzS5Jgz23lRpxz3W1kXB7sy08BifSRZLrynTa7q1h15D8OA Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d98f740e2174656a766c0f768b296d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ff34fab8a91a46538c63de5dcaa09d22 Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '100abe63-423b-44e3-aaa1-3d4eb3dfe1f3'} Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:21:05.039779 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Returning 404 to user: Instance 100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc76f66e-b2d9-4d00-abd3-23b7e5902ce9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3" status: 404 len: 111 microversion: 2.1 time: 0.033387 Sep 27 02:21:05.043191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3409/6860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:05 2022] GET /compute/v2.1/servers/100abe63-423b-44e3-aaa1-3d4eb3dfe1f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:21:08.108005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df88c524-133f-4f0e-a105-9a53e0719f11 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '.version_select at 0x7f24d4fb3d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:08.139931 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df88c524-133f-4f0e-a105-9a53e0719f11 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1959095756" status: 202 len: 0 microversion: 2.1 time: 0.036115 Sep 27 02:21:08.140621 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3452/6861] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 02:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1959095756 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:21:08.177175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: .version_select at 0x7f24d5067310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2146370822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2NATlL7AHwP4TybiMMBVN4bk0p/L4bCfHaLORSPtAuamYdom1FgKS1JxMjYD47PRKki5tt2g7Jn8zfJvmvoIEc8mVXTgcNvV0j419mx8L77WW19Pu9cIM9m1SVhziX+g=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:08.200778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:21:08.207632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:21:08.223771 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:21:09.229996 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34434. Sep 27 02:21:09.246001 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ffa94aa-e8e9-4287-87db-1e5ba7bee9e7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.073629 Sep 27 02:21:09.246618 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3410/6862] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:21:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:21:15.286762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=13 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:15.292118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1644833167", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "366359b5-01e2-435c-8d14-40e42465e46f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2146370822", "security_groups": [{"name": "tempest-secgroup-smoke-947817045"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:15.410315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] validate_networks() for [('366359b5-01e2-435c-8d14-40e42465e46f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:21:15.842080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:21:15.842503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:21:15.843172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:21:15.843753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:21:15.844194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:21:15.854581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:15.855064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:15.855506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:15.856263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:15.856737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:15.857159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:15.876068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:21:15.881714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:21:15.894438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:21:15.896771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:21:15.946364 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8cf82f2e-43d0-4172-8677-2a182bbe6030 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.661791 Sep 27 02:21:15.947594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3453/6863] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:21:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:21:15.956487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:15.960834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f50d463-349c-4618-b4c2-480265f3672c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:15.961496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f50d463-349c-4618-b4c2-480265f3672c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:16.035410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f50d463-349c-4618-b4c2-480265f3672c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:16.044416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f50d463-349c-4618-b4c2-480265f3672c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1267 microversion: 2.1 time: 0.089604 Sep 27 02:21:16.045279 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3411/6864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:15 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:17.069976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-683d6fab-fdff-4b82-bd59-04529fb1d132 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:17.070593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-683d6fab-fdff-4b82-bd59-04529fb1d132 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:17.131315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-683d6fab-fdff-4b82-bd59-04529fb1d132 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:17.139930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-683d6fab-fdff-4b82-bd59-04529fb1d132 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1267 microversion: 2.1 time: 0.075226 Sep 27 02:21:17.141906 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3454/6865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:17 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:18.164121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fd7ed504-b27f-40c6-b52f-ff4c5938bc2a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:18.164676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fd7ed504-b27f-40c6-b52f-ff4c5938bc2a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:18.220941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fd7ed504-b27f-40c6-b52f-ff4c5938bc2a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:18.228172 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fd7ed504-b27f-40c6-b52f-ff4c5938bc2a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1267 microversion: 2.1 time: 0.068055 Sep 27 02:21:18.228754 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3412/6866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:18 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:19.250856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:19.251469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:19.260198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:19.260742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:19.261184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:19.262071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:19.262536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:19.263084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:19.340865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:19.349436 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0491740b-31c0-45fd-9719-51a7dc32f494 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1327 microversion: 2.1 time: 0.102410 Sep 27 02:21:19.350040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3455/6867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:19 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:21:20.372576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:20.373251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:20.382732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:20.383232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:20.383681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:20.384390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:20.384856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:20.385295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:20.631465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:20.639495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad07ee03-b096-4107-a590-d89c2912eeb7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.270881 Sep 27 02:21:20.640105 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3413/6868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:20 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:20.773855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:20.785864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:20.786729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:20.787235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:20.798909 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] Creating event network-changed:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h2-859358-1 Sep 27 02:21:20.804023 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2edac7ac-bef2-4a0a-b2ad-9c7ab44cace5 req-2fe33279-bb60-441c-b23b-f7d827ac8981 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Sep 27 02:21:20.804726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3456/6869] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:21:21.662264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:21.662902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:21.669765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:21.670259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:21.670714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:21.671435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:21.671935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:21.672640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:21.802656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:21.810469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35ad8e9e-d69d-4baf-940c-38298382db64 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.152181 Sep 27 02:21:21.811047 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3414/6870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:21 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:22.835855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:22.836559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:22.842928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:22.843414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:22.843855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:22.844548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:22.845008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:22.845462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:22.976043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:22.985040 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88cedefb-d7a7-4659-a55d-0357bc53860a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.155023 Sep 27 02:21:22.985796 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3457/6871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:22 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:24.010573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:24.011198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:24.021970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:24.022464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:24.022957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:24.023618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:24.024084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:24.024523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:24.155892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:24.163669 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44967bd9-afe7-43ac-bb8b-5532086c24d6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.157112 Sep 27 02:21:24.164247 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3415/6872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:24 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:25.185616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:25.186247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:25.193614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:25.194104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:25.194549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:25.195246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:25.195709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:25.196143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:25.331798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:25.340193 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a3602448-4bc5-459e-b4e3-f4d030379bdc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.158544 Sep 27 02:21:25.340768 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3458/6873] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:25 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:26.363694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:26.364250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:26.371260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:26.371765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:26.372215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:26.372928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:26.373425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:26.373869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:26.401006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "name": "network-vif-plugged", "status": "completed", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:26.406445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:26.413887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:26.414603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:26.415071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:26.427409 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] Creating event network-vif-plugged:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h2-859358-1 Sep 27 02:21:26.432532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-94891b9a-891e-49b2-9ba1-93d38bfb6fb4 req-61a5c01d-bc2c-4485-a422-c278a2463575 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036168 Sep 27 02:21:26.433327 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3459/6874] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:21:26.527444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:26.535215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4f8a4ef0-915b-4ca9-8060-05c5e8870631 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.175534 Sep 27 02:21:26.535845 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3416/6875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:26 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:27.555319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=8 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:27.560449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:27.561151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:27.567585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:27.568066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:27.568507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:27.569188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:27.569667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:27.570090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:27.698949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:27.706719 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe999a99-f81f-48f6-bc01-5fa288965a00 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1392 microversion: 2.1 time: 0.152355 Sep 27 02:21:27.707803 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3460/6876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:27 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:28.729727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:28.730286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:28.733070 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:21:28.733217 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:21:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f (ip 10.222.0.52) !!! Sep 27 02:21:28.734506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:21:28.742439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:28.742938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:28.743389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:28.744104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:28.744576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:28.745020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:28.875315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:28.883222 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d891691a-20e7-4960-8532-6c3c7bf515e5 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1563 microversion: 2.1 time: 0.157492 Sep 27 02:21:28.883808 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3417/6877] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:28 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:28.905556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:28.906169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:28.913453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:28.913932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:28.914363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:28.915236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:28.915479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:28.915898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:29.048815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:29.056477 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23b26b6c-a774-40f6-a9a5-b17dfc29030c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1563 microversion: 2.1 time: 0.154771 Sep 27 02:21:29.057042 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3461/6878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:28 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:21:30.625984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:21:30.627272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:21:30.628604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:21:30.634435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:30.635266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:30.635782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:30.636741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:30.637433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:30.638095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:30.646037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:21:30.647395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:21:30.648044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:21:30.665458 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] Creating event network-changed:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h2-859358-1 Sep 27 02:21:30.671120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2ec108e8-46d6-4f1f-b6b8-10a0d50fda74 req-9f7f4825-467c-416a-bdf7-a168be4b07ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046009 Sep 27 02:21:30.672851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3462/6879] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:21:30.835382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:21:30.843364 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-205c872c-c313-4678-9e5f-20f711e806e6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1563 microversion: 2.1 time: 0.221777 Sep 27 02:21:30.843949 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3418/6880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:21:30 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:04.140451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:04.141193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:04.145363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:04.148106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:04.155371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:04.155850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:04.156285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:04.156971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:04.157443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:04.157870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:04.226647 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87a99e63-4b25-4cc4-9797-a404f631ea09 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action" status: 200 len: 24564 microversion: 2.1 time: 0.088168 Sep 27 02:22:04.227346 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3463/6881] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:22:04 2022] POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action => generated 24564 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:22:34.439640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:34.440406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:34.445007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:34.445647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:34.453137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:34.453659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:34.454106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:34.454812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:34.455274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:34.455711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:34.733727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:34.742135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82fa963f-f59b-4f92-985a-c278aa8dba87 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1681 microversion: 2.1 time: 0.304493 Sep 27 02:22:34.742716 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3419/6882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:34 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:34.839209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:34.841641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:34.844143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:34.844800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:22:34.851653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:34.852138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:34.852580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:34.853285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:34.853772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:34.854201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:34.925283 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ccfebe20-26f9-48fa-9ba6-d7196019a11d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action" status: 200 len: 32639 microversion: 2.1 time: 0.090575 Sep 27 02:22:34.925971 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3464/6883] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:22:34 2022] POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action => generated 32639 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:22:35.040304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:35.041420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:35.048255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:35.049235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:35.050070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:35.051345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:35.052181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:35.053005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:35.179654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-881dfde7-d8ff-4269-acaf-53172df2904b tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1832 microversion: 2.1 time: 0.144150 Sep 27 02:22:35.180227 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3420/6884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:35 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1832 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:35.209678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:35.212441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:35.219492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:35.219966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:35.220396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:35.221098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:35.221593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:35.222033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:35.247329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lazy-loading 'flavor' on Instance uuid 55959c01-d153-4534-a120-82db9ca8d06f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:22:35.259580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Going to try to live migrate instance to another host {{(pid=128779) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 27 02:22:36.994485 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c014418f-8666-4ca7-88bf-300a88bd26cc tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action" status: 202 len: 0 microversion: 2.1 time: 1.789844 Sep 27 02:22:36.999061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3465/6885] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:22:35 2022] POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action => generated 0 bytes in 1795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:22:37.004124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:37.005269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:37.013558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:37.013558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:37.014024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:37.014731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:37.015204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:37.015697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:37.156328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:37.164191 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-775622b9-ead2-4d9b-9b44-e386006bfa33 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.163933 Sep 27 02:22:37.164792 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3421/6886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:36 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:38.032136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "name": "network-vif-unplugged", "status": "completed", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:38.043385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:38.043866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:38.044308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:38.057104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] Creating event network-vif-unplugged:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h2-859358-1 Sep 27 02:22:38.060934 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-bab363bc-1334-4d87-a42c-101af66a28a7 req-4149e9c3-b73a-490e-a6a1-18c7e3431db0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032937 Sep 27 02:22:38.061822 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3466/6887] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:22:38.188364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:38.189008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:38.195565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:38.196055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:38.196500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:38.197197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:38.197698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:38.198137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:38.339592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:38.348163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2a09dadd-1eb2-4219-a154-a033e42c93c8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.163806 Sep 27 02:22:38.348774 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3422/6888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:38 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:39.372674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:39.373325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:39.379577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:39.380061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:39.380496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:39.381207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:39.381696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:39.382122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:39.570446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:39.578124 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-122a38a8-d3bd-443a-b456-cc1e08e89993 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.210636 Sep 27 02:22:39.578695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3467/6889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:39 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:40.099484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:40.109616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:40.110129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:40.110568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:40.121067 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] Creating event network-changed:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h2-859358-1 Sep 27 02:22:40.126417 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a6688d96-0c10-413f-964a-3bd269ed3d26 req-b45f074a-94ca-4b7c-8740-86c82aa0a967 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030539 Sep 27 02:22:40.127012 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3423/6890] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:22:40.601952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:40.602563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:40.609456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:40.609939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:40.610374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:40.611063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:40.611516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:40.611937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:40.766997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:40.776098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8916a1b3-3741-47cc-bafb-d5ad3c3c092c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.178540 Sep 27 02:22:40.776669 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3468/6891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:40 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:41.800790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:41.801537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:41.809201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:41.809746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:41.810189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:41.810888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:41.811349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:41.811782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:41.942486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:41.951046 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9db4c240-8997-4af8-832b-c02c580d6c41 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.154698 Sep 27 02:22:41.951635 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3424/6892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:41 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:42.975011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:42.977353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:42.983125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:42.983635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:42.984068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:42.984770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:42.985215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:42.985657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:43.122092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:43.130125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac64f248-b6fe-4fee-bed0-0d5faae16fd6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.159078 Sep 27 02:22:43.130708 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3469/6893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:42 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:44.153573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:44.154209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:44.160725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:44.161256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:44.161746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:44.162486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:44.162951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:44.163428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:44.445478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:44.453296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48320662-1ae4-4487-a612-23deab460de1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1691 microversion: 2.1 time: 0.303874 Sep 27 02:22:44.454220 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3425/6894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:44 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:45.476270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:45.477010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:45.483915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.484397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.484831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.485558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.486005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.486431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.635200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:45.643813 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-268ac96a-ea20-48e7-aace-0c3d5358dbca tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1681 microversion: 2.1 time: 0.171560 Sep 27 02:22:45.644751 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3470/6895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:45 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:45.666089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:45.666720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:45.673937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.674444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.674896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.675603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.676081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.676519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.804890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7852d7e5-b8d6-46e6-82a8-1986c504b7f2 tempest-TestNetworkAdvancedServerOps-26325793 tempest-TestNetworkAdvancedServerOps-26325793-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1832 microversion: 2.1 time: 0.142424 Sep 27 02:22:45.805497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3426/6896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:45 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1832 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:45.828083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:45.828723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:45.834756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.835844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.836271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.837001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:45.837659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:45.838145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:45.975758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:45.983460 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c22fc837-2b8d-4551-bfe9-83b5cf1179cc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1681 microversion: 2.1 time: 0.159283 Sep 27 02:22:45.984026 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3471/6897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:45 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:46.080314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:46.082573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:46.089193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:46.089740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:46.090196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:46.090932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:46.091398 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:46.091840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:46.142309 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a533a11e-ec97-4792-ad82-f78002bbeab9 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action" status: 200 len: 38631 microversion: 2.1 time: 0.065917 Sep 27 02:22:46.142942 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3427/6898] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:22:46 2022] POST /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f/action => generated 38631 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:22:47.109077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:47.109590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:47.111703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:47.116736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:47.117373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:47.117816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:47.118742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:47.119194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:47.119620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:47.123947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:47.124523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:47.125048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:47.136822 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] Creating event network-changed:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h1-859358-1 Sep 27 02:22:47.141965 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1c06b1bd-e311-4f60-abb0-d481ecd43ef0 req-276b005d-4e22-4c81-9173-baefdb73c5ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Sep 27 02:22:47.142997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3428/6899] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:22:47.150763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:22:47.234539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d91b1a5-b36b-43d4-8539-ccff94380158 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 204 len: 0 microversion: 2.1 time: 0.129505 Sep 27 02:22:47.238907 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3472/6900] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:22:47 2022] DELETE /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:22:47.246372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:47.247455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:47.254899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:47.255653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:47.256011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:47.257696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:47.258235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:47.258738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:47.398898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:47.406793 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-253a3d45-2dbe-4289-bbe3-25627724c7aa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 200 len: 1687 microversion: 2.1 time: 0.166370 Sep 27 02:22:47.407391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3429/6901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:47 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:48.431760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:48.432394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: 55959c01-d153-4534-a120-82db9ca8d06f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:48.439075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:48.439585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:48.440018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:48.440707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:48.441162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:48.441606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:48.455300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] HTTP exception thrown: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Request method failure captured: Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f HTTP/1.1 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMlze1W3x_Kg2PsUwaVfmjSKuVDvreZPVDdQ-dvuxU43gMdyqZ67Gpy3CtykNqqJp1y6HxkW6XS4KTbWwt5dYTwpP7SHQQRq8ogCOR8knZrke-3-ylcbPw0RIO3qmO6A0bzS5Jgz23lRpxz3W1kXB7sy08BifSRZLrynTa7q1h15D8OA Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d98f740e2174656a766c0f768b296d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: ff34fab8a91a46538c63de5dcaa09d22 Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '55959c01-d153-4534-a120-82db9ca8d06f'} Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:22:48.456941 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Returning 404 to user: Instance 55959c01-d153-4534-a120-82db9ca8d06f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:22:48.462106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fc2b6058-0428-4504-b0aa-06a69cb9403f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f" status: 404 len: 111 microversion: 2.1 time: 0.031112 Sep 27 02:22:48.463405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3473/6902] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:48 2022] GET /compute/v2.1/servers/55959c01-d153-4534-a120-82db9ca8d06f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:22:49.158336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55959c01-d153-4534-a120-82db9ca8d06f", "name": "network-vif-deleted", "tag": "fd22f09e-37e8-4863-8d6a-bb1243887ee3"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:49.168783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:49.169274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:49.169762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:49.181729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] Creating event network-vif-deleted:fd22f09e-37e8-4863-8d6a-bb1243887ee3 for instance 55959c01-d153-4534-a120-82db9ca8d06f on n-h1-859358-1 Sep 27 02:22:49.186532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e7a602e0-e241-4272-80a1-1772fa3358a8 req-2312c728-852d-4baf-bd50-b017f65583f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 Sep 27 02:22:49.187117 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3430/6903] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:22:51.763756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73810fe5-a8d3-462a-810b-ae95687a05c7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '.version_select at 0x7f24d4f058b0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:51.786493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73810fe5-a8d3-462a-810b-ae95687a05c7 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2146370822" status: 202 len: 0 microversion: 2.1 time: 0.026436 Sep 27 02:22:51.787361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3474/6904] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 02:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2146370822 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:22:51.819931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-17f3216d-f7f2-4030-bced-2a340c601f9b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: .version_select at 0x7f24d5627040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1131666670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpp1S5NtsQnpYrPC80wsutVXRoD9T+rUaWjLnrL9xIVvHBVF1IYOnsv21dMfempcvcjyyuGUU48EFVKYvEDyF/3kLf/mUDULyR/7KoYKAU04bd+0TktSdmaoxe4zECqJQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:51.836482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-17f3216d-f7f2-4030-bced-2a340c601f9b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:22:51.843131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-17f3216d-f7f2-4030-bced-2a340c601f9b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:22:51.868314 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-17f3216d-f7f2-4030-bced-2a340c601f9b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053882 Sep 27 02:22:51.868930 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3431/6905] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:22:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:22:57.551153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-636885938", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "b703934c-dfcc-45a2-9c11-fd544ff7a325"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1131666670", "security_groups": [{"name": "tempest-secgroup-smoke-311161405"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:22:57.670663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] validate_networks() for [('b703934c-dfcc-45a2-9c11-fd544ff7a325', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:22:58.184426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:22:58.184866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:22:58.185368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:22:58.185848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:22:58.186448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:22:58.197194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:58.197722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:58.198167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:58.198909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:58.199372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:58.199804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:58.218209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:22:58.224697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Getting quotas for user ff34fab8a91a46538c63de5dcaa09d22 and project 0d98f740e2174656a766c0f768b296d0. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:22:58.238438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:22:58.241710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:22:58.307350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7572728-beb8-4429-b43f-de18edc2073b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761404 Sep 27 02:22:58.320086 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3475/6906] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:22:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:22:58.323202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49615fad-e83d-4722-be0d-90f1b132d02f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:58.323956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-49615fad-e83d-4722-be0d-90f1b132d02f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:58.450884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-49615fad-e83d-4722-be0d-90f1b132d02f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:58.459708 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49615fad-e83d-4722-be0d-90f1b132d02f tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1266 microversion: 2.1 time: 0.140748 Sep 27 02:22:58.460311 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3432/6907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:58 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:22:59.487746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:22:59.488455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:22:59.497836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:59.498330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:59.498771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:59.499486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:22:59.499936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:22:59.500367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:22:59.563988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:22:59.572439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d7f5432-211d-4b22-a598-498ed26ba730 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1318 microversion: 2.1 time: 0.089327 Sep 27 02:22:59.573641 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3476/6908] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:22:59 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:00.597212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:00.597997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:00.610392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=58 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:00.613263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:00.613953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:00.614509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:00.615552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:00.616591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:00.624679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:00.963420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:00.973930 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3340c5a6-43db-4316-9af3-5d3c13f66db3 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.380856 Sep 27 02:23:00.974703 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3433/6909] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:00 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:01.597833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:23:01.609783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:01.610402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:01.610943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:01.623080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] Creating event network-changed:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:23:01.628168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d6427fb6-f416-42c3-857e-009844058efb req-991178cd-90c3-401f-bdb3-474253f48b9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034232 Sep 27 02:23:01.628777 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3477/6910] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:23:01.997618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:01.998368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:02.005141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:02.005690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:02.006149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:02.006868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:02.007345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:02.007790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:02.141056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:02.149771 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44a6a5da-82b3-44c9-b0d0-83c0457e4cfa tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.156109 Sep 27 02:23:02.150354 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3434/6911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:01 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:03.174376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:03.175085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:03.182150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:03.182608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:03.183049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:03.183746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:03.184197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:03.184627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:03.313320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:03.321056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee6994a-3704-4567-ac68-2a6567517aec tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.152112 Sep 27 02:23:03.321673 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3478/6912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:03 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:04.343582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:04.344163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:04.351140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:04.351628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:04.352090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:04.352822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:04.353273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:04.353746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:04.571189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:04.580493 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ea79e2d-5b15-46a9-94be-3a619f7ce370 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.240692 Sep 27 02:23:04.581445 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3435/6913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:04 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:05.603689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:05.604227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:05.607345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:05.612701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:05.613191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:05.613676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:05.614373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:05.614835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:05.615272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:05.619187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:05.752061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:05.760465 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d24872c-cedd-4221-974a-42b3f4b4ab17 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.160801 Sep 27 02:23:05.761046 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3479/6914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:05 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:06.783658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:06.784283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:06.786982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:06.794888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:06.795388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:06.795835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:06.796571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:06.797035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:06.797503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:06.887190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "name": "network-vif-plugged", "status": "completed", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:23:06.900492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:06.901178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:06.901942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:06.915534 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] Creating event network-vif-plugged:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:23:06.920794 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d2307187-31df-456e-a8e2-5b6c37b73d34 req-1c4ca710-577f-4d2c-812b-53f43c1e4aff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Sep 27 02:23:06.922087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3480/6915] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:23:06.937850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:06.946611 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b0faa569-88ad-4803-852d-bf58d9621d03 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.167113 Sep 27 02:23:06.947192 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3436/6916] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:06 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:07.971170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:07.971912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:07.978745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:07.979229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:07.979668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:07.980360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:07.980819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:07.981249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:08.109146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:08.116893 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-727084d1-1ca0-46ec-843a-d9bb62b128ee tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1391 microversion: 2.1 time: 0.150829 Sep 27 02:23:08.117486 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3481/6917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:07 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:09.139847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:09.140473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:09.143204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:09.149618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:09.150116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:09.150561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:09.151270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:09.151738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:09.152176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:09.284579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:09.292723 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-331d6e88-c853-4a99-96b0-965145592540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1563 microversion: 2.1 time: 0.156751 Sep 27 02:23:09.293290 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3437/6918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:09 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:09.315892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:09.316542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:09.318514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:09.319170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:09.325766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:09.326242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:09.326681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:09.327372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:09.327820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:09.328243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:09.463111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:09.470851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4b38151-208a-4a3f-9909-7091b6a681d8 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1563 microversion: 2.1 time: 0.158908 Sep 27 02:23:09.471418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3482/6919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:09 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:11.064493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:23:11.065133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:11.067257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:23:11.072033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:11.072726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:11.073423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:11.074150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:11.075260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:11.075764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:11.078513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:11.079203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:11.079698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:11.095041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] Creating event network-changed:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:23:11.101385 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-4ea69d00-a42f-40d0-9920-c4acb4f27736 req-35e0b1f3-bcc9-4de1-aa61-24184d8ca941 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037291 Sep 27 02:23:11.102518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3483/6920] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:23:11.262944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:23:11.271952 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b794c7c2-2c29-403e-a52a-ad3dbad3180d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1563 microversion: 2.1 time: 0.211236 Sep 27 02:23:11.273582 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3438/6921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:23:11 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:23:44.565527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:23:44.567701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:23:44.570032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=9 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:44.570674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=21 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:23:44.577111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:44.577467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:44.577909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:44.578877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:23:44.579391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:23:44.579990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:23:44.647570 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5285ec80-8001-4b22-a837-2fa707cee420 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action" status: 200 len: 24564 microversion: 2.1 time: 0.086322 Sep 27 02:23:44.648237 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3484/6922] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:23:44 2022] POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action => generated 24564 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:24:15.021421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:24:15.022255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:24:15.026658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:24:15.029482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:15.036189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.036679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.037124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.037863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.038329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.038770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.117357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:24:15.117800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:24:15.118304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:24:15.118722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:24:15.119181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:24:15.179236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:15.185601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.186093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.186538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.187254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.187719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.188153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.214745 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c556331b-9524-4489-949a-afe2ec4360e1 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action" status: 202 len: 1137 microversion: 2.1 time: 0.195204 Sep 27 02:24:15.215398 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3439/6923] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:24:15 2022] POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action => generated 1137 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 27 02:24:15.234655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:15.235988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:15.239050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:24:15.239835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:24:15.245666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.246160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.246590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.247323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:15.247808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:15.248234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:15.391640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:15.399469 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6761ef67-c9c8-4e03-81b5-6841e9ce04f0 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.169168 Sep 27 02:24:15.400043 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3485/6924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:15 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:16.423784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:16.424412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:16.431814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:16.432305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:16.433242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:16.433973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:16.434444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:16.434885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:16.570125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:16.578583 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05d80dc2-d328-429f-b6e4-ad00d6e1c88a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.158746 Sep 27 02:24:16.579151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3440/6925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:16 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:17.601055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:17.601690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:17.609223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:17.609741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:17.610175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:17.610856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:17.611309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:17.611727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:17.740061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:17.748344 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-691d5889-29d4-413e-b8c4-2fa9ceaae88c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.151236 Sep 27 02:24:17.748918 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3486/6926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:17 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:18.771500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:18.772125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:18.779800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:18.780288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:18.780756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:18.781481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:18.781946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:18.782383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:18.913692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:18.922122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f05325e4-6a0c-4073-ab4e-ee3636ed29f2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.154571 Sep 27 02:24:18.922698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3441/6927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:18 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:19.944811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:19.945455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:19.952293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:19.952779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:19.953219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:19.953938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:19.954395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:19.954826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:20.087043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:20.094788 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-84f23783-2444-4721-8082-fab108977fe6 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.153941 Sep 27 02:24:20.095369 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3487/6928] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:19 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:21.118382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:21.119013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:21.125980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:21.126479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:21.126959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:21.127660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:21.128131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:21.128573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:21.259252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:21.267873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3a45959-3fc4-4aa2-8db4-a96f4f101305 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.153437 Sep 27 02:24:21.268456 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3442/6929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:21 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:22.291517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:22.292649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:22.299499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:22.299982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:22.300680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:22.301377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:22.301829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:22.302250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:22.432279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:22.440081 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-427af562-f8f1-41d4-b8e8-9d2d39301698 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.152488 Sep 27 02:24:22.440654 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3488/6930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:22 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:23.462648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:23.463275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:23.470666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:23.471159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:23.471600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:23.472340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:23.472808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:23.473245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:23.893324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:23.900956 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cfb0de16-dd3c-49cb-a600-5ff7a00cbcbc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.442291 Sep 27 02:24:23.901547 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3443/6931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:23 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:24.923905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:24.924581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:24.931698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:24.932265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:24.932621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:24.933308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:24.933790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:24.934218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:25.065461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:25.073671 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f4a1066d-0753-407f-8feb-f5d5002e2ccc tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.153213 Sep 27 02:24:25.074252 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3489/6932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:24 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:26.099203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:26.099826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:26.107338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:26.107825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:26.108267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:26.108974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:26.109478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:26.109915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:26.240293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:26.247920 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-92dc3d47-fe02-45f8-9774-be79dc0cf51a tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1691 microversion: 2.1 time: 0.152689 Sep 27 02:24:26.248488 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3444/6933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:26 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:27.270356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:27.270969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:27.277939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:27.278419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:27.278850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:27.279537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:27.279988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:27.280416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:27.413231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:27.421491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14519e2d-5d96-4a42-b7de-0d4f43821e5d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1697 microversion: 2.1 time: 0.155028 Sep 27 02:24:27.422070 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3490/6934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:27 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:28.445173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:28.445832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:28.453226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:28.453755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:28.454204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:28.454905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:28.455369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:28.455804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:28.596933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:28.604701 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d48554fc-d0fd-4557-8af4-81e934b28406 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1697 microversion: 2.1 time: 0.163405 Sep 27 02:24:28.605261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3445/6935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:28 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:29.628203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:29.628817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:29.636283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:29.636771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:29.637208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:29.637929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:29.638410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:29.638840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:29.776124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:29.784290 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-772418d1-b7c2-4e1a-a295-4145ff709950 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1697 microversion: 2.1 time: 0.160042 Sep 27 02:24:29.784873 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3491/6936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:29 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:30.807337 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:30.807962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:30.814788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:30.815277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:30.815720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:30.816412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:30.816874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:30.817318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:30.954350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:30.962160 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-40dd2752-0337-4c61-af86-b4067e37cb3b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1697 microversion: 2.1 time: 0.158831 Sep 27 02:24:30.962742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3446/6937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:30 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:31.374764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:24:31.384991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:31.386143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:31.386579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:31.397540 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] Creating event network-vif-unplugged:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:24:31.403050 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0451208a-d5c7-43a8-87df-08ca64294097 req-9ab79688-f1ac-4264-a0d3-af83963a172d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031913 Sep 27 02:24:31.403596 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3492/6938] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:24:31.986143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:24:31.986781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:24:31.993970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:31.994471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:31.995448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:31.996161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:31.996636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:31.997084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:32.127980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:24:32.136040 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64f1de81-2d4a-4979-9c81-a61645036083 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1682 microversion: 2.1 time: 0.153810 Sep 27 02:24:32.136633 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3447/6939] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:24:31 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:24:33.507791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "name": "network-vif-plugged", "status": "completed", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:24:33.517547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:24:33.518032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:24:33.518467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:24:33.529381 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] Creating event network-vif-plugged:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:24:33.534428 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9680d5c8-056d-43a0-8e9c-e053bdb74229 req-a1cdef5b-0b53-4686-9f44-f49025d8e24f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031670 Sep 27 02:24:33.535130 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3493/6940] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:25:08.375651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:25:08.377891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:08.380111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=22 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:08.380791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:08.381663 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:25:08.381794 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action (ip 10.222.0.52) !!! Sep 27 02:25:08.389999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:08.390492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:08.390941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:08.391653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:08.392140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:08.392563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:08.467335 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c11ac2d-57a1-43c3-8f82-4bf188b30a8b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action" status: 200 len: 24571 microversion: 2.1 time: 0.095052 Sep 27 02:25:08.468030 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3448/6941] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:25:08 2022] POST /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b/action => generated 24571 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:25:39.677926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=18 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:39.678668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=46 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:39.680142 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:25:39.680268 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b (ip 10.222.0.52) !!! Sep 27 02:25:39.681635 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:25:39.681815 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b (ip 10.222.0.52) !!! Sep 27 02:25:39.685418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:39.686331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:25:39.703320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:39.703917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:39.711165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:39.711632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:39.712064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:39.712833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:39.713212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:39.713674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:39.740100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:25:39.765006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:25:39.775903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:39.776313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:39.776756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:39.787719 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] Creating event network-changed:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:25:39.793008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-e3f0b535-92a7-4c7f-b88d-89b27b154bda req-224fa2e4-d8d5-4a9f-93be-e68487de20ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115180 Sep 27 02:25:39.793967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3449/6942] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:25:39.822815 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2c923686-6386-4c68-9680-88ad6152623b tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 204 len: 0 microversion: 2.1 time: 0.148539 Sep 27 02:25:39.823404 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3494/6943] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:25:39 2022] DELETE /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:25:39.832733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:39.833633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:39.840920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:39.841577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:39.842285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:39.843074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:39.843785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:39.844114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:39.983734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:25:39.991974 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-91113a2c-e6f1-45d5-894f-8a5a408be540 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1688 microversion: 2.1 time: 0.163399 Sep 27 02:25:39.992493 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3450/6944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:25:39 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:25:41.017134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:41.017882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:41.024842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:41.025366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:41.025807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:41.026508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:41.026968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:41.027402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:41.166373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:25:41.174216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61e8324a-7a27-4962-baf3-c5be0d5d978d tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1688 microversion: 2.1 time: 0.161912 Sep 27 02:25:41.174792 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3495/6945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:25:41 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:25:42.197197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:42.197861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:42.205195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:42.205730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:42.206178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:42.206893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:42.207395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:42.207801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:42.282998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafd08d4-9e40-462a-ab1a-01ccab405b6b", "name": "network-vif-deleted", "tag": "e8cfd199-a6d1-42a5-8bd1-096c2d065770"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:25:42.287951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff34fab8a91a46538c63de5dcaa09d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d98f740e2174656a766c0f768b296d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:25:42.294105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:42.294591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:42.296377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:42.297661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7d58cfdf-feb8-413b-bb5d-aad02a71a94c tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 200 len: 1502 microversion: 2.1 time: 0.104508 Sep 27 02:25:42.298427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3451/6946] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:25:42 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 1502 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:25:42.309142 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] Creating event network-vif-deleted:e8cfd199-a6d1-42a5-8bd1-096c2d065770 for instance aafd08d4-9e40-462a-ab1a-01ccab405b6b on n-h2-859358-1 Sep 27 02:25:42.314412 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-81fa7763-4267-4925-8dce-2e61d021f667 req-000a0feb-a251-4cf0-a8d7-0b96ad86b79e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111734 Sep 27 02:25:42.315024 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3496/6947] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:25:43.320259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:43.320849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] [instance: aafd08d4-9e40-462a-ab1a-01ccab405b6b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:25:43.327678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:43.328182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:43.328636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:43.329404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:25:43.329886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:25:43.330330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:25:43.343641 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] HTTP exception thrown: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Request method failure captured: Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b HTTP/1.1 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMlze1W3x_Kg2PsUwaVfmjSKuVDvreZPVDdQ-dvuxU43gMdyqZ67Gpy3CtykNqqJp1y6HxkW6XS4KTbWwt5dYTwpP7SHQQRq8ogCOR8knZrke-3-ylcbPw0RIO3qmO6A0bzS5Jgz23lRpxz3W1kXB7sy08BifSRZLrynTa7q1h15D8OA Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d98f740e2174656a766c0f768b296d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d98f740e2174656a766c0f768b296d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 0d98f740e2174656a766c0f768b296d0 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1944438814 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: ff34fab8a91a46538c63de5dcaa09d22 Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1944438814-project Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aafd08d4-9e40-462a-ab1a-01ccab405b6b'} Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:25:43.345288 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Returning 404 to user: Instance aafd08d4-9e40-462a-ab1a-01ccab405b6b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9b8f579d-120c-4496-80e0-de2dbd3445bd tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b" status: 404 len: 111 microversion: 2.1 time: 0.030531 Sep 27 02:25:43.349403 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3452/6948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:25:43 2022] GET /compute/v2.1/servers/aafd08d4-9e40-462a-ab1a-01ccab405b6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:25:46.285698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09f8a65a-1f87-4f04-9327-b4ed9ff4a5e2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] Calling method '.version_select at 0x7f24d4f1c9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:25:46.314339 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09f8a65a-1f87-4f04-9327-b4ed9ff4a5e2 tempest-TestNetworkAdvancedServerOps-1944438814 tempest-TestNetworkAdvancedServerOps-1944438814-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1131666670" status: 202 len: 0 microversion: 2.1 time: 0.033815 Sep 27 02:25:46.314940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3497/6949] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 02:25:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1131666670 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:27:47.105696 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 02:27:47.106722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:27:47.107479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=16 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:27:47.108814 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 02:27:47.108951 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:27:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 27 02:27:47.110012 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:27:47.110144 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:27:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.52) !!! Sep 27 02:27:47.115171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e7093f4-7c76-4e40-8db7-288b69c60249 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Action: 'create', calling method: .version_select at 0x7f24d5410a60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1211119369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfDm38KdO34qpWuEKhw26uM+GqC1PeLRvWLV8Wtl9WKiR//WO9xi3JdIBvWQMbJtuEI7VrULmiOJSPGBPdtVKjpLy/0/wtK1jb7qpWOufLyVBlztmPUqwiZmT7HcyJS8g=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:27:47.137684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4e7093f4-7c76-4e40-8db7-288b69c60249 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Getting quotas for project e6d4e43e52bd495aaed6672580520f1d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:27:47.144767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-4e7093f4-7c76-4e40-8db7-288b69c60249 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Getting quotas for user 9b4f8b37503a4558a94282042a2e6c74 and project e6d4e43e52bd495aaed6672580520f1d. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:27:47.173408 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e7093f4-7c76-4e40-8db7-288b69c60249 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.070044 Sep 27 02:27:47.174014 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3453/6950] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:27:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:27:48.122622 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:27:48.124101 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 27 02:27:48.124101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:27:48.124839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:27:48.134162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-435377687", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "558bc63d-138a-4d5d-9a76-1214703ecd54", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1211119369", "security_groups": [{"name": "tempest-secgroup-smoke-783140861"}], "networks": [{"uuid": "eeeb3f4a-0460-4428-a3fa-8df5db94b6dd"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:27:48.488028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] validate_networks() for [('eeeb3f4a-0460-4428-a3fa-8df5db94b6dd', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:27:48.872173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:27:48.872615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:27:48.873397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:27:48.873823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:27:48.874241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:27:48.883598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:48.884082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:48.884544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:48.885307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:48.885791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:48.886220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:48.904863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Getting quotas for project e6d4e43e52bd495aaed6672580520f1d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:27:48.910176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Getting quotas for user 9b4f8b37503a4558a94282042a2e6c74 and project e6d4e43e52bd495aaed6672580520f1d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:27:48.969143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:27:48.971448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='558bc63d-138a-4d5d-9a76-1214703ecd54',volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:27:49.099773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0674fddf-23df-4e01-ac44-5c2048c70fd4 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.979401 Sep 27 02:27:49.100855 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3498/6951] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:27:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:27:49.118823 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36086. Sep 27 02:27:49.123760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e63aa3c8-7a38-4573-9320-1bc809a704ed tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:49.124477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e63aa3c8-7a38-4573-9320-1bc809a704ed tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:49.294265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e63aa3c8-7a38-4573-9320-1bc809a704ed tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:49.301164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e63aa3c8-7a38-4573-9320-1bc809a704ed tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1098 microversion: 2.1 time: 0.192763 Sep 27 02:27:49.301768 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3454/6952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:49 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1098 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:50.326858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:50.327473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:50.342164 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36104. Sep 27 02:27:50.346121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:50.346603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:50.347214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:50.348086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:50.348540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:50.348965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:50.357452 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36106. Sep 27 02:27:50.420143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:50.428807 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-685bbb9c-a527-49d8-ab7d-d3fafb2a7853 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1214 microversion: 2.1 time: 0.109488 Sep 27 02:27:50.429507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3499/6953] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:50 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:51.452285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:51.453555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:51.464254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:51.465011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:51.466339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:51.467236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:51.467715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:51.468160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:51.694540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:51.704416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0fcade60-7442-4506-bddd-5899e7cb14b7 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1281 microversion: 2.1 time: 0.255947 Sep 27 02:27:51.704997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3455/6954] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:51 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:51.973814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:27:51.986477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:51.987209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:51.987797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:52.002457 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] Creating event network-changed:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:27:52.007795 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-99fd20f3-5067-4895-bbdc-c33df0cd3f3f req-a48b748e-109a-43e4-93b6-10ed272a49b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037826 Sep 27 02:27:52.008724 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3500/6955] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:27:52.727850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:52.728620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:52.736037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:52.736545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:52.737002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:52.737756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:52.738233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:52.738827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:52.973602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:52.981965 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e2134a1-c8bf-4a20-bdea-ab4ed984496d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1281 microversion: 2.1 time: 0.258153 Sep 27 02:27:52.982865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3456/6956] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:52 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:54.006834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:54.007554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:54.014442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:54.014862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:54.015303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:54.016016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:54.016474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:54.016906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:54.159368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:54.167480 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-db7814eb-20c7-4991-89a6-7c29618fba9a tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1281 microversion: 2.1 time: 0.165934 Sep 27 02:27:54.168069 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3501/6957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:54 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:55.191187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:55.191828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:55.199227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:55.199744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:55.200187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:55.200913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:55.201405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:55.201856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:55.336278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:55.345285 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-894da57a-4a94-466a-9fec-043bb4777252 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1281 microversion: 2.1 time: 0.158191 Sep 27 02:27:55.345967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3457/6958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:55 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:56.368549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:56.369155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:56.377155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:56.377412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:56.377852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:56.378587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:56.379043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:56.379473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:56.509162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:56.516973 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6cd4c27-3f6c-4bb9-a5bf-9432d8131970 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.152343 Sep 27 02:27:56.517579 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3502/6959] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:56 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:57.540096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:57.540734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:57.548186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:57.548688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:57.549142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:57.549883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:57.550362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:57.550810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:57.684321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:57.692015 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b6b1b5d0-9348-48e8-8261-fa2fe0599b9f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.155896 Sep 27 02:27:57.692597 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3458/6960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:57 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:58.715020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:58.715728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:58.722883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:58.723372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:58.723816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:58.724521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:58.724979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:58.725437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:58.860263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:27:58.869062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cb8847ee-b1c1-4d0e-a33b-ad339f9c0886 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.158429 Sep 27 02:27:58.869769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3503/6961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:58 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:27:59.892553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:27:59.893188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:27:59.895929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:27:59.901473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:59.902070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:59.902527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:27:59.903250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:27:59.903717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:27:59.904157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:00.035578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:00.043864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39c042f7-3866-436f-ac23-78d63ca3a62f tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.155291 Sep 27 02:28:00.044562 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3459/6962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:27:59 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:01.067611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:01.068224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:01.070204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:01.070861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:01.077524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:01.078004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:01.078440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:01.079124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:01.079572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:01.079996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:01.219375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:01.227494 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b233cde-6050-49f0-a66d-a09cd91b8225 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.163717 Sep 27 02:28:01.228103 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3504/6963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:01 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:02.254352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:02.255623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:02.262371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:02.262876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:02.263325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:02.264047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:02.264518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:02.264959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:02.400421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:02.408791 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c457a3ff-c9a6-46db-b4ea-6769ca821092 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.158348 Sep 27 02:28:02.409448 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3460/6964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:02 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:03.431764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:03.432879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:03.439734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:03.440491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:03.440933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:03.441647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:03.442104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:03.442533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:03.574360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:03.582106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1f20497a-f171-4414-a25f-5d00f3cef22c tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.154559 Sep 27 02:28:03.582676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3505/6965] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:03 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:04.604249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:04.604880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:04.611736 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:04.612236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:04.612690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:04.613448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:04.613922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:04.614372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:04.743716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:04.752014 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c24a99d-6819-4f46-b1a8-043d76fb2352 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.151817 Sep 27 02:28:04.752592 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3461/6966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:04 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:05.775048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:05.775721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:05.783142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:05.783625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:05.784062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:05.784750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:05.785205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:05.785663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:05.923363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:05.931398 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c2f84e13-6758-402f-a5c5-ba515167d9b8 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.160279 Sep 27 02:28:05.931974 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3506/6967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:05 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:06.576653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "name": "network-vif-plugged", "status": "completed", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:06.586314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:06.586900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:06.587350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:06.598314 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] Creating event network-vif-plugged:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:06.603267 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-eb891ed9-cc85-44c6-974d-771f62db0f5c req-10429355-433d-4047-b40d-c3e0466b704b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108532 Sep 27 02:28:06.603850 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3462/6968] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:28:06.953921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:06.954537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:06.961703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:06.962178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:06.962612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:06.963793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:06.964246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:06.964668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:07.093951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:07.101561 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fa45f2ac-c152-403b-824b-52b10864ee3d tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.151481 Sep 27 02:28:07.102186 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3507/6969] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:06 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:08.125895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:08.126614 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:08.132720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:08.133209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:08.133691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:08.134390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:08.134853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:08.135328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:08.280572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:08.289022 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84790cda-22c8-4864-ac6b-3d53adc080d2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1269 microversion: 2.1 time: 0.168378 Sep 27 02:28:08.289625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3463/6970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:08 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:09.313628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:09.314277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:09.321169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:09.321689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:09.322132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:09.323452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:09.323907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:09.324338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:09.457577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:09.465612 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3fbf84f1-3070-44d9-971f-202bcc702376 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1457 microversion: 2.1 time: 0.155869 Sep 27 02:28:09.466187 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3508/6971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:09 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:09.487164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:09.487792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:09.495133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:09.495626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:09.496068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:09.496756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:09.497218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:09.497673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:09.625092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:09.632868 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a4b5a22-a1db-4654-970c-0c1596826bc0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1457 microversion: 2.1 time: 0.149745 Sep 27 02:28:09.633664 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3464/6972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:09 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1457 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:11.539466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:11.550425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:11.551236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:11.551721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:11.563929 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] Creating event network-changed:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:11.569901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-94a1235c-bb93-40c6-b9c2-0c813a9d6f83 req-9186a65c-806f-4f5d-bdf3-c57acfa21259 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033881 Sep 27 02:28:11.570734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3509/6973] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:28:12.515453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:12.526940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:12.527442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:12.527893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:12.546740 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] Creating event network-changed:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:12.553006 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-869d65e8-7140-4108-b4c9-3644c345cf3d req-67c04aae-dce9-4952-8b58-f2a071d59af9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040624 Sep 27 02:28:12.553850 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3465/6974] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:28:14.568143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:14.578455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:14.578930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:14.579356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:14.590666 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] Creating event network-changed:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:14.596764 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-535c556c-07e5-49f7-830b-35c567c7014c req-771a1d90-63ef-4581-ae17-eda31876100f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032106 Sep 27 02:28:14.597606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3510/6975] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:28:41.833504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:41.834141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:41.836443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:41.837278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=58 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:41.843096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:41.848873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:41.849577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=62 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:28:41.860596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:41.861076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:41.861551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:41.865732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:41.866253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:41.866705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:41.867532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:41.867917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:41.868359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:41.884452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] Creating event network-changed:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:41.894101 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d19eba62-84d8-4acb-89e0-5065233d2f3c req-e379b430-418f-407b-8800-5e55e7a0147d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055257 Sep 27 02:28:41.895193 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3511/6976] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:28:41.907871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:28:41.999773 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da9aac58-6d82-439a-8f7e-185af16b5133 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 204 len: 0 microversion: 2.1 time: 0.170998 Sep 27 02:28:42.001630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3466/6977] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:28:41 2022] DELETE /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:28:42.010558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:42.011272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:42.018789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:42.019277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:42.019914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:42.020617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:42.021225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:42.021974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:42.165167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:42.174029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1953717f-e68c-4b46-bcef-bdb3ebbc846e tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1581 microversion: 2.1 time: 0.167949 Sep 27 02:28:42.174622 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3512/6978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:42 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1581 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:43.198927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:43.199666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:43.206649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:43.207151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:43.207602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:43.208323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:43.208917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:43.209772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:43.368542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:43.377096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-302207be-4927-4047-a5b7-57cdc3184480 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1581 microversion: 2.1 time: 0.182644 Sep 27 02:28:43.377705 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3467/6979] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:43 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1581 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:44.354488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b072-9e51-4066-bdd7-2796cd7aae11", "name": "network-vif-deleted", "tag": "739a8e2e-5aa3-4666-897f-ef4e2957bb20"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:28:44.365920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:44.366393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:44.367502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:44.382301 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] Creating event network-vif-deleted:739a8e2e-5aa3-4666-897f-ef4e2957bb20 for instance 6235b072-9e51-4066-bdd7-2796cd7aae11 on n-h2-859358-1 Sep 27 02:28:44.388486 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-417eda3f-cedf-471e-955b-112705bfbae2 req-497d9c9f-da0a-463d-9018-9b2ac21f303c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Sep 27 02:28:44.389226 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3513/6980] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:28:44.400375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:44.401001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:44.408240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:44.408737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:44.409549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:44.410251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:44.410720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:44.411161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:44.478594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:44.486813 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca5f77f3-4d71-4f2a-95d0-37f35a6795cf tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1229 microversion: 2.1 time: 0.090240 Sep 27 02:28:44.487623 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3468/6981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:44 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:45.511175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:45.511786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:45.519534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:45.520019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:45.520457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:45.521160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:45.521642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:45.522075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:45.588166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:45.596743 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14293155-1929-434b-98f8-0df7dcab15c2 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1229 microversion: 2.1 time: 0.090026 Sep 27 02:28:45.597372 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3514/6982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:45 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:46.620574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:46.621248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:46.629184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:46.629722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:46.630181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:46.630902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:46.631383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:46.631829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:46.697674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:46.706405 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b09b8b2-0ef9-4608-a5fb-79156da18368 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1229 microversion: 2.1 time: 0.089783 Sep 27 02:28:46.707003 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3469/6983] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:46 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:47.728117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:47.728661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:47.735709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:47.736191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:47.736628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:47.737368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:47.737828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:47.738259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:47.801030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:47.809276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-56a23bf1-e269-4c0c-bca3-ed1a4ebfe4f0 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1229 microversion: 2.1 time: 0.085160 Sep 27 02:28:47.809879 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3515/6984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:47 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:48.833156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:48.833846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:48.841533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:48.841533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:48.841922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:48.842713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:48.843307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:48.843896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:48.877088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:48.877603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:48.878052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:48.878516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lazy-loading 'fault' on Instance uuid 6235b072-9e51-4066-bdd7-2796cd7aae11 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:28:48.919719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4f8b37503a4558a94282042a2e6c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d4e43e52bd495aaed6672580520f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:28:48.928502 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c313fee-c037-4087-8a87-8395f79b4caa tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 200 len: 1234 microversion: 2.1 time: 0.100467 Sep 27 02:28:48.929086 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3470/6985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:48 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:28:49.953746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:49.954367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] [instance: 6235b072-9e51-4066-bdd7-2796cd7aae11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:28:49.961197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:49.961722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:49.962166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:49.962857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:28:49.963309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:28:49.963739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:28:49.977390 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] HTTP exception thrown: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Request method failure captured: Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 HTTP/1.1 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMl8wo2Mdi17pcxsCvwVACBJM4ZmckUQY9SXTCgfVOg3pt3FLBgx2mWgye5O7S-NytkBa-IIvLt9KdKmmZj4CHpBTXyUIwBU_NMo_BwNnuZGEI8hTqAatv_ID3gNIuOUuUIhAFO0O_ZQEXmPyd8FdO01_7ZRjTCoUMDds5Lv_TqPQE5E Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: e6d4e43e52bd495aaed6672580520f1d Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestVolumeBackupRestore-1381903645 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d4e43e52bd495aaed6672580520f1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e6d4e43e52bd495aaed6672580520f1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e6d4e43e52bd495aaed6672580520f1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e6d4e43e52bd495aaed6672580520f1d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestVolumeBackupRestore-1381903645 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: e6d4e43e52bd495aaed6672580520f1d Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1381903645 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestVolumeBackupRestore-1381903645-project Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 9b4f8b37503a4558a94282042a2e6c74 Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestVolumeBackupRestore-1381903645-project Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6235b072-9e51-4066-bdd7-2796cd7aae11'} Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:28:49.979012 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Returning 404 to user: Instance 6235b072-9e51-4066-bdd7-2796cd7aae11 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca342b77-82ce-43cc-9bde-22521bc48270 tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11" status: 404 len: 111 microversion: 2.1 time: 0.031201 Sep 27 02:28:49.983213 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3516/6986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:28:49 2022] GET /compute/v2.1/servers/6235b072-9e51-4066-bdd7-2796cd7aae11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:28:50.137784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6da4a636-1b4a-42cd-ac43-977a428babba tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] Calling method '.version_select at 0x7f24d5105ca0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:28:50.162190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6da4a636-1b4a-42cd-ac43-977a428babba tempest-TestVolumeBackupRestore-1381903645 tempest-TestVolumeBackupRestore-1381903645-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1211119369" status: 202 len: 0 microversion: 2.1 time: 0.028141 Sep 27 02:28:50.162780 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3471/6987] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Sep 27 02:28:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1211119369 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:29:12.788342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:12.789270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:12.901796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-311143576", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:12.954538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] validate_networks() for None {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:29:13.250740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:29:13.251163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:29:13.251636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:29:13.252080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:29:13.252491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:29:13.261311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:13.261818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:13.262250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:13.262971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:13.263423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:13.263849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:13.281634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Getting quotas for project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:29:13.286809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Getting quotas for user 1f099dd5802f4d1b8d648a0c20ac784c and project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:29:13.299486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:29:13.301833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:29:13.347133 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f4e2500-8544-4cf7-ae6e-46b934dd21bd tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564252 Sep 27 02:29:13.347785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3517/6988] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:29:13.358369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:13.359207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:13.362999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1bec6119-7041-4d3a-a867-3aff9edd72b0 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:13.363638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1bec6119-7041-4d3a-a867-3aff9edd72b0 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:13.422396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1bec6119-7041-4d3a-a867-3aff9edd72b0 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:13.430110 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1bec6119-7041-4d3a-a867-3aff9edd72b0 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1221 microversion: 2.1 time: 0.073852 Sep 27 02:29:13.430686 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3472/6989] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:13 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:14.453189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:14.454422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:14.461546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:14.462036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:14.462469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:14.463361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:14.463821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:14.464260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:14.532384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:14.541952 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f38401c-e853-41f1-98db-4ed844df3989 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1273 microversion: 2.1 time: 0.093619 Sep 27 02:29:14.543180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3518/6990] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:14 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:15.567886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:15.568522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:15.575467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:15.576087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:15.576537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:15.577239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:15.577790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:15.578231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:16.086819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:16.095367 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d662df2f-8a2e-471e-9d2d-203032b03df2 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.531501 Sep 27 02:29:16.096079 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3473/6991] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:15 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:16.424238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f", "tag": "6b910bbd-cdaf-4909-8d06-466a3516bf96"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:16.435706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:16.436261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:16.436987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:16.448513 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] Creating event network-changed:6b910bbd-cdaf-4909-8d06-466a3516bf96 for instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f on n-h2-859358-1 Sep 27 02:29:16.454527 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-eb06cbca-c291-4d98-892b-55f1704756bb req-a4a70241-8daf-43ff-97d3-90ea715265e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034213 Sep 27 02:29:16.455734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3519/6992] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:17.117918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:17.118456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:17.125892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:17.126386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:17.126839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:17.127535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:17.128001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:17.128437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:17.258774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:17.266518 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bec29247-7ec1-42ef-810c-39c2600844b4 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.152754 Sep 27 02:29:17.267085 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3474/6993] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:17 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:18.290243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:18.290961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:18.297977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:18.298473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:18.298905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:18.299607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:18.300060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:18.300486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:18.434970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:18.443158 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0b771ab8-7a33-4101-87a9-0d37acc9150c tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.158174 Sep 27 02:29:18.443745 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3520/6994] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:18 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:19.466037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:19.467032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:19.473220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:19.473755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:19.474213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:19.474921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:19.475394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:19.475842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:19.604431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:19.612136 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8f0bcc4-5734-4037-95ad-81461273c6f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.150335 Sep 27 02:29:19.612724 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3475/6995] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:19 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:20.640330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:20.640954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:20.647569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:20.648056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:20.648495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:20.649181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:20.649676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:20.650105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:20.785973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:20.794151 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-24a5ef64-5c36-4889-9982-1d18c09fe54b tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.157741 Sep 27 02:29:20.794808 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3521/6996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:20 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:21.817525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:21.818062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:21.824859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:21.825373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:21.825831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:21.826536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:21.827004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:21.827448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:21.956727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:21.964506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-684c5d25-48e2-4135-bb0a-8b6b713ddc4d tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.151019 Sep 27 02:29:21.965078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3476/6997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:21 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:22.784133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f", "name": "network-vif-plugged", "status": "completed", "tag": "6b910bbd-cdaf-4909-8d06-466a3516bf96"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:22.795682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:22.796171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:22.796608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:22.812473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] Creating event network-vif-plugged:6b910bbd-cdaf-4909-8d06-466a3516bf96 for instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f on n-h2-859358-1 Sep 27 02:29:22.818063 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d8cca35e-e822-43d9-a405-d209731325b9 req-603773c7-c703-4195-bc95-451e03add243 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038169 Sep 27 02:29:22.818680 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3522/6998] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:22.987909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:22.988550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:22.995154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:22.995586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:22.996037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:22.996748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:22.997224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:22.997697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:23.124631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:23.132937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28b47461-4da1-4dbf-9055-4f714608b619 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.149369 Sep 27 02:29:23.133551 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3477/6999] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:22 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:24.152231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:24.153011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:24.159474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:24.161951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:24.170624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:24.171123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:24.171620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:24.172625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:24.173088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:24.173560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:24.308873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:24.317664 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b68caf4b-f0f8-4bf9-bf7d-11e8fb519b71 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1321 microversion: 2.1 time: 0.166271 Sep 27 02:29:24.318253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3523/7000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:24 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:25.343347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:25.343995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:25.345919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:25.351955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.352454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.352905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.353633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.354105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.354551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.485934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:25.493661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b3ae7d04-af89-49fb-a731-0d58a00625cc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1470 microversion: 2.1 time: 0.154193 Sep 27 02:29:25.494230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3478/7001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:25 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:25.568973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce97513f-28b9-4f7e-93af-dbe3a59e2dec tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '.version_select at 0x7f24d6bc3d30>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:25.635288 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce97513f-28b9-4f7e-93af-dbe3a59e2dec tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/a776011068b24808adce39566d47560f" status: 200 len: 371 microversion: 2.1 time: 0.121165 Sep 27 02:29:25.635861 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3524/7002] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 02:29:25 2022] GET /compute/v2.1/os-quota-sets/a776011068b24808adce39566d47560f => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:25.647769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fa493e62-3c07-4b55-9e63-86a7585cc32c tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-795954936", "id": 629970064, "os-flavor-access:is_public": "True"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:25.665766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fa493e62-3c07-4b55-9e63-86a7585cc32c tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021644 Sep 27 02:29:25.666327 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3479/7003] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:29:25 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:25.679280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "629970064"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:25.681580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:25.687690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.688212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.688651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.689370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.689817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.690243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.873156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53a73ac03e514b8b83143622abfbb384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a776011068b24808adce39566d47560f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:25.879345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-795954936 {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:29:25.885997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.886474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.886909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.887635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:25.888087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:25.888513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:25.914261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Getting quotas for project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:29:25.919240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Getting quotas for user 1f099dd5802f4d1b8d648a0c20ac784c and project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:29:25.931271 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.compute.api [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] ram quota exceeded for a776011068b24808adce39566d47560f, tried to resize instance. Sep 27 02:29:25.932082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Request method failure captured: Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action HTTP/1.1 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 38 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMl_4-HZffXohy3UhqHxGTEYR3NkEmY2TK3G679ZH5Vei3_xFBOe-Ae4ixAcA4JpJ_djooWM88KxxwXxuwZMbelTHAmvDzbeNLLZfQboqPBDE6WK2bAyQk89EUgFanRaGXUsuAA6V5T2VGr-PqNHI6WU19Wja-PUKfttuU1pVStwj3nA Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: a776011068b24808adce39566d47560f Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Role: admin,reader,member Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: admin,reader,member Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a776011068b24808adce39566d47560f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a776011068b24808adce39566d47560f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a776011068b24808adce39566d47560f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a776011068b24808adce39566d47560f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: a776011068b24808adce39566d47560f Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersAdminNegativeTestJSON-2049677135-project-admin Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 53a73ac03e514b8b83143622abfbb384 Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049677135-project-admin Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: {"resize": {"flavorRef": "629970064"}} Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f', 'body': {'resize': {'flavorRef': '629970064'}}} Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:25.945918 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77e7e1a4-20f7-4305-ac85-e53980c0db45 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action" status: 403 len: 118 microversion: 2.1 time: 0.272377 Sep 27 02:29:25.950545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3525/7004] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:29:25 2022] POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action => generated 118 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:29:25.957183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8b749375-dd17-413e-8083-999b09b2e6eb tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:25.975431 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8b749375-dd17-413e-8083-999b09b2e6eb tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/629970064" status: 202 len: 0 microversion: 2.1 time: 0.022528 Sep 27 02:29:25.976182 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3480/7005] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 02:29:25 2022] DELETE /compute/v2.1/flavors/629970064 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:29:25.984025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-abcd087d-3cd1-4e82-a757-a1390a80e323 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.004686 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-abcd087d-3cd1-4e82-a757-a1390a80e323 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024360 Sep 27 02:29:26.005248 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3526/7006] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 02:29:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:26.025429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8e1af94b-7885-44aa-9d7a-e0dad122aef2 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '.version_select at 0x7f24c479adc0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.099299 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8e1af94b-7885-44aa-9d7a-e0dad122aef2 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/a776011068b24808adce39566d47560f" status: 200 len: 371 microversion: 2.1 time: 0.077501 Sep 27 02:29:26.099869 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3481/7007] 10.222.0.52 () {58 vars in 1242 bytes} [Tue Sep 27 02:29:26 2022] GET /compute/v2.1/os-quota-sets/a776011068b24808adce39566d47560f => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:26.111527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-89e045d1-e1e5-4dec-bf59-ad0f07cf2056 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1725259993", "id": 788382675, "os-flavor-access:is_public": "True"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:26.129173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-89e045d1-e1e5-4dec-bf59-ad0f07cf2056 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021389 Sep 27 02:29:26.129790 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3527/7008] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:29:26 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:26.142057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "788382675"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:26.144395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:26.150484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.151036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.151456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.152165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.152634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.153078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.294413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '53a73ac03e514b8b83143622abfbb384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a776011068b24808adce39566d47560f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:26.300660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1725259993 {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:29:26.307641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.308138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.308593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.309361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.309835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.310277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.335315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Getting quotas for project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:29:26.340411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Getting quotas for user 1f099dd5802f4d1b8d648a0c20ac784c and project 3f67fc0af70c4dedbf58e45a5909ee79. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:29:26.353059 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] cores quota exceeded for a776011068b24808adce39566d47560f, tried to resize instance. Sep 27 02:29:26.353675 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Request method failure captured: Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action HTTP/1.1 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 38 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMl_4-HZffXohy3UhqHxGTEYR3NkEmY2TK3G679ZH5Vei3_xFBOe-Ae4ixAcA4JpJ_djooWM88KxxwXxuwZMbelTHAmvDzbeNLLZfQboqPBDE6WK2bAyQk89EUgFanRaGXUsuAA6V5T2VGr-PqNHI6WU19Wja-PUKfttuU1pVStwj3nA Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: a776011068b24808adce39566d47560f Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Role: admin,reader,member Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: admin,reader,member Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a776011068b24808adce39566d47560f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a776011068b24808adce39566d47560f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a776011068b24808adce39566d47560f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a776011068b24808adce39566d47560f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: a776011068b24808adce39566d47560f Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049677135 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-2049677135-project-admin Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 53a73ac03e514b8b83143622abfbb384 Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049677135-project-admin Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: {"resize": {"flavorRef": "788382675"}} Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f', 'body': {'resize': {'flavorRef': '788382675'}}} Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:26.355689 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc414698-ac29-4686-a7ab-f15e7489c8b1 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action" status: 403 len: 113 microversion: 2.1 time: 0.219450 Sep 27 02:29:26.363008 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3482/7009] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:29:26 2022] POST /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f/action => generated 113 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:29:26.365900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18e0b504-5948-467f-915b-32a57c5d4224 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.383298 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18e0b504-5948-467f-915b-32a57c5d4224 tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/788382675" status: 202 len: 0 microversion: 2.1 time: 0.021179 Sep 27 02:29:26.383921 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3528/7010] 10.222.0.52 () {58 vars in 1158 bytes} [Tue Sep 27 02:29:26 2022] DELETE /compute/v2.1/flavors/788382675 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:29:26.392399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3e654b8-1585-478a-9a06-d9aaccd1edea tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.672062 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3e654b8-1585-478a-9a06-d9aaccd1edea tempest-ServersAdminNegativeTestJSON-2049677135 tempest-ServersAdminNegativeTestJSON-2049677135-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.283923 Sep 27 02:29:26.673526 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3483/7011] 10.222.0.52 () {58 vars in 1146 bytes} [Tue Sep 27 02:29:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:26.694505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.695020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:26.705586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.706073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.706505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.707198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.707651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.708074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.732661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:29:26.812680 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-afe0160d-5d9e-41be-ba85-8901290e42f6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 204 len: 0 microversion: 2.1 time: 0.121703 Sep 27 02:29:26.813918 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3529/7012] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:29:26 2022] DELETE /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:29:26.822580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:26.823215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:26.829151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.829683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.830139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.830844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:26.831317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:26.831758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:26.960467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:26.968221 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ef26be07-4c65-43d7-adb5-1a5864b348c9 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1476 microversion: 2.1 time: 0.149640 Sep 27 02:29:26.968782 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3484/7013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:26 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1476 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:27.992453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:27.993159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:27.999990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:28.000466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:28.000899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:28.001607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:28.002057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:28.002476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:28.131462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:28.140683 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cde6e8f-4a14-4efe-a153-a0355edf1484 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1476 microversion: 2.1 time: 0.152457 Sep 27 02:29:28.141785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3530/7014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:27 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:28.863778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f", "name": "network-vif-deleted", "tag": "6b910bbd-cdaf-4909-8d06-466a3516bf96"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:28.877980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:28.878515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:28.878975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:28.891746 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] Creating event network-vif-deleted:6b910bbd-cdaf-4909-8d06-466a3516bf96 for instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f on n-h2-859358-1 Sep 27 02:29:28.902135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-54f627ec-34fc-41d1-8fc1-61b8f7aa0b89 req-52c0932f-2046-4f78-9369-de35d28ff487 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042962 Sep 27 02:29:28.902941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3485/7015] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:29.163757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:29.164380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:29.167578 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:29:29.167728 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f (ip 10.222.0.52) !!! Sep 27 02:29:29.175627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:29.176110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:29.176543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:29.177241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:29.177822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:29.178541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:29.210618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:29.211095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:29.211535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:29.211978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lazy-loading 'fault' on Instance uuid f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:29:29.255346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f099dd5802f4d1b8d648a0c20ac784c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f67fc0af70c4dedbf58e45a5909ee79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:29.263035 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f498b825-a5ff-4e4e-bfdf-e3a69e18aecc tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 200 len: 1311 microversion: 2.1 time: 0.103285 Sep 27 02:29:29.263607 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3531/7016] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:29 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:30.287134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:30.287880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] [instance: f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:30.294157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:30.294656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:30.295108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:30.295810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:30.296278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:30.296720 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:30.310651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] HTTP exception thrown: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Request method failure captured: Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f HTTP/1.1 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMl_4LBCj0LJoovkza6MvKtnq07g-p9zd2L4xOaSaeWpekire2ZeK1gJ2PEUm4KtRjF5wCSjrnhPktkI76uZY0udI_0m8JIHYZl2EJB52kFSHAJhGCIGxbYD0ClYLB5W4S7RXqzJBRrom09MqG0N6BI3KemHOePrKha9cqT-xmNUsHrY Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 3f67fc0af70c4dedbf58e45a5909ee79 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-423056634 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f67fc0af70c4dedbf58e45a5909ee79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3f67fc0af70c4dedbf58e45a5909ee79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f67fc0af70c4dedbf58e45a5909ee79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3f67fc0af70c4dedbf58e45a5909ee79", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersAdminNegativeTestJSON-423056634 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 3f67fc0af70c4dedbf58e45a5909ee79 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-423056634 Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersAdminNegativeTestJSON-423056634-project Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1f099dd5802f4d1b8d648a0c20ac784c Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersAdminNegativeTestJSON-423056634-project Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f'} Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:29:30.312293 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] Returning 404 to user: Instance f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c8b67d3e-640c-49b3-9bda-c8a84483ccf6 tempest-ServersAdminNegativeTestJSON-423056634 tempest-ServersAdminNegativeTestJSON-423056634-project] 10.222.0.52 "GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f" status: 404 len: 111 microversion: 2.1 time: 0.032307 Sep 27 02:29:30.317073 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3486/7017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:30 2022] GET /compute/v2.1/servers/f7e71ea5-f21e-4e81-91bb-62a76a3b2e6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:29:36.325515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:36.326317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:36.447702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-567275203", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "f2424ce1-4696-4ecb-b7a8-307a5aa706fc"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:36.523004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] validate_networks() for [('f2424ce1-4696-4ecb-b7a8-307a5aa706fc', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:29:36.932270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:29:36.932699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:29:36.933847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:29:36.934269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:29:36.934689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:29:36.952527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:36.963504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:36.963831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:36.965593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:36.966274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:36.966877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:36.986892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Getting quotas for project 85647a1b6b1140eca9e997507ec78df9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:29:36.992738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Getting quotas for user 4cfe48fe19c24e74b1bbd2702eaac389 and project 85647a1b6b1140eca9e997507ec78df9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:29:37.011160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:29:37.013641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:29:37.061806 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c6f3f87-0f0e-4449-8d4b-559e89b98656 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741545 Sep 27 02:29:37.062545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3532/7018] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 02:29:37.073865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d1626c0f-b99b-4f4e-9676-4272298c71c6 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:37.075179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d1626c0f-b99b-4f4e-9676-4272298c71c6 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:37.079012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:37.079798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:37.150406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d1626c0f-b99b-4f4e-9676-4272298c71c6 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:37.159447 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d1626c0f-b99b-4f4e-9676-4272298c71c6 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1214 microversion: 2.1 time: 0.089436 Sep 27 02:29:37.160015 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3487/7019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:37 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:38.183525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:38.184150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:38.192279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:38.192804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:38.193246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:38.193983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:38.194438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:38.194865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:38.258624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:38.267546 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c570208-ef8b-4709-bd66-d4e205ba11d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1274 microversion: 2.1 time: 0.089075 Sep 27 02:29:38.268377 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3533/7020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:38 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:39.290758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:39.291389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:39.298891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:39.299407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:39.299863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:39.300594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:39.301073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:39.301546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:39.610182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:39.623459 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8511cd76-4511-4272-bd5d-8b59324e8cbf tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.336501 Sep 27 02:29:39.625278 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3488/7021] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:39 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:39.835628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:39.848043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:39.848856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:39.849229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:39.869957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] Creating event network-changed:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h2-859358-1 Sep 27 02:29:39.879243 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ddb462df-d14b-4631-90bc-ae77a30e2985 req-2997b761-a14f-46b4-9185-7cd15eb17385 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050645 Sep 27 02:29:39.880157 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3534/7022] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:40.648032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:40.648788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:40.655799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:40.656784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:40.657233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:40.657961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:40.658422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:40.658986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:40.794536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:40.802858 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-46b3e32f-1065-4003-8923-4fa270897121 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.158747 Sep 27 02:29:40.803678 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3489/7023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:40 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:41.827115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:41.827825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:41.834047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:41.834530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:41.834974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:41.835668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:41.836125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:41.836555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:41.973886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:41.981682 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e065b23b-ce58-4b78-89b9-5bacc4433ca0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.159641 Sep 27 02:29:41.982284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3535/7024] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:41 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:43.005223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:43.005799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:43.012587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:43.013112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:43.013598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:43.014340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:43.014815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:43.015259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:43.143403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:43.151102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c31a25f7-281b-4f56-a7db-56dcb0bc1053 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.149884 Sep 27 02:29:43.151659 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3490/7025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:43 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:44.174508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:44.175128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:44.177882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:44.184174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:44.184654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:44.185086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:44.185804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:44.186261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:44.186683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:44.190503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:44.318346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:44.326168 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3390dae9-1305-41b0-8a50-f5ddf3d6a806 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.156105 Sep 27 02:29:44.326742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3536/7026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:44 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:45.348651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:45.349394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:45.352172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:45.357514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:45.358023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:45.358479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:45.359200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:45.359676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:45.360120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:45.365006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=78 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:45.569257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:45.577135 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc8db27e-db16-4e99-ac7b-e548386b976b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.232386 Sep 27 02:29:45.577746 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3491/7027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:45 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:46.600633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:46.601249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:46.608084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:46.608572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:46.609005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:46.609727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:46.610184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:46.611182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:46.816176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:46.825609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc6c992c-d53d-4680-8f26-42b6fe34de6c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.228839 Sep 27 02:29:46.826202 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3537/7028] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:46 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:46.855018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "name": "network-vif-plugged", "status": "completed", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:46.867286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:46.867805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:46.868279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:46.882291 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] Creating event network-vif-plugged:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h2-859358-1 Sep 27 02:29:46.887622 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1ac188ea-75ec-4b27-963e-4bf8817b7f15 req-cf7b2f32-8f52-44d3-9389-5bc84779ac69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036361 Sep 27 02:29:46.888224 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3492/7029] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:29:47.848501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:47.849118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:47.851034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:47.851700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:47.858561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:47.859070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:47.859514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:47.860679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:47.861138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:47.861597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:47.990908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:47.998557 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-847acc88-cc4a-4fee-81fd-9c62b1ce695b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1314 microversion: 2.1 time: 0.154206 Sep 27 02:29:47.999136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3538/7030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:47 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:49.019011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:29:49.025248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:49.025998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:49.032999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.033516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.033968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.034663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.035124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.035560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.163121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:49.170760 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f579a63-5f52-4a96-9612-5399cbed36d7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1502 microversion: 2.1 time: 0.152915 Sep 27 02:29:49.171325 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3493/7031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:49 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:29:49.193199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:29:49.195536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:49.202374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.202863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.203305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.204486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.204945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.205408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.233911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:49.239397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:29:49.246259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:29:49.246737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:29:49.247245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:29:49.247652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:29:49.248065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:29:49.315986 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6266d1ad-659f-4c0a-8059-34f82307c2d0 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "POST /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b/action" status: 202 len: 0 microversion: 2.1 time: 0.126514 Sep 27 02:29:49.319780 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3539/7032] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:29:49 2022] POST /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:29:49.325069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:49.325810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:49.332472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.333042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.333619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.334400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:49.334873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:49.335354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:49.503620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:49.511806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53417465-1702-4553-a18a-177153cefcb1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1511 microversion: 2.1 time: 0.190611 Sep 27 02:29:49.512386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3494/7033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:49 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:50.536979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:50.537719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:50.544624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:50.545103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:50.545573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:50.546259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:50.546718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:50.547131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:50.685307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:50.694057 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cd5c76b-5737-4a92-8912-fe2478d8e312 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1511 microversion: 2.1 time: 0.162148 Sep 27 02:29:50.694562 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3540/7034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:50 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:51.716793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:51.717421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:51.724709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:51.725211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:51.725841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:51.726560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:51.727032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:51.727482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:51.942703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:51.950480 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-16dc686f-07bf-4a80-9852-94ad89ae4dc1 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.237634 Sep 27 02:29:51.951055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3495/7035] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:51 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:52.973846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:52.974469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:52.981374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:52.981848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:52.982280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:52.982992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:52.983422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:52.983888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:53.199424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:53.208116 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f77b6b1e-b93a-4384-a0f0-b38bf0b4fcb9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.238214 Sep 27 02:29:53.208705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3541/7036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:52 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:54.230365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:54.230995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:54.237963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:54.238462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:54.238911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:54.239624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:54.240094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:54.240535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:54.382280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:54.390152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3f3501f-8262-420c-805a-1853a7590114 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.163745 Sep 27 02:29:54.390719 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3496/7037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:54 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:55.413854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:55.414465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:55.421314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:55.421822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:55.422260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:55.423016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:55.423475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:55.423907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:55.565960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:55.575647 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fa72657-1f20-40f3-b956-91c3ecb83004 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.165939 Sep 27 02:29:55.576223 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3542/7038] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:55 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:56.600654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:56.601282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:56.608249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:56.608742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:56.609198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:56.609933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:56.610405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:56.610847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:56.741299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:56.749308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ebddc1dc-56ad-48bd-a0a8-e7822805f64b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.152557 Sep 27 02:29:56.749909 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3497/7039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:56 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:57.771855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:57.772475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:57.779479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:57.779964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:57.780412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:57.781113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:57.781599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:57.782522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:57.917094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:57.925853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-094eacc2-3a63-44a1-8684-2cd2cfc8e5f4 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.157849 Sep 27 02:29:57.926613 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3543/7040] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:57 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:29:58.949288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:29:58.949954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:29:58.957766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:58.958284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:58.958751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:58.959494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:29:58.959974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:29:58.960426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:29:59.094187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:29:59.102664 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ffc11c23-26f0-4705-a72e-69938673c153 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.157478 Sep 27 02:29:59.103249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3498/7041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:29:58 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:00.126131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:00.126768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:00.133609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:00.134088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:00.134520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:00.135208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:00.135657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:00.136080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:00.267095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:00.274841 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e430ac6e-73fa-4855-9544-37246b8147ec tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.153148 Sep 27 02:30:00.275418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3544/7042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:00 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:01.296929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:01.298072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:01.305404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:01.305933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:01.306385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:01.307087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:01.307557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:01.307997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:01.438014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:01.445827 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-54248261-d6ed-44b0-a2bc-c19cead03709 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.152724 Sep 27 02:30:01.446339 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3499/7043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:01 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:02.468094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:02.468715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:02.476152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:02.476638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:02.477072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:02.477799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:02.478259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:02.478688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:02.610729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:02.618407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2eab54cf-84e4-41dc-aed0-99e1a4274698 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.154298 Sep 27 02:30:02.618983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3545/7044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:02 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:03.640299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:03.640916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:03.648452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:03.648943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:03.649422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:03.650124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:03.650585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:03.651022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:03.776725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:03.784432 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7765668-fe8c-49db-b956-af4c4563da66 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.148120 Sep 27 02:30:03.784991 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3500/7045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:03 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:04.807199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:04.807738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:04.815204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:04.815681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:04.816109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:04.816797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:04.817244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:04.817692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:04.949648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:04.957490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe7c33af-a5b0-43f8-bb4e-35f7cab701fc tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.154487 Sep 27 02:30:04.958080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3546/7046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:04 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:05.980201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:05.980824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:05.987777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:05.988276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:05.988741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:05.989470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:05.989940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:05.990382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:06.120431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:06.128699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df704bef-0221-4502-8ce4-06705bd44cff tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.152431 Sep 27 02:30:06.129268 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3501/7047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:05 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:07.151956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:07.152498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:07.160004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:07.160488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:07.160921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:07.161642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:07.162095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:07.162521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:07.296933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:07.304971 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4024b161-270d-4e8c-8d6d-ec5d1a7c0a82 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.157075 Sep 27 02:30:07.305581 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3547/7048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:07 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:08.328340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:08.328971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:08.336175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:08.336680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:08.337137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:08.337874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:08.338346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:08.338792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:08.465257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:08.473167 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b2c31db-ab14-48ce-8e45-4e8318ce7af7 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.148941 Sep 27 02:30:08.473763 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3502/7049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:08 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:09.496017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:09.496663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:09.503641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:09.504122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:09.504561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:09.505253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:09.505754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:09.506166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:09.635211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:09.645013 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-88bd7b48-f7b8-4800-b159-4ecd6fec0e3b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.152866 Sep 27 02:30:09.645649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3548/7050] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:09 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:10.668463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:10.669093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:10.676231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:10.676749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:10.677204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:10.677985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:10.678712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:10.679152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:10.811569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:10.819933 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60431029-248c-4018-af70-2cafad5c3117 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.155467 Sep 27 02:30:10.820500 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3503/7051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:10 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:11.842757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:11.843323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:11.850726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:11.851199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:11.851636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:11.852318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:11.852767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:11.853189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:11.985070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:11.993407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d2c33ae-b56e-45f5-a4c9-f2658bd5f35d tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.154602 Sep 27 02:30:11.993993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3549/7052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:11 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:13.016081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:13.016740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:13.023648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:13.024155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:13.024607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:13.025313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:13.025806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:13.026252 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:13.158448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:13.166416 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1368e9fd-90d0-47b2-97ec-478694ae0d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.154259 Sep 27 02:30:13.166986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3504/7053] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:13 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:14.189815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:14.190475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:14.197181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:14.197690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:14.198125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:14.198812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:14.199271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:14.199691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:14.331942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:14.334162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:14.341504 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17440127-10f5-4165-a5ca-185fa3d78d4b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.155959 Sep 27 02:30:14.342081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3550/7054] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:14 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:15.364227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:15.364856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:15.371724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:15.372218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:15.372664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:15.373390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:15.373855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:15.374290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:15.378941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=81 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:15.503634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:15.511362 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28ab0c15-4005-4c1c-9722-4abe31b6c00e tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.151528 Sep 27 02:30:15.511927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3505/7055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:15 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:16.534544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:16.535169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:16.538058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=34 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:16.544408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:16.544895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:16.545355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:16.546059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:16.546519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:16.546951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:16.673914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:16.681874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be3cb752-cd1c-4295-9913-ed2fbfde462b tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.151675 Sep 27 02:30:16.682453 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3551/7056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:16 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:17.705132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:17.705771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:17.708629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=30 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:17.713930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:17.714367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:17.714818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:17.715518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:17.715982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:17.716426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:17.846023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:17.853770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61feef43-7123-4b72-9058-fd2651666d68 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1516 microversion: 2.1 time: 0.153099 Sep 27 02:30:17.854404 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3506/7057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:17 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:18.877100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:18.877839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:18.884836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:18.885321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:18.885880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:18.886584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:18.887072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:18.887507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:18.910696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "name": "network-vif-unplugged", "status": "completed", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:18.922763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:18.923366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:18.924033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:18.937244 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Creating event network-vif-unplugged:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h1-859358-1 Sep 27 02:30:18.943729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] Instance 34434436-89a8-499a-a184-bd7aac47830b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:30:18.957250 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d141245b-720e-43a0-99b9-8778aea308e1 req-1e3e84ac-af88-4890-bc0f-afcb7e13acfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051597 Sep 27 02:30:18.958706 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3507/7058] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:30:19.029965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:19.038727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0f95ec7-88c5-4678-a0de-6434ca995905 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1515 microversion: 2.1 time: 0.166491 Sep 27 02:30:19.045553 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3552/7059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:18 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:20.063454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:20.064890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:20.071299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:20.071799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:20.072246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:20.072962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:20.073450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:20.073891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:20.207852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:20.215687 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31939d93-938d-4fc6-b652-41b319e8c881 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1515 microversion: 2.1 time: 0.157347 Sep 27 02:30:20.216258 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3508/7060] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:20 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:20.975037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:20.984350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:20.984819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:20.985246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:20.999438 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Creating event network-changed:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h1-859358-1 Sep 27 02:30:21.005295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] Instance 34434436-89a8-499a-a184-bd7aac47830b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:30:21.016402 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e9cd2716-090f-42fd-a5a2-cbc7a0177ae8 req-69b1f35c-875d-41bf-8bbd-04998746e35f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045410 Sep 27 02:30:21.017672 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3553/7061] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:30:21.238914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:21.240145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:21.249143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:21.249773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:21.250331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:21.251129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:21.252257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:21.252700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:21.548397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:21.558120 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-de1138ec-926f-4518-9af3-d1af8b82c4d3 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1513 microversion: 2.1 time: 0.323558 Sep 27 02:30:21.558800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3509/7062] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:21 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:22.583599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:22.584238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:22.590567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:22.591056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:22.591501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:22.592198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:22.592659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:22.593090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:22.723081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:22.730869 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92e2a4cf-65c6-49a6-9445-c934ed9da93f tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1510 microversion: 2.1 time: 0.152534 Sep 27 02:30:22.731455 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3554/7063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:22 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:22.753442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:22.753963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:22.760771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:22.761272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:22.761775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:22.762477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:22.762953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:22.763397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:22.793301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:30:22.843672 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Found an unconfirmed migration during delete, id: 16, status: finished Sep 27 02:30:24.419000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-217bd348-be48-4eb3-8848-e1b350106ab9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "DELETE /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 204 len: 0 microversion: 2.1 time: 1.669176 Sep 27 02:30:24.422740 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3510/7064] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:30:22 2022] DELETE /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 0 bytes in 1671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:30:24.428828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:24.429757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:24.436635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:24.437116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:24.437617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:24.438310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:24.438763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:24.439186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:24.568417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:24.576080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a842590d-a378-441d-9c8c-6ef6ba6e66f9 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1502 microversion: 2.1 time: 0.151558 Sep 27 02:30:24.576663 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3555/7065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:24 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:30:25.127384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "name": "network-vif-plugged", "status": "completed", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:25.137447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:25.137941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:25.138419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:25.149550 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] Creating event network-vif-plugged:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h1-859358-1 Sep 27 02:30:25.154409 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-fd028410-20af-4992-9bb2-bf6f7318dc44 req-f416ee3d-d16a-4ca9-b703-2c0a780e341c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087656 Sep 27 02:30:25.155010 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3511/7066] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:30:25.600066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:25.600681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:25.608481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:25.608968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:25.609425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:25.610229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:25.610571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:25.610985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:25.758326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cfe48fe19c24e74b1bbd2702eaac389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85647a1b6b1140eca9e997507ec78df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:25.766891 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-908b2b13-378a-4b59-afa5-f6873e31638c tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 200 len: 1502 microversion: 2.1 time: 0.170891 Sep 27 02:30:25.767658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3556/7067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:25 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:26.336621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34434436-89a8-499a-a184-bd7aac47830b", "name": "network-vif-deleted", "tag": "40d241a5-271b-49e2-81af-90d2525999d2"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:26.346511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.347007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.347461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.359506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] Creating event network-vif-deleted:40d241a5-271b-49e2-81af-90d2525999d2 for instance 34434436-89a8-499a-a184-bd7aac47830b on n-h1-859358-1 Sep 27 02:30:26.365047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1663b125-bc63-4527-96c0-106476689df4 req-904ec052-09b8-4f17-87e2-37ca2ef25336 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090589 Sep 27 02:30:26.365958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3512/7068] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:30:26.791304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:26.791922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:26.799486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.799959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.800442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.801125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.801603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.802025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.815953 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] HTTP exception thrown: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Request method failure captured: Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b HTTP/1.1 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmAQkmXqC5pMuXYo18PjwcTw_Wv9_SPjjSDv0DWtlZ-yTHKpQE7tOOqR11iKx6ry_SGqI-VjnAd7ck5OJKc-1ml2n-WUwb0rMcbh4j8wnTlWbRnZpyoZSXwV4G3pWfqZ0THaeT9lwuqIU1jW_-4knEa3wv6HGQleGw12XVc3HdueEHQ Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85647a1b6b1140eca9e997507ec78df9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4cfe48fe19c24e74b1bbd2702eaac389 Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '34434436-89a8-499a-a184-bd7aac47830b'} Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.817635 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Returning 404 to user: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5d21bb4-bccd-404f-8b38-e98e79918593 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 404 len: 111 microversion: 2.1 time: 0.032552 Sep 27 02:30:26.822029 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3557/7069] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:26 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:30:26.835378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:26.836030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:26.842457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.842995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.843444 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.844152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.844619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.845602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.858623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] HTTP exception thrown: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Request method failure captured: Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b HTTP/1.1 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmAQkmXqC5pMuXYo18PjwcTw_Wv9_SPjjSDv0DWtlZ-yTHKpQE7tOOqR11iKx6ry_SGqI-VjnAd7ck5OJKc-1ml2n-WUwb0rMcbh4j8wnTlWbRnZpyoZSXwV4G3pWfqZ0THaeT9lwuqIU1jW_-4knEa3wv6HGQleGw12XVc3HdueEHQ Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85647a1b6b1140eca9e997507ec78df9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4cfe48fe19c24e74b1bbd2702eaac389 Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '34434436-89a8-499a-a184-bd7aac47830b'} Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:30:26.860276 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Returning 404 to user: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:30:26.865152 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-56669470-8414-4a64-a4f2-5ce9a2544574 tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "DELETE /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 404 len: 111 microversion: 2.1 time: 0.031667 Sep 27 02:30:26.866214 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3513/7070] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:30:26 2022] DELETE /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:30:26.870759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:26.871375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] [instance: 34434436-89a8-499a-a184-bd7aac47830b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:26.877594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.878144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.878585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.879277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:26.879782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:26.880218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:26.893555 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] HTTP exception thrown: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Request method failure captured: Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b HTTP/1.1 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmAQkmXqC5pMuXYo18PjwcTw_Wv9_SPjjSDv0DWtlZ-yTHKpQE7tOOqR11iKx6ry_SGqI-VjnAd7ck5OJKc-1ml2n-WUwb0rMcbh4j8wnTlWbRnZpyoZSXwV4G3pWfqZ0THaeT9lwuqIU1jW_-4knEa3wv6HGQleGw12XVc3HdueEHQ Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/85647a1b6b1140eca9e997507ec78df9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_85647a1b6b1140eca9e997507ec78df9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 85647a1b6b1140eca9e997507ec78df9 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714528935 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4cfe48fe19c24e74b1bbd2702eaac389 Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-DeleteServersTestJSON-1714528935-project Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '34434436-89a8-499a-a184-bd7aac47830b'} Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:30:26.895092 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] Returning 404 to user: Instance 34434436-89a8-499a-a184-bd7aac47830b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:30:26.899467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1b4ba189-f1f9-454b-af37-8b361f11666a tempest-DeleteServersTestJSON-1714528935 tempest-DeleteServersTestJSON-1714528935-project] 10.222.0.52 "GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b" status: 404 len: 111 microversion: 2.1 time: 0.029557 Sep 27 02:30:26.900264 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3558/7071] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:26 2022] GET /compute/v2.1/servers/34434436-89a8-499a-a184-bd7aac47830b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:30:35.437862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1478211402", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "534e2b23-4a3c-4896-b770-dac8fb787d20"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:35.493165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] validate_networks() for [('534e2b23-4a3c-4896-b770-dac8fb787d20', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:30:35.876082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:30:35.876691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:30:35.877060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:30:35.877522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:30:35.877936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:30:35.887634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:35.888140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:35.888733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:35.889532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:35.890009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:35.890456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:35.908589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for project 92f782cd58b94a9e86d53b47dba84709. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:30:35.913911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for user 1783e65a8ef64526b3a9743b42b1c208 and project 92f782cd58b94a9e86d53b47dba84709. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:30:35.927596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:30:35.930533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:30:35.977995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d4edd130-6de8-41a6-a316-b4bfc33f5e7b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660789 Sep 27 02:30:35.978639 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3514/7072] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:30:35.990331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee9050c-8f2a-4e0c-9e77-a831b31119f5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:35.991468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee9050c-8f2a-4e0c-9e77-a831b31119f5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:36.060442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ee9050c-8f2a-4e0c-9e77-a831b31119f5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:36.067713 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee9050c-8f2a-4e0c-9e77-a831b31119f5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1218 microversion: 2.1 time: 0.081102 Sep 27 02:30:36.068322 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3559/7073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:35 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:37.091827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:37.092471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:37.099732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:37.100240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:37.101903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:37.101903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:37.101903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:37.102400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:37.177430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:37.191011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1cdbf5fa-1390-48b5-81fa-f19fe2ea2191 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1270 microversion: 2.1 time: 0.104224 Sep 27 02:30:37.192631 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3515/7074] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:37 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:38.214996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:38.215503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:38.218588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=39 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:38.224766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:38.225569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:38.226007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:38.226718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:38.227166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:38.227826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:38.513042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:38.523006 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea5d75e1-8e02-4960-8733-03a069dfc371 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1318 microversion: 2.1 time: 0.312225 Sep 27 02:30:38.537538 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3560/7075] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:38 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:38.983577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:38.999309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:38.999897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:39.000590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:39.027643 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] Creating event network-changed:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h1-859358-1 Sep 27 02:30:39.036766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bdf2a0c6-b777-42d4-858f-a5dc5037e241 req-3322f612-1021-453a-b65e-3fdc70424117 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060599 Sep 27 02:30:39.038013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3516/7076] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:30:39.549362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:39.550032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:39.557149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:39.557671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:39.558114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:39.558811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:39.559267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:39.559697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:39.694214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:39.701836 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c8dd2c5-8e4e-4af7-8b1c-ecd25bf72684 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1318 microversion: 2.1 time: 0.156384 Sep 27 02:30:39.702425 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3561/7077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:39 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:40.726757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:40.727482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:40.733658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:40.734156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:40.734602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:40.735912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:40.736381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:40.736823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:41.215475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:41.223312 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-755da818-244d-40c8-ba1a-8bb65098f05c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1318 microversion: 2.1 time: 0.501698 Sep 27 02:30:41.223898 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3517/7078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:40 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:42.246191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:42.246837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:42.253755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:42.254238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:42.254675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:42.255396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:42.255843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:42.256276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:42.384039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:42.392298 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a2bb48d-3eb7-4fc5-bf83-f4e1c4665741 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1318 microversion: 2.1 time: 0.150012 Sep 27 02:30:42.392880 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3562/7079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:42 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:43.084972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "name": "network-vif-plugged", "status": "completed", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:43.097571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:43.098198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:43.098610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:43.110311 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] Creating event network-vif-plugged:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h1-859358-1 Sep 27 02:30:43.116466 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f1f4179b-1243-4656-b793-3b3e012d6509 req-5cc248d3-4a0b-43f3-b68f-2b360cf69083 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035451 Sep 27 02:30:43.117065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3518/7080] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:30:43.415467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:43.416090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:43.423088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:43.423573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:43.424644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:43.425407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:43.425866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:43.426298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:43.557700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:43.566391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cec9fa8f-e7cf-4566-a535-7f09544f417d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1318 microversion: 2.1 time: 0.154743 Sep 27 02:30:43.566972 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3563/7081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:43 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:44.588658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:44.589479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:44.596620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.597118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.597602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:44.598309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.598781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.599268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:44.728424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:44.736736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7309a98-e438-4b28-9d2c-367d35dcae3f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1505 microversion: 2.1 time: 0.151892 Sep 27 02:30:44.737307 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3519/7082] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:44 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:44.759020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:44.759640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:44.766514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.766996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.767473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:44.768167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.768623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.769088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:44.898012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:44.905766 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f72b010-f975-4143-8271-1d526c9022ad tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1505 microversion: 2.1 time: 0.150637 Sep 27 02:30:44.906336 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3564/7083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:44 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:30:44.928362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:44.931083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:44.936990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.937533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.937988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:44.938692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:44.939157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:44.939641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.001051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fedbaefb-6562-46cb-a5ad-dfaf7dc420c6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "PUT /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1077 microversion: 2.1 time: 0.077048 Sep 27 02:30:45.001670 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3520/7084] 10.222.0.52 () {60 vars in 1256 bytes} [Tue Sep 27 02:30:44 2022] PUT /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1077 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:45.020239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:45.021594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:45.027535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.028014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.028449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.029142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.029629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.030055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.161902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:45.169658 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-15616623-daf2-462a-9c94-61bb1c83bd47 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1503 microversion: 2.1 time: 0.153351 Sep 27 02:30:45.170235 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3565/7085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:45 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:45.192261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:45.192913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:45.198972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.199466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.199908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.200603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.201062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.201528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.330922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:45.338717 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9cc9ceda-bc46-436b-898d-28660365e5d4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1503 microversion: 2.1 time: 0.150393 Sep 27 02:30:45.339285 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3521/7086] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:45 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:45.361183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:30:45.363565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:45.369479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.369972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.370414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.371108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.371565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.372016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.399955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:45.405255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:30:45.412400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:30:45.412834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:30:45.413318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:30:45.413761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:30:45.414179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:30:45.478854 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b3961362-09bf-4b4a-80fc-deddafa65328 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439/action" status: 202 len: 0 microversion: 2.1 time: 0.121390 Sep 27 02:30:45.479740 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3566/7087] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:30:45 2022] POST /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:30:45.488029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:45.488661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:45.494859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.495481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.495941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.496643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:45.497108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:45.497608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:45.501892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:45.657201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:45.665201 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-31e2d00e-241d-4624-8b6b-d3cf11dd780c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1514 microversion: 2.1 time: 0.181420 Sep 27 02:30:45.665819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3522/7088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:45 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:46.686284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:46.691146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:46.691806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:46.693630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:46.700709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:46.701201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:46.702060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:46.702409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:46.702937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:46.703292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:47.156213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:47.164153 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb93c00b-b44a-424a-a094-8e444f986834 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1514 microversion: 2.1 time: 0.479528 Sep 27 02:30:47.164735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3567/7089] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:46 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:30:48.187089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:48.187725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:48.189582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:48.190263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:48.191840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:30:48.198683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:48.199184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:48.199657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:48.200366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:48.200832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:48.201271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:48.338124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:48.345929 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04ffe868-2c79-4e63-b95b-a38e5e07346c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.162788 Sep 27 02:30:48.347148 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3523/7090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:48 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:49.369635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:49.370291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:49.377090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:49.377604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:49.378040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:49.378761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:49.379217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:49.379648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:49.508440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:49.516246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e342f456-f9a8-4a2e-98e4-e9bf0d7faa94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.150527 Sep 27 02:30:49.516824 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3568/7091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:49 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:50.538966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:50.539594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:50.546207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:50.546708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:50.547154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:50.547859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:50.548325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:50.548768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:50.679960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:50.688064 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ace97920-c804-4268-906e-9b7c8137d12a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.153023 Sep 27 02:30:50.688631 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3524/7092] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:50 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:51.713429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:51.714042 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:51.720402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:51.720823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:51.721312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:51.722020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:51.722475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:51.722900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:51.849791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:51.857548 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d5afdab-e562-4c2f-81b9-2605a2cbaaf8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.148015 Sep 27 02:30:51.858116 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3569/7093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:51 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:52.880949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:52.881695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:52.889120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:52.889660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:52.890121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:52.890855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:52.891333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:52.891915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:53.024063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:53.031886 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-52f66ad6-1291-4cfb-9485-79d83170cca9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.155643 Sep 27 02:30:53.032453 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3525/7094] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:52 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:54.056976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:54.057622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:54.064389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:54.064866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:54.065299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:54.066006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:54.066457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:54.066882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:54.200913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:54.209425 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c7cf89d-e2ff-4f83-b750-9b3cdd0af317 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.156560 Sep 27 02:30:54.210010 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3570/7095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:54 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:55.233072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:55.233726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:55.241212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:55.241748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:55.242202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:55.242910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:55.243381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:55.243826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:55.370887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:55.378698 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7b08f73-7d3f-4c9e-8008-ed56ed78d9fc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.149584 Sep 27 02:30:55.379272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3526/7096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:55 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:56.401505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:56.402152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:56.409026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:56.409534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:56.409967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:56.410652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:56.411103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:56.411525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:56.542189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:56.554979 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-630a6371-b884-4a5c-baeb-2af95444e806 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.157401 Sep 27 02:30:56.555573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3571/7097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:56 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:57.583282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:57.583913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:57.590925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:57.591424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:57.591879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:57.592586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:57.593056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:57.593535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:57.724057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:57.731864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6739ea97-4f12-422c-a466-928e032d20aa tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.152576 Sep 27 02:30:57.732437 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3527/7098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:57 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:58.756384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:58.757191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:58.764315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:58.764797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:58.765232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:58.765946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:58.766402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:58.766829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:58.906126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:30:58.914173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16b4c6b9-117a-43d2-ab9c-9ae1ca655fed tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.162316 Sep 27 02:30:58.914779 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3572/7099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:58 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:30:59.938609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:30:59.939245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:30:59.946727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:59.947219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:59.947664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:30:59.948364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:30:59.948829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:30:59.949269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:00.076155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:00.084467 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fdd123c7-2d7d-4c09-a6c0-b53469c67693 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.149836 Sep 27 02:31:00.085027 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3528/7100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:30:59 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:01.107222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:01.107840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:01.114669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:01.115148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:01.115584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:01.116276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:01.116728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:01.117174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:01.245853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:01.253656 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-966a91f5-607d-4d35-bec1-059a84ef540f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.150332 Sep 27 02:31:01.254235 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3573/7101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:01 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:02.276984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:02.277678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:02.284529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:02.285031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:02.285530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:02.286280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:02.287078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:02.287535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:02.419360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:02.427857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a800b017-0d84-46d9-9455-2c7d7a296977 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.154841 Sep 27 02:31:02.428435 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3529/7102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:02 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:03.450804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:03.451419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:03.458695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:03.459188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:03.459621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:03.460320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:03.460773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:03.461198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:03.596147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:03.604316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f82eca38-7173-4de0-ac8b-d0923c549952 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.157402 Sep 27 02:31:03.604899 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3574/7103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:03 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:04.627320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:04.627954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:04.635455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:04.635957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:04.636407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:04.637117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:04.637621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:04.638068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:04.772052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:04.779863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-88ffde1b-ec28-459b-be14-6e9da0998ddd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.156533 Sep 27 02:31:04.780441 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3530/7104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:04 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:05.804634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:05.805185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:05.812325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:05.812808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:05.813247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:05.813973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:05.814432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:05.814864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:05.821478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:05.949979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:05.959086 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c51922bd-c829-4f7f-af7e-1747bf91698c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.159343 Sep 27 02:31:05.959669 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3575/7105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:05 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:06.987698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:06.988254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:07.000443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:07.001189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:07.001789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:07.002528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:07.003007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:07.003451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:07.131317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:07.139037 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d90b4c6a-8f89-44a2-8fc0-5a2894c61b6d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.155335 Sep 27 02:31:07.139604 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3531/7106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:06 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:08.161687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:08.162331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:08.169270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:08.169776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:08.170204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:08.170894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:08.171373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:08.171847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:08.300080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:08.308562 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d1884175-a7bf-42c2-85b4-118e952cc3f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.150825 Sep 27 02:31:08.309142 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3576/7107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:08 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:09.332274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:09.332904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:09.340368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:09.340865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:09.341312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:09.342039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:09.342505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:09.342945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:09.476466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:09.484262 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2ede49b-c25a-4e7a-bab8-42b2ee75159d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.156125 Sep 27 02:31:09.484828 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3532/7108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:09 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:10.508470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:10.509089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:10.518772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:10.519254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:10.519692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:10.520382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:10.520834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:10.521265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:10.651417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:10.659102 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-67084836-f1a6-404a-a0a6-78835e33648a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.155158 Sep 27 02:31:10.659684 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3577/7109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:10 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:11.682877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:11.683508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:11.690506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:11.691005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:11.691457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:11.692694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:11.693164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:11.693642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:11.819696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:11.827532 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-014bedfe-94e9-420f-8164-cefb2dce691f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.148876 Sep 27 02:31:11.828107 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3533/7110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:11 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:12.850705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:12.851273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:12.858239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:12.858725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:12.859225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:12.859919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:12.860378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:12.860809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:12.997491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:13.005213 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d0e8dc2-fed4-4f69-a43b-4c76644a9cc7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.158593 Sep 27 02:31:13.005823 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3578/7111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:12 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:14.028076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:14.028737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:14.036073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:14.036564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:14.037009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:14.037739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:14.038206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:14.038645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:14.167938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:14.176552 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34cb6b45-e7d8-42b3-8743-254fd9c22933 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.152385 Sep 27 02:31:14.177140 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3534/7112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:14 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:15.199751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:15.200372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:15.207333 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:15.207819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:15.208257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:15.208963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:15.209450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:15.209885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:15.340761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:15.349111 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf37fd3e-aa37-4ab7-b48b-04b0b843400a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.153319 Sep 27 02:31:15.349738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3579/7113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:15 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:16.372305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:16.372934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:16.379782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:16.380277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:16.380723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:16.381452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:16.381916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:16.382357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:16.386254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=78 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:16.518907 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:16.527378 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50c33f1d-3bdf-4de4-a0d7-495e944c6dba tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.158992 Sep 27 02:31:16.527958 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3535/7114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:16 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:17.550327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:17.551568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:17.554533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=26 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:17.559934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:17.560587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:17.560925 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:17.561757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:17.562310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:17.562748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:17.695265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:17.703011 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6fc7f53c-5065-4426-8427-021724b6bbc9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.156561 Sep 27 02:31:17.703597 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3580/7115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:17 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:18.726815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:18.727382 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:18.730118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=26 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:18.735404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:18.735904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:18.736353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:18.737071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:18.737571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:18.738028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:18.868683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:18.876503 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67be94d0-5658-4c5f-8c26-51a111b65310 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1519 microversion: 2.1 time: 0.154236 Sep 27 02:31:18.877083 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3536/7116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:18 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:19.899852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:19.900498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:19.907885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:19.908374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:19.908813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:19.909539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:19.909994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:19.910927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:20.050164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:20.062936 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81a85d9a-b5d1-444a-9da5-90feb46fffee tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1518 microversion: 2.1 time: 0.166916 Sep 27 02:31:20.064059 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3581/7117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:19 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:20.100816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "name": "network-vif-unplugged", "status": "completed", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:20.110349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:20.110851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:20.111291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:20.122842 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Creating event network-vif-unplugged:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h2-859358-1 Sep 27 02:31:20.128235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:31:20.139153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-1f8c46c8-aa00-4fce-a208-62392d4fca2e req-9838de25-3994-4bb4-9cb6-4757c00345cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100547 Sep 27 02:31:20.139763 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3537/7118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:31:21.086815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:21.087463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:21.093634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:21.094117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:21.094561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:21.095249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:21.095706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:21.096130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:21.232467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:21.240912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a088ad74-20ac-4a49-b1a1-c5537452c829 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1516 microversion: 2.1 time: 0.158370 Sep 27 02:31:21.241511 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3582/7119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:21 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:22.155306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:22.165451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:22.165943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:22.166389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:22.178456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Creating event network-changed:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h2-859358-1 Sep 27 02:31:22.183992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:31:22.195128 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d4a58aa9-89b2-4e04-8a95-de79cb816d8b req-f0b52d64-0449-4ce8-8b91-53352aa27a49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044996 Sep 27 02:31:22.195726 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3538/7120] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:31:22.263822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:22.264435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:22.271100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:22.271580 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:22.272108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:22.273180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:22.273909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:22.274555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:22.479010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:22.486895 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c7ef0b7-9aaf-4cab-921c-06b7c16664b0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1516 microversion: 2.1 time: 0.227024 Sep 27 02:31:22.501761 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3583/7121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:22 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:23.513920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:23.514751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:23.521281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:23.521819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:23.522443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:23.523173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:23.523648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:23.524095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:23.731641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:23.740686 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d971138c-917f-4992-ac97-847f94677123 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1516 microversion: 2.1 time: 0.232222 Sep 27 02:31:23.741516 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3539/7122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:23 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:24.764243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:24.764826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:24.771672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:24.772159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:24.772602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:24.773306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:24.773793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:24.774260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:24.907434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:24.915832 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-46cbabac-bdaa-4bd7-95bd-a5730a20de94 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1513 microversion: 2.1 time: 0.155703 Sep 27 02:31:24.916452 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3584/7123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:24 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:24.938665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:24.939281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:24.946317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:24.946813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:24.947263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:24.947968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:24.948436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:24.949014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:25.011676 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-84f6d2b2-0380-4553-a259-63987ec14ef8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439/action" status: 204 len: 0 microversion: 2.1 time: 0.076428 Sep 27 02:31:25.012335 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3540/7124] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:31:24 2022] POST /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:31:25.020818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:25.021491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:25.027686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:25.028264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:25.028774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:25.029573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:25.030063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:25.030528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:25.277824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:25.286109 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aeaf5e9a-41c8-4c02-aeb1-d1eb01fcbf5c tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1513 microversion: 2.1 time: 0.269301 Sep 27 02:31:25.286698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3585/7125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:25 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:26.311802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:26.312553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:26.320374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:26.320997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:26.321489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:26.322199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:26.322667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:26.323107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:26.460752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:26.470045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50b9b90f-dfdc-4d8b-8f25-59bc315cd1bc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1505 microversion: 2.1 time: 0.163235 Sep 27 02:31:26.470629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3541/7126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:26 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:26.492792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:26.493468 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:26.500398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:26.500886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:26.501324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:26.502043 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:26.502500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:26.502929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:26.642095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:26.650496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d5f77d6-e287-4e5c-a0b7-cf9279b78bcd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1505 microversion: 2.1 time: 0.161971 Sep 27 02:31:26.651074 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3586/7127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:26 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:26.675932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bd5b0031-798c-455d-8c5a-4826ae10bba6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'create', calling method: .version_select at 0x7f24c47c8160>, body: {"keypair": {"name": "tempest-keypair-1504810765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEAK/MKNcLdM7z17+FHbKoUmTvjVDI3H8WyXd2rT7rXVn8eIYuWuyMN/ChsaCbbthMvxfY1YiyjdeWUL1aTx60L7cwYHEUVlCpx3jWB5n1adh7V/zkM0e0VUuwztYMtzA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:26.694081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bd5b0031-798c-455d-8c5a-4826ae10bba6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for project 92f782cd58b94a9e86d53b47dba84709. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:31:26.699107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-bd5b0031-798c-455d-8c5a-4826ae10bba6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for user 1783e65a8ef64526b3a9743b42b1c208 and project 92f782cd58b94a9e86d53b47dba84709. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:31:26.724573 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bd5b0031-798c-455d-8c5a-4826ae10bba6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052474 Sep 27 02:31:26.725326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3542/7128] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:31:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:31:27.279636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "name": "network-vif-plugged", "status": "completed", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:27.295209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:27.295744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:27.296173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:27.308908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] Creating event network-vif-plugged:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h2-859358-1 Sep 27 02:31:27.314761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8a01e8a9-cb56-4072-878c-6832dd92a0f5 req-786ec0fc-28b5-4ce1-8136-676078a8585e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039570 Sep 27 02:31:27.315538 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3587/7129] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:31:27.950628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:27.951286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:27.959832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:27.960330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:27.960776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:27.961509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:27.961976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:27.962414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:28.098598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:28.106477 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6c2e9cc-5e26-4bf7-bf26-1c3dd07e4b3d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 200 len: 1505 microversion: 2.1 time: 0.161380 Sep 27 02:31:28.107053 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3543/7130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:27 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:28.129272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:28.129895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:28.136899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:28.137416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:28.137861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:28.138550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:28.139006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:28.139464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:28.164416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:31:28.237818 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18cf1c12-c0f5-4058-a225-179fae9418e6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 204 len: 0 microversion: 2.1 time: 0.112861 Sep 27 02:31:28.239427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3588/7131] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:31:28 2022] DELETE /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:31:28.302098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1232499857", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "534e2b23-4a3c-4896-b770-dac8fb787d20"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:28.354690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] validate_networks() for [('534e2b23-4a3c-4896-b770-dac8fb787d20', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:31:28.828658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:31:28.829156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:31:28.829698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:31:28.830128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:31:28.830562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:31:28.840140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:28.840638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:28.841090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:28.841883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:28.842360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:28.842806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:28.861629 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for project 92f782cd58b94a9e86d53b47dba84709. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:31:28.866812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Getting quotas for user 1783e65a8ef64526b3a9743b42b1c208 and project 92f782cd58b94a9e86d53b47dba84709. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:31:28.879758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:31:28.882609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:31:28.934239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-677f441a-9250-4152-96f3-087baf30e5ca tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636524 Sep 27 02:31:28.934924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3544/7132] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:31:28.946787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4c266702-8497-4f17-99fe-77c2f63a6af1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:28.947586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4c266702-8497-4f17-99fe-77c2f63a6af1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:29.002933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4c266702-8497-4f17-99fe-77c2f63a6af1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:29.012250 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4c266702-8497-4f17-99fe-77c2f63a6af1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1218 microversion: 2.1 time: 0.069727 Sep 27 02:31:29.013012 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3589/7133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:28 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:30.036414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:30.037053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:30.043965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:30.044471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:30.044926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:30.045762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:30.046238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:30.046685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:30.118440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:30.127783 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c30e241f-cb2c-4f55-82dd-e316ec2067a5 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1270 microversion: 2.1 time: 0.096080 Sep 27 02:31:30.128565 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3545/7134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:30 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:30.325604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487a4303-c37c-470d-8b3f-3236a0fc0439", "name": "network-vif-deleted", "tag": "b67c2ddd-33ff-4b78-af18-f06052f2365a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:30.337634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:30.338187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:30.338638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:30.368136 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] Creating event network-vif-deleted:b67c2ddd-33ff-4b78-af18-f06052f2365a for instance 487a4303-c37c-470d-8b3f-3236a0fc0439 on n-h2-859358-1 Sep 27 02:31:30.374496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7013a5a4-e674-4a6b-bf7e-7fd1f004cc84 req-5e8f26ca-2ed0-470b-a5d5-c2a00d10c5be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052930 Sep 27 02:31:30.375418 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3590/7135] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:31:31.152778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:31.153504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:31.159735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:31.160856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:31.161453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:31.162288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:31.162843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:31.163509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:31.394231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:31.402363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25165095-a781-420d-8e29-12516519d944 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.255172 Sep 27 02:31:31.402944 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3546/7136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:31 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:32.398268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:32.407732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:32.408283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:32.408709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:32.420084 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] Creating event network-changed:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h2-859358-1 Sep 27 02:31:32.424844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dbe3fd77-c777-4fcd-ab37-5490a304ab0d req-4fd896bf-dbb6-4dc1-8536-0aa11c1983f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031602 Sep 27 02:31:32.426383 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3591/7137] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:31:32.426926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:32.427659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:32.435147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:32.435656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:32.436110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:32.436831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:32.437305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:32.437839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:32.593147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:32.601529 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1327343-7caa-42aa-b350-21511f662781 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.179311 Sep 27 02:31:32.602097 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3547/7138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:32 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:33.625375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:33.626098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:33.632322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:33.632809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:33.633255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:33.633979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:33.634444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:33.634876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:33.762579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:33.770794 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-54d80378-a6c8-4209-a1d3-5b224d05dc90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.150484 Sep 27 02:31:33.771366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3592/7139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:33 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:34.794090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:34.794773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:34.801639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:34.802139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:34.802610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:34.803324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:34.804045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:34.804484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:35.020186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:35.028096 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c49cd1d-51ad-4a55-a866-f5b02b4d050a tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.238078 Sep 27 02:31:35.028757 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3548/7140] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:34 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:36.052934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:36.053582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:36.060679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:36.061160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:36.061625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:36.062317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:36.062770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:36.063198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:36.065836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:36.192190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:36.200516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8da7de29-b88c-40ea-a267-b96a0551263b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.151491 Sep 27 02:31:36.201090 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3593/7141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:36 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:37.222380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:37.223010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:37.230211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:37.230730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:37.231156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:37.231869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:37.232868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:37.232868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:37.369109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:37.377941 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f9f0695-48a9-4049-a3b9-819f31b23e4b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.159725 Sep 27 02:31:37.379155 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3549/7142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:37 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:38.404384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:38.405007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:38.412670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:38.413157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:38.413618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:38.414315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:38.414770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:38.415202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:38.550922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:38.558978 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f5e486b4-0a57-4595-b6c3-0c90eaea6b3e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.158819 Sep 27 02:31:38.559559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3594/7143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:38 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:39.381039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "name": "network-vif-plugged", "status": "completed", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:39.387485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:39.388190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=10 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:39.394217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:39.394689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:39.395224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:39.410278 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] Creating event network-vif-plugged:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h2-859358-1 Sep 27 02:31:39.415367 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-14ebd2f2-97fe-4b67-9912-71e7e56d9200 req-aac939e5-4e1b-4af3-b7b7-3c4671aadc1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Sep 27 02:31:39.415978 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3550/7144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:31:39.582735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:39.583385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:39.585244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:39.591714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:39.592203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:39.592643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:39.593378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:39.593832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:39.594551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:39.721813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:39.730144 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70d37914-edca-4369-90fd-c162716a62cb tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.151935 Sep 27 02:31:39.730718 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3595/7145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:39 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:40.754933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:40.755579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:40.761910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:40.762407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:40.762859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:40.763559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:40.764027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:40.764497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:40.895561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:40.903561 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-716e4834-ec6a-4109-8cab-f1ee5ad57c99 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1318 microversion: 2.1 time: 0.154528 Sep 27 02:31:40.904138 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3551/7146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:40 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:41.926320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:41.926935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:41.934025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:41.934509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:41.934953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:41.935641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:41.936094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:41.936525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.066847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:42.074595 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8db2adbc-25c1-4b8b-8170-c0a84cfa3913 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1506 microversion: 2.1 time: 0.152184 Sep 27 02:31:42.075170 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3596/7147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:41 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:42.096828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:42.097493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:42.104823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.105316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.105790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.106493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.106958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.107395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.233951 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:42.241688 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f9c8cc3-f553-4ab5-9a8e-2efe44bf4145 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1506 microversion: 2.1 time: 0.148682 Sep 27 02:31:42.242250 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3552/7148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:42 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:42.263691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:31:42.265993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:42.272451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.272929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.273383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.274071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.274517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.274940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.301664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:42.307257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:31:42.313644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:31:42.314063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:31:42.314534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:31:42.314943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:31:42.315348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:31:42.382627 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f7adf0c-7c97-4370-bc9e-c92714b32000 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc/action" status: 202 len: 0 microversion: 2.1 time: 0.122761 Sep 27 02:31:42.383527 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3597/7149] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:31:42 2022] POST /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:31:42.392030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:42.392694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:42.399489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.400003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.400461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.401190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:42.401690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:42.402144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:42.421142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:42.564492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:42.573189 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f16269da-189d-4d44-88d3-9519fb0ca8bf tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1513 microversion: 2.1 time: 0.185155 Sep 27 02:31:42.573811 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3553/7150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:42 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:43.596189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:43.596808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:43.605258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:43.605763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:43.606197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:43.606880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:43.607330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:43.607753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:43.744400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:43.752670 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6334c7a-0e4c-435e-9e16-c40bc45ba4c1 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1513 microversion: 2.1 time: 0.160344 Sep 27 02:31:43.753254 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3598/7151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:43 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:44.776794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:44.777362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:44.784305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:44.784805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:44.785257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:44.786557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:44.787027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:44.787474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:44.916574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:44.924399 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-511401c2-5ff7-41e2-9ab5-9fefdde6eac7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.151606 Sep 27 02:31:44.924952 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3554/7152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:44 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:45.947600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:45.948218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:45.955071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:45.955552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:45.955992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:45.956678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:45.957134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:45.957589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:46.084100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:46.091726 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf9e5168-b398-452b-9e2d-2e04a8259d20 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.148079 Sep 27 02:31:46.092296 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3599/7153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:45 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:47.115102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:47.115730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:47.124767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:47.125267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:47.125747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:47.126459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:47.126937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:47.127381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:47.260553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:47.268360 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7757e77f-8d80-4c81-a93a-9cf0163b0f67 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.157661 Sep 27 02:31:47.268934 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3555/7154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:47 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:31:48.291274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:48.291887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:48.294861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:48.300324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:48.300807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:48.301245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:48.301972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:48.302430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:48.302886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:48.438222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:48.446330 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34ceb4b0-dd27-4267-a26b-f8777dc52ffc tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.159046 Sep 27 02:31:48.446904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3600/7155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:48 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:49.470198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:49.470906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:49.474178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:31:49.480107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:49.480640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:49.481154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:49.481895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:49.482367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:49.482812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:49.648414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:49.656423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a0b88d00-2dcb-4369-81af-6e07f37d64fe tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.190188 Sep 27 02:31:49.657103 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3556/7156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:49 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:50.681290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:50.681937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:50.688056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:50.688545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:50.688988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:50.689712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:50.690240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:50.690676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:50.823497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:50.831467 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-53c53083-8648-4bb6-86df-620db7ae59e8 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.155345 Sep 27 02:31:50.832619 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3601/7157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:50 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:51.855048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:51.855580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:51.865290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:51.865815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:51.866269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:51.866980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:51.867454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:51.867902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:52.004212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:52.012055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fc143b14-eff8-4bb0-a75f-6d5912bcd2d0 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.161083 Sep 27 02:31:52.012635 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3557/7158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:51 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:53.034232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:53.034850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:53.043966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:53.044450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:53.044887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:53.045609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:53.046066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:53.046495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:53.181717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:53.189374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31887c0f-a185-4345-a3e3-873b2309b8cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.159068 Sep 27 02:31:53.189952 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3602/7159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:53 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:54.212739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:54.213391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:54.220360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:54.220857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:54.221304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:54.222047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:54.222535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:54.222981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:54.353299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:54.361117 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e6ab095-216b-43a8-b937-b55d15b72e2d tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.152280 Sep 27 02:31:54.361663 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3558/7160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:54 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:55.383244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:55.383854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:55.390765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:55.391242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:55.391671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:55.392357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:55.392808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:55.393239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:55.519088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:55.527226 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d534a05-d496-4828-ad13-4ab455eceafd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.147872 Sep 27 02:31:55.527797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3603/7161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:55 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:56.552557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:56.553223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:56.560525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:56.561047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:56.561568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:56.562280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:56.562751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:56.563194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:56.689486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:56.697423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2027f35f-6d61-416c-bc07-5dca58180453 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.149439 Sep 27 02:31:56.698013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3559/7162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:56 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:57.720331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:57.721123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:57.729259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:57.729787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:57.730229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:57.730937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:57.731397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:57.731828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:57.864358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:57.872360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0387e80f-cd04-452b-969c-386d6196a287 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.156016 Sep 27 02:31:57.872942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3604/7163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:57 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:31:58.896858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:31:58.897513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:31:58.904271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:58.904762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:58.905214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:58.905941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:31:58.906414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:31:58.906856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:31:59.043419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:31:59.052465 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f71c1660-de0a-47a7-938c-8dbb35be5353 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.159866 Sep 27 02:31:59.053062 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3560/7164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:31:58 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:00.078865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:00.079508 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:00.086736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:00.087207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:00.087638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:00.088322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:00.088773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:00.089197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:00.216534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:00.224189 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f717fda3-ef67-42a6-b5e2-f4ba7c0a95b6 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.149164 Sep 27 02:32:00.224762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3605/7165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:00 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:01.247217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:01.247849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:01.255011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:01.255507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:01.255959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:01.256674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:01.257145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:01.257617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:01.384888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:01.392716 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-03e825b9-88f0-426d-b89f-61dbbb9ee35e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.149438 Sep 27 02:32:01.393289 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3561/7166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:01 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:02.416544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:02.417167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:02.424006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:02.424486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:02.424924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:02.426204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:02.426660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:02.427087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:02.561857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:02.569520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-27bc6327-fdec-48d1-a31f-019b755e2f9e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.156918 Sep 27 02:32:02.570104 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3606/7167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:02 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:03.592814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:03.593518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:03.600506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:03.601010 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:03.601501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:03.602216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:03.602693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:03.603143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:03.737392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:03.747232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-009b0a25-afc3-489e-8318-b2f9248b8b08 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.157951 Sep 27 02:32:03.748162 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3562/7168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:03 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:04.772337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:04.772866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:04.779789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:04.780305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:04.780748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:04.781471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:04.781929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:04.782361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:05.194442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:05.203565 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-122bb517-5826-4380-a8ab-a75d5ac2b4d2 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.435101 Sep 27 02:32:05.204221 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3607/7169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:04 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:06.228480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:06.229108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:06.235970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:06.236466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:06.236917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:06.237649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:06.238121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:06.238563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:06.364591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:06.372454 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab5b1e10-a3d2-4b8f-8dd8-92cf53780f61 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.147915 Sep 27 02:32:06.373036 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3563/7170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:06 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:07.396045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:07.396691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:07.405594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:07.406080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:07.406517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:07.407207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:07.407663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:07.408092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:07.410633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:07.538669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:07.546536 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d515489-76e0-468a-8abc-048c354563cd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.154430 Sep 27 02:32:07.547111 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3608/7171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:07 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:08.570547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:08.571171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:08.577599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:08.578093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:08.578538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:08.579236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:08.579702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:08.580141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:08.707187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:08.714893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a06d9b3b-e40a-4deb-9117-f2281d983e90 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.148865 Sep 27 02:32:08.715411 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3564/7172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:08 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:09.737874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:09.738418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:09.745213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:09.745728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:09.746162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:09.746848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:09.747297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:09.747719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:09.880700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:09.889528 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b476ba9e-560e-418c-a2de-0d9c3db01d2f tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.155522 Sep 27 02:32:09.890281 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3609/7173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:09 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:10.914040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:10.914706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:10.921645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:10.922145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:10.922599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:10.923309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:10.923779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:10.924225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:11.098005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:11.105880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1f16958c-1312-4a49-acc0-12bda8eb76c9 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1518 microversion: 2.1 time: 0.196348 Sep 27 02:32:11.106455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3565/7174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:10 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:11.680578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "name": "network-vif-unplugged", "status": "completed", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:11.691565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:11.692135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:11.692753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:11.704847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Creating event network-vif-unplugged:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h1-859358-1 Sep 27 02:32:11.710974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] Instance c408336e-c514-4bd5-a051-5e127b8fb1fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:32:11.721867 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-96c42ee4-8fd4-4cfb-a44f-dc9ddfc3714a req-10d6bc54-3192-4be5-9072-a57536e0abf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045234 Sep 27 02:32:11.722568 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3610/7175] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:32:12.129794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:12.130434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:12.137702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:12.138214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:12.138721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:12.139393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:12.139871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:12.140320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:12.278387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:12.287751 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f5b5c7c-90b0-4614-a89a-5b6e39f99268 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1517 microversion: 2.1 time: 0.162691 Sep 27 02:32:12.288943 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3566/7176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:12 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:13.313819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:13.314561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:13.321353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:13.321843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:13.322278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:13.322968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:13.323422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:13.323847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:13.451482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:13.459828 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfa6cb37-2c18-4657-bf50-19c9dbf788e7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1515 microversion: 2.1 time: 0.151103 Sep 27 02:32:13.460699 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3611/7177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:13 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:13.740416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:13.750652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:13.751139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:13.751583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:13.755238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=81 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:13.763777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Creating event network-changed:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h1-859358-1 Sep 27 02:32:13.769205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] Instance c408336e-c514-4bd5-a051-5e127b8fb1fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:32:13.780121 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-543a913a-d75a-40c1-b0fb-bf5cb991404b req-effba5bf-3419-40cb-b3e1-5ff57c4a5d97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044061 Sep 27 02:32:13.780708 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3567/7178] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:14.493722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:14.494341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:14.503948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.504434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.504888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.505606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.506066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.506498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.640894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:14.649605 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea491874-7887-48e6-b186-6ec7b6784058 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1512 microversion: 2.1 time: 0.159725 Sep 27 02:32:14.650179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3612/7179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:14 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:14.672409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:14.673043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:14.679393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.679884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.680327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.681027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.681519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.681959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.738574 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-644471c3-4bc0-4196-8055-bfd6e58f9621 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "POST /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc/action" status: 204 len: 0 microversion: 2.1 time: 0.070189 Sep 27 02:32:14.739218 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3568/7180] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:32:14 2022] POST /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:32:14.747576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:14.748323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:14.755443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.756066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.756514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.757442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:14.757914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:14.758351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:14.903803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:14.911549 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-417ceb8e-2351-4ed9-b330-50897f2874f4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1512 microversion: 2.1 time: 0.167939 Sep 27 02:32:14.912507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3613/7181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:14 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:15.936472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:15.937882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:15.947108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:15.947684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:15.948200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:15.948979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:15.949675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:15.950480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.089691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:16.098780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6cc60d9a-b48a-46ce-8b74-090f8feb20c4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1504 microversion: 2.1 time: 0.166690 Sep 27 02:32:16.105180 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3569/7182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:15 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:16.121319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:16.121984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:16.129616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.130108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.130553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.131254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.131712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.132141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.264063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:16.272470 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5a9f8de9-2ede-42d5-89cf-dc35a7c13a86 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1504 microversion: 2.1 time: 0.155216 Sep 27 02:32:16.273047 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3614/7183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:16 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:16.294270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:16.294914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:16.301451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.301956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.302415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.303136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.303610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.304321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.430455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:16.438259 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-27c4428f-8989-4bf2-b07c-648de3a86c6e tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1504 microversion: 2.1 time: 0.147867 Sep 27 02:32:16.438833 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3570/7184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:16 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:16.460541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:16.461035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:16.466974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.467454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.467891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.468578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.469026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.469476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.494048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:32:16.569596 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2a294bb1-a5d9-4aef-95d2-2ed24ed13858 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 204 len: 0 microversion: 2.1 time: 0.112438 Sep 27 02:32:16.570382 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3615/7185] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:32:16 2022] DELETE /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:32:16.586127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:16.586634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:16.592560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.593052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.593526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.594220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.594683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.595120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.620165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:32:16.664263 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.compute.api [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Instance is already in deleting state, ignoring this request Sep 27 02:32:16.665093 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6831343-3f49-4a0a-bea6-adf0dcf148af tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 204 len: 0 microversion: 2.1 time: 0.083107 Sep 27 02:32:16.665696 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3571/7186] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:32:16 2022] DELETE /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:32:16.674679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:16.675990 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:16.682207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.682699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.683144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.683840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:16.684302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:16.684737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:16.811696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:16.819373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31f76133-c300-4100-9f09-514a5c8d1270 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1510 microversion: 2.1 time: 0.148973 Sep 27 02:32:16.819945 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3616/7187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:16 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:17.562343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "name": "network-vif-plugged", "status": "completed", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:17.573106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:17.573824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:17.574268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:17.586333 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] Creating event network-vif-plugged:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h1-859358-1 Sep 27 02:32:17.591214 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-a8c0b419-7ab2-4644-a640-be68e6804e18 req-dc27bd7e-c182-4263-ab26-12e60a082159 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Sep 27 02:32:17.591807 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3572/7188] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:17.842048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:17.842575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:17.849422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:17.849911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:17.850352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:17.851048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:17.851504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:17.851932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:18.075695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1783e65a8ef64526b3a9743b42b1c208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f782cd58b94a9e86d53b47dba84709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:18.083480 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c509843-4e90-4f32-a9c5-2add22d728f7 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 200 len: 1510 microversion: 2.1 time: 0.245414 Sep 27 02:32:18.084151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3617/7189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:17 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:18.401400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c408336e-c514-4bd5-a051-5e127b8fb1fc", "name": "network-vif-deleted", "tag": "b463d30b-63b4-476e-a300-95e1284fa8c0"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:18.411961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:18.412459 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:18.412910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:18.425786 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] Creating event network-vif-deleted:b463d30b-63b4-476e-a300-95e1284fa8c0 for instance c408336e-c514-4bd5-a051-5e127b8fb1fc on n-h1-859358-1 Sep 27 02:32:18.433834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-735ef6e8-4a03-4003-a1f7-ab4816ee92c5 req-ba4bacf8-b0e1-4bba-bcb7-b008c060147d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Sep 27 02:32:18.434447 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3573/7190] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:19.106332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:19.106877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: c408336e-c514-4bd5-a051-5e127b8fb1fc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:19.109676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:19.115475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.115959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.116390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.117081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.117597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.118023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.132494 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] HTTP exception thrown: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Request method failure captured: Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc HTTP/1.1 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmBLconqqDAnnLp4kVPP-afuqW2Is77jEVxL-sinhTJphxSBdfglsMaeIvgh-XsdLhskElDaL01Me4-crY3nAaKgQNaX1hsCjk0i0OMTy5CDcYB08E8KMPV9t9Sb-80rIXtkXLUBbOSrmG6Vi6ent8uNwrXj4BUTOFAwHocucOnQEiY Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_92f782cd58b94a9e86d53b47dba84709", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1783e65a8ef64526b3a9743b42b1c208 Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c408336e-c514-4bd5-a051-5e127b8fb1fc'} Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.134160 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Returning 404 to user: Instance c408336e-c514-4bd5-a051-5e127b8fb1fc could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-64f49177-2c4e-451d-8db9-779be2a6ce69 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc" status: 404 len: 111 microversion: 2.1 time: 0.033195 Sep 27 02:32:19.139263 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3618/7191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:19 2022] GET /compute/v2.1/servers/c408336e-c514-4bd5-a051-5e127b8fb1fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:32:19.146361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64b0b303-2081-46dc-a17e-862c66d28a0b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '.version_select at 0x7f24c4748f70>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:19.168130 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64b0b303-2081-46dc-a17e-862c66d28a0b tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504810765" status: 202 len: 0 microversion: 2.1 time: 0.027534 Sep 27 02:32:19.168793 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3574/7192] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Sep 27 02:32:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504810765 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:32:19.760772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:19.761264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:19.769491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.770003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.770436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.771131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.771579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.772001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.785607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] HTTP exception thrown: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Request method failure captured: Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 HTTP/1.1 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmBLconqqDAnnLp4kVPP-afuqW2Is77jEVxL-sinhTJphxSBdfglsMaeIvgh-XsdLhskElDaL01Me4-crY3nAaKgQNaX1hsCjk0i0OMTy5CDcYB08E8KMPV9t9Sb-80rIXtkXLUBbOSrmG6Vi6ent8uNwrXj4BUTOFAwHocucOnQEiY Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_92f782cd58b94a9e86d53b47dba84709", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 1783e65a8ef64526b3a9743b42b1c208 Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '487a4303-c37c-470d-8b3f-3236a0fc0439'} Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:32:19.787130 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Returning 404 to user: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-63fe3c10-8cc9-4690-a179-876d192bccfd tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 404 len: 111 microversion: 2.1 time: 0.031768 Sep 27 02:32:19.791572 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3619/7193] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:32:19 2022] DELETE /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:32:19.797014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:19.797821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] [instance: 487a4303-c37c-470d-8b3f-3236a0fc0439] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:19.799747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:19.807457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.807947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.808391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.809089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:19.809582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:19.810016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:19.823430 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] HTTP exception thrown: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Request method failure captured: Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 HTTP/1.1 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmBLconqqDAnnLp4kVPP-afuqW2Is77jEVxL-sinhTJphxSBdfglsMaeIvgh-XsdLhskElDaL01Me4-crY3nAaKgQNaX1hsCjk0i0OMTy5CDcYB08E8KMPV9t9Sb-80rIXtkXLUBbOSrmG6Vi6ent8uNwrXj4BUTOFAwHocucOnQEiY Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/92f782cd58b94a9e86d53b47dba84709"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_92f782cd58b94a9e86d53b47dba84709", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 92f782cd58b94a9e86d53b47dba84709 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-346531702 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 1783e65a8ef64526b3a9743b42b1c208 Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerDiskConfigTestJSON-346531702-project Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '487a4303-c37c-470d-8b3f-3236a0fc0439'} Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:32:19.825062 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] Returning 404 to user: Instance 487a4303-c37c-470d-8b3f-3236a0fc0439 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab853484-b8b7-4bd4-a36e-fb96c7cb4cc4 tempest-ServerDiskConfigTestJSON-346531702 tempest-ServerDiskConfigTestJSON-346531702-project] 10.222.0.52 "GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439" status: 404 len: 111 microversion: 2.1 time: 0.033347 Sep 27 02:32:19.829391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3575/7194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:19 2022] GET /compute/v2.1/servers/487a4303-c37c-470d-8b3f-3236a0fc0439 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:32:28.110497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ab06813e-2ff9-4492-8113-96d1ca2fa824 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: .version_select at 0x7f24d4d83310>, body: {"keypair": {"name": "tempest-keypair-990269760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1VAljrDFWMUoD7TbD0G7ay+WC2XS2B3P6AmNXcNIzGV0YxmGV6sEBhQ0AeERwuztf0xbVmVHCZDV+MA4tGHxWZOWMuzX027SD4a7SUya6q7gutx8Ix4U3cEnRpT2r4tQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:28.128803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ab06813e-2ff9-4492-8113-96d1ca2fa824 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:32:28.134072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ab06813e-2ff9-4492-8113-96d1ca2fa824 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:32:28.164183 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ab06813e-2ff9-4492-8113-96d1ca2fa824 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170057 Sep 27 02:32:28.164815 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3620/7195] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:32:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:32:29.796294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-426436343", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f"}], "security_groups": [{"name": "tempest-securitygroup--1473647238"}], "key_name": "tempest-keypair-990269760", "user_data": "}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:29.819386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:29.908562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] validate_networks() for [('742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:32:30.312892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:32:30.313364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:32:30.313861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:32:30.314292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:32:30.314725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:32:30.324076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:30.324575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:30.325071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:30.325961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:30.326447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:30.326898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:30.343917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:32:30.350037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:32:30.363174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:32:30.365704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:32:30.416174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a90868c7-ec20-4a51-b59e-943f0b1100a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.624246 Sep 27 02:32:30.423000 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3576/7196] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:32:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:32:30.426586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:30.431207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5837286-16dc-4249-8f82-f07df80bab6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:30.431839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5837286-16dc-4249-8f82-f07df80bab6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:30.490984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5837286-16dc-4249-8f82-f07df80bab6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:30.498681 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5837286-16dc-4249-8f82-f07df80bab6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1237 microversion: 2.1 time: 0.074551 Sep 27 02:32:30.500716 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3621/7197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:30 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:32:31.521595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:31.522239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:31.530515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:31.532169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:31.532814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:31.533573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:31.534212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:31.534665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:31.613906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:31.626796 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29f008b3-3ab0-441b-9b24-2a08ecd872c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1297 microversion: 2.1 time: 0.109544 Sep 27 02:32:31.629846 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3577/7198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:31 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:32.651993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:32.652646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:32.665466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:32.665992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:32.666435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:32.667149 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:32.667607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:32.668052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:32.867515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:32.877393 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cd78428-c1dd-4d95-82d0-b4470e1ddfd0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.229453 Sep 27 02:32:32.878988 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3622/7199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:32 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:33.403195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:33.418135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:33.418657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:33.419281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:33.435894 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] Creating event network-changed:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h1-859358-1 Sep 27 02:32:33.441051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-28f722da-8601-4d9a-bbce-25dbdc60e34b req-84199aca-3449-4f17-a8fb-98468c5e3342 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042420 Sep 27 02:32:33.441709 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3578/7200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:33.901702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:33.902353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:33.909883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:33.910366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:33.910805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:33.911498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:33.911956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:33.912386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:34.044824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:34.052556 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a5e7583-99d4-42be-b684-d5d5f2739e74 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.154852 Sep 27 02:32:34.053129 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3623/7201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:33 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:35.077128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:35.077896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:35.084436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:35.084923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:35.085387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:35.086086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:35.086553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:35.086992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:35.215158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:35.223433 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1af5819-912c-4840-b94d-8bc752e337ec tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.151426 Sep 27 02:32:35.224000 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3579/7202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:35 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:36.246206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:36.246830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:36.253679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:36.254164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:36.254605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:36.255304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:36.255765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:36.256194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:36.384978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:36.392761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47a48eed-4113-4955-ac95-8acf8e10879f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.150550 Sep 27 02:32:36.393365 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3624/7203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:36 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:37.415908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:37.416542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:37.423150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:37.423656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:37.424111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:37.424819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:37.425293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:37.425769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:37.560798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:37.568731 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b00e2192-7078-4d95-b7fc-23cb20cc4d57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.156950 Sep 27 02:32:37.569310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3580/7204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:37 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:37.648271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "name": "network-vif-plugged", "status": "completed", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:37.663724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:37.664219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:37.664661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:37.676446 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] Creating event network-vif-plugged:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h1-859358-1 Sep 27 02:32:37.682022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3b0b08ed-7371-408a-a467-990beaba2ce1 req-266289d5-76b3-48d3-a966-b8c9ec09d3a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039718 Sep 27 02:32:37.682800 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3625/7205] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:38.591796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:38.592598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:38.599908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:38.600403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:38.600855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:38.601580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:38.602049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:38.602486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:38.730407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:38.738937 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39cde8eb-bc1b-4265-85f3-e1e170e501f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1363 microversion: 2.1 time: 0.151047 Sep 27 02:32:38.739641 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3581/7206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:38 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:39.762178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:39.762807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:39.769891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:39.770371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:39.771078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:39.771472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:39.771922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:39.772466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:39.908983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:32:39.916709 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5932c825-1c13-4e56-a7ab-cb037a34ef4f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1551 microversion: 2.1 time: 0.158898 Sep 27 02:32:39.917280 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3626/7207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:32:39 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:32:39.939995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:32:39.940517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:32:39.947384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:39.947887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:39.948343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:39.949057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:39.949650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:39.950105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:40.025663 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db945723-9899-4e3b-a48e-d7da1883df09 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089524 Sep 27 02:32:40.026268 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3582/7208] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:32:39 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:32:40.956934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:32:40.962097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:32:40.968729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:32:40.969239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:32:40.969696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:32:40.980663 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] Creating event network-changed:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h1-859358-1 Sep 27 02:32:40.985666 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a5aaa90e-290f-47a2-9a14-9a376d986b49 req-422d1778-145f-41ea-953c-80102f6bf0d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Sep 27 02:32:40.986264 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3627/7209] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:14.766825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.767577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.770750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.771544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=32 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.776691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:14.777318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:14.787367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:14.787863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:14.788310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:14.789023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:14.789528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:14.789976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:14.924075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:14.932170 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e44f6c15-cf5b-4699-a1a2-a28c1b151d14 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.166332 Sep 27 02:33:14.932742 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3583/7210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:14 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:14.953600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.954406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=28 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:14.959195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:14.959915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:14.968252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:14.968743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:14.969186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:14.969922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:14.970385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:14.970818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.099752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:15.108373 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-31d33841-4786-4463-b3d6-b5f45e958475 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.157326 Sep 27 02:33:15.108934 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3628/7211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:14 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:15.130598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:15.131245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:15.137220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.137755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.138209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.138920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.139399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.139844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.270935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:15.278828 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f10a881-f2a9-45ac-9cd2-4df59b7afcaa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.152653 Sep 27 02:33:15.279408 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3584/7212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:15 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:15.301069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:15.303318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:15.309482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.309970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.310407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.311102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.311557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.311984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.343012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:15.348360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:33:15.354771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:33:15.355195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:33:15.355666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:33:15.356077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:33:15.356486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:33:15.418090 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe867051-e64e-4fcd-a792-18435e5274e8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/action" status: 202 len: 0 microversion: 2.1 time: 0.121171 Sep 27 02:33:15.418710 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3629/7213] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:33:15 2022] POST /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:33:15.427664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:15.428295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:15.434829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.435342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.435821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.436519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:15.436995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:15.437528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:15.622096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:15.630998 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-682ef033-adc0-4e74-837a-34f58f861b65 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1678 microversion: 2.1 time: 0.207574 Sep 27 02:33:15.631589 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3585/7214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:15 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:16.655215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:16.655827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:16.662646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:16.663123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:16.663554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:16.664239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:16.664690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:16.665111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:16.799749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:16.808420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5151d946-202d-413e-9f89-86733008e963 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1678 microversion: 2.1 time: 0.157875 Sep 27 02:33:16.809011 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3630/7215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:16 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:17.832554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:17.833160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:17.840026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:17.840554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:17.841008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:17.841742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:17.842213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:17.842656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:17.978016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:17.985798 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9af8f3e3-a85d-4780-8791-05a0ef0ef6e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.157718 Sep 27 02:33:17.986407 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3586/7216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:17 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:19.008159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:19.008814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:19.015655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:19.016144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:19.016583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:19.017281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:19.017769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:19.018202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:19.144265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:19.151980 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dae2d2b3-b9dc-4d35-820d-7ac2491429bf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.147864 Sep 27 02:33:19.152559 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3631/7217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:19 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:20.175377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:20.176026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:20.183172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:20.183667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:20.184114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:20.184814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:20.185279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:20.185745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:20.313166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:20.321610 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53dbd204-6461-402f-9151-45ffa7936594 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.150626 Sep 27 02:33:20.322178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3587/7218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:20 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:21.344169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:21.344788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:21.351073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:21.351557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:21.352020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:21.352756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:21.353302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:21.353820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:21.485207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:21.493445 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f8e8da4-22f0-4dbf-8001-d3fbc0b51479 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.153319 Sep 27 02:33:21.494013 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3632/7219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:21 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:22.516182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:22.516737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:22.524008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:22.524518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:22.524944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:22.525717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:22.526181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:22.526621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:22.657491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:22.665476 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a65d4139-9129-4ef5-a5ce-78ce7b54021f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.153261 Sep 27 02:33:22.666111 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3588/7220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:22 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:23.688897 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:23.689537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:23.696263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:23.696745 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:23.697309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:23.698035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:23.698488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:23.698913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:23.824754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:23.833013 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-16c2df79-d00d-4d53-b3c0-348b561d331c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.148066 Sep 27 02:33:23.833616 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3633/7221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:23 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:24.856620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:24.857172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:24.864609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:24.865113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:24.865592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:24.866306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:24.866775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:24.867222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:24.995971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:25.003823 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d80ae93-19fd-46e9-9e5c-d4b31178ad66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.151192 Sep 27 02:33:25.004395 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3589/7222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:24 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:26.027061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:26.027672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:26.034599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:26.035078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:26.035533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:26.036194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:26.036644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:26.037068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:26.172548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:26.181700 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9d26e508-869f-4b88-8633-b7b8d314fc66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.158481 Sep 27 02:33:26.182434 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3634/7223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:26 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:27.206689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:27.207331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:27.214290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:27.214797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:27.215250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:27.215994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:27.216469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:27.216918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:27.346075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:27.353962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d30566bb-2e33-48ec-ab05-e1b8516582cb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.151806 Sep 27 02:33:27.354616 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3590/7224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:27 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:28.377790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:28.378401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:28.385173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:28.385681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:28.386116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:28.386801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:28.387253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:28.387676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:28.515437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:28.523221 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-48be964d-d008-43c3-aa61-5a35b5e6c4b2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.149935 Sep 27 02:33:28.523798 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3635/7225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:28 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:29.549422 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:29.550074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:29.557091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:29.557611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:29.558058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:29.558767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:29.559239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:29.559672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:29.691119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:29.698791 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b2760e6-f2bd-4772-8ca8-22b320e8c1e6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.153407 Sep 27 02:33:29.699357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3591/7226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:29 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:30.722949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:30.723500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:30.730265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:30.730730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:30.731175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:30.731877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:30.732338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:30.732766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:31.130128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:31.137785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-335c796e-018a-4cb0-a818-d055796e5e6c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.419415 Sep 27 02:33:31.138361 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3636/7227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:30 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:32.163299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:32.163929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:32.171227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:32.171721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:32.172171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:32.172949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:32.173452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:32.173891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:32.304763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:32.312537 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ddbd38e8-3af0-409c-a780-fb3b77cd08c2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.154692 Sep 27 02:33:32.313113 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3592/7228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:32 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:33.335498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:33.336138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:33.343225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:33.343708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:33.344170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:33.344857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:33.345395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:33.346316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:33.471939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:33.479668 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a74daed7-253f-4fe9-80f8-8c5ce7d0d84d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1683 microversion: 2.1 time: 0.148077 Sep 27 02:33:33.480231 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3637/7229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:33 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:34.504084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:34.504815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:34.511628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:34.512121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:34.512571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:34.513281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:34.513776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:34.514225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:34.730558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:34.740031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b275f550-d523-437b-9ff0-06bf72d062f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1682 microversion: 2.1 time: 0.240474 Sep 27 02:33:34.740882 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3593/7230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:34 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:33:34.755816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "name": "network-vif-unplugged", "status": "completed", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:34.766545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:34.767062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:34.767501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:34.779514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Creating event network-vif-unplugged:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h2-859358-1 Sep 27 02:33:34.785839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] Instance ff60c340-08f1-406a-8709-a871c91ca9a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:33:34.797463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6116d80a-9e94-426c-a181-8a01a4c424db req-1d5ea1ee-167f-48a1-8e98-c0e21a494e68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045788 Sep 27 02:33:34.798081 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3638/7231] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:35.763168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:35.763805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:35.770805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:35.771331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:35.771783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:35.772493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:35.772963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:35.773562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:35.910447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:35.918438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec4e0dab-7041-4624-9c4b-ab9890a39704 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1682 microversion: 2.1 time: 0.159230 Sep 27 02:33:35.919013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3594/7232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:35 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:36.839615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:36.851014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:36.851541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:36.852035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:36.863892 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Creating event network-changed:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h2-859358-1 Sep 27 02:33:36.869157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] Instance ff60c340-08f1-406a-8709-a871c91ca9a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:33:36.880258 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e420aa8a-40df-4dfc-b390-96159f6982d5 req-e26ad051-a0b6-46f5-9a0a-242e2684a3db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044752 Sep 27 02:33:36.880846 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3639/7233] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:36.943051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:36.944346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:36.951482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:36.951982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:36.952429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:36.953141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:36.953642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:36.954080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:37.084099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:37.092146 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e22b6d03-a3ff-48bf-9d90-bacccbdd08de tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1680 microversion: 2.1 time: 0.153698 Sep 27 02:33:37.092722 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3595/7234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:36 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:38.116855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:38.117538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:38.123668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:38.124151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:38.124589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:38.125280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:38.125763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:38.126192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:38.258559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:38.266512 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-facc34b6-86b5-4245-adf2-025b4f6c74c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1680 microversion: 2.1 time: 0.154839 Sep 27 02:33:38.267087 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3640/7235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:38 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:39.293376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:39.294603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:39.303284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.304179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.305280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.306613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.307511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.308359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.441390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:39.449295 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c8de37da-0b21-4e9e-ab8f-57c1e80a15ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1677 microversion: 2.1 time: 0.161064 Sep 27 02:33:39.449906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3596/7236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:39 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:39.471959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:39.472495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:39.479260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.479738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.480169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.480853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.481304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.481751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.542096 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cb52bf5-a1b3-4e31-b730-ac4cfbc70828 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/action" status: 204 len: 0 microversion: 2.1 time: 0.074342 Sep 27 02:33:39.542728 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3641/7237] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:33:39 2022] POST /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:33:39.556808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:39.557547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:39.564264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.564771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.565361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.566162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:39.566639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:39.567089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:39.703829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:39.712437 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-95f8181a-183f-48ac-827c-167936644031 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1677 microversion: 2.1 time: 0.165425 Sep 27 02:33:39.713016 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3597/7238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:39 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:40.739196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:40.739921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:40.746992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:40.747548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:40.748112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:40.748994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:40.749649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:40.750097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:40.897871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:40.900177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:40.907526 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fb988c56-e0e8-4f0b-951d-6026e66bcc11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.173978 Sep 27 02:33:40.908630 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3642/7239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:40 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:40.931191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:40.931820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:40.938814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:40.939306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:40.939755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:40.940455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:40.940921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:40.941449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.073882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:41.082140 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e25e1c53-e881-405e-bca7-05150366b140 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.155016 Sep 27 02:33:41.082649 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3598/7240] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:40 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:41.104568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:41.105190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:41.112764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.113248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.113715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.114415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.114872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.115301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.248020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:41.256358 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba61f7c4-8430-4555-a02c-13577d1d8e41 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1669 microversion: 2.1 time: 0.155762 Sep 27 02:33:41.256929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3643/7241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:41 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:41.278866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:41.279375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:41.285875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.286372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.286817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.287515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.287978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.288424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.306471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=100 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:41.314264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:33:41.387012 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-048fa88b-c2d1-41a2-934b-284387e5b7c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 204 len: 0 microversion: 2.1 time: 0.111762 Sep 27 02:33:41.387599 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3599/7242] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:33:41 2022] DELETE /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:33:41.396435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:41.397062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:41.402987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.403477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.403920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.404620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:41.405083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:41.405551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:41.536544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:41.544350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5836fc11-272e-4789-b8ed-519d4189ef35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1675 microversion: 2.1 time: 0.152409 Sep 27 02:33:41.544929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3644/7243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:41 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:42.028722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "name": "network-vif-plugged", "status": "completed", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:42.042350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:42.042977 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:42.043436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:42.055023 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] Creating event network-vif-plugged:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h2-859358-1 Sep 27 02:33:42.060010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c6c6da39-fe7b-42ea-a950-023b1983a199 req-61e6e8fa-ea45-4194-b334-5eb7b200e1f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Sep 27 02:33:42.060812 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3600/7244] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:42.567845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:42.568572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:42.575595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:42.576084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:42.576529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:42.577223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:42.577725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:42.578161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:42.707661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:42.715572 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce3e463b-5295-4196-a536-68bff2d48ae6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1675 microversion: 2.1 time: 0.151578 Sep 27 02:33:42.716079 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3645/7245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:42 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:43.741104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:43.742443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:43.750206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff60c340-08f1-406a-8709-a871c91ca9a6", "name": "network-vif-deleted", "tag": "9da2e308-bafb-466d-813c-edf1135c03af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:43.752098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:43.752612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:43.753220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:43.754411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:43.754888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:43.755512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:43.761172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:43.761952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:43.762381 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:43.780427 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] Creating event network-vif-deleted:9da2e308-bafb-466d-813c-edf1135c03af for instance ff60c340-08f1-406a-8709-a871c91ca9a6 on n-h2-859358-1 Sep 27 02:33:43.788642 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-a9942e0b-fa81-4e6b-ab33-3b9a24252787 req-36b06a5a-bb86-4acd-bd22-bb8cdc12a2ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041661 Sep 27 02:33:43.790533 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3646/7246] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:33:43.831059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:43.839947 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-598f5f98-0579-48cf-8591-8a750fbe0165 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 200 len: 1607 microversion: 2.1 time: 0.104216 Sep 27 02:33:43.840553 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3601/7247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:43 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 1607 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:44.866584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:44.867289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:44.874952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:44.875465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:44.875901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:44.877176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:44.877661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:44.878091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:44.892272 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 HTTP/1.1 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ff60c340-08f1-406a-8709-a871c91ca9a6'} Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:33:44.894385 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b1ae3d6-0f30-4ef8-a2b3-2faf011d233d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 404 len: 111 microversion: 2.1 time: 0.033447 Sep 27 02:33:44.900473 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3647/7248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:44 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 02:33:44.910835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:44.911468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:44.914406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:44.919730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:44.920231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:44.920691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:44.921409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:44.922058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:44.922508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:44.937712 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 HTTP/1.1 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ff60c340-08f1-406a-8709-a871c91ca9a6'} Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:33:44.940053 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-019ac6a2-fa2d-447d-88e8-f3da01565e4b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 404 len: 111 microversion: 2.1 time: 0.034607 Sep 27 02:33:44.944699 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3602/7249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:44 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:33:44.993791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-310377421", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f"}], "security_groups": [{"name": "tempest-securitygroup--1473647238"}], "key_name": "tempest-keypair-990269760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:45.002946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=45 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:33:45.097268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] validate_networks() for [('742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:33:45.531729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:33:45.532156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:33:45.533186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:33:45.533639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:33:45.534061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:33:45.542772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:45.543287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:45.543729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:45.544457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:45.544913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:45.545366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:45.564504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:33:45.569833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:33:45.582626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:33:45.584958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:33:45.632466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f2414631-0345-4c2b-b9f0-b1bdd6efa1c0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.642817 Sep 27 02:33:45.633107 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3648/7250] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:33:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:33:45.644926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-390b9924-8396-4c1f-aeb6-e04be69cce59 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:45.645750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-390b9924-8396-4c1f-aeb6-e04be69cce59 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:45.711659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-390b9924-8396-4c1f-aeb6-e04be69cce59 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:45.718826 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-390b9924-8396-4c1f-aeb6-e04be69cce59 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1237 microversion: 2.1 time: 0.078369 Sep 27 02:33:45.719387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3603/7251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:45 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:46.743497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:46.744366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:46.752960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:46.753587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:46.754139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:46.754855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:46.755572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:46.757064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:46.832450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:46.840414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4ace8d0d-f9a6-4de9-b1a9-ae2422ffafad tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1307 microversion: 2.1 time: 0.101286 Sep 27 02:33:46.840990 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3649/7252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:46 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:47.865136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:47.865841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:47.873770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:47.874279 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:47.874741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:47.875467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:47.875939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:47.877028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:48.012162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:48.025510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aadbf460-34b7-48ef-bc80-bda3b0595220 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1363 microversion: 2.1 time: 0.164708 Sep 27 02:33:48.026108 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3604/7253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:47 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:48.124401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:48.135718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:48.136208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:48.136651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:48.151228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] Creating event network-changed:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h1-859358-1 Sep 27 02:33:48.156479 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e613e4d2-58b0-4bd4-828f-652742219e96 req-a09e3214-7990-47ed-9cc8-55e52c9af53e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Sep 27 02:33:48.157139 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3650/7254] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:49.049315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:49.049926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:49.057113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:49.057641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:49.058095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:49.058806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:49.059295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:49.059744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:49.185783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:49.194008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8131523-fc77-436b-87ce-b6e0fc55b78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1363 microversion: 2.1 time: 0.148674 Sep 27 02:33:49.194591 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3605/7255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:49 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:50.219366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:50.220584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:50.227257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:50.227735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:50.228171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:50.228866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:50.229317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:50.229764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:50.363800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:50.371547 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40383692-9341-4908-bb38-e8f03d984521 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1363 microversion: 2.1 time: 0.157467 Sep 27 02:33:50.372117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3651/7256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:50 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:51.395243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:51.395875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:51.402976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:51.403481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:51.403932 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:51.404636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:51.405106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:51.405581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:51.541071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:51.548777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7b28c41c-f022-4ab0-8e2a-698de143efbd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1363 microversion: 2.1 time: 0.157458 Sep 27 02:33:51.549368 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3606/7257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:51 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:51.969374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "name": "network-vif-plugged", "status": "completed", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:51.981252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:51.981765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:51.982378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:51.994369 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] Creating event network-vif-plugged:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h1-859358-1 Sep 27 02:33:51.999307 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f1beca6c-e12f-4545-bd55-3cb96713631b req-3c5f3b61-504d-4b52-8071-4c9d74368bbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033744 Sep 27 02:33:52.000133 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3652/7258] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:52.572181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:52.572842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:52.579653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:52.580152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:52.580605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:52.581316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:52.581812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:52.582254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:52.709638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:52.717529 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-53508486-11e5-4f74-8055-2f70dd20c459 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1363 microversion: 2.1 time: 0.149338 Sep 27 02:33:52.718046 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3607/7259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:52 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:53.742859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:53.743564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:53.750575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:53.751093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:53.752066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:53.752754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:53.753213 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:53.753667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:53.879302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:33:53.887058 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6acc115-f1a6-4f6d-a5ae-134684c7feff tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1550 microversion: 2.1 time: 0.148527 Sep 27 02:33:53.887628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3653/7260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:33:53 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:33:53.911475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:33:53.911988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:33:53.918828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:53.919330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:53.919781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:53.920488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:53.920957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:53.921447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:53.998976 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecdd8d70-25ba-424e-92ef-19fc1aef24e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091333 Sep 27 02:33:53.999612 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3608/7261] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:33:53 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:33:54.948457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:33:54.959275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:33:54.959754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:33:54.960194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:33:54.971214 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] Creating event network-changed:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h1-859358-1 Sep 27 02:33:54.976246 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-685e1f4b-baa7-42a5-b8dd-11afd7526b98 req-c33ebdd7-5fc1-4311-a579-3a500a715fb4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031499 Sep 27 02:33:54.976905 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3654/7262] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:34:28.829227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.830102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=15 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.831375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.835717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:28.843793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:28.844666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:28.845275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:28.873704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Going to try to stop instance {{(pid=128778) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 02:34:28.916187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f4c80de9-18a2-48e0-9cc2-0914ae0d5cae tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action" status: 202 len: 0 microversion: 2.1 time: 0.088485 Sep 27 02:34:28.916786 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3609/7263] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:34:28 2022] POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:34:28.926765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:28.927484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:28.931159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.932038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.932730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.933389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=49 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:28.937308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:28.937851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:28.938273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:28.939014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:28.939451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:28.940475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:29.072409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:29.080232 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a22267dd-388f-45fc-882f-1b29b9a49b55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.158881 Sep 27 02:34:29.080778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3655/7264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:28 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:34:30.104734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:30.105518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:30.111725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:30.112230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:30.112686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:30.113429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:30.113906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:30.114354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:30.246286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:30.254512 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d96baf8e-33d1-4419-89d0-70101eee367d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.155024 Sep 27 02:34:30.255088 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3610/7265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:30 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:31.278200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:31.278825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:31.286307 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:31.286789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:31.287232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:31.287930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:31.288388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:31.288827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:31.419883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:31.427716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5909020d-918e-4396-bfd4-171624cfa51c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.153521 Sep 27 02:34:31.428287 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3656/7266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:31 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:32.450213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:32.450833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:32.457813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:32.458314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:32.458758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:32.459475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:32.459930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:32.460363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:32.597781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:32.605544 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-942aa3f0-3262-41b9-96f6-308556fdd8ee tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.159223 Sep 27 02:34:32.606110 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3611/7267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:32 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:33.629194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:33.629759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:33.636536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:33.637020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:33.637501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:33.638194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:33.638650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:33.639081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:33.764122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:33.772383 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7aaa046-eef9-4d5e-805f-35b9ec874900 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.147209 Sep 27 02:34:33.772953 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3657/7268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:33 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:34.798081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:34.798637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:34.805969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:34.806472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:34.806927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:34.807639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:34.808112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:34.808559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:34.939566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:34.948031 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c8b86f99-90d7-4605-bfcd-7bd81e54acbb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.154264 Sep 27 02:34:34.948593 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3612/7269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:34 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:35.971299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:35.971924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:35.979208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:35.979701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:35.980139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:35.980834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:35.981286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:35.981767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:36.113754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:36.121799 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dd7927cd-2edb-40a7-8d3e-6eee40c93e5a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.154384 Sep 27 02:34:36.122391 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3658/7270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:35 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:37.144170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:37.144801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:37.151731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:37.152232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:37.152682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:37.153412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:37.153885 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:37.154328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:37.289727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:37.297516 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3178c2a9-9249-462d-a74f-995113cdba36 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.157314 Sep 27 02:34:37.298126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3613/7271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:37 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:38.320964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:38.321631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:38.328473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:38.328958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:38.329422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:38.330118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:38.330579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:38.331010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:38.464375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:38.472614 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07efe2cb-0a4c-4a13-9f6d-27aae47dd071 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.155619 Sep 27 02:34:38.473179 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3659/7272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:38 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:39.496470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:39.497101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:39.504264 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:39.504765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:39.505217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:39.505954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:39.506423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:39.506867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:39.633853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:39.641926 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b9518e8-1173-48a1-8131-10c75fa8951d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.149580 Sep 27 02:34:39.642509 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3614/7273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:39 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:40.665069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:40.665708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:40.672554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:40.673031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:40.673498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:40.674188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:40.674641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:40.675064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:40.804228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:40.812521 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-23e27ea7-c20a-4124-b12b-507ec1a7c918 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.151322 Sep 27 02:34:40.813122 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3660/7274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:40 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:41.836196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:41.836767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:41.843660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:41.844134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:41.844578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:41.845273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:41.845784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:41.846246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:41.979597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:41.987855 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1ba9f71c-e172-4791-99d0-a56baf31bc17 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.155674 Sep 27 02:34:41.988428 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3615/7275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:41 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:43.011647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:43.012262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:43.019680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:43.020160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:43.020594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:43.021285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:43.021764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:43.022193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:43.153772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:43.161894 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9540e33-b03b-4dd1-a600-d55edd54b8f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.154138 Sep 27 02:34:43.162462 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3661/7276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:43 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:44.187886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:44.188519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:44.195536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:44.196038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:44.196494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:44.197209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:44.197717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:44.198162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:44.334564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:44.342423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-675a8e05-8f39-4da9-86a9-d9c1127a552e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.160000 Sep 27 02:34:44.342997 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3616/7277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:44 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:45.366385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:45.367011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:45.373903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.374391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.374832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.375530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.375991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.376699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.503710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:45.511525 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff6a04c0-22a9-471f-843f-58dcf3ed9075 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1655 microversion: 2.1 time: 0.149780 Sep 27 02:34:45.512097 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3662/7278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:45 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:45.535093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:45.537408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:45.544165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.544652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.545099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.545824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.546289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.546744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.628367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:45.633739 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Old instance type m1.heat2, new instance type m1.heat {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:34:45.640204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:34:45.640634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:34:45.641119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:34:45.641570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:34:45.641993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:34:45.748775 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60e4b9fc-6bc7-47ed-8eb1-c764da423a37 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action" status: 202 len: 0 microversion: 2.1 time: 0.218394 Sep 27 02:34:45.749427 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3617/7279] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:34:45 2022] POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:34:45.757744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:45.758352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:45.764351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.764838 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.765278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.766015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:45.766477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:45.766908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:45.908682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:45.916908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5cf8a730-df3b-44f8-a811-c62623439ebf tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.163207 Sep 27 02:34:45.917993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3663/7280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:45 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:46.940155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:46.940790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:46.948482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:46.948978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:46.949448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:46.950156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:46.950641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:46.951077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:47.086545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:47.094628 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a3b9ec27-16a3-4e2b-907c-6083638842b7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1678 microversion: 2.1 time: 0.158458 Sep 27 02:34:47.095209 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3618/7281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:46 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:48.118822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:48.119392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:48.126202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:48.126685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:48.127141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:48.127831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:48.128286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:48.128714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:48.268731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:48.276664 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73d98da7-cd60-41b8-85c9-ce1e6a439e0a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1683 microversion: 2.1 time: 0.161822 Sep 27 02:34:48.277227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3664/7282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:48 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:49.300783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:49.301440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:49.308157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:49.308663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:49.309118 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:49.309874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:49.310344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:49.310788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:49.445740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:49.459711 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12c3215b-e774-4118-9960-cc44ea572d8d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1683 microversion: 2.1 time: 0.157636 Sep 27 02:34:49.459711 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3619/7283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:49 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:49.908892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:49.920820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:49.921403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:49.921898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:49.935055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Creating event network-vif-unplugged:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h2-859358-1 Sep 27 02:34:49.940847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:34:49.952006 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-05e0fade-0acb-4569-9c1f-bd5ce398b7e9 req-f71d26a4-db44-4750-ad8e-5837acf141bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047657 Sep 27 02:34:49.952628 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3665/7284] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:34:50.480400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:50.481069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:50.489274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:50.489816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:50.490625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:50.491253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:50.491722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:50.492159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:50.714992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:50.723202 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83ec3687-2dfe-4453-a69a-ff09cd1b305b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1682 microversion: 2.1 time: 0.246810 Sep 27 02:34:50.723773 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3620/7285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:50 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:51.748048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:51.748688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:51.755573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:51.756062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:51.756505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:51.757204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:51.757707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:51.758143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:51.891702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:51.902807 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c5f274c0-1d1a-4d69-95a7-45765db1c796 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1680 microversion: 2.1 time: 0.160178 Sep 27 02:34:51.903398 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3666/7286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:51 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:51.987485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:51.997928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:51.998470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:51.998871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:52.010640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Creating event network-changed:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h2-859358-1 Sep 27 02:34:52.015972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:34:52.026934 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-5e138f57-0bba-4046-b040-74714d469b3d req-8fdd1e4e-477d-46f3-9397-b81353e5973d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043734 Sep 27 02:34:52.027537 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3621/7287] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:34:52.927879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:52.928493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:52.935754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:52.936241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:52.936680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:52.937407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:52.937891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:52.938323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:53.133356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:53.141044 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-372b695a-fa5e-4f61-a09b-7ae86a678c32 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1680 microversion: 2.1 time: 0.217645 Sep 27 02:34:53.141647 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3667/7288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:52 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:54.165728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:54.167348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:54.174300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.175116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.175675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.176668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.177155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.177641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.581275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:54.590210 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e3d0724e-52d9-4e82-b080-b5c004b21c1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1676 microversion: 2.1 time: 0.429831 Sep 27 02:34:54.594970 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3622/7289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:54 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1676 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:54.618509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:54.619935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:54.628305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.628807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.629252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.629996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.630461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.630898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.690315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef8408fc-ec92-45fd-8e33-6c533b362b80 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action" status: 204 len: 0 microversion: 2.1 time: 0.076077 Sep 27 02:34:54.690966 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3668/7290] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:34:54 2022] POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:34:54.699243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:54.699878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:54.706879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.707759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.708384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.709448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:54.710168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:54.710531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:54.731036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:54.785115 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:34:54.785574 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:34:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae (ip 10.222.0.52) !!! Sep 27 02:34:54.930628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:54.939292 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5a8a0ec-3cc4-44b0-97ae-23c84db68d99 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1676 microversion: 2.1 time: 0.243805 Sep 27 02:34:54.940455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3623/7291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:54 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:55.960330 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:34:55.960870 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:34:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae (ip 10.222.0.52) !!! Sep 27 02:34:55.966413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:55.967131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:55.975574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:55.976060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:55.976500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:55.977199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:55.977699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:55.978169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.107202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:56.115544 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-072af7bd-f289-407b-8933-be5f015617ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1655 microversion: 2.1 time: 0.156622 Sep 27 02:34:56.116120 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3669/7292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:55 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:56.138127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:56.138752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:56.145533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.146029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.146476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.147182 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.147648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.148089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.281518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:56.290181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "name": "network-vif-plugged", "status": "completed", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:56.290423 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6248fe5-58e8-49fd-982c-9feb7f790b28 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1655 microversion: 2.1 time: 0.156029 Sep 27 02:34:56.290923 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3624/7293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:56 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:56.301944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.302523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.303066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.315824 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] Creating event network-vif-plugged:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h2-859358-1 Sep 27 02:34:56.319607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:34:56.321134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-dc776b75-79df-4bf1-8031-b98ed57263fc req-84b1a7ff-d309-4cb5-a4ac-24e312a12ac1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035592 Sep 27 02:34:56.321772 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3670/7294] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:34:56.326787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.327356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.327871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.354111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Going to try to start instance {{(pid=128778) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 02:34:56.407277 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-48af7893-d955-42f6-a04a-44aea8470f29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action" status: 202 len: 0 microversion: 2.1 time: 0.093937 Sep 27 02:34:56.407984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3625/7295] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:34:56 2022] POST /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:34:56.416811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:56.417554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:56.424132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.424701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.425140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.425921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:56.426360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:56.426785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:56.446417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:56.570718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:56.578715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3456a55c-b1eb-4d32-9b79-8bc90bfc9d34 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1664 microversion: 2.1 time: 0.166166 Sep 27 02:34:56.579334 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3671/7296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:56 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:34:57.603979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:57.604697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:57.610814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.611798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.612245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:57.612941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.613436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.613879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:57.752522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:57.760363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fd563fa-c135-4dba-a75a-bab4aeb1efcc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1668 microversion: 2.1 time: 0.161547 Sep 27 02:34:57.760941 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3626/7297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:57 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:34:57.783449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:57.784011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:57.790696 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.791377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.791817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:57.792521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.792978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.793426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:57.821206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:34:57.897034 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d4cb7527-8461-4df2-a5b1-a4efdcdd61c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 204 len: 0 microversion: 2.1 time: 0.117889 Sep 27 02:34:57.897734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3672/7298] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:34:57 2022] DELETE /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:34:57.908935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:57.909688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:57.919277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.919789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.920235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:57.921094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:57.922085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:57.922591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:58.053226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:58.061263 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8e4ea43-31a2-4474-8a62-aaab501317a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1674 microversion: 2.1 time: 0.157986 Sep 27 02:34:58.061875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3627/7299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:57 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:34:59.085269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:34:59.086018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:34:59.088812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:34:59.094106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:59.094595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:59.095037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:59.095735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:34:59.096194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:34:59.096633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:34:59.224204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:34:59.232066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d0ca2b3-3e53-4105-84eb-e4c36bffcd33 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1674 microversion: 2.1 time: 0.151093 Sep 27 02:34:59.232692 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3673/7300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:34:59 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:00.257689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:00.258448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:00.264087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=43 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:35:00.266301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:00.268421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:00.269013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:00.269971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:00.270563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:00.271147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:00.367259 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:00.375322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-44c8c339-0889-45c4-a495-b2e475fb9841 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 200 len: 1606 microversion: 2.1 time: 0.124019 Sep 27 02:35:00.376048 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3628/7301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:00 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:00.451747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed288ae-6af6-43ca-8bdb-42f25a4325ae", "name": "network-vif-deleted", "tag": "7cd9af8c-3f47-4d2a-8dc3-090e89011a53"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:35:00.467852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:00.468572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:00.469011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:00.480719 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] Creating event network-vif-deleted:7cd9af8c-3f47-4d2a-8dc3-090e89011a53 for instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae on n-h2-859358-1 Sep 27 02:35:00.487046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-689de0ad-0c76-4831-9053-d8e07f60cb79 req-a80ac1b2-3d0f-4691-9238-0be412b8f204 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039074 Sep 27 02:35:00.487657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3674/7302] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:35:01.400111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:01.400737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:01.407498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:01.408574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:01.409028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:01.409775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:01.410241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:01.410683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:01.424718 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae HTTP/1.1 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '6ed288ae-6af6-43ca-8bdb-42f25a4325ae'} Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:35:01.426466 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4c21968f-631c-4da5-a02d-4a580fcfaa57 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 404 len: 111 microversion: 2.1 time: 0.032132 Sep 27 02:35:01.431049 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3629/7303] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:01 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:35:01.443314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:01.444031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:01.450535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:01.451059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:01.451489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:01.452230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:01.452807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:01.453288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:01.468752 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae HTTP/1.1 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6ed288ae-6af6-43ca-8bdb-42f25a4325ae'} Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:35:01.471180 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4336d84-55fd-4351-94ab-f236e319deb4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 404 len: 111 microversion: 2.1 time: 0.034040 Sep 27 02:35:01.475773 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3675/7304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:01 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:35:01.520805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1981338453", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f"}], "security_groups": [{"name": "tempest-securitygroup--1473647238"}], "key_name": "tempest-keypair-990269760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:35:01.623676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] validate_networks() for [('742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:35:01.995317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:35:01.995822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:35:01.996313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:35:01.996737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:35:01.997187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:35:02.006170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:02.006667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:02.007115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:02.007858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:02.008325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:02.008765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:02.025816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:35:02.031104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:35:02.044234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:35:02.046593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:35:02.092572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-841577d5-8327-4cda-aa84-37a32f5f7d4d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.576113 Sep 27 02:35:02.093211 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3630/7305] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:35:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:35:02.105074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9003533-7197-4b04-99f7-3701dfc7d8f9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:02.105723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9003533-7197-4b04-99f7-3701dfc7d8f9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:02.164531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c9003533-7197-4b04-99f7-3701dfc7d8f9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:02.171721 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9003533-7197-4b04-99f7-3701dfc7d8f9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1238 microversion: 2.1 time: 0.070565 Sep 27 02:35:02.172293 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3676/7306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:02 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:35:03.195840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:03.197847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:03.207388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:03.208027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:03.208585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:03.209438 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:03.210012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:03.210714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:03.309969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:03.318613 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d876c60e-4dfc-40fd-ad4a-71da58ecc7fa tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1308 microversion: 2.1 time: 0.127220 Sep 27 02:35:03.319258 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3631/7307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:03 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:04.342289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:04.342900 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:04.351012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:04.351506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:04.352005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:04.352724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:04.353190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:04.353660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:04.484140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:04.492531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fedc528-3fa6-47ef-8f84-4c0763f77acb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.154369 Sep 27 02:35:04.493038 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3677/7308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:04 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:04.829866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:35:04.841036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:04.841668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:04.842185 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:04.853986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] Creating event network-changed:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:35:04.859345 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-4c45c007-7c2c-4fbf-a791-6f9b8871e1a2 req-79e58278-2cf5-43c4-87a3-b71d7cecdc87 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033433 Sep 27 02:35:04.860371 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3632/7309] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:35:05.517663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:05.518300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:05.525174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:05.525699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:05.526140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:05.526840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:05.527299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:05.527735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:05.655071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:05.662896 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0a84866-62bc-4365-a796-9ed3e618f6f5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.149883 Sep 27 02:35:05.663467 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3678/7310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:05 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:06.687962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:06.688722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:06.695045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:06.695547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:06.695998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:06.696702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:06.697180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:06.697646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:06.835722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:06.843529 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e6dbaef-e0da-4979-8a39-a49d2d38bf39 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.160690 Sep 27 02:35:06.844103 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3633/7311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:06 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:07.867458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:07.868109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:07.875153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:07.875648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:07.876088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:07.877287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:07.877780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:07.878210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:08.015174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:08.022778 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-370579ac-a95a-4797-9f7e-b1421ce6d664 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.159259 Sep 27 02:35:08.023368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3679/7312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:07 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:09.045875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:09.046535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:09.053196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:09.053722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:09.054440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:09.055409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:09.055880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:09.056323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:09.182999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:09.191813 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf0d1d9a-1450-4cb2-a32f-f1b170cf760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.149896 Sep 27 02:35:09.192392 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3634/7313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:09 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:10.216999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:10.217667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:10.225010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:10.225528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:10.225977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:10.226676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:10.227130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:10.227553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:10.357399 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:10.365651 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-08379a91-3dd4-4ebb-b5e6-df54168dc9e7 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.153878 Sep 27 02:35:10.366171 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3680/7314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:10 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:11.388141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:11.388846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:11.395633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:11.396130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:11.396578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:11.397283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:11.397819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:11.398261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:11.528198 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:11.536553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d12ba186-a995-49a9-8ed7-e2c6272c6f55 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.152427 Sep 27 02:35:11.537132 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3635/7315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:11 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:12.387048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "name": "network-vif-plugged", "status": "completed", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:35:12.393572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:35:12.401534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:12.401534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:12.401534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:12.413875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] Creating event network-vif-plugged:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:35:12.420131 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8812c28e-3234-4def-b4f0-dab9a26f7438 req-07e76c79-1005-4a05-a9fe-375703dbe3b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Sep 27 02:35:12.421079 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3681/7316] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:35:12.561119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:12.561786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:12.564483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:35:12.565236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:35:12.572589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:12.573094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:12.573576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:12.574297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:12.574768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:12.575212 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:12.702507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:12.710226 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d26c9544-e37a-4c21-ac27-4c78511a5787 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.153069 Sep 27 02:35:12.710801 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3636/7317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:12 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:13.735279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:13.736004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:13.742179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:13.742661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:13.743100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:13.743791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:13.744241 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:13.744671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:13.875664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:13.884212 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff244eb7-38ee-4835-8643-685fa6d91092 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1364 microversion: 2.1 time: 0.153608 Sep 27 02:35:13.884673 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3682/7318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:13 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:14.908663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:14.909995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:14.916904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:14.917694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:14.918139 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:14.918843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:14.919317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:14.919756 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:15.049586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:35:15.057640 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7f0e07e3-1b08-4df5-94fd-1bcd9ca601b4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1551 microversion: 2.1 time: 0.152895 Sep 27 02:35:15.058195 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3637/7319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:35:14 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:35:15.080672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:35:15.081153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:35:15.088711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:15.089200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:15.089697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:15.090404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:15.090863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:15.091325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:15.168082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8d81678-16ab-449a-86c7-879f392f7077 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091330 Sep 27 02:35:15.168689 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3683/7320] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:35:15 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:35:16.078833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:35:16.089033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:35:16.089564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:35:16.090012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:35:16.101382 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] Creating event network-changed:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:35:16.106543 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-76ff17e7-ea45-4d48-9ede-2a9fd84e380e req-4828d804-ece7-4015-8335-eec201c056d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031369 Sep 27 02:35:16.107208 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3638/7321] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:30.391481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=23 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:30.392247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:30.397044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:30.399315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:30.406913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:30.407402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:30.407846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:30.409178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:30.409661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:30.410096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:30.438725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:30.444118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=128779) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:36:30.450658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:36:30.451083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:36:30.451561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:36:30.451977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:36:30.452398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:36:30.516625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-230a10fc-7327-4c94-ad68-db2dad98f189 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/action" status: 202 len: 0 microversion: 2.1 time: 0.127690 Sep 27 02:36:30.517232 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3684/7322] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:36:30 2022] POST /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:36:30.525140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:30.525927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:30.530895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:30.531632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:30.540695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:30.541439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:30.542238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:30.543202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:30.543908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:30.544367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:30.706345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:30.714331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7029047c-580d-4434-a8f9-0cbac2dd21ca tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1678 microversion: 2.1 time: 0.192137 Sep 27 02:36:30.714894 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3639/7323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:30 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:31.738845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:31.739379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:31.746236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:31.746722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:31.747158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:31.747846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:31.748299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:31.748724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:31.877765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:31.885631 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8fa3ab60-71b3-4fd3-86e2-bba6107d4b02 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1678 microversion: 2.1 time: 0.152177 Sep 27 02:36:31.886213 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3685/7324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:31 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:32.911048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:32.911641 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:32.918465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:32.918962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:32.919406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:32.920108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:32.920573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:32.921009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:33.049774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:33.057715 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-705ae289-7c99-4490-87ea-c5163ab7b82f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.151935 Sep 27 02:36:33.058282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3640/7325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:32 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:34.080739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:34.081398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:34.088145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:34.088630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:34.089073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:34.089798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:34.090261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:34.090693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:34.220559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:34.228318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c46992c-7d27-4ee9-bbe3-2b624b5d760f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.152163 Sep 27 02:36:34.228887 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3686/7326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:34 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:35.251802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:35.252460 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:35.259967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:35.260470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:35.260925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:35.261675 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:35.262153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:35.262603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:35.398120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:35.405938 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8101187a-56c8-498b-bd70-6ccce2d30636 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.158182 Sep 27 02:36:35.406516 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3641/7327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:35 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:36.430257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:36.430903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:36.438369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:36.438852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:36.439328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:36.440646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:36.441105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:36.441570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:36.569526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:36.577249 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b49efb5-6831-4883-98c4-3948d1591101 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.151292 Sep 27 02:36:36.577846 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3687/7328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:36 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:37.599850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:37.600513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:37.606982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:37.607473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:37.607919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:37.608618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:37.609084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:37.609552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:37.742519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:37.750670 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b561b577-8e6d-4328-a6d4-eb6ce6f2c6bc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.155361 Sep 27 02:36:37.751265 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3642/7329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:37 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:38.773029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:38.773679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:38.780403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:38.780882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:38.781318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:38.782024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:38.782480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:38.782906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:38.910504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:38.918376 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6594f8ab-f04d-4855-a333-cf0ec3660e25 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.149323 Sep 27 02:36:38.919178 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3688/7330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:38 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:39.943192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:39.943818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:39.950605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:39.951099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:39.951545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:39.952242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:39.952705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:39.953140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:40.085071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:40.092782 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a1a329da-a45e-4e17-9308-e7efb49594eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.153997 Sep 27 02:36:40.093372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3643/7331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:39 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:41.115454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:41.116079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:41.123312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:41.123802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:41.124240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:41.124935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:41.125431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:41.125867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:41.513848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:41.522374 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2bd09b04-1cbe-4552-b4c1-5511fd4fcc44 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.410838 Sep 27 02:36:41.523174 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3689/7332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:41 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:42.545311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:42.546006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:42.553049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:42.553586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:42.554049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:42.555001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:42.555481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:42.555926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:42.693431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:42.702545 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-535463ec-ff6a-4010-a7b1-d515a99af927 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.161170 Sep 27 02:36:42.703122 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3644/7333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:42 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:43.726970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:43.727525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:43.734443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:43.734929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:43.735373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:43.736679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:43.737148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:43.737605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:43.863738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:43.871769 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74f3113f-307e-4110-906c-436c575cd78f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1683 microversion: 2.1 time: 0.148784 Sep 27 02:36:43.872354 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3690/7334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:43 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:44.894601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:44.895373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:44.902496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:44.903351 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:44.904231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:44.905642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:44.906564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:44.907148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:45.043712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:45.052124 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b06562a-ff47-4a20-8add-50926abe6ab1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1682 microversion: 2.1 time: 0.161445 Sep 27 02:36:45.052713 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3645/7335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:44 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:45.172286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "name": "network-vif-unplugged", "status": "completed", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:45.182839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:45.183330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:45.183770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:45.195490 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Creating event network-vif-unplugged:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h1-859358-1 Sep 27 02:36:45.201110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:36:45.212219 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b4ceadfb-d0ac-4df4-aee1-df9c1ae6e03a req-1ecbe2c6-a59d-43e7-9b91-74ae757026c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100659 Sep 27 02:36:45.213015 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3691/7336] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:46.075823 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:46.076652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:46.083970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:46.084476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:46.084933 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:46.085682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:46.086162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:46.086612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:46.224297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:46.232400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29c3fd66-63fe-49be-a8b3-ae09c5b715d0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1682 microversion: 2.1 time: 0.160529 Sep 27 02:36:46.232985 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3646/7337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:46 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:47.235528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:47.246036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:47.246510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:47.246940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:47.255373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:47.256025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:47.261562 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Creating event network-changed:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h1-859358-1 Sep 27 02:36:47.262822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:47.263328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:47.263780 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:47.264492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:47.264962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:47.265431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:47.266973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:36:47.277523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-9eeaeb64-9ee2-42ea-aa6c-8306e4085045 req-7c6d6466-1afc-4f29-82ca-c2c050981d64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046925 Sep 27 02:36:47.278135 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3692/7338] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:47.486651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:47.495835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ffbaffe4-17d8-4af6-9000-eb45c76d0df0 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1680 microversion: 2.1 time: 0.244248 Sep 27 02:36:47.496457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3647/7339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:47 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:36:48.521348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:48.522108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:48.528299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.528778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.529232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.529951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.530405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.530866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.665777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:48.673760 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5416bfe8-cd88-4ad8-bda7-8c02727c98eb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1677 microversion: 2.1 time: 0.158076 Sep 27 02:36:48.674338 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3693/7340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:48 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:48.698306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:48.699340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:48.706807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.707308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.707755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.708481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.709238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.709454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.750636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.751144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.751584 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.752596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.753621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.754048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.778645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:36:48.783923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:36:48.892310 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-73ad762a-0712-4a52-857f-71d1d83d9c1a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/action" status: 202 len: 0 microversion: 2.1 time: 0.198346 Sep 27 02:36:48.893376 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3648/7341] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:36:48 2022] POST /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:36:48.901866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:48.902596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:48.908987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.909615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.910063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:48.910871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:48.911486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:48.911950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:49.116487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:49.124846 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ee86c70e-152d-4987-87de-ad232bb514d2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.226875 Sep 27 02:36:49.125647 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3694/7342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:48 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:50.149785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:50.150510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:50.157199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:50.157732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:50.158186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:50.158981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:50.160428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:50.160904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:50.291025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:50.298915 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0e87b27d-d2db-40c6-8eaa-874361d6d03f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.153660 Sep 27 02:36:50.299493 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3649/7343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:50 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:50.782119 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "name": "network-vif-plugged", "status": "completed", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:50.793950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:50.794458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:50.794922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:50.808144 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Creating event network-vif-plugged:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h1-859358-1 Sep 27 02:36:50.813698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:36:50.825046 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c257d3d7-0505-455f-a4ce-4fa30e0b211b req-5b8559f4-2768-46ce-9ba4-b08d3fddba07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112147 Sep 27 02:36:50.825703 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3695/7344] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:51.321642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:51.322291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:51.329427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:51.330009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:51.330475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:51.332001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:51.332709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:51.333235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:51.475618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:51.487650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2158b572-3c03-4405-96e7-df264e359ff3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.169466 Sep 27 02:36:51.488298 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3650/7345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:51 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:52.096139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "name": "network-vif-unplugged", "status": "completed", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:52.106447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:52.106926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:52.107359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:52.120251 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Creating event network-vif-unplugged:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:36:52.126473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:36:52.140464 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8cf82f1a-e90d-4d88-9b00-d513fb3a887b req-2b94e849-0d61-430c-8989-f2f5ef37200d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103191 Sep 27 02:36:52.141324 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3696/7346] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:52.512190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:52.513141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:52.521622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:52.522346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:52.523028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:52.523764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:52.524242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:52.524698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:52.735260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:52.743737 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1edc1687-d96a-4cd2-b35a-bc04e5b6e444 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.235604 Sep 27 02:36:52.744312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3651/7347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:52 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:53.767857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:53.768589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:53.775591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:53.776067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:53.776501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:53.777191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:53.777670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:53.778094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:53.910506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:53.918332 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5892c2d-3055-4fbb-b662-b95686fc55d3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.155106 Sep 27 02:36:53.918920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3697/7348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:53 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:54.155785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:36:54.166975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:54.167462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:54.167902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:54.180159 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Creating event network-changed:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:36:54.182605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:54.186620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:36:54.198164 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8a87b4c5-4753-4c9e-b68a-4f770b22efec req-999f4da2-dc2e-45f8-9f8e-368b60151726 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046101 Sep 27 02:36:54.198796 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3652/7349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:36:54.943005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:54.943633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:54.950677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:54.951168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:54.951612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:54.952311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:54.952774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:54.953208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:55.085823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:55.093555 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d00a73e2-0ef6-4e7a-9eae-b7ad87bf3b6b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.154515 Sep 27 02:36:55.094137 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3698/7350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:54 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:56.118387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:56.119133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:56.126647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:56.127176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:56.127626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:56.128333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:56.128804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:56.129249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:56.263939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:56.272314 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a901f743-ee09-416d-a7b1-340b33c8954d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1676 microversion: 2.1 time: 0.158851 Sep 27 02:36:56.272888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3653/7351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:56 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:57.294754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:57.295398 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:57.302688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.303184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.303628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.304310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.304762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.305484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.433575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:57.441265 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-28eacff8-0859-4407-8d0c-5b7ba3f5e331 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1669 microversion: 2.1 time: 0.150545 Sep 27 02:36:57.441863 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3699/7352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:57 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:36:57.465266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:57.465946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:57.473383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.473883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.474335 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.475035 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.475500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.475941 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.605845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:57.613506 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86c02308-7c5f-43e5-afef-53659338d6dd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1669 microversion: 2.1 time: 0.152068 Sep 27 02:36:57.614090 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3654/7353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:57 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:57.635242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:57.635861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:57.641983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.642470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.642909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.644094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.644553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.644980 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.666234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:57.780972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:57.789052 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c74e001-85cd-4809-8977-639e3ef672c6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1669 microversion: 2.1 time: 0.157516 Sep 27 02:36:57.789434 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3700/7354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:57 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:57.811122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:57.811625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:57.818143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.818638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.819081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.819786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.820266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.820690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.845934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:36:57.926948 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a5329938-dd94-4df1-9922-39ec2f117c23 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 204 len: 0 microversion: 2.1 time: 0.118934 Sep 27 02:36:57.927611 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3655/7355] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:36:57 2022] DELETE /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:36:57.938013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:57.938625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:57.945511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.945995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.946426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:57.947311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:57.947768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:57.948195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:58.077652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:58.085542 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1ddfd4fd-fcd1-488d-99f5-15173dbf404f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1675 microversion: 2.1 time: 0.152655 Sep 27 02:36:58.086118 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3701/7356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:57 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:36:59.108631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:36:59.109374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:36:59.112622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:36:59.118078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:59.118579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:59.119031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:59.119741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:36:59.120208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:36:59.120654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:36:59.255681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:36:59.263859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04a52e09-91d3-4a99-b40d-812a320f52b8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1675 microversion: 2.1 time: 0.159497 Sep 27 02:36:59.264461 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3656/7357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:36:59 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:00.259787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa51f81-e6e0-4af1-921c-03b1a31589cc", "name": "network-vif-deleted", "tag": "51f95c0f-2c9b-416b-83d7-6f2df7bf2403"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:37:00.270589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:00.271071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:00.271512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:00.284176 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] Creating event network-vif-deleted:51f95c0f-2c9b-416b-83d7-6f2df7bf2403 for instance aaa51f81-e6e0-4af1-921c-03b1a31589cc on n-h2-859358-1 Sep 27 02:37:00.289735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-64a4295b-5b38-4bbf-a5f1-8d4420066ff0 req-1fd0a421-3b67-45ac-a7ea-d9405c10dd81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035129 Sep 27 02:37:00.290507 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3702/7358] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:37:00.290835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:00.292577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:00.300992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:00.301515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:00.301965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:00.302811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:00.303300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:00.303728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:00.378062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:00.386148 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-329eea9e-46c4-436a-96d2-526c028088df tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 200 len: 1323 microversion: 2.1 time: 0.103124 Sep 27 02:37:00.386732 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3657/7359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:00 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:37:01.411520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:01.412232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:01.414188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=43 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:37:01.419676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:01.420158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:01.420628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:01.421321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:01.421803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:01.422232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:01.436505 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc HTTP/1.1 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'aaa51f81-e6e0-4af1-921c-03b1a31589cc'} Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:37:01.438166 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2eeabe2f-bf6a-454c-955b-6a1341edb017 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 404 len: 111 microversion: 2.1 time: 0.033692 Sep 27 02:37:01.442711 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3703/7360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:01 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:37:01.455741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:01.456589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:01.462670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:37:01.465546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:01.466055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:01.466535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:01.467251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:01.467749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:01.468218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:01.483446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc HTTP/1.1 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aaa51f81-e6e0-4af1-921c-03b1a31589cc'} Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:37:01.485192 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c7b97ae-ffaa-4305-a03f-1138d718672b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 404 len: 111 microversion: 2.1 time: 0.035013 Sep 27 02:37:01.490326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3658/7361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:01 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:37:01.535873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1332954850", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f"}], "security_groups": [{"name": "tempest-securitygroup--1473647238"}], "key_name": "tempest-keypair-990269760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:37:01.638536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] validate_networks() for [('742e8ef8-1ae8-4f5b-9dd8-9e22c7af7f9f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:37:02.005724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:37:02.006179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:37:02.006708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:37:02.007139 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:37:02.007564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:37:02.016224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:02.016705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:02.017145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:02.018408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:02.018863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:02.019293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:02.037266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:37:02.042568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:37:02.055046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:37:02.057409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:37:02.105163 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7dc9f705-c6fe-411a-a0c7-19c66ee3befb tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.573630 Sep 27 02:37:02.105848 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3704/7362] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:37:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:37:02.117160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dee600e5-387c-47b9-a900-526e124a1c48 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:02.117844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dee600e5-387c-47b9-a900-526e124a1c48 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:02.172056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dee600e5-387c-47b9-a900-526e124a1c48 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:02.178981 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dee600e5-387c-47b9-a900-526e124a1c48 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1238 microversion: 2.1 time: 0.065686 Sep 27 02:37:02.179544 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3659/7363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:02 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:03.203529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:03.204150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:03.211466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:03.211964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:03.212426 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:03.213127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:03.213678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:03.214107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:03.296206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:03.304593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-20df12a8-d3f4-4768-84f2-a54e84a1fa07 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1298 microversion: 2.1 time: 0.105842 Sep 27 02:37:03.305820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3705/7364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:03 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:04.328709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:04.329388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:04.337150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:04.337617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:04.338062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:04.338774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:04.339265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:04.339703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:04.566296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:04.574387 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f9c8994-eec8-49fd-bcdf-19c5e0e5f492 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.249584 Sep 27 02:37:04.589629 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3660/7365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:04 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:04.751552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:37:04.763538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:04.764109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:04.764815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:04.776421 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] Creating event network-changed:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:37:04.781188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aec7947c-c588-4bc8-91e0-429bcb1e55cb req-48cd295e-f88c-4c17-93c9-8659681b2a70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033495 Sep 27 02:37:04.782001 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3706/7366] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:37:05.598810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:05.599445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:05.606288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:05.606790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:05.607248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:05.607968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:05.608447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:05.608890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:05.735432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:05.743319 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c5c9fae6-9e89-4206-92b9-2c25107a5bdc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.149105 Sep 27 02:37:05.743891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3661/7367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:05 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:06.767940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:06.768612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:06.774810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:06.775296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:06.775735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:06.776425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:06.776882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:06.777312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:06.917372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:06.925950 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-638cd09c-be8e-4d62-baf3-2605df90d17b tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.163187 Sep 27 02:37:06.926537 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3707/7368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:06 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:07.949810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:07.950425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:07.957618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:07.958120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:07.958568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:07.959278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:07.959743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:07.960179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:08.171856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:08.179750 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b633df0-5c77-4157-b5a2-da3f45323478 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.234023 Sep 27 02:37:08.180778 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3662/7369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:07 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:09.203492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:09.204112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:09.211045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:09.211532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:09.211971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:09.212666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:09.213124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:09.213584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:09.342735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:09.351322 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a7a5191-8c20-4551-a032-2a8f700006a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.151791 Sep 27 02:37:09.351985 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3708/7370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:09 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:10.374796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:10.375494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:10.384949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:10.385471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:10.385920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:10.386633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:10.387099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:10.387535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:10.521202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:10.528957 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9e29167-517c-43d1-8bf2-d7055027e081 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.158087 Sep 27 02:37:10.529566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3663/7371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:10 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:10.943385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-plugged", "status": "completed", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:37:10.955720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:10.956211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:10.956837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:10.971632 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] Creating event network-vif-plugged:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:37:10.976922 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-3149bde8-ec08-4eee-9169-e007a1628f1f req-e235b620-3f95-465e-9f42-ec669cc1004f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037022 Sep 27 02:37:10.977271 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3709/7372] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:37:11.552877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:11.553537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:11.560813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:11.561315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:11.561790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:11.562493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:11.562963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:11.563401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:11.694403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:11.702236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efe01fe0-5213-4a10-875c-19adeae2907a tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1364 microversion: 2.1 time: 0.153777 Sep 27 02:37:11.702810 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3664/7373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:11 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:37:12.725642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:12.726359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:12.729142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:37:12.729837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:37:12.736181 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:12.736671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:12.737112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:12.737850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:12.738311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:12.738746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:13.127569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:37:13.135350 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4203c4e8-bddf-455f-a963-0a2e964b1d29 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1551 microversion: 2.1 time: 0.414037 Sep 27 02:37:13.135926 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3710/7374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:37:12 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1551 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:37:13.157999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:37:13.158550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:37:13.160428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:37:13.166648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:13.167146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:13.167598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:13.168298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:13.168764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:13.169202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:13.245414 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d7b88f7a-bc3a-484e-a6b9-6d131d6b314e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091296 Sep 27 02:37:13.246065 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3665/7375] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:37:13 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:37:14.480730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:37:14.491000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:37:14.491477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:37:14.491907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:37:14.503315 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] Creating event network-changed:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:37:14.508144 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8bab89d2-631a-4ff0-841c-0ef8707b1c4a req-49a7f914-16f4-490a-a77b-bd6329a0ddea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031224 Sep 27 02:37:14.508753 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3711/7376] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:38:28.027421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=17 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:28.028479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:28.029711 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:38:28.029889 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 (ip 10.222.0.52) !!! Sep 27 02:38:28.031144 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:38:28.031285 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 (ip 10.222.0.52) !!! Sep 27 02:38:28.037752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:28.038388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:28.049610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:28.050660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:28.051120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:28.051838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:28.052311 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:28.052758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:28.179613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:28.187648 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23406221-57d3-46bb-9b7c-1a94eff93d66 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1669 microversion: 2.1 time: 0.162748 Sep 27 02:38:28.188220 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3666/7377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:28 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:28.210093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:28.210855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=44 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:28.212330 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:38:28.212491 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments (ip 10.222.0.52) !!! Sep 27 02:38:28.224764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0849b18-c0a7-4794-a2d8-2ba5c9b14455"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:38:28.227244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:28.234709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:28.235196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:28.235633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:28.236332 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:28.236789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:28.237828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:28.492787 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4ccee49-bc63-48a8-a9a0-05e9cf7ab3dc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285756 Sep 27 02:38:28.498897 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3712/7378] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:38:28 2022] POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:38:39.205303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:38:39.208176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:39.210786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:39.211458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:39.217493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:39.217995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:39.218451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:39.219186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:39.219656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:39.220104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:39.248714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:39.255437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Old instance type m1.heat2, new instance type m1.heat {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:38:39.265143 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:38:39.265622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:38:39.266108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:38:39.266536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:38:39.266969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:38:39.332580 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33a070d7-84f5-4441-9703-285e8bfbfee8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/action" status: 202 len: 0 microversion: 2.1 time: 0.131159 Sep 27 02:38:39.333191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3667/7379] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:38:39 2022] POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:38:39.339581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:39.340436 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:38:39.344491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:39.345218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:39.352660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:39.353151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:39.353621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:39.354320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:39.354782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:39.355210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:39.493517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:39.504197 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3d7b74e8-3753-42e3-9b0c-1639d41519f3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1724 microversion: 2.1 time: 0.166439 Sep 27 02:38:39.504787 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3713/7380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:39 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:40.528953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:40.529547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:40.537268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:40.537819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:40.538274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:40.539192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:40.539803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:40.540216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:40.762836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:40.771420 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d30720b3-b184-4e55-849e-b2a3e01e7e62 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1724 microversion: 2.1 time: 0.247357 Sep 27 02:38:40.772019 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3668/7381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:40 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:41.794660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:41.795204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:41.802558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:41.803052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:41.803488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:41.804187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:41.804642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:41.805363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:41.932826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:41.941259 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-51722118-d0bd-46d3-b36f-2a93a559aed8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.150643 Sep 27 02:38:41.941864 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3714/7382] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:41 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:42.964562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:42.965226 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:42.972037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:42.972518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:42.972973 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:42.973704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:42.974170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:42.974607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:43.102012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:43.110230 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28f04c6b-0cc2-48ad-90f3-3e78b3c6bfb9 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.149594 Sep 27 02:38:43.110800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3669/7383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:42 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:44.134582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:44.135230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:44.142101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:44.142585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:44.143019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:44.143712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:44.144168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:44.145212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:44.274800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:44.283053 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-17427aba-bd09-43b6-a8f7-c1f87cf2ae7e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.152423 Sep 27 02:38:44.283638 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3715/7384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:44 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:45.306630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:45.307261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:45.314151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:45.314649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:45.315106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:45.315817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:45.316289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:45.316731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:45.447203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:45.455486 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71325982-11d5-4113-bac0-9c6bf71d287d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.153131 Sep 27 02:38:45.456064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3670/7385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:45 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:46.479620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:46.480237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:46.487025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:46.487506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:46.487944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:46.489292 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:46.489766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:46.490243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:46.620789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:46.629060 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7b7dff0-c036-4c37-87e4-c078afe274b1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.153370 Sep 27 02:38:46.629658 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3716/7386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:46 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:47.652639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:47.653269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:47.660078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:47.660582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:47.661094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:47.661826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:47.662295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:47.662735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:47.801997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:47.810557 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ca11b0be-0331-40b0-84f5-ab6addc3a0c1 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.162139 Sep 27 02:38:47.811128 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3671/7387] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:47 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:48.835032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:48.835673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:48.842542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:48.843031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:48.843474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:48.844205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:48.844669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:48.845108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:48.978135 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:48.986358 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac41397f-2fe1-46ef-998a-2873f6876b7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.155879 Sep 27 02:38:48.986930 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3717/7388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:48 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:50.011835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:50.012483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:50.021132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:50.021666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:50.022126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:50.022848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:50.023332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:50.023785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:50.156513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:50.165247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1fa9da12-ab03-4bcf-9b3a-b9338ee5abac tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.158869 Sep 27 02:38:50.165857 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3672/7389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:50 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:51.189656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:51.190273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:51.197636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:51.198118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:51.198554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:51.199249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:51.199707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:51.200131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:51.334425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:51.342797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7b06a7e0-e9d9-474a-9264-b8ca1912d7c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.157177 Sep 27 02:38:51.343371 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3718/7390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:51 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:52.366585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:52.367213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:52.374095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:52.374593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:52.375055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:52.375760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:52.376228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:52.376701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:52.509396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:52.517736 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d958c339-08a4-451a-b68d-88e43a3d5584 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.155703 Sep 27 02:38:52.518310 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3673/7391] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:52 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:53.540811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:53.541459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:53.548297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:53.548781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:53.549224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:53.549963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:53.550420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:53.550923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:53.697425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:53.706650 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-388b64af-1c97-4cb5-9d8c-5d5994f1725e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.169255 Sep 27 02:38:53.709671 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3719/7392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:53 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:54.731606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:54.732312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:54.744002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:54.744512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:54.744971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:54.745732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:54.746213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:54.746662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:54.879922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:54.888350 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb24b50a-eb4c-4516-84f4-ad6afeec7e9d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1729 microversion: 2.1 time: 0.161823 Sep 27 02:38:54.888928 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3674/7393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:54 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:55.913134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:55.914102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:55.921279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:55.921803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:55.922250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:55.922958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:55.923418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:55.923881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:56.021748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-unplugged", "status": "completed", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:38:56.032322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:56.032871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:56.033288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:56.046894 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Creating event network-vif-unplugged:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h1-859358-1 Sep 27 02:38:56.053170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:38:56.064483 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-09c5ce8d-589a-4519-9245-3f25a326deec req-8045e525-2a73-4d49-916f-ccd76ee26de6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047177 Sep 27 02:38:56.065405 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3675/7394] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:38:56.170927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:56.179335 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-60c81ef1-35ea-469c-b235-ac1355a25f11 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1728 microversion: 2.1 time: 0.270776 Sep 27 02:38:56.179931 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3720/7395] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:55 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1728 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:57.209960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:57.210689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:57.217098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:57.217642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:57.218093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:57.218821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:57.219294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:57.219746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:57.358078 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:57.367569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4cdd3b83-2295-4410-99cb-5309b7e5c4db tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.163235 Sep 27 02:38:57.368472 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3676/7396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:57 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:58.082270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:38:58.092739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:58.093304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:58.093836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:58.106099 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Creating event network-changed:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h1-859358-1 Sep 27 02:38:58.112005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:38:58.123882 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7e222606-6178-40f8-9505-bc7e84538501 req-095d8a6a-fe8b-4fa6-a7c0-4ba5e0177a90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045373 Sep 27 02:38:58.124700 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3721/7397] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:38:58.391496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:58.392136 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:58.406129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:58.406680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:58.407142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:58.407877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:58.408355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:58.408805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:58.618612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:58.630922 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6df748eb-31e4-4926-ac68-f76ed78804ba tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.243212 Sep 27 02:38:58.634961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3677/7398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:58 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:38:59.655984 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:38:59.656700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:38:59.663064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:59.663471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:59.663912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:59.664640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:38:59.665098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:38:59.665557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:38:59.800066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:38:59.809385 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ed695b1-12a3-4f39-8d0e-268991325dfc tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.158517 Sep 27 02:38:59.809984 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3722/7399] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:38:59 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:00.832282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:00.833563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:00.841124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:00.841662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:00.842135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:00.842864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:00.843500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:00.843958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:00.982356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:00.991353 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-05f8ff97-649a-48f2-9509-fea0afa38da5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.163110 Sep 27 02:39:00.992013 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3678/7400] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:00 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:02.014647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:02.015168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:02.022623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:02.023107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:02.023539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:02.024225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:02.024679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:02.025103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:02.163004 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:02.171351 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13c44189-138c-46d6-8f59-c4e2ea0c68f6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.160750 Sep 27 02:39:02.171937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3723/7401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:02 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:03.194875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:03.195526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:03.202446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:03.202953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:03.203410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:03.204129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:03.204604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:03.205052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:03.335048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:03.343808 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cfb11319-231b-4749-bc2e-726b9eec4b1c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.152906 Sep 27 02:39:03.344387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3679/7402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:03 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:04.368207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:04.368826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:04.375677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:04.376159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:04.376601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:04.377288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:04.377764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:04.378218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:04.505621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:04.513928 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5b7bfe1-9a51-4486-a846-bf688cce6f56 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.150270 Sep 27 02:39:04.514499 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3724/7403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:04 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:05.537835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:05.538470 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:05.545393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:05.545898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:05.546356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:05.547067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:05.547538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:05.547984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:05.687802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:05.696140 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b08edb97-59d2-4f48-aa02-8270a8f135ce tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.162939 Sep 27 02:39:05.696718 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3680/7404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:05 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:06.719905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:06.720458 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:06.727775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:06.728258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:06.728693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:06.729405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:06.729861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:06.730281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:06.868296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:06.877155 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-463e5b76-fca8-4ccc-be27-68f0dbf8513e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.161185 Sep 27 02:39:06.877761 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3725/7405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:06 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:07.900942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:07.901602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:07.908140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:07.908642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:07.909093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:07.909844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:07.910321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:07.911338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:08.042407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:08.050887 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5042ef58-876b-4f62-8cbd-a304b0cb8ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.154023 Sep 27 02:39:08.051489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3681/7406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:07 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:09.075495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:09.076020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:09.082934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:09.083414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:09.083846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:09.084533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:09.084988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:09.085447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:09.218312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:09.228572 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c8158eea-6d08-4068-88b9-c66dff149999 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1726 microversion: 2.1 time: 0.157074 Sep 27 02:39:09.229154 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3726/7407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:09 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:10.253640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:10.254377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:10.257765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=35 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:10.263131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.263639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.264097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.264845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.265321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.265794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.270028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:10.419086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:10.429134 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d4200b61-1994-43ad-a1fe-c05bd9f8f318 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1723 microversion: 2.1 time: 0.179203 Sep 27 02:39:10.430448 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3682/7408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:10 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:10.453362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:10.453920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:10.457651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=29 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:10.462813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.463310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.463750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.464462 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.465097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.465391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.470095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=83 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:10.504313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.504716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.505156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.505957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.506370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.506797 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.527414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:39:10.532529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Getting quotas for user 95a03a848dfb48dfa6cf776e9dc649f5 and project 8bb336febf92475ebd6355f271a3eb2d. Resources: {'cores', 'ram'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:39:10.635683 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0e50a5b3-d003-49ba-bb7e-d364ff40f381 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/action" status: 202 len: 0 microversion: 2.1 time: 0.186080 Sep 27 02:39:10.636339 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3727/7409] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:39:10 2022] POST /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:39:10.644432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:10.645395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:10.651650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.652159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.652618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.653386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:10.653948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:10.654481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:10.800266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:10.809011 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed6dcd0a-b7c3-4cfb-8f76-980cc0d429a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.168445 Sep 27 02:39:10.809617 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3683/7410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:10 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:11.832863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:11.833617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:11.840591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:11.841066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:11.841548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:11.842233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:11.842683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:11.843110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:11.977417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:11.985857 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c04e4f11-2840-44f2-a757-548919f190c4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.157433 Sep 27 02:39:11.986437 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3728/7411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:11 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:13.010917 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:13.011557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:13.020719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:13.021219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:13.021699 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:13.022461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:13.022925 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:13.023364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:13.158583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:13.167102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1167f149-7a3e-43f1-9cbf-04436891af35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.160183 Sep 27 02:39:13.167672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3684/7412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:13 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:13.360962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-plugged", "status": "completed", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:13.373212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:13.373827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:13.374422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:13.390715 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Creating event network-vif-plugged:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h1-859358-1 Sep 27 02:39:13.397669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:39:13.412419 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-c42361fd-7480-4cf6-896f-2d6559720631 req-dd104507-ee72-4e92-b2bc-54ed4d250e16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055223 Sep 27 02:39:13.413425 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3729/7413] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:39:14.191069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:14.192205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:14.199276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:14.199786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:14.200241 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:14.200960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:14.201461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:14.201916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:14.334690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:14.343236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-70bbb9db-4a69-4c89-8fb8-12a5d62270af tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.156138 Sep 27 02:39:14.343908 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3685/7414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:14 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:15.367820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:15.368565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:15.374731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:15.375278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:15.375721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:15.376418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:15.376875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:15.377303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:15.510324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:15.518847 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d793eab-8f25-4480-90c1-f4ca7e6fc638 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.156752 Sep 27 02:39:15.519428 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3730/7415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:15 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:15.717643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-unplugged", "status": "completed", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:15.729418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:15.729905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:15.730356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:15.743042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Creating event network-vif-unplugged:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:39:15.748418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:39:15.760083 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-c68b5370-278a-4e59-8997-82b585811777 req-a0cb4932-245d-49db-8f59-ea16781a9cc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046335 Sep 27 02:39:15.760708 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3686/7416] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:39:16.542054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:16.542679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:16.549203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:16.549721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:16.550165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:16.550863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:16.551342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:16.551744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:16.685571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:16.695448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c4b3de7f-3683-49b1-b563-01de70c0afd2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.157194 Sep 27 02:39:16.696141 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3731/7417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:16 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:17.719356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:17.720079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:17.727994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:17.728491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:17.728943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:17.729701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:17.730175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:17.730738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:17.804959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:17.816753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:17.817546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:17.817987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:17.830504 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Creating event network-changed:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:39:17.837007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128779) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:39:17.848349 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8b200abb-bd16-4365-be6a-d03c32379cab req-84fc54be-241f-4523-9b35-04da03a7c1e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047040 Sep 27 02:39:17.849206 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3732/7418] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:39:17.878568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:17.898386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-935b4194-c6ef-4ff3-bf26-d3c6b72b7d24 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.183259 Sep 27 02:39:17.923698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3687/7419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:17 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:18.928136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:18.928862 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:18.935757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:18.936251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:18.936693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:18.937441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:18.937903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:18.938338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:19.070936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:19.079493 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2d974db0-cb5b-4f8b-b3e6-6d55abdd0188 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.157208 Sep 27 02:39:19.080083 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3733/7420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:18 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:20.104419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:20.105001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:20.111475 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:20.111967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:20.112412 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:20.113112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:20.113600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:20.114041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:20.246250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:20.255133 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d4183e1-59b1-4f75-8ce4-a9749583f862 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.154912 Sep 27 02:39:20.255705 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3688/7421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:20 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:21.278556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:21.279315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:21.281358 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:21.287382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:21.287903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:21.288345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:21.289075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:21.289561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:21.289994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:21.427588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:21.436250 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cb09638-8f43-404a-95c6-7273cb1e4ce8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.162128 Sep 27 02:39:21.436829 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3734/7422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:21 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:22.460134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:22.460770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:22.467920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:22.468429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:22.468880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:22.469633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:22.470105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:22.470548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:22.601408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:22.609778 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-678dfb74-8a10-4c7b-a00c-c2d1fa76a3a2 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.154215 Sep 27 02:39:22.610353 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3689/7423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:22 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:23.632733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:23.633373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:23.649271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:23.649791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:23.650224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:23.650926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:23.651377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:23.651803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:23.786101 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:23.794347 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1cb5083f-b0fd-426c-853c-8d13e0e53d10 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.165606 Sep 27 02:39:23.794940 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3735/7424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:23 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:24.818211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:24.818839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:24.825897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:24.826397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:24.826852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:24.827572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:24.828041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:24.828482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:25.285237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:25.293503 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fca252cb-c48a-439b-a0eb-43684343b92c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.479740 Sep 27 02:39:25.294064 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3690/7425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:24 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:26.318786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:26.319495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:26.326618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:26.327429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:26.327870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:26.328575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:26.329082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:26.329540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:26.471625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:26.480194 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-da0c9ad7-46c9-41e6-9dce-2bca081258c8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.165879 Sep 27 02:39:26.480779 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3736/7426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:26 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:27.507399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:27.508034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:27.514940 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:27.515446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:27.515905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:27.516622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:27.517102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:27.517591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:27.646004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:27.654346 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-363b113b-8fee-45ad-8360-89c30ae7c6e5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.150880 Sep 27 02:39:27.654927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3691/7427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:27 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:28.678045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:28.678658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:28.685979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:28.686457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:28.686888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:28.687572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:28.688028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:28.688453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:28.819688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:28.827879 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f630df9c-eed4-440e-b1cf-7939a28aca1d tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.154387 Sep 27 02:39:28.828446 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3737/7428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:28 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:29.851755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:29.852296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:29.859437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:29.859945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:29.860400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:29.868099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:29.868732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:29.869214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:30.012350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:30.021455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7cbb5a2-f2a3-42af-9cdb-4d10d1b8ec3c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1722 microversion: 2.1 time: 0.174280 Sep 27 02:39:30.022040 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3692/7429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:29 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:31.045420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:31.045953 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:31.052756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.053235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.053702 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.055844 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.056304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.057073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.185073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:31.193575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9752a2e1-f7b1-4ab3-8d08-b485806aacd6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1715 microversion: 2.1 time: 0.152124 Sep 27 02:39:31.194146 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3738/7430] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:31 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:31.216133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:31.216761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:31.224269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.224761 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.225207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.225944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.226408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.226846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.355676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:31.364013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a4b4547-9d8e-4641-9b55-4aba65248f7c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1715 microversion: 2.1 time: 0.151793 Sep 27 02:39:31.364595 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3693/7431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:31 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:31.386701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:31.387324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:31.393507 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.394738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.395209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.395905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.396380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.397167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.529679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:31.538008 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fbaab611-4c7f-4a4e-8341-403d249ee6b6 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1715 microversion: 2.1 time: 0.155316 Sep 27 02:39:31.538584 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3739/7432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:31 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:31.560524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:31.560834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:31.567650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.568161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.568620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.569356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.569841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.570289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.599020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:39:31.680463 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-18871092-0f1b-4777-ab8d-b047e27df1fd tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 204 len: 0 microversion: 2.1 time: 0.123523 Sep 27 02:39:31.681277 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3694/7433] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:39:31 2022] DELETE /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:39:31.690146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:31.690793 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:31.697302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.697831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.698281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.698995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.699459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.699888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.723504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-plugged", "status": "completed", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:31.733353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:31.734020 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:31.734293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:31.746900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] Creating event network-vif-plugged:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:39:31.751986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7dbc6c32-9fdb-494a-ae78-fbd3c291752e req-2df65fab-b17f-4667-9760-e0b3dbf2250d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Sep 27 02:39:31.752859 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3695/7434] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:39:31.832871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:31.841299 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ab42660-faab-47d8-8402-8dd9a16f264e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1721 microversion: 2.1 time: 0.155282 Sep 27 02:39:31.841895 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3740/7435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:31 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:39:32.865974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:32.866698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:32.872882 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:32.873406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:32.873863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:32.874567 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:32.875039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:32.875478 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:33.009449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:33.017710 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a871f0c5-22d6-4102-8a2f-a37428527493 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1721 microversion: 2.1 time: 0.156856 Sep 27 02:39:33.018286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3696/7436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:32 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:34.098369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:34.099172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:34.106606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:34.107425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:34.108092 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:34.109058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:34.109624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:34.110068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:34.126907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:34.183476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:34.193009 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-47e7728d-b609-4a82-86a9-72133c6371a5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1653 microversion: 2.1 time: 0.098185 Sep 27 02:39:34.193845 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3741/7437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:34 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:39:34.352103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a520e15e-7d6d-4210-80ff-b3dfdb3ca095", "name": "network-vif-deleted", "tag": "59ca4297-5fcf-4f74-8a71-ea262cd25a29"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:34.365399 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:34.365896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:34.366343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:34.379603 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] Creating event network-vif-deleted:59ca4297-5fcf-4f74-8a71-ea262cd25a29 for instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 on n-h2-859358-1 Sep 27 02:39:34.386873 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-38362e12-58d8-42aa-87ad-80f4a390473d req-85078a6f-7c48-4edb-883d-edc513eb31fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039143 Sep 27 02:39:34.387497 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3697/7438] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:39:35.216659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:35.217628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:35.225234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:35.225889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:35.226430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:35.227417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:35.227998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:35.228528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:35.302499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:35.311635 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c13cf2b5-6daf-4a21-b6f5-1ad7f55e299e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1369 microversion: 2.1 time: 0.099302 Sep 27 02:39:35.312302 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3742/7439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:35 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:39:36.338305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:36.338965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:36.346254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:36.346753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:36.347202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:36.347912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:36.348388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:36.348827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:36.416223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:36.418577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:36.426139 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-61fbbc80-9d55-4604-ac36-2f76e8577108 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1369 microversion: 2.1 time: 0.092198 Sep 27 02:39:36.427523 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3698/7440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:36 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:37.450842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:37.451492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:37.460427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:37.460921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:37.461372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:37.462095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:37.462554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:37.462988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:37.524625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:37.533002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-14a0d39f-548d-4445-a972-8d5ea91d1464 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1369 microversion: 2.1 time: 0.086117 Sep 27 02:39:37.533848 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3743/7441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:37 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:38.557757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:38.558746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:38.566782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:38.567355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:38.567818 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:38.568509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:38.568975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:38.569453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:38.604542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:38.605051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:38.605556 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:38.606108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lazy-loading 'fault' on Instance uuid a520e15e-7d6d-4210-80ff-b3dfdb3ca095 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:39:38.649845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a03a848dfb48dfa6cf776e9dc649f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb336febf92475ebd6355f271a3eb2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:38.657642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7510cb22-2307-4444-85ef-076a28c65272 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 200 len: 1328 microversion: 2.1 time: 0.105289 Sep 27 02:39:38.658231 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3699/7442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:38 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:39.683037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:39.683649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:39.690794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:39.691276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:39.692229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:39.692919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:39.693397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:39.693828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:39.708607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 HTTP/1.1 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a520e15e-7d6d-4210-80ff-b3dfdb3ca095'} Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:39.710316 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-534e0f85-8f8f-4a1b-b1c0-51d1242e4098 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 404 len: 111 microversion: 2.1 time: 0.032970 Sep 27 02:39:39.714885 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3744/7443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:39 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:39.772234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:39.774467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:39.781281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:39.781809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:39.782266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:39.783001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:39.783536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:39.784009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:39.796426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments HTTP/1.1 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': 'a520e15e-7d6d-4210-80ff-b3dfdb3ca095'} Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:39.798122 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-83725b22-4de5-4c67-bb3f-8df810b5d81c tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032041 Sep 27 02:39:39.801812 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3700/7444] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:39:39 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.134841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.135340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.138109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:43.143341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.143819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.144252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.144938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.145409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.145837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.159948 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 HTTP/1.1 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a520e15e-7d6d-4210-80ff-b3dfdb3ca095'} Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.161529 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.165851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-405950c9-8a94-40c8-98f6-275adf7b6d4e tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 404 len: 111 microversion: 2.1 time: 0.032068 Sep 27 02:39:43.166897 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3745/7445] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:39:43 2022] DELETE /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.171352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.171986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: a520e15e-7d6d-4210-80ff-b3dfdb3ca095] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.174920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:43.181607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.182105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.182564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.183270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.183742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.184186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.198484 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 HTTP/1.1 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a520e15e-7d6d-4210-80ff-b3dfdb3ca095'} Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.200044 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance a520e15e-7d6d-4210-80ff-b3dfdb3ca095 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97b2a170-ee20-4c42-a01f-3edbb18e25d5 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095" status: 404 len: 111 microversion: 2.1 time: 0.034042 Sep 27 02:39:43.206462 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3701/7446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:43 2022] GET /compute/v2.1/servers/a520e15e-7d6d-4210-80ff-b3dfdb3ca095 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.210343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.210882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.217609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.218100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.218538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.219253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.219705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.220132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.235579 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc HTTP/1.1 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'aaa51f81-e6e0-4af1-921c-03b1a31589cc'} Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.237188 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b1e417ac-d20d-4732-882d-a51f7558606f tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 404 len: 111 microversion: 2.1 time: 0.032449 Sep 27 02:39:43.243478 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3746/7447] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:39:43 2022] DELETE /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.248292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.249091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: aaa51f81-e6e0-4af1-921c-03b1a31589cc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.256023 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.256528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.256981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.257740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.258247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.258723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.276626 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc HTTP/1.1 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'aaa51f81-e6e0-4af1-921c-03b1a31589cc'} Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.278479 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance aaa51f81-e6e0-4af1-921c-03b1a31589cc could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86059c1b-b3cb-42ab-ae53-081e2c1139d8 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc" status: 404 len: 111 microversion: 2.1 time: 0.035705 Sep 27 02:39:43.282842 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3702/7448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:43 2022] GET /compute/v2.1/servers/aaa51f81-e6e0-4af1-921c-03b1a31589cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.289736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.290322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.296490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.297067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.297538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.298229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.298680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.299106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.313761 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae HTTP/1.1 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '6ed288ae-6af6-43ca-8bdb-42f25a4325ae'} Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.315360 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7ba2a376-9719-414e-bc4c-7385d5febbb3 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 404 len: 111 microversion: 2.1 time: 0.031618 Sep 27 02:39:43.322933 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3747/7449] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:39:43 2022] DELETE /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.325284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.325948 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: 6ed288ae-6af6-43ca-8bdb-42f25a4325ae] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.332011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.332555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.333008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.333740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.334217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.334660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.348785 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae HTTP/1.1 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '6ed288ae-6af6-43ca-8bdb-42f25a4325ae'} Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.350366 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance 6ed288ae-6af6-43ca-8bdb-42f25a4325ae could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12691633-261b-40a2-b4a2-7e2fb69327d4 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae" status: 404 len: 111 microversion: 2.1 time: 0.030309 Sep 27 02:39:43.354363 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3703/7450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:43 2022] GET /compute/v2.1/servers/6ed288ae-6af6-43ca-8bdb-42f25a4325ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.360753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.361202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.367774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.368260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.368710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.369437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.369901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.370338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.384105 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 HTTP/1.1 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ff60c340-08f1-406a-8709-a871c91ca9a6'} Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.385744 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-07a09daf-adac-44c4-a89f-b4356dcad7ab tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 404 len: 111 microversion: 2.1 time: 0.030436 Sep 27 02:39:43.389998 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3748/7451] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:39:43 2022] DELETE /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.396448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.397155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] [instance: ff60c340-08f1-406a-8709-a871c91ca9a6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:43.403313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.403889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.404426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.405423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:43.405878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:43.406421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:43.420908 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] HTTP exception thrown: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Request method failure captured: Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 HTTP/1.1 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmC7qnlWUobVJcXF1YlXhQkhGGFHV5axhtTAX8DzN78Kn87fy2IeL99tMURQ3ln8EKL-3Y68wvlz7JssZ4glKiQFIRD8NkblXeMVlLhwOoUj96sMZpeJ864xdnb9FEAQqOIO8MNaPokM73EPHgQ_o2-GmGNh7tMeOeJb6mN9gvJdT5A Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb336febf92475ebd6355f271a3eb2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb336febf92475ebd6355f271a3eb2d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 8bb336febf92475ebd6355f271a3eb2d Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServerActionsTestJSON-170982729 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 95a03a848dfb48dfa6cf776e9dc649f5 Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServerActionsTestJSON-170982729-project Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ff60c340-08f1-406a-8709-a871c91ca9a6'} Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:39:43.422582 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Returning 404 to user: Instance ff60c340-08f1-406a-8709-a871c91ca9a6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-54adff33-2c6f-43ef-842c-055d5b80f085 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6" status: 404 len: 111 microversion: 2.1 time: 0.032962 Sep 27 02:39:43.428326 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3704/7452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:43 2022] GET /compute/v2.1/servers/ff60c340-08f1-406a-8709-a871c91ca9a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:39:43.435600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc27dbf4-4849-47ec-a30c-4a5916dead35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] Calling method '.version_select at 0x7f24d556cee0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:43.460514 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc27dbf4-4849-47ec-a30c-4a5916dead35 tempest-ServerActionsTestJSON-170982729 tempest-ServerActionsTestJSON-170982729-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990269760" status: 202 len: 0 microversion: 2.1 time: 0.028645 Sep 27 02:39:43.461706 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3749/7453] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Sep 27 02:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990269760 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:39:52.807446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-150250744", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "185be8d0-5ebd-475d-a261-8ca0d4e82471"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:52.865324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] validate_networks() for [('185be8d0-5ebd-475d-a261-8ca0d4e82471', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:39:53.295150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:39:53.295606 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:39:53.296093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:39:53.296509 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:39:53.296930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:39:53.306984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:53.307487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:53.307942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:53.308705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:53.309178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:53.309648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:53.326445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Getting quotas for project cd27eec9f0fb4f77a9142951d524c83c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:39:53.331625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Getting quotas for user c27b23ea840b444fb9d42114c432e857 and project cd27eec9f0fb4f77a9142951d524c83c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:39:53.343797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:39:53.346149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:39:53.391967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b6a3518-d71f-467a-9ad6-fd02ff7bfc00 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727170 Sep 27 02:39:53.392625 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3705/7454] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:39:53.404188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96145f2b-0af2-4d51-9a14-171eef1c5c48 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:53.405394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96145f2b-0af2-4d51-9a14-171eef1c5c48 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:53.408631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=25 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:39:53.533554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96145f2b-0af2-4d51-9a14-171eef1c5c48 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:53.541932 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96145f2b-0af2-4d51-9a14-171eef1c5c48 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1216 microversion: 2.1 time: 0.141538 Sep 27 02:39:53.542696 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3750/7455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:53 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:54.567045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:54.568330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:54.575188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:54.576056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:54.578191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:54.579187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:54.579923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:54.580605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:54.723114 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:54.731306 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bc46d1de-4e2e-44d8-8988-ecc60293e3f1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1276 microversion: 2.1 time: 0.169942 Sep 27 02:39:54.732051 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3706/7456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:54 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:55.757888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:55.758526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:55.771865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:55.772372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:55.772831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:55.773593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:55.774089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:55.774530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:55.973621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:55.985459 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c6f792d0-e3a9-4afe-9282-904f2afc0499 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.233530 Sep 27 02:39:55.986368 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3751/7457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:55 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:56.072534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae876a97-5b22-4ab6-bb16-67875aaf4b11", "tag": "61b9992c-accf-4d64-9e04-dfe0de8db61a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:39:56.089086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:56.089879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:56.090595 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:56.105107 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] Creating event network-changed:61b9992c-accf-4d64-9e04-dfe0de8db61a for instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 on n-h1-859358-1 Sep 27 02:39:56.111065 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8030b310-2a1d-4d8d-b18b-c2805191e2f1 req-a549ae4e-1b36-48ef-a8ce-1d77b47f3494 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043343 Sep 27 02:39:56.111672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3707/7458] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:39:57.009360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:57.009992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:57.016761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:57.017239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:57.017703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:57.018396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:57.018847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:57.019271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:57.155826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:57.164181 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cbcda36e-4ab2-464d-b992-8c7269ed45f0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.158778 Sep 27 02:39:57.164763 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3752/7459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:57 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:39:58.187323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:58.188040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:58.195776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:58.196267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:58.196716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:58.197442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:58.197909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:58.198347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:58.329920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:58.338308 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbad9d9d-6781-46dc-bf60-cd3f170856a0 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.155082 Sep 27 02:39:58.338914 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3708/7460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:58 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:39:59.362159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:39:59.362672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:39:59.370168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:59.370663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:59.371106 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:59.371806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:39:59.372262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:39:59.372693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:39:59.503078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:39:59.511312 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ee6bb0f-dc2b-4d86-910d-102942d03551 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.153119 Sep 27 02:39:59.512008 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3753/7461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:39:59 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:00.534946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:00.535579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:00.542518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:00.543022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:00.543512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:00.544222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:00.544696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:00.545141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:00.673997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:00.682157 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5a591df0-55ae-4ed7-a511-e0d6a62ef673 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.151174 Sep 27 02:40:00.682729 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3709/7462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:00 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:01.576010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae876a97-5b22-4ab6-bb16-67875aaf4b11", "name": "network-vif-plugged", "status": "completed", "tag": "61b9992c-accf-4d64-9e04-dfe0de8db61a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:01.588850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:01.589370 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:01.589823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:01.602776 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] Creating event network-vif-plugged:61b9992c-accf-4d64-9e04-dfe0de8db61a for instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 on n-h1-859358-1 Sep 27 02:40:01.608124 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2dfa1ccc-29bd-4d74-be6f-5ad74776bad7 req-70d87ef5-e374-45b3-8478-5c8d34b30d25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035848 Sep 27 02:40:01.608729 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3754/7463] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:40:01.704272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:01.704824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:01.713904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:01.714665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:01.715188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:01.715913 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:01.716389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:01.716841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:01.850495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:01.858329 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a09b397b-356e-47f7-9bbb-efc5973b8b1c tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1316 microversion: 2.1 time: 0.158147 Sep 27 02:40:01.858924 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3710/7464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:01 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:02.880360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:02.881066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:02.888190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:02.888666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:02.889097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:02.889815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:02.890269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:02.890689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:03.025150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:03.032923 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-be1d8fd1-c992-455e-8ed8-66e4b5ff3350 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.156876 Sep 27 02:40:03.033528 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3755/7465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:02 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:03.093485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-778022787", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "185be8d0-5ebd-475d-a261-8ca0d4e82471"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:03.146750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] validate_networks() for [('185be8d0-5ebd-475d-a261-8ca0d4e82471', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:40:03.316095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:03.337892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:03.510682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:40:03.511151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:40:03.511640 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:40:03.512077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:40:03.512504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:40:03.521327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:03.521883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:03.522338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:03.523080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:03.523553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:03.524022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:03.540580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Getting quotas for project cd27eec9f0fb4f77a9142951d524c83c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:40:03.545740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Getting quotas for user c27b23ea840b444fb9d42114c432e857 and project cd27eec9f0fb4f77a9142951d524c83c. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:40:03.558688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:40:03.561008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:40:03.605074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8bc1fca9-b144-459f-851e-15a1a29f4552 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515389 Sep 27 02:40:03.605759 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3711/7466] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:40:03.617192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0c390b29-ac7b-4fc6-a1be-94a9dbf8d30e tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:03.617859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0c390b29-ac7b-4fc6-a1be-94a9dbf8d30e tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:03.622031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:03.674656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0c390b29-ac7b-4fc6-a1be-94a9dbf8d30e tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:03.682575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0c390b29-ac7b-4fc6-a1be-94a9dbf8d30e tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1216 microversion: 2.1 time: 0.069696 Sep 27 02:40:03.683227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3756/7467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:03 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:04.706778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:04.707416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:04.715315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:04.715874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:04.716473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:04.717220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:04.717786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:04.718278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:04.801068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:04.810522 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ec9d861-e847-4865-94c5-9420716d3d19 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1276 microversion: 2.1 time: 0.108739 Sep 27 02:40:04.811408 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3712/7468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:04 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:05.835153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:05.835778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:05.852012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:05.852520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:05.853166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:05.854228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:05.854873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:05.855310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:06.004736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:06.014075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9c72db2e-f3aa-483e-8fcb-3bc9595e8cf9 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.183183 Sep 27 02:40:06.015145 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3757/7469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:05 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:06.469436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13409b34-a51d-4e9a-9a7f-b0da76e6aafb", "tag": "e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:06.481006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:06.481549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:06.482004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:06.493954 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] Creating event network-changed:e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb for instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb on n-h2-859358-1 Sep 27 02:40:06.499702 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-46a79c6b-bfe0-49cc-8815-b74e10433738 req-1972c4ed-1b7a-48c6-ac70-5fbac095446c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Sep 27 02:40:06.502970 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3713/7470] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:40:07.040737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:07.041322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:07.048852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:07.049382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:07.049817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:07.050532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:07.050993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:07.051419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:07.181150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:07.188963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a376dd3f-e6ad-4cbb-8869-bd762da9aa3b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.152866 Sep 27 02:40:07.189573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3758/7471] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:07 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:08.213080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:08.213849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:08.220307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:08.220793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:08.221233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:08.221954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:08.222446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:08.222880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:08.360088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:08.368713 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3314fe21-0fb3-4c21-8a8d-6bcacfe272bf tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.161422 Sep 27 02:40:08.369282 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3714/7472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:08 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:09.393931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:09.394565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:09.400312 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:40:09.400509 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb (ip 10.222.0.52) !!! Sep 27 02:40:09.405532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:09.406017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:09.406453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:09.407158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:09.407608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:09.408030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:09.546321 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:09.554474 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4343f8ad-cea8-4412-912e-60d6e54de920 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.165942 Sep 27 02:40:09.555325 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3759/7473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:09 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:10.578116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:10.578670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:10.586092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:10.586580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:10.587024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:10.587726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:10.588189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:10.588626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:10.591307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=64 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:10.729626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:10.737452 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-36be0d5a-0416-46fc-9788-72c964e88dc4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.163288 Sep 27 02:40:10.738032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3715/7474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:10 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:11.759809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:11.760432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:11.767564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:11.768059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:11.768500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:11.769215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:11.769727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:11.770651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:11.933494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:11.941874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-92ce5f9f-8b5e-40c3-a283-e694fe5ffe40 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.185837 Sep 27 02:40:11.942449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13409b34-a51d-4e9a-9a7f-b0da76e6aafb", "name": "network-vif-plugged", "status": "completed", "tag": "e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:11.949752 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3760/7475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:11 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:11.955019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:11.955821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:11.956268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:11.969184 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] Creating event network-vif-plugged:e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb for instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb on n-h2-859358-1 Sep 27 02:40:11.974848 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-dfbd0a7c-def8-42b6-8da6-e1df578fdfc9 req-a9c12e37-7b3d-4c77-a8c0-d76d9f2712d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036187 Sep 27 02:40:11.975457 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3716/7476] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:40:12.966703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:12.967330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:12.974755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:12.975245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:12.975687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:12.976396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:12.976855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:12.977288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:13.119232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:13.126992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e50b545e-cce7-4073-98fd-00f28ec7e82a tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1316 microversion: 2.1 time: 0.164268 Sep 27 02:40:13.127573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3761/7477] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:12 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:14.148292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:14.149103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:14.153415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:14.154129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:14.155947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:14.163039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.163537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.163986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.164689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.165156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.165627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.295132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:14.303304 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c5f290c-2084-4d8b-933e-352246ada23b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1505 microversion: 2.1 time: 0.156358 Sep 27 02:40:14.303911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3717/7478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:14 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:14.325778 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:14.326270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:14.328170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:14.329652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:14.335665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.336301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.336751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.337612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.338162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.338596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.364708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:40:14.438701 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-302b02bd-4a23-4e24-9ef1-c0669a6d8736 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "DELETE /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 204 len: 0 microversion: 2.1 time: 0.116237 Sep 27 02:40:14.439568 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3762/7479] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:40:14 2022] DELETE /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 02:40:14.448233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:14.448908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:14.455246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.455752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.456206 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.456922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:14.457435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:14.458019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:14.589242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:14.597013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-df23b5c3-7bfe-499f-a95c-f5ac5d80ce94 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1511 microversion: 2.1 time: 0.152765 Sep 27 02:40:14.597642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3718/7480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:14 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:15.621367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:15.622077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:15.628840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:15.629318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:15.629781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:15.630467 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:15.631499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:15.631924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:15.764582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:15.772740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1e62bd5b-18f6-49a7-b93e-fd3939daaadb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1511 microversion: 2.1 time: 0.155691 Sep 27 02:40:15.773321 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3763/7481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:15 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:16.446097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13409b34-a51d-4e9a-9a7f-b0da76e6aafb", "name": "network-vif-deleted", "tag": "e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:16.459376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:16.459875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:16.460320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:16.481606 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] Creating event network-vif-deleted:e5298b4e-8b0a-4a52-bae5-3d4d074dd5eb for instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb on n-h2-859358-1 Sep 27 02:40:16.487891 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-916181c5-26f1-4df4-810f-b17eaadcb06f req-f4072304-e7b6-4755-ad58-816d299d4097 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045249 Sep 27 02:40:16.488744 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3719/7482] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:40:16.795856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:16.796490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:16.803469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:16.803960 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:16.804402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:16.805380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:16.805846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:16.806281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:16.837996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:16.838409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:16.838868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:16.839335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lazy-loading 'fault' on Instance uuid 13409b34-a51d-4e9a-9a7f-b0da76e6aafb {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:40:16.881569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:16.889745 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-077ba4cd-bf94-4240-988c-fa7d453a51f8 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 200 len: 1306 microversion: 2.1 time: 0.097803 Sep 27 02:40:16.890331 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3764/7483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:16 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:17.915258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:17.916011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:17.922320 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:17.922813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:17.923274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:17.923969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:17.924449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:17.924868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:17.938962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb HTTP/1.1 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '13409b34-a51d-4e9a-9a7f-b0da76e6aafb'} Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:17.940603 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 404 to user: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e4019bcd-3195-4182-beab-cfe6a967042b tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 404 len: 111 microversion: 2.1 time: 0.032496 Sep 27 02:40:17.945572 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3720/7484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:17 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:40:17.952123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:17.952751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:17.959665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:17.960158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:17.960608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:17.961306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:17.961842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:17.962279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.093157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.101505 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-74d556f2-1353-4eec-9f27-cad487da4a76 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.153279 Sep 27 02:40:18.102093 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3765/7485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:17 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:40:18.124041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:18.126388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.131832 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1/action HTTP/1.1 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 32 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: {"resize": {"flavorRef": "452"}} Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1', 'body': {'resize': {'flavorRef': '452'}}} Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:40:18.133407 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 404 to user: Instance fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3539549-d541-4dc5-af64-51d2d8b414b4 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "POST /compute/v2.1/servers/fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1/action" status: 404 len: 111 microversion: 2.1 time: 0.014700 Sep 27 02:40:18.138364 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3721/7486] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:40:18 2022] POST /compute/v2.1/servers/fc7f2112-84c6-47c2-9aad-a6ef6d1b45b1/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:40:18.143394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:18.144006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.149839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.150317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.150754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.151442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.151892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.152319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.282885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.291123 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e4746cd5-c38c-484a-b584-ffd6fbca2ed5 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.151646 Sep 27 02:40:18.291700 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3766/7487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:18 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:18.314457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:18.315082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.322192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.322683 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.323127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.323826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.324291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.324729 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.453898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.462465 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-78c9fdf1-362b-4341-81ca-f2c86e71c631 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.151770 Sep 27 02:40:18.464590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3722/7488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:18 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:18.485736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2f16d6ca-1815-47dd-a6a0-a3a8bd38f042"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:18.487969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.493871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.494353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.494788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.495482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.495934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.496356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.500453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:18.590343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.595714 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: request: POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action HTTP/1.1 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 65 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: {"resize": {"flavorRef": "2f16d6ca-1815-47dd-a6a0-a3a8bd38f042"}} Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: exception: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ae876a97-5b22-4ab6-bb16-67875aaf4b11', 'body': {'resize': {'flavorRef': '2f16d6ca-1815-47dd-a6a0-a3a8bd38f042'}}} Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:18.607998 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 400 to user: Flavor 2f16d6ca-1815-47dd-a6a0-a3a8bd38f042 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13899e6a-a4bd-49fa-901f-260d60001251 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action" status: 400 len: 107 microversion: 2.1 time: 0.127770 Sep 27 02:40:18.612519 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3767/7489] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:40:18 2022] POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action => generated 107 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:40:18.618455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:18.619098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.625111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.625649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.626107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.626821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.627297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.627744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.757862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.765630 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-efb1215f-1c01-4b64-b39f-bce686ecde05 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.151059 Sep 27 02:40:18.766206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3723/7490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:18 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:18.789255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:18.790019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.795908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.796386 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.796824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.797544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.797995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.798418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.929630 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:18.937708 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-73fd1a33-c434-45fc-8934-cef43ba80f63 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.152937 Sep 27 02:40:18.938278 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3768/7491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:18 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:18.960915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-caf29223-c5d9-4a40-b9c4-f05fc4f44118 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-caf29223-c5d9-4a40-b9c4-f05fc4f44118 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: request: POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action HTTP/1.1 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 29 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: {"resize": {"flavorRef": ""}} Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'ae876a97-5b22-4ab6-bb16-67875aaf4b11', 'body': {'resize': {'flavorRef': ''}}} Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise error Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi '' Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:18.964545 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-caf29223-c5d9-4a40-b9c4-f05fc4f44118 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-caf29223-c5d9-4a40-b9c4-f05fc4f44118 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action" status: 400 len: 113 microversion: 2.1 time: 0.009714 Sep 27 02:40:18.969911 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3724/7492] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:40:18 2022] POST /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 02:40:18.974046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:18.974664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:18.981606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.982090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.982533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:18.983222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:18.983680 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:18.984109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.118010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:19.126420 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-43f93ee6-a702-46d2-82d9-f85a6b4e405f tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1506 microversion: 2.1 time: 0.156115 Sep 27 02:40:19.127016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3769/7493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:18 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:40:19.153993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:19.154510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:19.161585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.162083 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.162526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.163224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.163690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.164127 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.176967 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb HTTP/1.1 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '13409b34-a51d-4e9a-9a7f-b0da76e6aafb'} Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:40:19.178526 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 404 to user: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e4a02f1d-d194-49d5-afbe-c5f2aa695289 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "DELETE /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 404 len: 111 microversion: 2.1 time: 0.030671 Sep 27 02:40:19.183887 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3725/7494] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:40:19 2022] DELETE /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:40:19.188571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:19.189192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: 13409b34-a51d-4e9a-9a7f-b0da76e6aafb] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:19.195716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.196197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.196632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.197326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.197846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.198279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.212120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb HTTP/1.1 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '13409b34-a51d-4e9a-9a7f-b0da76e6aafb'} Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:19.213669 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 404 to user: Instance 13409b34-a51d-4e9a-9a7f-b0da76e6aafb could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e581e9d3-cd4b-44aa-b09c-8bf9cdcfd3e1 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb" status: 404 len: 111 microversion: 2.1 time: 0.030444 Sep 27 02:40:19.218767 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3770/7495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:19 2022] GET /compute/v2.1/servers/13409b34-a51d-4e9a-9a7f-b0da76e6aafb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:40:19.223785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:19.224308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:19.230623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.231113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.231561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.232254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.232716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.233151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.258892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:40:19.335400 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e28743e5-f6c1-45e2-a042-60af492f501d tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 204 len: 0 microversion: 2.1 time: 0.115437 Sep 27 02:40:19.336095 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3726/7496] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:40:19 2022] DELETE /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:40:19.344234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:19.344867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:19.350847 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.351326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.351763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.352457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:19.352914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:19.353357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:19.483644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:19.492013 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-258b51b3-8395-465d-ac0d-4007e93068be tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1512 microversion: 2.1 time: 0.151893 Sep 27 02:40:19.492585 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3771/7497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:19 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:40:20.516188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:20.516916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:20.523705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:20.524203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:20.524652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:20.525376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:20.525846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:20.526291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:20.658870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:20.667149 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bf653d58-fc2c-4c2f-8758-b486010c3007 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1512 microversion: 2.1 time: 0.155327 Sep 27 02:40:20.667729 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3727/7498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:20 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:21.409421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae876a97-5b22-4ab6-bb16-67875aaf4b11", "name": "network-vif-deleted", "tag": "61b9992c-accf-4d64-9e04-dfe0de8db61a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:21.422815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:21.423573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:21.424016 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:21.443267 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] Creating event network-vif-deleted:61b9992c-accf-4d64-9e04-dfe0de8db61a for instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 on n-h1-859358-1 Sep 27 02:40:21.451174 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-965a1967-7f13-4510-be07-ad80fbdf1396 req-75153509-31cb-4bab-8a2c-00f9a6b57333 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046073 Sep 27 02:40:21.452205 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3772/7499] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:40:21.690886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:21.691506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:21.698979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:21.699468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:21.699947 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:21.700647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:21.701109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:21.701574 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:21.731356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:21.731778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:21.732231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:21.732684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lazy-loading 'fault' on Instance uuid ae876a97-5b22-4ab6-bb16-67875aaf4b11 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:40:21.777607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27b23ea840b444fb9d42114c432e857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd27eec9f0fb4f77a9142951d524c83c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:21.785528 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f6932dc6-b43f-4aa2-b8e7-2701299b9f17 tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 200 len: 1306 microversion: 2.1 time: 0.098551 Sep 27 02:40:21.786350 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3728/7500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:21 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:22.808762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:22.809502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] [instance: ae876a97-5b22-4ab6-bb16-67875aaf4b11] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:22.816495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:22.816975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:22.817448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:22.818140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:22.818597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:22.819583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:22.832727 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] HTTP exception thrown: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Request method failure captured: Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 HTTP/1.1 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmJ4d9OwipgCdYWOSe-EL6he5suzS0i89TQFK9MtoEgxgpKMlXj78eL8UfYqH5duej4_mzUMZzhxLnVIc7In0j8ybcURtwLIGxPIK6qy0cqf8klpFlofV5gAWc6A4afqEylIq6Z6NCqNAaB7GgYiMwLFgcZ4w9YTvkpyeDV4rrD40SE Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd27eec9f0fb4f77a9142951d524c83c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd27eec9f0fb4f77a9142951d524c83c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: cd27eec9f0fb4f77a9142951d524c83c Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-ServersNegativeTestJSON-93534292 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: c27b23ea840b444fb9d42114c432e857 Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-ServersNegativeTestJSON-93534292-project Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'ae876a97-5b22-4ab6-bb16-67875aaf4b11'} Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:40:22.834935 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] Returning 404 to user: Instance ae876a97-5b22-4ab6-bb16-67875aaf4b11 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7c5e573f-1349-47e3-9f13-256eeb36dabb tempest-ServersNegativeTestJSON-93534292 tempest-ServersNegativeTestJSON-93534292-project] 10.222.0.52 "GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11" status: 404 len: 111 microversion: 2.1 time: 0.032093 Sep 27 02:40:22.840071 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3773/7501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:22 2022] GET /compute/v2.1/servers/ae876a97-5b22-4ab6-bb16-67875aaf4b11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:40:53.331326 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:53.332099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:53.505138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-822c4eb8-0519-4c7f-9e1c-7bbeb4d824fa tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: .version_select at 0x7f24da524b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-686376688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChrnR8nnG9mDzhJk8EUmZa0Lyll2hDNyW9AxnDposyjy2UUvDoJvcMX8NvryM0VqpasU75/ZA0Gshqj/RmjiVaILF4kbZ+0fWdnN69+wYJZ5kpoV71Sm9vGs1o41pBWyg=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:53.520496 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-822c4eb8-0519-4c7f-9e1c-7bbeb4d824fa tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:40:53.525684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-822c4eb8-0519-4c7f-9e1c-7bbeb4d824fa tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:40:53.557665 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-822c4eb8-0519-4c7f-9e1c-7bbeb4d824fa tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.231463 Sep 27 02:40:53.558412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3729/7502] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:40:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:40:53.612022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1950464854", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-686376688", "networks": [{"uuid": "b46a5e52-e877-4f24-87b4-0b9b074fc092"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:53.622096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:53.622929 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=26 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:40:53.671532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] validate_networks() for [('b46a5e52-e877-4f24-87b4-0b9b074fc092', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:40:54.120194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:40:54.120625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:40:54.121652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:40:54.122233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:40:54.122899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:40:54.133248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:54.134137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:54.134799 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:54.136031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:54.136493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:54.137011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:54.158158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:40:54.164203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:40:54.177601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:40:54.180018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:40:54.231305 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef3c4112-98a9-4060-8be9-533948ed38d2 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623099 Sep 27 02:40:54.231969 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3774/7503] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:40:54.243076 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecb40454-4230-4104-a9ff-6a4bb372df3f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:54.243721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecb40454-4230-4104-a9ff-6a4bb372df3f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:54.299754 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecb40454-4230-4104-a9ff-6a4bb372df3f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:54.308916 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecb40454-4230-4104-a9ff-6a4bb372df3f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1262 microversion: 2.1 time: 0.069775 Sep 27 02:40:54.309906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3730/7504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:54 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:55.338109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:55.339154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:55.345779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:55.346598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:55.347269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:55.348100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:55.348627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:55.349811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:55.418868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:55.426775 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-624d646d-5396-4fe0-9e8b-a9cd1656a89a tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1314 microversion: 2.1 time: 0.094855 Sep 27 02:40:55.427851 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3775/7505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:55 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1314 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:56.471110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:56.479612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:56.493722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:56.494718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:56.495240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:56.495986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:56.496741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:56.497193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:56.751702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:56.761497 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-04a55677-db30-4688-a0f5-b13c0b7a61a1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.313741 Sep 27 02:40:56.769902 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3731/7506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:56 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:57.178735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c06095-f562-4ae1-8699-bde511f91dda", "tag": "8dfc616e-5c9a-4bdc-a414-b8edc7b14011"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:40:57.197078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:57.198219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:57.199045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:57.242463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] Creating event network-changed:8dfc616e-5c9a-4bdc-a414-b8edc7b14011 for instance 85c06095-f562-4ae1-8699-bde511f91dda on n-h2-859358-1 Sep 27 02:40:57.247905 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-92b807b0-dc0e-44e8-a056-7155309d9026 req-cc12178a-4370-4f6a-a52c-cdfe97cac056 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074724 Sep 27 02:40:57.248927 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3776/7507] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:40:57.784788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:57.785468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:57.793854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:57.794507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:57.795116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:57.796079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:57.796784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:57.797400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:57.950016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:57.969397 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2912cd72-bfd5-46e8-8e1c-32082ef054b5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.188591 Sep 27 02:40:57.970324 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3732/7508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:57 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:40:58.995276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:40:58.996177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:40:59.003594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:59.004208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:59.004512 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:59.006200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:40:59.006823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:40:59.007431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:40:59.140355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:40:59.148360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1be64735-223a-40f0-8727-acd1651759de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.157538 Sep 27 02:40:59.148934 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3777/7509] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:40:58 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:00.171390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:00.172087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:00.179205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:00.179703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:00.180410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:00.181131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:00.181627 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:00.182070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:00.379086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:00.387414 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4b42ae42-98c7-411f-b015-4434f06f2344 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.220121 Sep 27 02:41:00.388011 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3733/7510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:00 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:01.411109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:01.411728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:01.418640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:01.419127 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:01.419571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:01.420283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:01.420739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:01.421171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:01.552695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:01.560889 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8455461f-a652-41d0-8c48-c7d1f21c72d0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.153834 Sep 27 02:41:01.561516 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3778/7511] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:01 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:02.584169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:02.584832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:02.591581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:02.592075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:02.592528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:02.593235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:02.593724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:02.594160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:02.722364 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:02.730113 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9191f11-f5ab-47b9-a9fb-95df82b3bac0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.150464 Sep 27 02:41:02.730677 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3734/7512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:02 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:03.753460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:03.754014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:03.760866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:03.761362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:03.761822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:03.762514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:03.762969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:03.763397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:03.890014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:03.898296 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cfc0673a-cc2b-4043-9137-62a073f0e9be tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.148958 Sep 27 02:41:03.898869 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3779/7513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:03 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:04.131074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c06095-f562-4ae1-8699-bde511f91dda", "name": "network-vif-plugged", "status": "completed", "tag": "8dfc616e-5c9a-4bdc-a414-b8edc7b14011"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:04.141791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:04.142268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:04.142711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:04.154624 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] Creating event network-vif-plugged:8dfc616e-5c9a-4bdc-a414-b8edc7b14011 for instance 85c06095-f562-4ae1-8699-bde511f91dda on n-h2-859358-1 Sep 27 02:41:04.159581 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-da00b2bc-2427-4cc4-9043-76c4570664a4 req-4751ff5d-f148-4354-afc4-a6c6a6209487 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Sep 27 02:41:04.160174 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3735/7514] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:04.924524 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:04.925237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:04.928488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:04.929516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:04.936901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:04.937410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:04.937845 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:04.938540 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:04.938989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:04.939415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:05.076363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:05.084825 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5192ad8f-f103-402a-92f0-d56eb7dd1177 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1362 microversion: 2.1 time: 0.164248 Sep 27 02:41:05.085471 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3780/7515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:04 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:06.105696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:06.110725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:06.111453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:06.118716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:06.119219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:06.119665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:06.120383 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:06.120854 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:06.121296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:06.253486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:06.261258 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34d731eb-082b-40d9-b20e-aef0327ffe4f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1554 microversion: 2.1 time: 0.156589 Sep 27 02:41:06.261928 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3736/7516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:06 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:41:06.283323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:06.283944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:06.291376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:06.291863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:06.292302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:06.292999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:06.293485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:06.293915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:06.421685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:06.430320 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-848bdb23-595a-4cd2-a8b2-d9237a48d570 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1554 microversion: 2.1 time: 0.150704 Sep 27 02:41:06.430920 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3781/7517] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:06 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:08.032156 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f347799a-ae2b-4ffc-81c3-ed74441ed348"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:08.034559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:08.042116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:08.042619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:08.043068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:08.043775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:08.044237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:08.044673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:08.300763 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c620dacd-8a25-4d2f-bf84-42a7430d2d35 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272485 Sep 27 02:41:08.301508 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3737/7518] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:41:08 2022] POST /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:19.008161 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:19.008693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:19.011562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:19.012230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=40 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:19.018827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:19.019311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:19.019801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:19.020986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:19.021475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:19.021906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:19.101034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lazy-loading 'services' on Instance uuid 85c06095-f562-4ae1-8699-bde511f91dda {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:41:19.172198 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8d32a809-683b-4426-bf41-64a938ba2514 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments/f347799a-ae2b-4ffc-81c3-ed74441ed348" status: 202 len: 0 microversion: 2.1 time: 0.168361 Sep 27 02:41:19.172801 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3782/7519] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:41:19 2022] DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments/f347799a-ae2b-4ffc-81c3-ed74441ed348 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:41:19.179747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:19.180803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:19.185322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:19.187730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:19.196727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:19.197224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:19.197700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:19.198409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:19.198873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:19.199312 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:19.231689 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d5033df-2b7c-4644-adc1-323c9feef76c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053820 Sep 27 02:41:19.232173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3738/7520] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:19 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:41:20.245735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:20.248155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:20.254577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:20.255063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:20.255505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:20.256200 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:20.256651 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:20.257083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:20.289874 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6cb9136b-f0f7-4449-af6f-218a712e743b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049294 Sep 27 02:41:20.290447 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3783/7521] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:20 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:21.303159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:21.305807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:21.313085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:21.313625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:21.314084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:21.314817 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:21.315290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:21.315737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:21.347687 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-33f1633e-c4dd-404d-90e9-28f9c03c04fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049189 Sep 27 02:41:21.350148 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3739/7522] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:21 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:22.361983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:22.364821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:22.371371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:22.371858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:22.372301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:22.373002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:22.373490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:22.373923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:22.404244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-70152ebc-7c7a-42fe-978e-c504bb386d55 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Sep 27 02:41:22.404820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3784/7523] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:22 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:23.416301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:23.418579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:23.425425 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:23.425966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:23.426416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:23.427155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:23.427625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:23.428074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:23.459439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e8732e7f-7c30-4947-9788-728ce4e040bf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047123 Sep 27 02:41:23.460257 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3740/7524] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:23 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:24.472141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:24.475034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:24.481803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:24.482290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:24.482731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:24.483445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:24.483891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:24.484325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:24.513496 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8dd99e4-6634-4d18-be44-69b486159686 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045520 Sep 27 02:41:24.514065 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3785/7525] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:24 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:41:24.525315 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:24.525880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:24.532717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:24.533211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:24.533690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:24.534393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:24.534861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:24.535958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:24.611277 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance 85c06095-f562-4ae1-8699-bde511f91dda is not attached to volume f347799a-ae2b-4ffc-81c3-ed74441ed348 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments/f347799a-ae2b-4ffc-81c3-ed74441ed348 HTTP/1.1 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 85c06095-f562-4ae1-8699-bde511f91dda is not attached to volume f347799a-ae2b-4ffc-81c3-ed74441ed348 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': '85c06095-f562-4ae1-8699-bde511f91dda', 'id': 'f347799a-ae2b-4ffc-81c3-ed74441ed348'} Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f347799a-ae2b-4ffc-81c3-ed74441ed348. Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c06095-f562-4ae1-8699-bde511f91dda is not attached to volume f347799a-ae2b-4ffc-81c3-ed74441ed348 Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:41:24.623711 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c06095-f562-4ae1-8699-bde511f91dda is not attached to volume f347799a-ae2b-4ffc-81c3-ed74441ed348 Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance 85c06095-f562-4ae1-8699-bde511f91dda is not attached to volume f347799a-ae2b-4ffc-81c3-ed74441ed348 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c09a3c53-2806-43fe-b48c-8f23bd644a65 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments/f347799a-ae2b-4ffc-81c3-ed74441ed348" status: 404 len: 154 microversion: 2.1 time: 0.103918 Sep 27 02:41:24.628213 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3741/7526] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:41:24 2022] DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda/os-volume_attachments/f347799a-ae2b-4ffc-81c3-ed74441ed348 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:41:28.011134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:28.011654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:28.018589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:28.019083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:28.019577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:28.020780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:28.021265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:28.021725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:28.058818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:41:28.140323 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f0ba0ed2-9c49-493c-9b77-f4ea3e264512 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 204 len: 0 microversion: 2.1 time: 0.132722 Sep 27 02:41:28.141016 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3786/7527] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:41:28 2022] DELETE /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:41:28.150463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:28.151106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:28.161526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:28.162038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:28.162497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:28.163217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:28.163695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:28.164146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:28.297322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:28.305973 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c7fb1094-4580-49df-9616-e915583ca450 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1560 microversion: 2.1 time: 0.159629 Sep 27 02:41:28.306555 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3742/7528] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:28 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:41:29.330194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:29.330937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:29.338523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:29.339009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:29.339476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:29.340169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:29.340627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:29.341056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:29.475928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:29.483796 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72236d64-9bdf-469c-92b6-c72a36ea499d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1560 microversion: 2.1 time: 0.157924 Sep 27 02:41:29.484374 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3787/7529] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:29 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:30.476232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c06095-f562-4ae1-8699-bde511f91dda", "name": "network-vif-deleted", "tag": "8dfc616e-5c9a-4bdc-a414-b8edc7b14011"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:30.502181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:30.502938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:30.503403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:30.506251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:30.506877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:30.514968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:30.515455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:30.515898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:30.516611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:30.517071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:30.517533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:30.526895 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] Creating event network-vif-deleted:8dfc616e-5c9a-4bdc-a414-b8edc7b14011 for instance 85c06095-f562-4ae1-8699-bde511f91dda on n-h2-859358-1 Sep 27 02:41:30.537668 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-498be756-6fd1-484a-a7f1-76f93210eb3b req-00b7cd53-249e-4361-addf-e53c49fb3c28 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068180 Sep 27 02:41:30.538794 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3743/7530] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:30.591615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:30.601110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1402506a-6e14-4b7d-9e2f-329e170bfa6d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 200 len: 1518 microversion: 2.1 time: 0.098856 Sep 27 02:41:30.602017 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3788/7531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:30 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 1518 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:41:31.625995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:31.626721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: 85c06095-f562-4ae1-8699-bde511f91dda] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:31.632984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:31.633560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:31.634067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:31.634774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:31.635245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:31.635696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:31.648849 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda HTTP/1.1 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '85c06095-f562-4ae1-8699-bde511f91dda'} Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:41:31.650506 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance 85c06095-f562-4ae1-8699-bde511f91dda could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8fa5788-4e48-420a-ad3b-5e68ba5e2531 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda" status: 404 len: 111 microversion: 2.1 time: 0.031143 Sep 27 02:41:31.655426 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3744/7532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:31 2022] GET /compute/v2.1/servers/85c06095-f562-4ae1-8699-bde511f91dda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:41:31.661786 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59a11909-f7e7-4900-8a95-3555abc1634e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '.version_select at 0x7f24d5fad670>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:31.683206 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59a11909-f7e7-4900-8a95-3555abc1634e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-686376688" status: 202 len: 0 microversion: 2.1 time: 0.026417 Sep 27 02:41:31.683780 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3789/7533] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Sep 27 02:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-686376688 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:41:31.700972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9e8a99c5-4d63-4ff0-8987-54f0f848ad0d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: .version_select at 0x7f24d59039d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1162368639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu/LNDGBWENCfHm+TkbI6x1JfgxvwZNqftFNi5fiQyfTbgKgu90vIDamC3AA1ELf3dg0oaQ5IHDOrfy8t1CVNyqSHWbX+qE6o66yuC1yoWgQR7AoLVnT+a17zbBjuaaBQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:31.716589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9e8a99c5-4d63-4ff0-8987-54f0f848ad0d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:41:31.721573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-9e8a99c5-4d63-4ff0-8987-54f0f848ad0d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:41:31.746074 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9e8a99c5-4d63-4ff0-8987-54f0f848ad0d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049000 Sep 27 02:41:31.746664 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3745/7534] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:41:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:31.797411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2086571318", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1162368639", "networks": [{"uuid": "b46a5e52-e877-4f24-87b4-0b9b074fc092"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:31.850006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] validate_networks() for [('b46a5e52-e877-4f24-87b4-0b9b074fc092', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:41:32.213079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:41:32.213552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:41:32.214034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:41:32.214447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:41:32.214864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:41:32.224275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:32.224806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:32.225193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:32.225963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:32.226419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:32.226853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:32.243814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:41:32.248989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:41:32.261128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:41:32.263487 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:41:32.309798 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96908396-ba3e-4865-aef7-de4a464db712 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516514 Sep 27 02:41:32.310465 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3790/7535] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:41:32.322097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8af1d269-9e66-492b-b94d-c7e87e6a0abf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:32.322727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8af1d269-9e66-492b-b94d-c7e87e6a0abf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:32.376360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8af1d269-9e66-492b-b94d-c7e87e6a0abf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:32.384806 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8af1d269-9e66-492b-b94d-c7e87e6a0abf tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1263 microversion: 2.1 time: 0.066579 Sep 27 02:41:32.385388 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3746/7536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:32 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:33.409642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:33.410708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:33.421190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:33.422050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:33.422502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:33.423287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:33.423746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:33.424173 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:33.493732 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:33.502318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7a5f8ec-aef2-4702-9031-8b86799923c9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1333 microversion: 2.1 time: 0.096917 Sep 27 02:41:33.503498 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3791/7537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:33 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:34.524742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:34.525617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:34.532512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:34.532992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:34.533486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:34.534209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:34.534681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:34.535131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:34.721389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:34.730049 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a176537e-7d52-4ed9-a6a0-7874ad476771 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.209260 Sep 27 02:41:34.730634 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3747/7538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:34 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:34.795817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a552203e-dd64-462f-9c8f-7bb912d07587", "tag": "6dfda0a6-79fa-49d7-9b2e-6e40837c8558"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:34.808834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:34.809685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:34.810277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:34.822291 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] Creating event network-changed:6dfda0a6-79fa-49d7-9b2e-6e40837c8558 for instance a552203e-dd64-462f-9c8f-7bb912d07587 on n-h2-859358-1 Sep 27 02:41:34.827559 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-66785029-9dd2-4944-8b5b-a55963c11545 req-7ea70aee-512a-49f0-a4eb-e21ece2facf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035824 Sep 27 02:41:34.828653 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3792/7539] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:35.754237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:35.754895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:35.762535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:35.763026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:35.763503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:35.764207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:35.764679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:35.765121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:35.893775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:35.902047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-39147851-2a54-41ff-b4dd-ff1afd2bd1a5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.151753 Sep 27 02:41:35.902618 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3748/7540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:35 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:36.927041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:36.927802 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:36.935245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:36.935722 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:36.936155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:36.936865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:36.937314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:36.937763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:37.073217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:37.080899 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-467ac4ab-75c4-433a-a5bf-7f515518458f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.159034 Sep 27 02:41:37.081518 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3793/7541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:36 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:38.104074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:38.104694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:38.111615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:38.112110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:38.112561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:38.113273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:38.113771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:38.114238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:38.248267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:38.256029 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8cfac0e5-9bd8-4a61-a751-c43b6e45a1f7 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.156404 Sep 27 02:41:38.256602 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3749/7542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:38 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:39.279531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:39.280143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:39.287495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:39.287970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:39.288403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:39.289114 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:39.289586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:39.290017 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:39.416065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:39.423677 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-91882bd8-e60a-437d-8f9f-baedb8b93d7e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.148121 Sep 27 02:41:39.424247 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3794/7543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:39 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:40.294607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a552203e-dd64-462f-9c8f-7bb912d07587", "name": "network-vif-plugged", "status": "completed", "tag": "6dfda0a6-79fa-49d7-9b2e-6e40837c8558"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:40.306347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:40.306844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:40.307294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:40.319320 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] Creating event network-vif-plugged:6dfda0a6-79fa-49d7-9b2e-6e40837c8558 for instance a552203e-dd64-462f-9c8f-7bb912d07587 on n-h2-859358-1 Sep 27 02:41:40.324252 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0f729e9f-763f-44d6-a840-ae68842852b5 req-bec2e3d5-ab12-4205-ade6-496eb94591a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Sep 27 02:41:40.324865 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3750/7544] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:40.450175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:40.450716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:40.457877 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:40.458131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:40.458761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:40.459489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:40.460151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:40.460356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:40.587855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:40.595694 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90d1e9eb-51a5-48b9-80a2-2efd94293b90 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.149506 Sep 27 02:41:40.596277 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3795/7545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:40 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:41.621045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:41.621804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:41.628111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:41.628608 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:41.629056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:41.629794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:41.630266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:41.630707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:41.767514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:41.777032 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-668199fa-7b5f-4e66-aa09-d6c6c1e33c67 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1363 microversion: 2.1 time: 0.161161 Sep 27 02:41:41.777671 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3751/7546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:41 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:42.800694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:42.801367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:42.804184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:42.804999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:42.811203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:42.811689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:42.812129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:42.812820 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:42.813276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:42.813728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:42.945275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:42.953020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-553be069-2b25-4430-825c-dc4d682b65fb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1555 microversion: 2.1 time: 0.156208 Sep 27 02:41:42.953563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3796/7547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:42 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:42.975562 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:42.976191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:42.981462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:42.984272 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:42.984767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:42.985216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:42.985956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:42.986424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:42.986865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:43.119302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:41:43.127068 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5b3b083d-240d-4487-865f-8d585e0270ae tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1555 microversion: 2.1 time: 0.155408 Sep 27 02:41:43.127642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3752/7548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:41:42 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:41:44.652846 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b50af2f9-a47a-4cfd-9354-553bb876b314"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:41:44.655336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:44.662122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:44.662636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:44.663073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:44.663763 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:44.664215 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:44.664641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:44.910710 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:44.933414 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fae5233f-0fd7-4897-8422-433ab11e14ba tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284408 Sep 27 02:41:44.934047 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3797/7549] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:41:44 2022] POST /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:55.636471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:55.636994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:55.640605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:55.641361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=66 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:55.648483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:55.649116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:55.649598 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:55.650319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:55.650791 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:55.651237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:55.731799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lazy-loading 'services' on Instance uuid a552203e-dd64-462f-9c8f-7bb912d07587 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:41:55.821153 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b686f0bc-d32d-4731-9b86-3338644b94de tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments/b50af2f9-a47a-4cfd-9354-553bb876b314" status: 202 len: 0 microversion: 2.1 time: 0.188445 Sep 27 02:41:55.822204 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3753/7550] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:41:55 2022] DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments/b50af2f9-a47a-4cfd-9354-553bb876b314 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:41:55.829226 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:55.830174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:41:55.834347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:55.836770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:55.845773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:55.846343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:55.846782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:55.847489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:55.847945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:55.848376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:55.881362 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d9ece4df-4327-4513-8834-2cef958a6300 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054496 Sep 27 02:41:55.881899 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3798/7551] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:55 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:41:56.894755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:56.898055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:56.905196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:56.905722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:56.906181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:56.906898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:56.907360 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:56.907795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:56.939722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-084fec51-cd3c-4d8b-874f-f13e86f17128 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Sep 27 02:41:56.940290 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3754/7552] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:56 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:57.952917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:57.955319 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:57.963475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:57.963983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:57.964415 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:57.965134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:57.965627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:57.966065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:58.008581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e82cb332-b5b2-463b-961c-f0ce73e458a3 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060236 Sep 27 02:41:58.009405 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3799/7553] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:57 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:41:59.020875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:41:59.023230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:41:59.030522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:59.031039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:59.031573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:59.032867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:41:59.032867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:41:59.033402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:41:59.065121 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38161ad3-ba7a-4ba1-ae65-ae1c129bd0cb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048221 Sep 27 02:41:59.066047 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3755/7554] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:41:59 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:00.078636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:00.080863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:00.087790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:00.088269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:00.088705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:00.089420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:00.089879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:00.090310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:00.121582 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ea8c0e2e-383c-4972-a8c0-0687f108aadc tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Sep 27 02:42:00.122153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3800/7555] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:00 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:01.133927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:01.136108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:01.143333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:01.143843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:01.144301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:01.145068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:01.146221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:01.146671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:01.180681 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dd542be6-26b6-4633-b1c3-bdf8d211190f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051094 Sep 27 02:42:01.181252 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3756/7556] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:01 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:42:01.191890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:01.192943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:01.199754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:01.200230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:01.200665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:01.201374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:01.201834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:01.202256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:01.277115 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance a552203e-dd64-462f-9c8f-7bb912d07587 is not attached to volume b50af2f9-a47a-4cfd-9354-553bb876b314 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments/b50af2f9-a47a-4cfd-9354-553bb876b314 HTTP/1.1 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a552203e-dd64-462f-9c8f-7bb912d07587 is not attached to volume b50af2f9-a47a-4cfd-9354-553bb876b314 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'a552203e-dd64-462f-9c8f-7bb912d07587', 'id': 'b50af2f9-a47a-4cfd-9354-553bb876b314'} Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b50af2f9-a47a-4cfd-9354-553bb876b314. Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a552203e-dd64-462f-9c8f-7bb912d07587 is not attached to volume b50af2f9-a47a-4cfd-9354-553bb876b314 Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:01.279170 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a552203e-dd64-462f-9c8f-7bb912d07587 is not attached to volume b50af2f9-a47a-4cfd-9354-553bb876b314 Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance a552203e-dd64-462f-9c8f-7bb912d07587 is not attached to volume b50af2f9-a47a-4cfd-9354-553bb876b314 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7a2a656-e746-4e0d-9496-a88e0c04a06d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments/b50af2f9-a47a-4cfd-9354-553bb876b314" status: 404 len: 154 microversion: 2.1 time: 0.092854 Sep 27 02:42:01.283933 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3801/7557] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:42:01 2022] DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587/os-volume_attachments/b50af2f9-a47a-4cfd-9354-553bb876b314 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:42:04.624543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:04.625205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:04.634299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:04.634789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:04.635386 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:04.636116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:04.636583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:04.637026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:04.664733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:42:04.741993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb80963f-2b0a-40be-9bde-a69ce056745c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 204 len: 0 microversion: 2.1 time: 0.120910 Sep 27 02:42:04.742517 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3757/7558] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:42:04 2022] DELETE /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:42:04.750822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:04.751449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:04.759775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:04.760265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:04.760706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:04.761438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:04.761899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:04.762329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:04.896972 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:04.904864 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52790fa6-19f1-441a-a1c1-e2f9e7e81817 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1561 microversion: 2.1 time: 0.158027 Sep 27 02:42:04.905591 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3802/7559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:04 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:42:05.928931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:05.929692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:05.937133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:05.937665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:05.938123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:05.938835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:05.939304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:05.939749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:06.071816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:06.079591 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a04e1fa7-2553-4e11-bdc5-1b813fe2b36d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1561 microversion: 2.1 time: 0.155078 Sep 27 02:42:06.080166 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3758/7560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:05 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:07.103697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:07.106184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:07.115688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:07.116739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:07.117383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:07.118093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:07.118729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:07.119159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:07.195993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:07.196974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a552203e-dd64-462f-9c8f-7bb912d07587", "name": "network-vif-deleted", "tag": "6dfda0a6-79fa-49d7-9b2e-6e40837c8558"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:07.208155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:07.208760 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:07.209375 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:07.210248 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ba972c7-5717-4c6a-955b-df24bd1bd068 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 200 len: 1519 microversion: 2.1 time: 0.110420 Sep 27 02:42:07.210837 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3803/7561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:07 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 1519 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:07.221871 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] Creating event network-vif-deleted:6dfda0a6-79fa-49d7-9b2e-6e40837c8558 for instance a552203e-dd64-462f-9c8f-7bb912d07587 on n-h2-859358-1 Sep 27 02:42:07.228622 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f52dfea4-1ae1-4e3d-9be1-29464717effd req-89b796cf-ec4c-47c1-a79e-9cfb86e7c24c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110414 Sep 27 02:42:07.230386 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3759/7562] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:08.234165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:08.234801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: a552203e-dd64-462f-9c8f-7bb912d07587] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:08.241864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:08.242343 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:08.242782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:08.243469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:08.243922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:08.244347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:08.257449 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 HTTP/1.1 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'a552203e-dd64-462f-9c8f-7bb912d07587'} Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:08.259002 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance a552203e-dd64-462f-9c8f-7bb912d07587 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b4cb5be9-d967-407b-9bad-08458648ffcb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587" status: 404 len: 111 microversion: 2.1 time: 0.030146 Sep 27 02:42:08.263735 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3804/7563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:08 2022] GET /compute/v2.1/servers/a552203e-dd64-462f-9c8f-7bb912d07587 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:42:08.271240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2c9b04b-27bb-48f4-a2b7-cab0c9ce2bc1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '.version_select at 0x7f24d55fb040>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:08.291331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2c9b04b-27bb-48f4-a2b7-cab0c9ce2bc1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1162368639" status: 202 len: 0 microversion: 2.1 time: 0.025836 Sep 27 02:42:08.291897 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3760/7564] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 02:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1162368639 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:42:08.309255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e8d974b9-c16a-424d-a023-1c50ef52b22c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: .version_select at 0x7f24d536d790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1649361407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe1E2pzZoxKxK21wZ6fUdzI6lzb6td0Cj3NLfdjX75LZTcZu8MBkDamoq/1OOGB4Gv/atGHCAfmbUMfq80Va3AeBGwo2k2+/Fz4p8Z6kXIkMYQJyaT5meVmu4Un7y0urA=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:08.324965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e8d974b9-c16a-424d-a023-1c50ef52b22c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:42:08.330861 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e8d974b9-c16a-424d-a023-1c50ef52b22c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:42:08.354131 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e8d974b9-c16a-424d-a023-1c50ef52b22c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049050 Sep 27 02:42:08.354725 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3805/7565] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:42:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:08.404919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2123166426", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1649361407", "networks": [{"uuid": "b46a5e52-e877-4f24-87b4-0b9b074fc092"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:08.457237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] validate_networks() for [('b46a5e52-e877-4f24-87b4-0b9b074fc092', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:42:08.834149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:42:08.834591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:42:08.835077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:42:08.835500 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:42:08.835923 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:42:08.844626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:08.845120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:08.845661 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:08.846540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:08.846858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:08.847296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:08.866701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:42:08.873801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Getting quotas for user 212bb4bafe1c4a4ab38dcbff0dc99e1f and project aba13c7c9b834acd80a58a48063af9de. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:42:08.888757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:42:08.891282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:42:08.940879 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c319851-ca15-4804-9eb3-77a821f39eb0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539778 Sep 27 02:42:08.941590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3761/7566] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:42:08.952654 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37a49a5d-19b8-49ed-b073-96e06cf8e4f1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:08.953273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37a49a5d-19b8-49ed-b073-96e06cf8e4f1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:09.007087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-37a49a5d-19b8-49ed-b073-96e06cf8e4f1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:09.014222 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37a49a5d-19b8-49ed-b073-96e06cf8e4f1 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1263 microversion: 2.1 time: 0.065468 Sep 27 02:42:09.015115 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3806/7567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:08 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:10.037721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:10.038340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:10.045995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:10.046715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:10.047158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:10.048046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:10.048515 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:10.049008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:10.124587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:10.133554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e0cbbf00-51db-4f88-be4e-172da1f2c4ec tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1333 microversion: 2.1 time: 0.099762 Sep 27 02:42:10.134335 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3762/7568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:10 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:11.157495 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:11.158146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:11.165089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:11.165612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:11.166054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:11.166757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:11.167214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:11.167644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:11.319081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:11.326930 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-66559ddd-6da7-42b7-a7c7-79c2fd5af950 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.173443 Sep 27 02:42:11.327526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3807/7569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:11 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:11.420253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df606c0b-6ab7-450c-a216-9cb926c88f90", "tag": "2720f592-1e95-41a1-945b-3fcfcdaa5082"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:11.432551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:11.433492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:11.434310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:11.446863 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] Creating event network-changed:2720f592-1e95-41a1-945b-3fcfcdaa5082 for instance df606c0b-6ab7-450c-a216-9cb926c88f90 on n-h2-859358-1 Sep 27 02:42:11.451768 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9f766f03-5a73-4949-be89-587434c97ab1 req-e2c03c80-dff2-488d-a6ce-6c38e3755f66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035751 Sep 27 02:42:11.452873 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3763/7570] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:12.350794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:12.351432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:12.358378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:12.358865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:12.359308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:12.360009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:12.360470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:12.360904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:12.492346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:12.500032 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-817c8c78-7c5c-4127-b2ed-46c88e11727d tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.153690 Sep 27 02:42:12.500612 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3808/7571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:12 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:13.525956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:13.526680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:13.532853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:13.533362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:13.533832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:13.534537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:13.535004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:13.535445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:13.674468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:13.682654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9f581928-f24d-4d49-bd4e-867cdf638527 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.163036 Sep 27 02:42:13.683246 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3764/7572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:13 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:14.706037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:14.706814 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:14.714183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:14.714684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:14.715132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:14.715851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:14.716313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:14.716749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:14.851909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:14.859926 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b791dd4e-d527-4eb8-a212-b5520bed134b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.157769 Sep 27 02:42:14.860606 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3809/7573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:14 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:15.883563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:15.884096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:15.891570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:15.892067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:15.892520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:15.893234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:15.893743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:15.894187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:16.023289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:16.031097 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-afa51409-db7c-4053-b4ea-d570178d56b9 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.151544 Sep 27 02:42:16.031656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3765/7574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:15 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:42:17.053287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:17.053963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:17.061075 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:17.061594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:17.062036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:17.062735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:17.063194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:17.063625 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:17.191473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:17.199184 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bdbe84ef-ced1-4cf7-980d-f24ebbb1e956 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.149966 Sep 27 02:42:17.199759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3810/7575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:17 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:18.222404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:18.223033 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:18.230021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:18.230518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:18.230968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:18.231677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:18.232150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:18.232590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:18.361811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:18.370492 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e33de6f2-4d35-4ea5-9016-abf61285432b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.152037 Sep 27 02:42:18.371074 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3766/7576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:18 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:18.529941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df606c0b-6ab7-450c-a216-9cb926c88f90", "name": "network-vif-plugged", "status": "completed", "tag": "2720f592-1e95-41a1-945b-3fcfcdaa5082"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:18.541283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:18.541789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:18.542223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:18.553593 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] Creating event network-vif-plugged:2720f592-1e95-41a1-945b-3fcfcdaa5082 for instance df606c0b-6ab7-450c-a216-9cb926c88f90 on n-h2-859358-1 Sep 27 02:42:18.558848 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-8cd3573b-eaf5-45fb-9733-a01e9f7dd131 req-fb305b6e-80d7-46f6-8c8d-21d27e8abb30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090545 Sep 27 02:42:18.559419 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3811/7577] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:19.394535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:19.395160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:19.397667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:19.398358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:19.404570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:19.405068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:19.405548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:19.406254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:19.406725 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:19.407172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:19.533676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:19.541359 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a844d4d-2060-458e-b6d9-1e98a0d55563 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1363 microversion: 2.1 time: 0.150970 Sep 27 02:42:19.541935 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3767/7578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:19 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:20.561362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:20.566617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:20.567316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:20.573766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:20.574243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:20.574676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:20.575357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:20.575808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:20.576228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:20.706976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:20.715504 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bcfad026-5a40-4fee-8d1a-ff9a1b5eb824 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1554 microversion: 2.1 time: 0.155025 Sep 27 02:42:20.716028 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3812/7579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:20 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:20.738357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:20.738986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:20.745901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:20.746395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:20.746851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:20.747554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:20.748025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:20.748464 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:20.880125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:20.888764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cbf29015-df38-4521-a887-e2d6f76212e5 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1554 microversion: 2.1 time: 0.154196 Sep 27 02:42:20.889429 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3768/7580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:20 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:22.391485 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fbf3bae-ddac-4ed6-a3d0-f07dff59b319"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:22.394000 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:22.400874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:22.401387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:22.401831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:22.402523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:22.402975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:22.403403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:22.665963 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-76f71490-309b-432b-8789-fa631acba036 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "POST /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278033 Sep 27 02:42:22.666594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3813/7581] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:42:22 2022] POST /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:33.368125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:33.368677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:33.371503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:33.372172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:33.378290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:33.378781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:33.379228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:33.379930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:33.380395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:33.380830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:33.462633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lazy-loading 'services' on Instance uuid df606c0b-6ab7-450c-a216-9cb926c88f90 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:42:33.534780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71036f1b-7987-49c3-8514-a90c718122bb tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments/9fbf3bae-ddac-4ed6-a3d0-f07dff59b319" status: 202 len: 0 microversion: 2.1 time: 0.170506 Sep 27 02:42:33.535546 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3769/7582] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:42:33 2022] DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments/9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:42:33.545156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:33.547472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:33.552234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:33.553062 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:42:33.558268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:33.558756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:33.559195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:33.559901 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:33.560357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:33.560785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:33.593859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8f0a0b77-5021-4313-bd97-63a082af578c tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053065 Sep 27 02:42:33.594427 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3814/7583] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:33 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:34.607313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:34.609693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:34.617679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:34.618179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:34.618626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:34.619332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:34.619793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:34.620229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:34.650374 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5cd18457-7a72-48af-9064-943bc080e11b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Sep 27 02:42:34.650937 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3770/7584] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:34 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:35.663010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:35.665277 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:35.672521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:35.673013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:35.673478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:35.674191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:35.674642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:35.675071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:35.708522 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d892a05-e680-4f61-a868-2d860e03e773 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049587 Sep 27 02:42:35.709162 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3815/7585] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:35 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:36.723303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:36.726150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:36.733041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:36.733577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:36.734034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:36.734745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:36.735217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:36.735669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:36.766510 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4389cec1-285f-489b-ba99-38e55dc425f0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047239 Sep 27 02:42:36.767089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3771/7586] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:36 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:37.779265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:37.781488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:37.788919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:37.789427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:37.789869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:37.790564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:37.791021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:37.791451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:37.822002 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0257ceb7-faa9-418f-b8af-b6dd24beb357 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Sep 27 02:42:37.822578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3816/7587] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:37 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:42:38.834521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:38.836724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:38.843374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:38.843871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:38.844317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:38.845021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:38.845514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:38.845953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:38.876091 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2f57d05b-b120-4b19-aa51-eb5b07d30d0e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045517 Sep 27 02:42:38.876665 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3772/7588] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:42:38 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:42:38.888312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:38.888813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:38.895647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:38.896131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:38.896573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:38.897265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:38.898008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:38.898769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:38.978643 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 is not attached to volume 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments/9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 HTTP/1.1 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 is not attached to volume 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': 'df606c0b-6ab7-450c-a216-9cb926c88f90', 'id': '9fbf3bae-ddac-4ed6-a3d0-f07dff59b319'} Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319. Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 is not attached to volume 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:38.980282 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 is not attached to volume 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 is not attached to volume 9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-159b5f4f-2706-4c87-b065-55a30b0a1592 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments/9fbf3bae-ddac-4ed6-a3d0-f07dff59b319" status: 404 len: 154 microversion: 2.1 time: 0.097461 Sep 27 02:42:38.985252 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3817/7589] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:42:38 2022] DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90/os-volume_attachments/9fbf3bae-ddac-4ed6-a3d0-f07dff59b319 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:42:42.325604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:42.326155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:42.333231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:42.334261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:42.334715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:42.335439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:42.335908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:42.336356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:42.363830 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:42:42.446591 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a992a72-9e8f-46f9-bd1f-91c76a9ed9c0 tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 204 len: 0 microversion: 2.1 time: 0.124461 Sep 27 02:42:42.447312 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3773/7590] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:42:42 2022] DELETE /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:42:42.462073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:42.463328 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:42.471299 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:42.471863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:42.472372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:42.473261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:42.473748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:42.474921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:42.604959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:42.613078 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aa318cb7-e06a-4090-8e11-bb0caef12e8b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1560 microversion: 2.1 time: 0.156112 Sep 27 02:42:42.613615 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3818/7591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:42 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:43.642295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:43.643153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:43.650372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:43.650863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:43.651306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:43.652009 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:43.652468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:43.652903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:43.781047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:43.789689 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ce03fa0a-c6f7-4f06-a069-1522fde5213f tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1560 microversion: 2.1 time: 0.157284 Sep 27 02:42:43.790272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3774/7592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:43 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:44.815045 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:44.816573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:44.823715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:44.824208 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:44.824652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:44.825432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:44.825898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:44.826329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:44.884135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df606c0b-6ab7-450c-a216-9cb926c88f90", "name": "network-vif-deleted", "tag": "2720f592-1e95-41a1-945b-3fcfcdaa5082"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:42:44.894339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:44.894831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:44.895278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:44.907770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] Creating event network-vif-deleted:2720f592-1e95-41a1-945b-3fcfcdaa5082 for instance df606c0b-6ab7-450c-a216-9cb926c88f90 on n-h2-859358-1 Sep 27 02:42:44.914688 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-243e4aa4-6fb3-454d-b8d3-bb63cc14bff3 req-40cb11ad-5a1e-4f40-8a06-ab35ca58c416 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Sep 27 02:42:44.915322 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3775/7593] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:42:44.918472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212bb4bafe1c4a4ab38dcbff0dc99e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba13c7c9b834acd80a58a48063af9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:42:44.926740 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3dab482a-f868-44d6-a1f6-526dcf5a094e tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 200 len: 1518 microversion: 2.1 time: 0.116549 Sep 27 02:42:44.927363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3819/7594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:44 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 1518 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:42:45.951978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:45.952696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] [instance: df606c0b-6ab7-450c-a216-9cb926c88f90] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:42:45.958959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:45.959450 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:45.959894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:45.960591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:42:45.961052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:42:45.961522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:42:45.977869 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] HTTP exception thrown: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Request method failure captured: Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 HTTP/1.1 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmKw-yhyrjCWNKxVxeL9paIAz6M-0tPCqiDxb78fsZjW6qraZO1gSRlzMWiho9d04nGx7yTaUiVxhwDWK_t3ziO3sAf5KF-G88b34D2Rnqbv7cMWJNB5uDwyR2eIOr8un9bJrxjx6Ll2KBA8EJFL_UA_s4SPetNkedCo0wztbX-Yh_s Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aba13c7c9b834acd80a58a48063af9de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aba13c7c9b834acd80a58a48063af9de", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: aba13c7c9b834acd80a58a48063af9de Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1970101218 Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 212bb4bafe1c4a4ab38dcbff0dc99e1f Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestEncryptedCinderVolumes-1970101218-project Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'df606c0b-6ab7-450c-a216-9cb926c88f90'} Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:42:45.979489 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Returning 404 to user: Instance df606c0b-6ab7-450c-a216-9cb926c88f90 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2d01073-e98b-44b3-8896-dbdad15b061b tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90" status: 404 len: 111 microversion: 2.1 time: 0.034124 Sep 27 02:42:45.984322 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3776/7595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:42:45 2022] GET /compute/v2.1/servers/df606c0b-6ab7-450c-a216-9cb926c88f90 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:42:45.990577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-03334ee5-e355-405b-b2d1-9d5801d5d0dd tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] Calling method '.version_select at 0x7f24d5fc51f0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:42:46.010640 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-03334ee5-e355-405b-b2d1-9d5801d5d0dd tempest-TestEncryptedCinderVolumes-1970101218 tempest-TestEncryptedCinderVolumes-1970101218-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1649361407" status: 202 len: 0 microversion: 2.1 time: 0.024521 Sep 27 02:42:46.011222 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3820/7596] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 02:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1649361407 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:43:12.965258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b05bd2cf-468b-4d0d-b45d-74fce9cc143d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: .version_select at 0x7f24d5627310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1483609284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC741iswdiYw8AihDrKUjDQOc9HNA66rJjcmhqrv3ZTbVKa20Zof6dPp0Wl08Jpx01mLrcczr+sZJng6InhBJKRlVDeJCZsVpaOv2kp/qI5w1BktiSVjztGS8HUvXYGABA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:12.971001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:12.971672 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:12.985088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b05bd2cf-468b-4d0d-b45d-74fce9cc143d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for project 4efdcf34170d468d9babacb19929f1cd. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:43:12.990411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-b05bd2cf-468b-4d0d-b45d-74fce9cc143d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for user 64f558c5122741b2b6b3eee2681ddb28 and project 4efdcf34170d468d9babacb19929f1cd. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:43:13.013722 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b05bd2cf-468b-4d0d-b45d-74fce9cc143d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052527 Sep 27 02:43:13.014357 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3777/7597] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:43:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:13.061695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=36 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:13.062396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:13.070782 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-772474062", "imageRef": "824a4f8a-7034-4782-9965-056f7e1b5e6d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1483609284", "networks": [{"uuid": "79b55bf7-add9-4ddb-88c6-2dd2d6eb37ac"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:13.123254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] validate_networks() for [('79b55bf7-add9-4ddb-88c6-2dd2d6eb37ac', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:43:13.501069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:43:13.501532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:43:13.502038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:43:13.502459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:43:13.502871 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:43:13.511693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:13.512179 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:13.512619 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:13.513376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:13.513836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:13.514266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:13.531948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for project 4efdcf34170d468d9babacb19929f1cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:43:13.537780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for user 64f558c5122741b2b6b3eee2681ddb28 and project 4efdcf34170d468d9babacb19929f1cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:43:13.550033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:43:13.552948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='824a4f8a-7034-4782-9965-056f7e1b5e6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:43:13.597907 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4d029e92-06aa-4dd7-a610-4816396e2174 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538108 Sep 27 02:43:13.599473 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3821/7598] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:43:13.610092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-493778f4-82af-452e-9e34-fe362a0c34b6 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:13.610724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-493778f4-82af-452e-9e34-fe362a0c34b6 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:13.664359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-493778f4-82af-452e-9e34-fe362a0c34b6 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:13.671410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-493778f4-82af-452e-9e34-fe362a0c34b6 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1258 microversion: 2.1 time: 0.065245 Sep 27 02:43:13.672086 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3778/7599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:13 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:14.696069 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:14.696689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:14.702967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:14.703461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:14.703896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:14.704592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:14.705047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:14.705510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:14.776192 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:14.784139 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5ac552aa-432f-456e-98b4-b5606a711f5d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1310 microversion: 2.1 time: 0.093590 Sep 27 02:43:14.784954 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3822/7600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:14 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:15.816632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:15.818461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:15.831568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:15.832467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:15.834211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:15.835159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:15.835815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:15.836632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:15.995173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:16.003339 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3e39fdf3-8a69-4338-bfbc-53c2c827fcde tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.198754 Sep 27 02:43:16.004109 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3779/7601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:15 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:17.027648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:17.028265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:17.035410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:17.035924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:17.036368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:17.044607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:17.045188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:17.045692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:17.182383 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:17.191014 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f208d02d-1933-43d5-bbb4-8f0a302b0038 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.167187 Sep 27 02:43:17.191605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3823/7602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:17 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:18.214666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:18.215289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:18.223163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:18.223662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:18.224110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:18.224825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:18.225289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:18.225753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:18.381213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:18.389651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9445d7f-d488-40c7-b218-03ca7f126aac tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.178750 Sep 27 02:43:18.390248 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3780/7603] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:18 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:19.412646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:19.413267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:19.420531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:19.421435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:19.421884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:19.422600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:19.423064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:19.423501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:19.562627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:19.571180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-65a63440-4841-4a76-854f-d46156d3f372 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.163031 Sep 27 02:43:19.571767 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3824/7604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:19 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:20.595268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:20.595995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:20.603225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:20.603732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:20.604189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:20.604929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:20.605423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:20.605855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:20.765745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:20.774233 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-776f6eec-d1e9-402b-8fc5-6d5395854039 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.183385 Sep 27 02:43:20.776049 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3781/7605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:20 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:21.798911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:21.799565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:21.806121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:21.806605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:21.807056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:21.807764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:21.808232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:21.808670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:21.949514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:21.958040 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8bb6b7ca-7c20-483a-91c6-10d67f6b7700 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.163147 Sep 27 02:43:21.958632 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3825/7606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:21 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:22.980145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:22.980784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:22.987846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:22.988348 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:22.988801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:22.989626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:22.990101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:22.990575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:23.116092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:23.123902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c7a1c9b-bc21-4b71-92ab-4cf2518e06bc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.147686 Sep 27 02:43:23.124481 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3782/7607] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:22 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:24.147474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:24.148923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:24.152517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:24.153279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:24.159673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:24.160159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:24.160598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:24.161297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:24.162339 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:24.162770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:24.288979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:24.296785 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-45de5020-b5e2-46e1-a266-acf2126ebf30 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.154715 Sep 27 02:43:24.297375 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3826/7608] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:24 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:25.320701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:25.321352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:25.323218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:25.329397 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:25.329898 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:25.330350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:25.331060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:25.331527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:25.331970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:25.461850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:25.469619 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5c3f1c11-a395-44bd-9b7a-d617f3fd4d51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.153414 Sep 27 02:43:25.470189 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3783/7609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:25 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:26.492071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:26.492719 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:26.499892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:26.500375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:26.500809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:26.501527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:26.501982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:26.502406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:26.654549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:26.662318 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8754bde6-c645-4f50-b9ca-5b141fc83cc3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.174151 Sep 27 02:43:26.662904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3827/7610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:26 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:27.186372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:27.197146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:27.197983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:27.198446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:27.209677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] Creating event network-changed:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:43:27.214551 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-89aaab44-2fdb-4d8e-b4b0-cfd768b6b1c1 req-5fcd824c-e50a-42d1-a604-6bb30dc24fde service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031964 Sep 27 02:43:27.215158 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3784/7611] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:27.686088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:27.686653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:27.694046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:27.694526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:27.694958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:27.695641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:27.696090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:27.696511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:27.823330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:27.830967 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d714865-ce17-425a-94d7-897f93312b95 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.148905 Sep 27 02:43:27.831536 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3828/7612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:27 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:28.856195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:28.856857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:28.863132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:28.863660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:28.864106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:28.864806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:28.865274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:28.865741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:28.996405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:29.004369 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87721d1e-1098-46ca-babd-c1bce3267cc8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.153396 Sep 27 02:43:29.005173 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3785/7613] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:28 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:30.026459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:30.026997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:30.033812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:30.034293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:30.034724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:30.035473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:30.035928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:30.036841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:30.167643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:30.175452 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f02d1b9a-e4ae-4927-8f80-6d5ce78d9f51 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.153051 Sep 27 02:43:30.176030 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3829/7614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:30 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:31.199119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:31.199769 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:31.206790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:31.207294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:31.207750 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:31.208465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:31.208936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:31.209411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:31.339359 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:31.347213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fbd6eac8-f6a5-462e-8d73-3678628269fa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.152024 Sep 27 02:43:31.348031 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3786/7615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:31 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:32.369886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:32.370501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:32.377372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:32.377876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:32.378311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:32.379006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:32.379460 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:32.379888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:32.777910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:32.785788 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-59ece68f-e17d-48ed-9f6d-f676bdf1c742 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.419661 Sep 27 02:43:32.786794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3830/7616] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:32 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:32.899211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "name": "network-vif-plugged", "status": "completed", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:32.911465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:32.911963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:32.912411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:32.924553 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] Creating event network-vif-plugged:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:43:32.931242 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f7a44319-a523-4b92-9261-90573940543d req-bf64c089-8644-4de1-bfd4-ebef3eee6153 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036156 Sep 27 02:43:32.931854 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3787/7617] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:33.811679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:33.812297 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:33.824416 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:33.824927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:33.825403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:33.826133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:33.826594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:33.827024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:33.958400 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:33.966966 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c44681bc-4ddf-4440-bc4e-49dd1a65a89c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1358 microversion: 2.1 time: 0.159330 Sep 27 02:43:33.967548 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3831/7618] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:33 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:34.992204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:34.992927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:34.999171 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:34.999663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.000110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.000808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.001266 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.001724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.128972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:35.136888 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-660649e8-4594-4e36-8df4-a27701b85572 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1548 microversion: 2.1 time: 0.150301 Sep 27 02:43:35.137502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3788/7619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:34 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:35.160455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:35.160997 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:35.168699 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.169186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.169669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.170373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.170834 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.171268 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.301991 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:35.310276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-96af317c-838b-4303-baf1-3548a1bbd1d7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1548 microversion: 2.1 time: 0.154165 Sep 27 02:43:35.310856 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3832/7620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:35 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:35.332421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:35.337811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:35.338625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Searching by: {'deleted': False, 'project_id': '4efdcf34170d468d9babacb19929f1cd'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:43:35.344994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.345535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.345990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.346738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.347208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.347657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.370942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:43:35.398232 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8501e85-edaf-46b1-8151-7ac5e72e519f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069619 Sep 27 02:43:35.398819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3789/7621] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 02:43:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:35.410601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:35.411165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:35.417231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.417756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.418199 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.418888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:35.419352 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:35.419783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:35.548741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:35.557187 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6788a709-06c2-43bf-8e26-49e70b7e9050 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1548 microversion: 2.1 time: 0.150565 Sep 27 02:43:35.557791 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3833/7622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:35 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:37.093609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c752dd-7853-445c-b331-88150b49e187"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:37.096022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:37.103463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:37.103958 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:37.104407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:37.105116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:37.105612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:37.106063 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:37.358403 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-408ef680-3d3e-4e3d-a1e6-e328396d2dc4 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268672 Sep 27 02:43:37.359022 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3790/7623] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:43:37 2022] POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:50.401627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:50.402239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:50.404899 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:50.405740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=74 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:50.411564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:50.412044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:50.412475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:50.413164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:50.413645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:50.414067 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:50.544568 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:50.553439 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f775e95d-b8c6-472a-b9d2-ffd880896db9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1594 microversion: 2.1 time: 0.155899 Sep 27 02:43:50.554021 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3834/7624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:50 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:52.551155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:52.552781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:52.553498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:43:52.562878 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:52.578190 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:52.578930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:52.579385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:52.595918 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] Creating event network-changed:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:43:52.601737 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ad739280-949a-42cb-b29b-9d4995eba10b req-c02108d8-5a56-4893-ada0-2f05ed07f5ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052452 Sep 27 02:43:52.602732 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3791/7625] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:43:53.696425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1634154479"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:53.696995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:53.703379 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:53.703855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:53.704288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:53.704978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:53.705455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:53.705880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:53.831051 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Adding security group cc9bdc69-8cbd-4298-944b-657bf459468c to port 592b3860-8548-47f1-94f2-931d893f72fd Sep 27 02:43:54.153319 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-487d884c-58ef-447a-b287-682b9b33bf73 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action" status: 202 len: 0 microversion: 2.1 time: 0.461203 Sep 27 02:43:54.156324 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3835/7626] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:43:53 2022] POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:43:54.170967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:43:54.172302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:43:54.185840 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:54.196557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:54.197491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:54.199096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:54.199685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:54.200487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:54.350569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:43:54.360693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:43:54.361572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:43:54.362279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:43:54.366462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:43:54.374662 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] Creating event network-changed:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:43:54.375242 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b24873c2-40f2-4d00-ab01-70985c10a13a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1759 microversion: 2.1 time: 0.214348 Sep 27 02:43:54.375895 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3792/7627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:43:54 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1759 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:43:54.380566 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-51027afd-702b-4d0b-a1a4-6bca189aa7f0 req-2674e6e2-c81a-4b65-a47f-8a4ee444755f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192060 Sep 27 02:43:54.381252 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3836/7628] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:46:06.954310 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 02:46:06.955068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:46:06.955829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:46:06.957175 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:46:06.957306 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action (ip 10.222.0.52) !!! Sep 27 02:46:06.958594 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:46:06.958594 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action (ip 10.222.0.52) !!! Sep 27 02:46:06.964138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:46:06.966415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:46:06.976802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:06.977302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:06.977793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:06.978507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:06.978982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:06.979427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:07.051077 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1a60994f-7d9f-4d0c-ac1b-604052c78118 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action" status: 202 len: 0 microversion: 2.1 time: 0.099095 Sep 27 02:46:07.051979 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3793/7629] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:46:06 2022] POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:46:07.059027 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:46:07.059912 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:46:07.060543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:46:07.061362 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:46:07.062531 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:46:07.062688 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 (ip 10.222.0.52) !!! Sep 27 02:46:07.064039 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 27 02:46:07.071597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:46:07.072621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:46:07.081256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:07.081780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:07.082217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:07.082921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:07.083374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:07.083804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:07.307061 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:46:07.315827 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-75ce2896-fb9a-4899-8ea4-a81ce1acdbd8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1761 microversion: 2.1 time: 0.258600 Sep 27 02:46:07.316392 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3837/7630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:46:07 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1761 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:46:08.337894 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:46:08.342873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:46:08.343597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:46:08.350895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:08.351393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:08.351844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:08.352555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:46:08.353026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:46:08.353512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:46:08.359051 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39782. Sep 27 02:46:08.549781 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:46:08.559124 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-65a09945-89f9-42bc-9c21-5042fabb66c3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1759 microversion: 2.1 time: 0.222877 Sep 27 02:46:08.559703 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3794/7631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:46:08 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1759 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:47:52.464885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:47:52.465707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:47:52.466713 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:47:52.466903 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action (ip 10.222.0.52) !!! Sep 27 02:47:52.477870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1634154479"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:47:52.478407 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:52.493577 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39814. Sep 27 02:47:52.497354 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39816. Sep 27 02:47:52.501744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:52.502228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:52.502669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:52.503409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:52.503866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:52.504295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:52.632999 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Removing security group cc9bdc69-8cbd-4298-944b-657bf459468c from port 592b3860-8548-47f1-94f2-931d893f72fd Sep 27 02:47:52.934254 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fae0e4e1-4ae1-42ce-87bb-a5bc345dc711 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action" status: 202 len: 0 microversion: 2.1 time: 0.472705 Sep 27 02:47:52.934870 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3838/7632] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:47:52 2022] POST /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:47:52.950155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:47:52.950963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:47:52.956553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:47:52.979849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:52.980613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:52.981248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:52.986751 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39828. Sep 27 02:47:52.997517 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] Creating event network-changed:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:47:53.002830 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-bfa75210-ee36-4936-8ea8-61b1144dd811 req-1ec751f3-6317-4e92-9473-107906c20c2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062892 Sep 27 02:47:53.003743 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3795/7633] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:54.124451 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:54.125009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:54.130963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:54.131449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:54.131891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:54.132590 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:54.133051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:54.133521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:54.215015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lazy-loading 'services' on Instance uuid 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:47:54.289687 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf9bf834-e460-42d5-b334-1b5f5e8abd96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments/26c752dd-7853-445c-b331-88150b49e187" status: 202 len: 0 microversion: 2.1 time: 0.170309 Sep 27 02:47:54.290342 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3839/7634] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:47:54 2022] DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments/26c752dd-7853-445c-b331-88150b49e187 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:47:54.301104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:54.303801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:54.311930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:54.312829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:54.313381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:54.314625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:54.315099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:54.315713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:54.347485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34ccde39-20f9-44e7-b7b3-258f79c4e706 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Sep 27 02:47:54.348072 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3796/7635] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:54 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:55.026258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:47:55.036560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:55.037041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:55.037677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:55.051859 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] Creating event network-changed:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:47:55.057075 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-546c4a56-df5f-48ee-9854-51b69aa9f7cb req-227a858d-211f-4638-a556-e0394de52f25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037533 Sep 27 02:47:55.057759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3840/7636] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:55.361670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:55.364021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:55.371200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:55.371831 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:55.372388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:55.373209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:55.373828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:55.374372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:55.408729 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-956ef89f-047e-458e-9e7d-492c2734d36b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051349 Sep 27 02:47:55.409739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3797/7637] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:55 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:56.422957 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:56.425322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:56.432572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:56.433058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:56.433522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:56.434223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:56.434679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:56.435129 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:56.469519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c24b5857-b745-425f-8b8f-20af42478729 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051593 Sep 27 02:47:56.470124 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3841/7638] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:56 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:57.481292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:57.483525 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:57.490336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:57.490834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:57.491284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:57.491997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:57.492463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:57.492903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:57.522824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9c0ebcd7-9875-4b40-87f2-f5a0df5e8ab1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Sep 27 02:47:57.523284 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3798/7639] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:57 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:58.535757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:58.538281 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:58.545484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:58.546079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:58.546598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:58.547542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:58.548073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:58.548694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:58.579912 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ff531d7c-c369-4924-821e-d535940b49ed tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048477 Sep 27 02:47:58.580797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3842/7640] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:58 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:47:59.593113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:59.595331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:59.602177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:59.602673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:59.603123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:59.603825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:59.604294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:59.604734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:59.633042 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-12e939cb-fe11-4088-bec2-09273ecd5362 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044597 Sep 27 02:47:59.633636 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3799/7641] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:47:59 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:47:59.644805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:47:59.645293 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:47:59.652094 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:59.652574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:59.653010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:59.653735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:47:59.654187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:47:59.654617 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:47:59.728148 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] HTTP exception thrown: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 is not attached to volume 26c752dd-7853-445c-b331-88150b49e187 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Request method failure captured: Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: request: DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments/26c752dd-7853-445c-b331-88150b49e187 HTTP/1.1 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmMyHmHN-GbwhmmPnGv1QG83UY9LQbyxEhXz20XSSIk8Nw5PD5PzmLP57nXA8GwNNq-AHhOuyu_y6UmMmhinlqCWq6I2PiaUzORwulEbWhg1jC-WFQ42V7u4LAmszUkKVx_ZFGRnecoCmM7H1djWD0YVjpBnxmbX4wVvg9Ci-fFZm6U Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4efdcf34170d468d9babacb19929f1cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 64f558c5122741b2b6b3eee2681ddb28 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 is not attached to volume 26c752dd-7853-445c-b331-88150b49e187 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'server_id': '669f04bd-3ef3-4ea0-b049-7ffc5df4ef30', 'id': '26c752dd-7853-445c-b331-88150b49e187'} Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 26c752dd-7853-445c-b331-88150b49e187. Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 is not attached to volume 26c752dd-7853-445c-b331-88150b49e187 Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:47:59.729945 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 is not attached to volume 26c752dd-7853-445c-b331-88150b49e187 Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Returning 404 to user: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 is not attached to volume 26c752dd-7853-445c-b331-88150b49e187 {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3734b875-2b10-4f48-925c-2d6e8cc4e78a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments/26c752dd-7853-445c-b331-88150b49e187" status: 404 len: 154 microversion: 2.1 time: 0.090596 Sep 27 02:47:59.735717 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3843/7642] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:47:59 2022] DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30/os-volume_attachments/26c752dd-7853-445c-b331-88150b49e187 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:48:02.984939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:02.985483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:02.992746 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:02.993248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:02.993738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:02.994510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:02.995465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:02.995908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:03.022196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:48:03.120174 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f45e079-924d-4295-8dda-695848d6ca62 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 204 len: 0 microversion: 2.1 time: 0.138803 Sep 27 02:48:03.120815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3800/7643] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:48:02 2022] DELETE /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:48:03.129157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:03.130024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:03.138007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:03.138504 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:03.138945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:03.139792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:03.140252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:03.141085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:03.319734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:03.328185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b403a33-07ec-4382-be65-0384dc78bc4e tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1554 microversion: 2.1 time: 0.202908 Sep 27 02:48:03.328698 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3844/7644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:03 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:48:04.352716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:04.353482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:04.361034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:04.361570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:04.362021 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:04.362730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:04.363197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:04.363639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:04.491877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:04.500122 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b156e856-010e-42a6-b5a9-988ca892f6e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1554 microversion: 2.1 time: 0.151716 Sep 27 02:48:04.500696 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3801/7645] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:04 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:05.537454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:05.538731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:05.549098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:05.550621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:05.551079 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:05.552238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:05.552724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:05.553165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:05.625936 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:05.633790 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-82848430-038b-4716-9413-223696f45873 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 200 len: 1512 microversion: 2.1 time: 0.113035 Sep 27 02:48:05.634371 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3845/7646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:05 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 1512 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:05.650944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669f04bd-3ef3-4ea0-b049-7ffc5df4ef30", "name": "network-vif-deleted", "tag": "592b3860-8548-47f1-94f2-931d893f72fd"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:05.661714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:05.662213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:05.662668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:05.674709 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] Creating event network-vif-deleted:592b3860-8548-47f1-94f2-931d893f72fd for instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 on n-h2-859358-1 Sep 27 02:48:05.681220 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2944f032-0a92-4b98-b8af-2bd67d11155b req-ce10fd7b-75bf-4f20-80af-c20bc320fb6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096689 Sep 27 02:48:05.682393 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3802/7647] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:06.658030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:06.658672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:06.665858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:06.667112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:06.667549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:06.668259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:06.668725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:06.669160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:06.682925 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] HTTP exception thrown: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Request method failure captured: Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 HTTP/1.1 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmMyHmHN-GbwhmmPnGv1QG83UY9LQbyxEhXz20XSSIk8Nw5PD5PzmLP57nXA8GwNNq-AHhOuyu_y6UmMmhinlqCWq6I2PiaUzORwulEbWhg1jC-WFQ42V7u4LAmszUkKVx_ZFGRnecoCmM7H1djWD0YVjpBnxmbX4wVvg9Ci-fFZm6U Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4efdcf34170d468d9babacb19929f1cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 64f558c5122741b2b6b3eee2681ddb28 Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '669f04bd-3ef3-4ea0-b049-7ffc5df4ef30'} Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:48:06.684477 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Returning 404 to user: Instance 669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34a0dbac-e9b7-4db3-829c-479e534e5c86 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30" status: 404 len: 111 microversion: 2.1 time: 0.031883 Sep 27 02:48:06.689227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3846/7648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:06 2022] GET /compute/v2.1/servers/669f04bd-3ef3-4ea0-b049-7ffc5df4ef30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:48:06.695314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dc86bb5f-3608-4f6b-bb8d-3277ae5867db tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '.version_select at 0x7f24d5067280>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:06.718996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dc86bb5f-3608-4f6b-bb8d-3277ae5867db tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483609284" status: 202 len: 0 microversion: 2.1 time: 0.027821 Sep 27 02:48:06.719489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3803/7649] 10.222.0.52 () {58 vars in 1272 bytes} [Tue Sep 27 02:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1483609284 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:48:15.818822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b6620bca-df84-4564-88f2-579b062fe088 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: .version_select at 0x7f24d651fc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-78170254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqSwGHdUINbIQQJxoec4CFdJK+OR70/2YuRZDeUI9Lu6b4L+1ZQDlN3O8UYAVI+SdXo/F8Y/EurLArkm/9IwY/tUPzORMSbNnRb3tlRLZpqRfNnH8nmeN8HnSNYgw2k1g=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:15.836279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b6620bca-df84-4564-88f2-579b062fe088 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for project 4efdcf34170d468d9babacb19929f1cd. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:48:15.842020 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-b6620bca-df84-4564-88f2-579b062fe088 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for user 64f558c5122741b2b6b3eee2681ddb28 and project 4efdcf34170d468d9babacb19929f1cd. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:48:15.867637 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b6620bca-df84-4564-88f2-579b062fe088 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.052682 Sep 27 02:48:15.868152 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3847/7650] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:48:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:15.916960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:15.921814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1602660182", "imageRef": "59169cd2-5b94-43d8-ad52-3e4b9dcde02a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-78170254", "networks": [{"uuid": "79b55bf7-add9-4ddb-88c6-2dd2d6eb37ac"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:15.974247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] validate_networks() for [('79b55bf7-add9-4ddb-88c6-2dd2d6eb37ac', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:48:16.379523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:48:16.379961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:48:16.380449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:48:16.380868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:48:16.381291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:48:16.390684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:16.391173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:16.391644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:16.392376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:16.392841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:16.393274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:16.410889 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for project 4efdcf34170d468d9babacb19929f1cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:48:16.416018 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Getting quotas for user 64f558c5122741b2b6b3eee2681ddb28 and project 4efdcf34170d468d9babacb19929f1cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:48:16.428093 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:48:16.430516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59169cd2-5b94-43d8-ad52-3e4b9dcde02a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:48:16.478003 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13e5aab3-e6a5-40ce-9b38-01c4388a47b5 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562839 Sep 27 02:48:16.478682 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3804/7651] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:48:16.492047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c59c860b-fd9c-46ba-9895-5e760464a38c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:16.493222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c59c860b-fd9c-46ba-9895-5e760464a38c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:16.550335 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c59c860b-fd9c-46ba-9895-5e760464a38c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:16.559004 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c59c860b-fd9c-46ba-9895-5e760464a38c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1257 microversion: 2.1 time: 0.071317 Sep 27 02:48:16.565433 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3848/7652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:16 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:17.584472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:17.585122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:17.592237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:17.592845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:17.593371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:17.594157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:17.594698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:17.595202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:17.662413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:17.670890 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6a878dc0-223b-4cf6-9139-202569faefab tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1327 microversion: 2.1 time: 0.093275 Sep 27 02:48:17.671519 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3805/7653] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:17 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:18.695361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:18.697013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:18.706171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:18.712447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:18.713986 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:18.714796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:18.715939 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:18.716627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:18.717559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:18.941729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:18.956173 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-896b757b-a65a-42eb-9239-dc205cf0c8cc tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.261006 Sep 27 02:48:18.957136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3849/7654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:18 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:19.980177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:19.981430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:19.988582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:19.989081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:19.989555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:19.990284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:19.990751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:19.991231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:20.169393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:20.177446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c3ab0ac6-9413-4e7e-88ee-9e3a19a71518 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.201218 Sep 27 02:48:20.178055 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3806/7655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:19 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:21.202250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:21.202875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:21.210648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:21.211153 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:21.211597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:21.212315 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:21.212779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:21.213239 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:21.378266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:21.386935 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6c23e78d-d08b-49b7-b132-4dc12c823714 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.189254 Sep 27 02:48:21.387520 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3850/7656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:21 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:22.410246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:22.410879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:22.418030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:22.418535 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:22.418988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:22.419706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:22.420178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:22.420620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:22.588976 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:22.598837 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5588e74b-585b-4560-bfaa-8b7aab0b5a3f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.192355 Sep 27 02:48:22.599698 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3807/7657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:22 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:23.624470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:23.626342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:23.629499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:23.652175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:23.652730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:23.653187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:23.653945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:23.654454 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:23.654891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:23.798857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:23.809413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ac98ccb1-2a88-4b2b-920a-08254cfddb79 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.191058 Sep 27 02:48:23.810738 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3851/7658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:23 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:24.832407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:24.832980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:24.835449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:24.842473 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:24.842987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:24.843441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:24.844170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:24.844643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:24.845089 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:24.989581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:24.997752 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c2f061e-1784-4639-a153-9ce057427bfa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.169245 Sep 27 02:48:24.998499 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3808/7659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:24 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:26.020206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:26.020825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:26.027721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:26.028203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:26.028637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:26.029329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:26.029803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:26.030223 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:26.272815 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:26.281110 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-047ab837-6d31-4540-9f51-aaf8af354422 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.264855 Sep 27 02:48:26.281726 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3852/7660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:26 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:26.651472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:26.658124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:26.658968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:26.664975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:26.665489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:26.666427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:26.679283 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] Creating event network-changed:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:48:26.685650 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-760be288-4348-4a3b-9706-05bd1a2b96e5 req-53859c9d-ef17-4617-9b63-63b5247dadfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037632 Sep 27 02:48:26.686415 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3809/7661] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:27.304109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:27.304653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:27.306761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:27.312854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:27.313346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:27.313790 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:27.314475 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:27.314922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:27.315345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:27.440662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:27.448838 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-52d4fe20-0027-4099-895c-74d63894d80f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.148694 Sep 27 02:48:27.449436 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3853/7662] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:27 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:28.473581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:28.474316 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:28.481049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:28.481578 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:28.482034 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:28.482747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:28.483227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:28.483670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:28.615026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:28.622766 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d384bb7-f370-47ef-be09-c4e84e44655f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.154332 Sep 27 02:48:28.623339 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3810/7663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:28 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:29.644503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:29.645123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:29.652110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:29.652591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:29.653026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:29.653752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:29.654211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:29.654639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:29.783678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:29.792010 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b12ae8fd-01aa-4713-bde7-c0a16465ec81 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.151464 Sep 27 02:48:29.792586 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3854/7664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:29 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:30.815278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:30.815943 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:30.823381 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:30.823896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:30.824346 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:30.825049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:30.825554 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:30.825998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:30.953254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:30.960993 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4af39d0c-296a-4e7e-9d06-a631268bf3a2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.149696 Sep 27 02:48:30.961594 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3811/7665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:30 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:31.984432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:31.985046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:31.992172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:31.992655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:31.993084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:31.993794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:31.994896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:31.995320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:32.125206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:32.133196 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9335805d-007c-49d5-abbe-072c3d0b2055 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.152657 Sep 27 02:48:32.133889 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3855/7666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:31 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:32.311047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "name": "network-vif-plugged", "status": "completed", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:32.320653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:32.321141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:32.321607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:32.335447 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] Creating event network-vif-plugged:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:48:32.340942 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-b8a3fb50-1f7c-493f-9943-27e1a3214fe3 req-155a481a-3313-47b5-95e7-e2646635dee9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090939 Sep 27 02:48:32.341566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3812/7667] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:33.157055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:33.157700 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:33.164484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:33.164965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:33.165494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:33.166186 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:33.166638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:33.167070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:33.576599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:33.584328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4196a295-4c02-4bff-b763-083d95439446 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1357 microversion: 2.1 time: 0.431179 Sep 27 02:48:33.584911 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3856/7668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:33 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1357 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:34.607861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:34.608572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:34.614795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.615287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.615735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.616434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.616897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.617369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.754511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:34.762973 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3762702a-9418-4ed7-954d-e2583eb92953 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1547 microversion: 2.1 time: 0.160216 Sep 27 02:48:34.763548 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3813/7669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:34 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:34.784837 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:34.785587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:34.792327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.792808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.793243 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.793973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.794428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.794892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.924191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:34.933011 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfa7833d-402a-4386-8e09-bf3b4fccf2a3 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1547 microversion: 2.1 time: 0.152067 Sep 27 02:48:34.933987 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3857/7670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:34 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:34.958214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:34.963417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:34.964209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Searching by: {'deleted': False, 'project_id': '4efdcf34170d468d9babacb19929f1cd'} {{(pid=128778) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 02:48:34.970187 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.970689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.971135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.971871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:34.972363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:34.972802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:34.997134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.multi_cell_list [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128778) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 02:48:35.025235 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-272b8745-a383-41c1-b0cf-87e6d8f8ed93 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070942 Sep 27 02:48:35.025875 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3814/7671] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Sep 27 02:48:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:35.037544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:35.038325 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:35.045687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:35.046174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:35.046613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:35.047312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:35.047767 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:35.048196 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:35.175869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:35.184363 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-704e5971-1681-47d4-a6a2-e646e2bf099d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1547 microversion: 2.1 time: 0.150858 Sep 27 02:48:35.184942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3858/7672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:35 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:36.729687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efdfbc9d-984b-4c51-8e80-0a1a806985f7"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:36.732058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:36.738827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:36.739354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:36.739801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:36.740495 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:36.740956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:36.741419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:36.976602 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-862cbbba-4122-4e5b-b08d-c48c1be4b55a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250788 Sep 27 02:48:36.977228 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3815/7673] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Sep 27 02:48:36 2022] POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:47.753279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:47.753931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:47.756775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=15 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:47.757464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=60 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:47.763931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:47.764421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:47.764860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:47.765584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:47.766046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:47.766477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:47.893099 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:47.902025 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9ab3aaa6-78fc-4c59-8fd6-783b4dd2e86f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1593 microversion: 2.1 time: 0.152619 Sep 27 02:48:47.902594 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3859/7674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:47 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:49.537283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:49.546681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:49.547533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=15 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:49.548082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:48:49.551101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:49.551600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:49.552144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:49.567215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] Creating event network-changed:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:48:49.572625 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6003994a-4bfe-4d9f-97f5-7653b18efa3f req-fc7efce0-719f-4db9-8d98-8cc1503bdacc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039185 Sep 27 02:48:49.574201 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3816/7675] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:48:50.514291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-997834072"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:50.514842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:50.525083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:50.525604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:50.526721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:50.527615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:50.528082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:50.528515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:50.672532 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.network.security_group_api [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Adding security group 8b13e51b-404a-4dd8-885f-817fc44287c0 to port a936c639-770e-4c3d-9c9a-ce0bd869e427 Sep 27 02:48:50.997607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c9a10e00-219b-4bb9-afc6-996b76b3b6ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action" status: 202 len: 0 microversion: 2.1 time: 0.487381 Sep 27 02:48:50.998354 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3860/7676] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:48:50 2022] POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:48:51.008418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:48:51.009356 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:48:51.017419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:51.017926 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:51.018419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:51.020286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:51.020771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:51.021218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:51.180276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:48:51.189707 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a8e4dece-9de2-4549-b8bc-b2c129253e11 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1757 microversion: 2.1 time: 0.186841 Sep 27 02:48:51.190318 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3817/7677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:48:51 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:48:51.588808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:48:51.598613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:48:51.599304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:48:51.599818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:48:51.613750 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] Creating event network-changed:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:48:51.619076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e31627f4-8c46-43d5-918f-f9268f30ef61 req-14acf347-a5b4-4ebf-be02-87f12ba1db16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034869 Sep 27 02:48:51.619695 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3861/7678] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:06.211385 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:49:06.213662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:06.217263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:06.217960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=8 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:06.223985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:06.224476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:06.224928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:06.225657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:06.226124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:06.226564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:06.300173 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8f3cdbd0-bbe1-4811-97ee-05575e2161c1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action" status: 202 len: 0 microversion: 2.1 time: 0.092512 Sep 27 02:49:06.300800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3818/7679] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:49:06 2022] POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:49:06.307678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:06.308817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:06.313488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:06.314204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:06.321437 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:06.321918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:06.322447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:06.323163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:06.323606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:06.324033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:06.854456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:06.863399 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8dbcd3f7-21b8-4ad6-8868-5ad3b00a2147 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1749 microversion: 2.1 time: 0.558179 Sep 27 02:49:06.863983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3862/7680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:06 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1749 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:07.888547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:07.889263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:07.895455 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:07.895952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:07.896410 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:07.897111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:07.897611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:07.898077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:08.043632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:08.052499 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecbd257d-085c-4cff-bb8c-49b821470579 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.169185 Sep 27 02:49:08.053260 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3819/7681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:07 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:09.076063 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:09.076681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:09.083664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:09.084147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:09.084581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:09.085280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:09.085762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:09.086191 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:09.232748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:09.241166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81771a40-6cf0-4a5c-ae8b-1b0a51799eb8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.169064 Sep 27 02:49:09.241769 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3863/7682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:09 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:10.265388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:10.266027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:10.272681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:10.273178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:10.273677 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:10.274384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:10.274856 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:10.275305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:10.413250 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:10.421575 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55f3b575-0448-406f-805a-a745d9320d09 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.160711 Sep 27 02:49:10.422150 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3820/7683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:10 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:11.445556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:11.446169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:11.453021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:11.453545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:11.453982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:11.454673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:11.455123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:11.455548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:11.602777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:11.611792 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-210a902a-94c1-4f02-8b4f-de3358ddd2b7 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.170170 Sep 27 02:49:11.612366 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3864/7684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:11 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:12.634903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:12.635558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:12.643109 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:12.643549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:12.644000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:12.644705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:12.645174 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:12.645646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:12.793869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:12.802857 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13aef9b6-df49-46a9-afc4-50e62d4a9128 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.171932 Sep 27 02:49:12.803424 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3821/7685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:12 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:13.828038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:13.828589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:13.835581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:13.836065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:13.836499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:13.837187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:13.837670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:13.838104 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:13.976781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:13.985120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef6ca319-a1df-4790-b6bd-e768f02ef0b2 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.162294 Sep 27 02:49:13.985725 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3865/7686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:13 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:15.008649 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:15.009277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:15.016125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:15.016618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:15.017065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:15.017797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:15.018261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:15.018697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:15.158620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:15.166859 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-38a3c153-73d1-4131-bfb2-acb0f74f9a59 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.162090 Sep 27 02:49:15.167420 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3822/7687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:15 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:16.190881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:16.191474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:16.198296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:16.198776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:16.199203 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:16.199888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:16.200337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:16.200761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:16.341554 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:16.349789 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f7334962-0086-4233-93ba-40f4563c660f tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.162827 Sep 27 02:49:16.350358 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3866/7688] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:16 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:49:17.373679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:17.374261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:17.381163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:17.381698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:17.382151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:17.382855 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:17.383321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:17.383764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:17.525693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:17.533996 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8dfd7da2-e79c-4fc9-a6b3-fe248f0714e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1754 microversion: 2.1 time: 0.164992 Sep 27 02:49:17.534566 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3823/7689] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:17 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:18.557751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:18.558423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:18.565273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:18.565785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:18.566221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:18.566911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:18.567378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:18.567808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:18.710534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:49:18.719716 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-10608c11-52bf-445a-a1d2-50b836c5d4ae tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1757 microversion: 2.1 time: 0.166169 Sep 27 02:49:18.720222 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3867/7690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:49:18 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:49:51.096717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-997834072"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:49:51.097323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:51.099862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=12 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:51.100682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:51.108228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:51.108719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:51.109163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:51.110405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:51.110869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:51.111301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:51.242554 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.network.security_group_api [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Removing security group 8b13e51b-404a-4dd8-885f-817fc44287c0 from port a936c639-770e-4c3d-9c9a-ce0bd869e427 Sep 27 02:49:51.545239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5c601ee-758a-44c8-a384-2ef6e5aa927c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action" status: 202 len: 0 microversion: 2.1 time: 0.452507 Sep 27 02:49:51.546094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3824/7691] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:49:51 2022] POST /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:49:51.563134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:49:51.577184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:51.578872 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=36 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:49:51.580388 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:49:51.580784 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:49:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 02:49:51.586547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:51.587622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:51.588392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:51.612209 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] Creating event network-changed:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:49:51.618418 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-64eab296-5d18-4a78-b1a2-be926efb5bb9 req-112b35c4-e188-4857-8a51-ce72c5a297de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058834 Sep 27 02:49:51.619891 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3868/7692] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:52.674065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:52.674591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:52.681265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:52.681816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:52.682267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:52.683017 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:52.683741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:52.684237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:52.770029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lazy-loading 'services' on Instance uuid a6fdbcb1-a4ca-4723-b967-f802947173d6 {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:49:52.841947 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb58b493-aa59-4fa5-8e75-7414ed40dec8 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments/efdfbc9d-984b-4c51-8e80-0a1a806985f7" status: 202 len: 0 microversion: 2.1 time: 0.172576 Sep 27 02:49:52.842542 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3825/7693] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:49:52 2022] DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments/efdfbc9d-984b-4c51-8e80-0a1a806985f7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:49:52.851546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:52.853902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:52.860221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:52.860698 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:52.861133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:52.861852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:52.862301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:52.862750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:52.893367 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cf957cba-7498-4ded-be0e-05a842a712f1 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Sep 27 02:49:52.893936 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3869/7694] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:52 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:49:53.638639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:49:53.652680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:53.653248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:53.653778 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:53.665000 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] Creating event network-changed:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:49:53.669764 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-36dd3da7-a06c-44a0-8b69-0eb9228146dc req-96b91986-76ed-48c0-9590-6c647e77d206 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038285 Sep 27 02:49:53.670336 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3826/7695] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:53.905948 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:53.908167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:53.915548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:53.916029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:53.916664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:53.917384 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:53.917840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:53.918267 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:53.952413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-09617d78-76cb-4bf4-a590-17dc7eea5f0b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050667 Sep 27 02:49:53.953312 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3870/7696] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:53 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:54.967604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:54.970964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:54.977488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:54.977992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:54.978440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:54.979154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:54.979616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:54.980052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:55.010441 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b456706b-2664-4955-88ec-c2434875c1e9 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048415 Sep 27 02:49:55.011301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3827/7697] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:54 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:56.023691 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:56.025863 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:56.032656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:56.033140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:56.033611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:56.034306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:56.034755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:56.035178 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:56.067999 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37292345-300e-431b-b72d-acbf48c56a1b tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Sep 27 02:49:56.068540 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3871/7698] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:56 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:57.080483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:57.082691 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:57.089625 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:57.090122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:57.090572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:57.091275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:57.091744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:57.092186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:57.122744 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2b7ae311-871e-4800-a4a2-f648de0350aa tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046725 Sep 27 02:49:57.123320 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3828/7699] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:57 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:49:58.134914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:58.137138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:58.144185 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:58.144668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:58.145100 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:58.145818 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:58.146270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:58.146694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:58.176136 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f305a7a0-5ca0-4f40-993b-abb69fb4ec96 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045266 Sep 27 02:49:58.176705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3872/7700] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Sep 27 02:49:58 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 02:49:58.187667 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:49:58.188263 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:49:58.195283 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:58.195784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:58.196236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:58.196966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:49:58.197458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:49:58.197899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:49:58.274470 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] HTTP exception thrown: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 is not attached to volume efdfbc9d-984b-4c51-8e80-0a1a806985f7 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Request method failure captured: Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: request: DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments/efdfbc9d-984b-4c51-8e80-0a1a806985f7 HTTP/1.1 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmMyHmHN-GbwhmmPnGv1QG83UY9LQbyxEhXz20XSSIk8Nw5PD5PzmLP57nXA8GwNNq-AHhOuyu_y6UmMmhinlqCWq6I2PiaUzORwulEbWhg1jC-WFQ42V7u4LAmszUkKVx_ZFGRnecoCmM7H1djWD0YVjpBnxmbX4wVvg9Ci-fFZm6U Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4efdcf34170d468d9babacb19929f1cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 64f558c5122741b2b6b3eee2681ddb28 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 is not attached to volume efdfbc9d-984b-4c51-8e80-0a1a806985f7 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'server_id': 'a6fdbcb1-a4ca-4723-b967-f802947173d6', 'id': 'efdfbc9d-984b-4c51-8e80-0a1a806985f7'} Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id efdfbc9d-984b-4c51-8e80-0a1a806985f7. Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 is not attached to volume efdfbc9d-984b-4c51-8e80-0a1a806985f7 Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:49:58.276121 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 is not attached to volume efdfbc9d-984b-4c51-8e80-0a1a806985f7 Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Returning 404 to user: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 is not attached to volume efdfbc9d-984b-4c51-8e80-0a1a806985f7 {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f9a8f56b-5d2b-4e8b-8ba6-0fd8461cc9af tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments/efdfbc9d-984b-4c51-8e80-0a1a806985f7" status: 404 len: 154 microversion: 2.1 time: 0.094218 Sep 27 02:49:58.280802 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3829/7701] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Sep 27 02:49:58 2022] DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6/os-volume_attachments/efdfbc9d-984b-4c51-8e80-0a1a806985f7 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:50:01.541071 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:01.541616 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:01.548927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:01.549421 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:01.549858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:01.550553 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:01.551128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:01.551420 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:01.576353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:50:01.651410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fcc7732a-9738-4bf3-ae0b-476cf86ede8c tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 204 len: 0 microversion: 2.1 time: 0.113814 Sep 27 02:50:01.652063 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3873/7702] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:50:01 2022] DELETE /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:50:01.661572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:01.662224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:01.670378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:01.670874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:01.671349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:01.672462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:01.672964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:01.673432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:01.809757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:01.818163 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-417054d6-f94c-4a25-8007-51b449bb8155 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1553 microversion: 2.1 time: 0.161574 Sep 27 02:50:01.818739 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3830/7703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:01 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:02.842546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:02.843247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:02.850740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:02.851221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:02.851652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:02.852336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:02.852783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:02.853204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:02.980978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:02.989301 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3e06306c-afb5-4184-b765-eeb2abf1da9d tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1553 microversion: 2.1 time: 0.151086 Sep 27 02:50:02.989914 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3874/7704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:02 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:03.817157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fdbcb1-a4ca-4723-b967-f802947173d6", "name": "network-vif-deleted", "tag": "a936c639-770e-4c3d-9c9a-ce0bd869e427"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:03.826850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:03.827476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:03.827991 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:03.840419 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] Creating event network-vif-deleted:a936c639-770e-4c3d-9c9a-ce0bd869e427 for instance a6fdbcb1-a4ca-4723-b967-f802947173d6 on n-h1-859358-1 Sep 27 02:50:03.845987 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3144d749-2978-43b8-83fb-b22b72383ec2 req-cc473029-d86e-404f-b0ca-e6bf9b47bb15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126497 Sep 27 02:50:03.846583 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3831/7705] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:50:04.012132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:04.012747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:04.020430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:04.020919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:04.021378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:04.022091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:04.022542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:04.022964 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:04.055450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:04.055937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:04.056382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:04.056831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lazy-loading 'fault' on Instance uuid a6fdbcb1-a4ca-4723-b967-f802947173d6 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 02:50:04.102849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f558c5122741b2b6b3eee2681ddb28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efdcf34170d468d9babacb19929f1cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:04.111661 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e9b3ea55-2195-4339-ab40-5ed7d02bfd1a tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 200 len: 1347 microversion: 2.1 time: 0.103382 Sep 27 02:50:04.112257 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3875/7706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:04 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:05.137161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:05.137906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] [instance: a6fdbcb1-a4ca-4723-b967-f802947173d6] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:05.144384 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:05.144879 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:05.145322 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:05.146039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:05.146499 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:05.146936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:05.160213 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] HTTP exception thrown: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Request method failure captured: Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 HTTP/1.1 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmMyHmHN-GbwhmmPnGv1QG83UY9LQbyxEhXz20XSSIk8Nw5PD5PzmLP57nXA8GwNNq-AHhOuyu_y6UmMmhinlqCWq6I2PiaUzORwulEbWhg1jC-WFQ42V7u4LAmszUkKVx_ZFGRnecoCmM7H1djWD0YVjpBnxmbX4wVvg9Ci-fFZm6U Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4efdcf34170d468d9babacb19929f1cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4efdcf34170d468d9babacb19929f1cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 4efdcf34170d468d9babacb19929f1cd Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1986947587 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 64f558c5122741b2b6b3eee2681ddb28 Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestMinimumBasicScenario-1986947587-project Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': 'a6fdbcb1-a4ca-4723-b967-f802947173d6'} Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:50:05.161867 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Returning 404 to user: Instance a6fdbcb1-a4ca-4723-b967-f802947173d6 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d828f931-48ad-4ad7-b6b5-ee07eb2ff125 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6" status: 404 len: 111 microversion: 2.1 time: 0.031240 Sep 27 02:50:05.167176 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3832/7707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:05 2022] GET /compute/v2.1/servers/a6fdbcb1-a4ca-4723-b967-f802947173d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:50:05.171860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-12d30409-cc89-4494-b017-36a1c3775482 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] Calling method '.version_select at 0x7f24d67744c0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:05.193516 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-12d30409-cc89-4494-b017-36a1c3775482 tempest-TestMinimumBasicScenario-1986947587 tempest-TestMinimumBasicScenario-1986947587-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-78170254" status: 202 len: 0 microversion: 2.1 time: 0.025323 Sep 27 02:50:05.194234 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3876/7708] 10.222.0.52 () {58 vars in 1266 bytes} [Tue Sep 27 02:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-78170254 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:50:14.506795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: .version_select at 0x7f24d5067310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-446687860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFREI/gkeGkkkdRos/s7O6RY6m9yEXgaXJBrUfZ2xUjr3jqeSujjR8RDBXGzh/5XHukFt5DBOmcOolMl1obr3I/r8A8ZOPuEhnkARSSaPdBRS1jdcKg9DYHkGFpJ8YwckQ=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:14.522728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:50:14.527876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:50:14.542413 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:50:15.152209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:15.549493 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40380. Sep 27 02:50:15.564902 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-49435920-60a7-41d9-a56e-1ac26a6a43d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.220825 Sep 27 02:50:15.565547 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3833/7709] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:50:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:50:21.549774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:21.551772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:21.556087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1054091461", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a8ac2b1a-952d-4482-946d-a17285da567f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-446687860", "security_groups": [{"name": "tempest-secgroup-smoke-1295156312"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:21.671317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] validate_networks() for [('a8ac2b1a-952d-4482-946d-a17285da567f', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:50:22.182734 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:50:22.183350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:50:22.183579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:50:22.184433 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:50:22.185097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:50:22.196024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:22.196520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:22.196974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:22.197748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:22.198210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:22.198648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:22.218932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:50:22.225434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:50:22.240688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:50:22.243120 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:50:22.307677 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e89812ee-700f-400b-bf5b-a68233dd4005 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760801 Sep 27 02:50:22.309388 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3877/7710] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:50:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:50:22.323895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-25f39000-3a05-45e5-8fe8-47b600aa590c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:22.324688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-25f39000-3a05-45e5-8fe8-47b600aa590c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:22.327191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:22.387814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-25f39000-3a05-45e5-8fe8-47b600aa590c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:22.395960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-25f39000-3a05-45e5-8fe8-47b600aa590c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1266 microversion: 2.1 time: 0.078822 Sep 27 02:50:22.396986 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3834/7711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:22 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:23.420463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:23.421087 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:23.428463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:23.429102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:23.430026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:23.430927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:23.431601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:23.434783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:23.518574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:23.541446 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f335b841-c009-40e6-905e-ceadbc16a647 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1318 microversion: 2.1 time: 0.125896 Sep 27 02:50:23.542742 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3878/7712] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:23 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:24.566511 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:24.567148 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:24.574296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:24.574808 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:24.575472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:24.576379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:24.576847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:24.577566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:24.816292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:24.825763 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20acbbab-f74b-4ebf-9b74-8fc6c98cc05b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.263096 Sep 27 02:50:24.826505 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3835/7713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:24 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:25.280627 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb86c571-5c19-45bb-8052-5efb062ddc9f", "tag": "a51d45cd-24e6-4bd4-bef1-d9069215ab67"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:25.298932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:25.299572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:25.300021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:25.315463 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] Creating event network-changed:a51d45cd-24e6-4bd4-bef1-d9069215ab67 for instance bb86c571-5c19-45bb-8052-5efb062ddc9f on n-h2-859358-1 Sep 27 02:50:25.327446 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-117d0bd0-24a9-4067-a8af-7d27b01f947b req-451feaf0-724c-4396-b659-d33baf5cfd6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050639 Sep 27 02:50:25.329613 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3879/7714] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:50:25.851207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:25.851832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:25.858711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:25.859199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:25.859643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:25.860340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:25.860801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:25.861240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:26.001155 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:26.009007 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68c4a947-9e3c-4863-af0f-324ac7a343fd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.161715 Sep 27 02:50:26.009607 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3836/7715] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:25 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:27.033750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:27.034492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:27.040701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:27.041253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:27.041723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:27.042419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:27.042879 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:27.043312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:27.172927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:27.180698 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef3a9c29-9c60-4e99-af6e-cb96b0b81098 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.152692 Sep 27 02:50:27.181278 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3880/7716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:27 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:28.203115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:28.203753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:28.210594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:28.211097 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:28.211549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:28.212275 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:28.212752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:28.213200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:28.345659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:28.353686 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-50654f10-a06b-47e4-acec-6f871fc522f0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.154399 Sep 27 02:50:28.354275 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3837/7717] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:28 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:29.376008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:29.376649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:29.383674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:29.384167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:29.384602 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:29.385638 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:29.386105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:29.386516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:29.528204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:29.536185 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc3964ed-49fc-4042-af3a-43882a262562 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.164031 Sep 27 02:50:29.536762 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3881/7718] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:29 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:30.558380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:30.559038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:30.566210 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:30.566708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:30.567157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:30.567864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:30.568334 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:30.568779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:30.702751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:30.710616 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-886868d1-fa9d-418e-a8ed-a69193a2fea0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.156212 Sep 27 02:50:30.711206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3838/7719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:30 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:31.388409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb86c571-5c19-45bb-8052-5efb062ddc9f", "name": "network-vif-plugged", "status": "completed", "tag": "a51d45cd-24e6-4bd4-bef1-d9069215ab67"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:31.399572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:31.400065 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:31.400652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:31.412080 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] Creating event network-vif-plugged:a51d45cd-24e6-4bd4-bef1-d9069215ab67 for instance bb86c571-5c19-45bb-8052-5efb062ddc9f on n-h2-859358-1 Sep 27 02:50:31.417294 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-6e5f0335-d109-4a27-91b3-947af2399e25 req-7b5fd30d-06ff-4d47-b02e-f7305d19ed16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032554 Sep 27 02:50:31.417994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3882/7720] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:50:31.733637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:31.734265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:31.741797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:31.742301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:31.742747 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:31.743448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:31.743909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:31.744345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:31.872762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:31.880719 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b85a515f-f973-4550-a116-948ec5461410 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.151000 Sep 27 02:50:31.881294 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3839/7721] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:31 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:32.901148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:32.902053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:32.908777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:32.909742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:32.918322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:32.918942 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:32.919648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:32.920126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:32.920584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:32.921015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:33.057912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:33.066065 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cc4f5040-f57c-48e0-a2c9-0f1c07c33678 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1392 microversion: 2.1 time: 0.165852 Sep 27 02:50:33.066638 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3883/7722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:32 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:34.089630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:34.090255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:34.092079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:50:34.098546 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:34.099038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:34.099486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:34.100184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:34.100654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:34.101092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:34.234988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:34.243406 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-63496d99-4975-4fbb-8e89-aea3e3c20f3d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1564 microversion: 2.1 time: 0.157720 Sep 27 02:50:34.243984 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3840/7723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:34 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:34.265294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:34.265924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:34.272674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:34.273154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:34.273650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:34.274342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:34.274798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:34.275221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:34.409309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:34.417117 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1595c1c-0de1-4fc2-8f64-c74ce018c30f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1564 microversion: 2.1 time: 0.155680 Sep 27 02:50:34.417728 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3884/7724] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:34 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:50:36.310423 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:50:36.311061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:50:36.314575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb86c571-5c19-45bb-8052-5efb062ddc9f", "tag": "a51d45cd-24e6-4bd4-bef1-d9069215ab67"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:50:36.317883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:36.318389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:36.318844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:36.319694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:36.320175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:36.320620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:36.326686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:50:36.327198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:50:36.327642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:50:36.340030 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] Creating event network-changed:a51d45cd-24e6-4bd4-bef1-d9069215ab67 for instance bb86c571-5c19-45bb-8052-5efb062ddc9f on n-h2-859358-1 Sep 27 02:50:36.346671 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-eea2cdf1-5d9f-4217-be10-d505c150c46d req-7cbedb27-0547-46a3-a93f-96836b602568 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037088 Sep 27 02:50:36.347284 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3885/7725] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:50:36.506757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:50:36.514878 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d69f146-c54a-4c2d-9547-9b0a2526a758 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1564 microversion: 2.1 time: 0.208984 Sep 27 02:50:36.515891 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3841/7726] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:50:36 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:09.836549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:09.838878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:09.841177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:09.841853 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:09.848713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:09.849188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:09.849678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:09.850373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:09.850826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:09.851249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:09.936313 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e020a4f5-5553-4245-b076-62d11929deab tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action" status: 200 len: 24572 microversion: 2.1 time: 0.104135 Sep 27 02:51:09.936951 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3886/7727] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:51:09 2022] POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action => generated 24572 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:51:40.367056 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=17 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:40.367824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=42 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:40.369193 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:51:40.369330 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action (ip 10.222.0.52) !!! Sep 27 02:51:40.373785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:40.374331 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:40.384531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:40.385027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:40.385502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:40.386205 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:40.386668 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:40.387105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:40.452119 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b53e8fe9-3389-432e-af74-833861865703 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action" status: 202 len: 0 microversion: 2.1 time: 0.086827 Sep 27 02:51:40.452922 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3842/7728] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:51:40 2022] POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:51:40.467392 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:40.468112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:40.472095 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:40.472736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:40.478989 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:40.479474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:40.479913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:40.480614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:40.481072 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:40.481530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:40.664193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:40.671957 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0628ed2d-9207-4dea-862c-81421c4fddd3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1688 microversion: 2.1 time: 0.208850 Sep 27 02:51:40.672534 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3887/7729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:40 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:41.699005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:41.699724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:41.705952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:41.706452 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:41.707555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:41.708288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:41.708763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:41.709199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:41.887145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:41.894896 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3dc0d05b-6527-4c3b-af7f-f5172e29eef2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1668 microversion: 2.1 time: 0.201308 Sep 27 02:51:41.895450 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3843/7730] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:41 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1668 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:43.003159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:43.005444 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:43.013146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.013664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.014108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.014801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.015255 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.015682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.081616 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aabe83ff-0c76-4aa2-9e74-faf443e4fe21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action" status: 200 len: 32643 microversion: 2.1 time: 0.082252 Sep 27 02:51:43.082250 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3888/7731] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:51:42 2022] POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action => generated 32643 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 02:51:43.093901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:43.094456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:43.101784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.102280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.102732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.103437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.103905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.104344 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.171780 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15a77e83-899e-4212-b9d0-dcb33664dbb7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action" status: 202 len: 0 microversion: 2.1 time: 0.081582 Sep 27 02:51:43.175329 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3844/7732] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:51:43 2022] POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:51:43.181849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:43.182557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:43.190591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.191251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.191849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.192576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:43.193053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:43.193514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:43.330110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:43.338594 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0d4e4953-ef5a-4e5a-a365-5e3b33eec607 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1675 microversion: 2.1 time: 0.160962 Sep 27 02:51:43.339170 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3889/7733] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:43 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:44.366243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:44.366964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:44.373191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:44.373719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:44.374170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:44.374872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:44.375341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:44.375783 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:44.510905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:44.518741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13b554a5-8032-42dd-bd3c-60a665d62ff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1683 microversion: 2.1 time: 0.158182 Sep 27 02:51:44.519308 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3845/7734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:44 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:44.614391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:44.616720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:44.624855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:44.625365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:44.625807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:44.626509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:44.626963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:44.627391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:44.695335 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-99f00afb-bfbc-4e2c-9225-e990c9bdbe62 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action" status: 200 len: 35355 microversion: 2.1 time: 0.085405 Sep 27 02:51:44.695972 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3890/7735] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:51:44 2022] POST /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f/action => generated 35355 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:51:45.758839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:45.759709 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:45.761865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb86c571-5c19-45bb-8052-5efb062ddc9f", "tag": "a51d45cd-24e6-4bd4-bef1-d9069215ab67"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:45.766708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:45.767208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:45.767859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:45.768587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:45.769054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:45.769520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:45.773041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:45.773673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:45.774103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:45.785782 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] Creating event network-changed:a51d45cd-24e6-4bd4-bef1-d9069215ab67 for instance bb86c571-5c19-45bb-8052-5efb062ddc9f on n-h2-859358-1 Sep 27 02:51:45.790870 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-02b7098a-6ef7-4e45-a1ee-1acfe82c32ce req-256f9909-b2fa-4c61-b461-012b112a5d36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033235 Sep 27 02:51:45.792102 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3891/7736] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:51:45.796393 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:51:45.881740 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55acdafd-f5ad-4403-b7c1-c372d90a890a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 204 len: 0 microversion: 2.1 time: 0.126252 Sep 27 02:51:45.882962 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3846/7737] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:51:45 2022] DELETE /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:51:45.893945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:45.894743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:45.901142 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:45.901752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:45.902257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:45.903037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:45.903544 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:45.904056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:46.039659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:46.047400 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1099f2b1-0a67-4a3c-b28c-5b4f2f56d004 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1689 microversion: 2.1 time: 0.159245 Sep 27 02:51:46.047970 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3892/7738] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:45 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:51:47.073821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:47.074548 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:47.081306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:47.081836 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:47.082294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:47.082999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:47.083469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:47.083915 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:47.216116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:47.223884 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed8bbdb2-8d05-43ce-bbcd-ffbc51b41892 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1689 microversion: 2.1 time: 0.154425 Sep 27 02:51:47.224449 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3847/7739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:47 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:48.244585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb86c571-5c19-45bb-8052-5efb062ddc9f", "name": "network-vif-deleted", "tag": "a51d45cd-24e6-4bd4-bef1-d9069215ab67"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:48.247930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:48.248647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:48.256097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:48.256592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:48.257008 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:48.257163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:48.258428 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:48.258905 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:48.259993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:48.260681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:48.261436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:48.273995 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] Creating event network-vif-deleted:a51d45cd-24e6-4bd4-bef1-d9069215ab67 for instance bb86c571-5c19-45bb-8052-5efb062ddc9f on n-h2-859358-1 Sep 27 02:51:48.279180 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-354d2588-f214-47c9-8f6f-f44f5326ef92 req-d12776d0-0bb1-4e8b-8dcc-31aa5b715fd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038383 Sep 27 02:51:48.279937 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3893/7740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:51:48.338273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:48.346054 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d58748ff-7aff-4bee-8681-a7cb38f420b4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 200 len: 1502 microversion: 2.1 time: 0.102555 Sep 27 02:51:48.346622 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3848/7741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:48 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 1502 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:51:49.370350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:49.371056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: bb86c571-5c19-45bb-8052-5efb062ddc9f] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:49.377188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:49.377701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:49.378140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:49.378827 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:49.379278 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:49.379706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:49.392797 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] HTTP exception thrown: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Request method failure captured: Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f HTTP/1.1 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmTlaYhCzmBMnvVU4Pp0BM0ucZc9blqclHjo3pR0kpX05yANTAt7g3sqhXl6pQJJlYSrHVcd5Pt3scDWKSK_kKmlmF8JKSmHcmxeYppR1_oP7gTG5v5Md67kbiUkDTlV8Pc_7FBLW7OOx2iZ2Zgp7EmRN3a3w155k-jPvIcJvifMzmQ Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51de9730ad83427fbbcf9ec5d7d407f9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4153e8ea91314301bb8184bf2e95ab4c Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'bb86c571-5c19-45bb-8052-5efb062ddc9f'} Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:51:49.394922 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Returning 404 to user: Instance bb86c571-5c19-45bb-8052-5efb062ddc9f could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26b72462-a5dd-49a8-b314-a43f8ebf0d34 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f" status: 404 len: 111 microversion: 2.1 time: 0.031090 Sep 27 02:51:49.399692 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3894/7742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:49 2022] GET /compute/v2.1/servers/bb86c571-5c19-45bb-8052-5efb062ddc9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:51:52.633236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-86fd0bea-be36-4dd4-83b6-49512ccafab4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '.version_select at 0x7f24d5627af0>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:52.654892 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-86fd0bea-be36-4dd4-83b6-49512ccafab4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-446687860" status: 202 len: 0 microversion: 2.1 time: 0.025820 Sep 27 02:51:52.655683 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3849/7743] 10.222.0.52 () {58 vars in 1281 bytes} [Tue Sep 27 02:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-446687860 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:51:52.695825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-81964199-5e8d-4bd1-95a2-59ba90889fa5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: .version_select at 0x7f24d583b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1622499092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF7MlnGqW52zwQP11WKujG3lAU5eFbxSkUu/lYCAex5pARMlNgI88jp2t8mA5VuuMbhzwh+FQXhbSK8UtLvCHBnDl6+CU2Yn7wQKECE3aPl1kEBFWAR4HUlFe9DtKU48g=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:52.712519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-81964199-5e8d-4bd1-95a2-59ba90889fa5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:51:52.717659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-81964199-5e8d-4bd1-95a2-59ba90889fa5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:51:52.742417 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-81964199-5e8d-4bd1-95a2-59ba90889fa5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050878 Sep 27 02:51:52.743024 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3895/7744] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:51:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:51:58.290390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-246434217", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "a072080b-39de-47f1-b925-347c1c3321de"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1622499092", "security_groups": [{"name": "tempest-secgroup-smoke-472210335"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:51:58.343051 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:51:58.426693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] validate_networks() for [('a072080b-39de-47f1-b925-347c1c3321de', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:51:58.893297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:51:58.894349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:51:58.894849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:51:58.900545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:51:58.901365 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:51:58.918849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:58.919607 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:58.920708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:58.922935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:51:58.926565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:51:58.927317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:51:58.978965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:51:58.986090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:51:59.002979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:51:59.005794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:51:59.056468 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-055958d7-7aee-40e3-8bf5-f770c1af9ae0 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.771472 Sep 27 02:51:59.057426 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3850/7745] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:51:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:51:59.070644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f274a384-91c5-4d2d-afb5-96d36cbb7d5b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:51:59.071403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f274a384-91c5-4d2d-afb5-96d36cbb7d5b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:51:59.149761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f274a384-91c5-4d2d-afb5-96d36cbb7d5b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:51:59.157731 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f274a384-91c5-4d2d-afb5-96d36cbb7d5b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1266 microversion: 2.1 time: 0.092324 Sep 27 02:51:59.160468 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3896/7746] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:51:59 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:00.182217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:00.184200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:00.194297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:00.195113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:00.196448 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:00.197446 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:00.198184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:00.199011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:00.276273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:00.288841 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3c0db1e6-ced3-4c94-acaf-eb7da5f949fc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1326 microversion: 2.1 time: 0.112254 Sep 27 02:52:00.289455 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3851/7747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:00 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:01.314669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:01.315294 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:01.317963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=32 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:01.326341 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:01.327090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:01.327806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:01.328768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:01.329482 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:01.330150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:01.626669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:01.635244 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b82a69b-6406-4b7b-bbde-901788819010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.326107 Sep 27 02:52:01.635828 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3897/7748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:01 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:01.853092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e7be31-00c6-4848-8b25-57879a7ca1bc", "tag": "ed2b795e-09db-4a2d-8d88-2cd92022c0af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:52:01.871493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:01.871999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:01.872454 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:01.899789 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] Creating event network-changed:ed2b795e-09db-4a2d-8d88-2cd92022c0af for instance 03e7be31-00c6-4848-8b25-57879a7ca1bc on n-h2-859358-1 Sep 27 02:52:01.905156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-2fadc5e3-1067-4bfc-abf9-9cc9cc2cb2de req-1aefaac4-1f16-407b-80ec-d3aa5f4e8b96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055818 Sep 27 02:52:01.905841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3852/7749] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:52:02.658564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:02.659242 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:02.666110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:02.666585 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:02.667019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:02.667708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:02.668164 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:02.668592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:02.803914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:02.812021 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e1da95f2-1a61-4b22-aec8-6cdbf9480635 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.157170 Sep 27 02:52:02.812599 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3898/7750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:02 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:03.837267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:03.838042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:03.844300 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:03.844793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:03.845240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:03.845965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:03.846429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:03.847573 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:03.982436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:03.990705 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-68434c28-30e5-463b-8be1-7f738b517dd5 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.158528 Sep 27 02:52:03.991279 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3853/7751] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:03 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:05.013305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:05.013869 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:05.021274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:05.021783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:05.022220 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:05.022908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:05.023360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:05.023784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:05.153565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:05.161257 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-357bf7be-d2c3-4ab8-9e2a-bf31a4db0539 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.151896 Sep 27 02:52:05.161872 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3899/7752] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:05 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:06.184052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:06.184688 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:06.192404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:06.192901 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:06.193373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:06.194086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:06.194557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:06.195001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:06.326324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:06.334801 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5989da7-749a-43f4-aa00-84b50d27489f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.154650 Sep 27 02:52:06.335372 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3854/7753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:06 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:07.356733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:07.357373 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:07.364327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:07.364810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:07.365250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:07.365970 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:07.366432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:07.366866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:07.498644 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:07.506377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-807d00ad-8b3e-4c47-9808-5bbf9c42c455 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.153538 Sep 27 02:52:07.506952 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3900/7754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:07 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:07.841877 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e7be31-00c6-4848-8b25-57879a7ca1bc", "name": "network-vif-plugged", "status": "completed", "tag": "ed2b795e-09db-4a2d-8d88-2cd92022c0af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:52:07.854938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:07.855678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:07.856028 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:07.868256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] Creating event network-vif-plugged:ed2b795e-09db-4a2d-8d88-2cd92022c0af for instance 03e7be31-00c6-4848-8b25-57879a7ca1bc on n-h2-859358-1 Sep 27 02:52:07.873639 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8e8ed2f6-4c3e-4346-8e6c-18dc643eae0d req-18577979-0ee6-414d-a84f-405e0745fb82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Sep 27 02:52:07.874387 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3855/7755] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:52:08.529576 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:08.530136 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:08.537589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:08.538077 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:08.538516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:08.539210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:08.539683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:08.540110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:08.669954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:08.678239 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5655602e-b45b-471d-bc7d-604d41d1fff3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1391 microversion: 2.1 time: 0.152630 Sep 27 02:52:08.678824 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3901/7756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:08 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:09.773199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:09.773969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:09.778689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:09.779414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:09.786492 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:09.786990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:09.787441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:09.788146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:09.788644 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:09.789085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:09.923294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:09.931604 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-29b6f867-8bc6-4eb7-a59b-5f76f4efefb2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1563 microversion: 2.1 time: 0.160344 Sep 27 02:52:09.932166 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3856/7757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:09 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:09.953866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:09.954479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:09.956351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:09.962794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:09.963286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:09.963721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:09.964417 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:09.964891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:09.965313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:10.099551 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:10.107328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9625d4a2-f24d-4281-b8e2-accf7fce81cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1563 microversion: 2.1 time: 0.157425 Sep 27 02:52:10.107896 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3902/7758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:09 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:11.997601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e7be31-00c6-4848-8b25-57879a7ca1bc", "tag": "ed2b795e-09db-4a2d-8d88-2cd92022c0af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:52:12.006041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:52:12.006676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:12.009622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:12.012068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:12.015433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:12.015945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:12.016389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:12.017113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:12.017626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:12.018068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:12.018938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:12.019657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:12.020109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:12.033598 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] Creating event network-changed:ed2b795e-09db-4a2d-8d88-2cd92022c0af for instance 03e7be31-00c6-4848-8b25-57879a7ca1bc on n-h2-859358-1 Sep 27 02:52:12.039097 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-63f1fd8f-1ca9-48f4-953b-abbb9cf2fd1a req-37fb0489-e289-46e0-a6e7-da5552cd8f4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045184 Sep 27 02:52:12.039766 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3903/7759] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:52:12.171634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:52:12.179738 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c482469-a99c-4539-b2fe-65af5b879ade tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1563 microversion: 2.1 time: 0.188954 Sep 27 02:52:12.180328 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3857/7760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:52:11 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:52:45.471690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:45.472427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:52:45.477285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:52:45.479610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:52:45.486582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:45.487068 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:45.487511 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:45.488206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:52:45.488661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:52:45.489089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:52:45.563531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d0f3fcc0-59c9-4919-a515-1f63668bd339 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action" status: 200 len: 24569 microversion: 2.1 time: 0.093893 Sep 27 02:52:45.564173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3904/7761] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:52:45 2022] POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action => generated 24569 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:53:15.968645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:53:15.969429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:53:15.974168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:53:15.976340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:15.983309 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:15.983828 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:15.984270 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:15.984967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:15.985461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:15.985897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:16.059488 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb5a5ca4-6446-44ec-9533-af9dc0db236c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action" status: 202 len: 0 microversion: 2.1 time: 0.092818 Sep 27 02:53:16.060154 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3858/7762] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:53:15 2022] POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:53:16.069472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:16.071449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:16.074171 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:53:16.074835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:53:16.080949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:16.081469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:16.081913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:16.082621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:16.083084 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:16.083520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:16.295423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:16.303468 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5d8fe7f7-e95e-430f-b77f-9c2719423128 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1674 microversion: 2.1 time: 0.238334 Sep 27 02:53:16.304127 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3905/7763] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:16 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:17.329510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:17.330232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:17.337390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:17.337894 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:17.338343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:17.339055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:17.339576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:17.340019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:17.480440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:17.488255 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1eddf36c-f4f6-4447-ac0c-3e1fdadc8b33 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.164113 Sep 27 02:53:17.488819 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3859/7764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:17 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:18.512510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:18.513128 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:18.520671 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:18.521152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:18.521614 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:18.522301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:18.522752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:18.523175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:18.650531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:18.658360 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3a93aba3-6610-4c25-9db1-c56487322da8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.150297 Sep 27 02:53:18.658958 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3906/7765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:18 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:19.681812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:19.682472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:19.689560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:19.690079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:19.690524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:19.691229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:19.691694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:19.692129 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:19.823158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:19.830878 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a7973659-243c-4cfc-b697-bdd3c152435a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.153008 Sep 27 02:53:19.831435 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3860/7766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:19 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:20.855573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:20.856113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:20.858922 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:53:20.859057 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc (ip 10.222.0.52) !!! Sep 27 02:53:20.867951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:20.868438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:20.868874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:20.869597 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:20.870056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:20.870481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:21.003125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:21.011057 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-87b6be11-dfe9-4987-ab09-70fd952b7b70 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.160387 Sep 27 02:53:21.011685 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3907/7767] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:20 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:22.034790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:22.035347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:22.043238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:22.043730 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:22.044173 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:22.044872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:22.045353 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:22.045800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:22.179178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:22.187660 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-57af3a2b-5ef4-43ac-b3f3-401aa93796cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.156780 Sep 27 02:53:22.188563 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3861/7768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:22 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:23.211685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:23.212303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:23.218306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:23.218784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:23.219228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:23.219917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:23.220369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:23.220794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:23.353463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:23.361491 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-822d2dee-53ff-4e65-9408-a47e8d4bd9e9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.154186 Sep 27 02:53:23.362080 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3908/7769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:23 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:24.385792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:24.386431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:24.393025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:24.393569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:24.394024 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:24.394733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:24.395207 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:24.395652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:24.531208 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:24.539035 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6f72fcde-ef35-4dd0-8e69-4823f96187d6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.157214 Sep 27 02:53:24.540272 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3862/7770] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:24 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:25.563265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:25.563917 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:25.571361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:25.571843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:25.572279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:25.572966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:25.573449 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:25.573881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:25.708287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:25.716103 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dacc7703-8d4c-45bf-b088-590c8dba0dd4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.157023 Sep 27 02:53:25.716618 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3909/7771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:25 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:26.739887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:26.740434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:26.747370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:26.747862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:26.748307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:26.749007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:26.749507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:26.749944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:26.880343 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:26.888518 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-260610c1-bca3-4637-9024-97b5cd87156a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.152637 Sep 27 02:53:26.889089 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3863/7772] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:26 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:27.913811 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:27.915188 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:27.921271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:27.921816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:27.922236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:27.922933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:27.923393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:27.923821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:28.060374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:28.073767 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c03fca41-3c05-4cbf-85d2-e7bd7626f440 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1679 microversion: 2.1 time: 0.165212 Sep 27 02:53:28.074364 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3910/7773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:27 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:53:29.098774 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:53:29.099431 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:53:29.114336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:29.114927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:29.115417 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:29.116154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:53:29.116633 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:53:29.117084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:53:29.250249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:53:29.258045 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ac0eabb0-c462-440c-9b32-655df1219752 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1682 microversion: 2.1 time: 0.163530 Sep 27 02:53:29.258611 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3864/7774] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:53:29 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:01.471739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:01.474054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:01.476264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:01.476923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=36 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:01.483354 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:01.483843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:01.484283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:01.484977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:01.485484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:01.485908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:01.557701 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aaa2abe9-1d01-4290-8654-0b448dbcb8d1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action" status: 200 len: 69137 microversion: 2.1 time: 0.089859 Sep 27 02:54:01.558356 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3911/7775] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:54:01 2022] POST /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc/action => generated 69137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:54:18.578673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:18.579204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:18.581507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:18.582557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:18.582956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:18.583050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:18.591242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:18.591886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:18.592637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:18.593591 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:18.594284 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:18.594806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:18.624512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:54:18.648097 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e7be31-00c6-4848-8b25-57879a7ca1bc", "tag": "ed2b795e-09db-4a2d-8d88-2cd92022c0af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:18.659526 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:18.660014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:18.661376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:18.672389 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] Creating event network-changed:ed2b795e-09db-4a2d-8d88-2cd92022c0af for instance 03e7be31-00c6-4848-8b25-57879a7ca1bc on n-h2-859358-1 Sep 27 02:54:18.677831 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-7ceb7417-e764-4806-95a0-ebd19bd93350 req-e0f011a6-20af-474b-895a-46d04b447ebf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101210 Sep 27 02:54:18.678648 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3912/7776] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:54:18.710914 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6200327c-8a8f-4205-af81-5f8947f02e5a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 204 len: 0 microversion: 2.1 time: 0.137106 Sep 27 02:54:18.711502 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3865/7777] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:54:18 2022] DELETE /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:54:18.730265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:18.731090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:18.738615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:18.739465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:18.740260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:18.741197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:18.741949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:18.742604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:18.894878 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:18.903036 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d8224bb-1ebc-4e48-8a2b-3ebb38117277 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1688 microversion: 2.1 time: 0.179404 Sep 27 02:54:18.903616 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3913/7778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:18 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:19.927075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:19.927794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:19.935427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:19.935920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:19.936367 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:19.937066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:19.937563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:19.938002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:20.071538 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:20.080190 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e435d790-e4f0-44c9-a7fe-51ea900acefa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1688 microversion: 2.1 time: 0.157326 Sep 27 02:54:20.080855 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3866/7779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:19 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:21.035438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e7be31-00c6-4848-8b25-57879a7ca1bc", "name": "network-vif-deleted", "tag": "ed2b795e-09db-4a2d-8d88-2cd92022c0af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:21.046660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:21.047143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:21.047582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:21.059636 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] Creating event network-vif-deleted:ed2b795e-09db-4a2d-8d88-2cd92022c0af for instance 03e7be31-00c6-4848-8b25-57879a7ca1bc on n-h2-859358-1 Sep 27 02:54:21.065440 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d023e688-1ec0-4f12-b106-2cf1c7116496 req-28d51011-a328-4bda-8c82-00f00d91e05a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033661 Sep 27 02:54:21.066061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3914/7780] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:54:21.104797 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:21.105493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:21.112389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:21.112887 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:21.113590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:21.114317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:21.114789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:21.115234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:21.179287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:21.187723 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f2466cc7-3f90-4ade-8472-9dc3442340d8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 200 len: 1351 microversion: 2.1 time: 0.087084 Sep 27 02:54:21.190043 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3867/7781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:21 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:54:22.214629 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:22.215365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 03e7be31-00c6-4848-8b25-57879a7ca1bc] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:22.221606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:22.222108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:22.222523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:22.223214 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:22.223670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:22.224096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:22.237192 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] HTTP exception thrown: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Request method failure captured: Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc HTTP/1.1 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmTlaYhCzmBMnvVU4Pp0BM0ucZc9blqclHjo3pR0kpX05yANTAt7g3sqhXl6pQJJlYSrHVcd5Pt3scDWKSK_kKmlmF8JKSmHcmxeYppR1_oP7gTG5v5Md67kbiUkDTlV8Pc_7FBLW7OOx2iZ2Zgp7EmRN3a3w155k-jPvIcJvifMzmQ Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51de9730ad83427fbbcf9ec5d7d407f9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4153e8ea91314301bb8184bf2e95ab4c Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '03e7be31-00c6-4848-8b25-57879a7ca1bc'} Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:54:22.238831 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Returning 404 to user: Instance 03e7be31-00c6-4848-8b25-57879a7ca1bc could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d23022a-4c74-4bfe-93ee-36cfd49ab12f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc" status: 404 len: 111 microversion: 2.1 time: 0.031496 Sep 27 02:54:22.243410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3915/7782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:22 2022] GET /compute/v2.1/servers/03e7be31-00c6-4848-8b25-57879a7ca1bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:54:25.527612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-119892a2-561a-41c5-b2d1-d9d18653aa21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '.version_select at 0x7f24d611cb80>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:25.532424 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [None req-119892a2-561a-41c5-b2d1-d9d18653aa21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:54:26.540507 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [None req-119892a2-561a-41c5-b2d1-d9d18653aa21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [fdffa5f6-9e89-4bbc-b91c-168f12182b00] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40776. Sep 27 02:54:26.560829 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-119892a2-561a-41c5-b2d1-d9d18653aa21 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1622499092" status: 202 len: 0 microversion: 2.1 time: 1.037386 Sep 27 02:54:26.561437 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3868/7783] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 02:54:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1622499092 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:54:26.590506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: .version_select at 0x7f24d5ec88b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-70545224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1bd7dS49l3odfw7SOZg7dMUP5zR2tFoFQsTjBOzwLrKOlAY7vRC78oxIARo2rDyX8pNVPASh5cixTcv/qs9QnwsG65anW7BhK6hdbZf8+W8IzLw3NrSsTS6axXT8+4zQ=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:26.606601 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:54:26.612396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:54:26.625207 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [c46c9e6a-c05b-4595-be6f-134cc801dbc9] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 02:54:27.632066 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [c46c9e6a-c05b-4595-be6f-134cc801dbc9] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40780. Sep 27 02:54:27.646657 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a0dd64e-830f-4a48-bfb2-e4242f2866e6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.060844 Sep 27 02:54:27.647363 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3916/7784] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:54:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:54:33.067180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:33.071713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1768045372", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "c48c90be-3518-417a-95dc-4b0b024f20c5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-70545224", "security_groups": [{"name": "tempest-secgroup-smoke-346720679"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:33.185236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] validate_networks() for [('c48c90be-3518-417a-95dc-4b0b024f20c5', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:54:33.788168 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:54:33.788656 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:54:33.789288 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:54:33.789814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:54:33.790313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:54:33.801489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:33.804396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:33.804396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:33.805327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:33.806186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:33.806833 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:33.832228 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:54:33.838321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:54:33.862523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:54:33.867037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:54:33.940290 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-13e44aa4-f2f3-4343-9297-2d2f90e8960f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.874122 Sep 27 02:54:33.941105 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3869/7785] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:54:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:54:33.950669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=12 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:33.960688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6258fb1f-06d8-44a7-bd86-5163d184a145 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:33.961557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6258fb1f-06d8-44a7-bd86-5163d184a145 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:34.025058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6258fb1f-06d8-44a7-bd86-5163d184a145 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:34.036585 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6258fb1f-06d8-44a7-bd86-5163d184a145 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1265 microversion: 2.1 time: 0.087559 Sep 27 02:54:34.037304 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3917/7786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:33 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:35.063289 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:35.064906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:35.072297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:35.073673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:35.074421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:35.075396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:35.076087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:35.076758 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:35.246421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:35.264178 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-77d8703e-bdb6-40cd-9cf0-99116eae1a20 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1325 microversion: 2.1 time: 0.205477 Sep 27 02:54:35.264800 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3870/7787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:35 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:36.287306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:36.287931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:36.294855 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:36.295578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:36.296190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:36.297098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:36.297581 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:36.298194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:36.445760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:36.453804 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4f8f561a-6a17-454f-98ad-0c41e991b48e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.170356 Sep 27 02:54:36.454398 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3918/7788] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:36 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:36.731357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:36.746458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:36.747426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:36.748529 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:36.763936 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] Creating event network-changed:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h2-859358-1 Sep 27 02:54:36.770006 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-3c11af43-bbf4-44f5-9188-90586b8fcc5e req-e3a5c5af-9cb5-46e7-8808-853c61783d85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043442 Sep 27 02:54:36.770752 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3871/7789] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:54:37.477422 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:37.478048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:37.485628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:37.486116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:37.486583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:37.487285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:37.487743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:37.488201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:37.620687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:37.628472 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-26621409-707f-4449-938a-3410543eb57e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.154998 Sep 27 02:54:37.629050 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3919/7790] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:37 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:38.652874 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:38.653621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:38.659871 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:38.660368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:38.660820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:38.661558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:38.662029 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:38.662471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:38.793522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:38.801440 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f241353d-2809-440b-a954-ff605635a72e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.153640 Sep 27 02:54:38.802019 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3872/7791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:38 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:39.824262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:39.824906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:39.831860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:39.832296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:39.832737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:39.833472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:39.833941 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:39.834368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:39.962706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:39.970903 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2b7320f5-cf6b-44b6-b940-65c92954d6dd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.150666 Sep 27 02:54:39.971481 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3920/7792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:39 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:40.995748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:40.996463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:41.003203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:41.003690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:41.004389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:41.005088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:41.005590 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:41.006025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:41.134651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:41.142236 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-876a34a9-7995-427a-af3a-a22651c53d52 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.151933 Sep 27 02:54:41.142798 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3873/7793] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:40 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:42.164762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:42.165442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:42.172305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:42.172787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:42.173260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:42.174028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:42.174484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:42.174909 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:42.309107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:42.317204 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-155ee52d-8337-4489-b65d-9d610faff397 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.156381 Sep 27 02:54:42.317820 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3921/7794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:42 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:43.340630 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:43.341254 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:43.348370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:43.348862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:43.349307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:43.350030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:43.350493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:43.350931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:43.484588 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:43.492358 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-28b3446f-2c3f-4da5-b7ce-febb4878175c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.156244 Sep 27 02:54:43.492927 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3874/7795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:43 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:44.516411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:44.517156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:44.519983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:44.525022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:44.525539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:44.525978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:44.526695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:44.527146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:44.527571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:44.577949 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:44.579798 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:44.651427 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "name": "network-vif-plugged", "status": "completed", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:44.661111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:44.661483 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:44.661936 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:44.669808 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:44.673668 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] Creating event network-vif-plugged:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h2-859358-1 Sep 27 02:54:44.678525 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b22503e-6d77-4eec-8800-7be2c84f6393 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.166117 Sep 27 02:54:44.678677 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-92f18af9-d7b3-4e90-ac98-4177a403d32f req-1d1d6519-ef50-4116-9bb3-156f36a770f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106392 Sep 27 02:54:44.679108 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3922/7796] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:44 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:44.679249 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3875/7797] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:54:45.702237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:45.702848 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:45.709667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:45.710144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:45.710574 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:45.711258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:45.711713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:45.712138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:45.843488 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:45.851193 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-13e096a6-c0ec-43f3-a2b4-6cca7719114d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1390 microversion: 2.1 time: 0.152874 Sep 27 02:54:45.851780 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3923/7798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:45 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:46.876072 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:46.876745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:46.882904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:46.883395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:46.883842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:46.884536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:46.884998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:46.885953 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:47.022589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:47.030473 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bae7cba1-ae10-4b72-9074-92d25282f0b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1562 microversion: 2.1 time: 0.159579 Sep 27 02:54:47.031039 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3876/7799] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:46 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:47.052823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:47.053500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:47.060947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:47.061497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:47.061944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:47.062652 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:47.063147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:47.063633 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:47.197520 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:47.205407 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-25bfb4cf-2b51-4bb9-aa46-96a5e70df11a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1562 microversion: 2.1 time: 0.156458 Sep 27 02:54:47.205994 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3924/7800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:47 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:54:48.777290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:54:48.782217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:54:48.786162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:54:48.789019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:48.793919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:54:48.799963 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:48.800477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:48.800930 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:48.801682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:48.802150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:48.802597 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:48.810140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:54:48.810621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:54:48.811059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:54:48.823667 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] Creating event network-changed:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h2-859358-1 Sep 27 02:54:48.828805 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-e978e8ca-a93a-4752-886f-1d8e8ae27098 req-5cac5776-1d3b-4d19-b709-ac238af4cb0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050200 Sep 27 02:54:48.829526 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3925/7801] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:54:49.048268 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:54:49.056651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fcfeb0b7-898a-417a-8455-02ddb14b24ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1562 microversion: 2.1 time: 0.284204 Sep 27 02:54:49.057244 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3877/7802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:54:48 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1562 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:22.379635 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=44 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:22.380390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:22.431190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:55:22.433615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:22.440679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:22.441163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:22.441622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:22.442324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:22.442777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:22.443207 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:22.556059 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f09db289-fcdf-4fa1-836e-426c5ba81392 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action" status: 200 len: 24568 microversion: 2.1 time: 0.178366 Sep 27 02:55:22.556708 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3926/7803] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:55:22 2022] POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action => generated 24568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:55:52.987813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:55:52.990069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:52.992086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:52.992827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=42 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:53.000249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:53.000744 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:53.001195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:53.001924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:53.002388 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:53.002822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:53.042338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:53.048673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Old instance type m1.heat2, new instance type m1.heat {{(pid=128778) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 27 02:55:53.055249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:55:53.055680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:55:53.056163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:55:53.056583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:55:53.057004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:55:53.119422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-11141a8e-b240-48c8-9909-4e95e97f1378 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action" status: 202 len: 0 microversion: 2.1 time: 0.136626 Sep 27 02:55:53.120025 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3878/7804] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:55:52 2022] POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:55:53.129785 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:53.130499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:53.133361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:53.134018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:55:53.140464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:53.140952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:53.141470 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:53.142260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:53.142823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:53.143324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:53.299443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:53.307323 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6f9bc5c0-0b6f-4e2d-84ea-a12c1fd3146a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1690 microversion: 2.1 time: 0.182075 Sep 27 02:55:53.307904 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3927/7805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:53 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:54.333261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:54.333937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:54.341487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:54.341984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:54.342436 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:54.343146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:54.343610 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:54.344044 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:54.474085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:54.481874 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-20aca3a9-ebc4-4657-a939-d967057b1d4b tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1690 microversion: 2.1 time: 0.153541 Sep 27 02:55:54.482421 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3879/7806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:54 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:55.504956 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:55.505612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:55.513311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:55.513830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:55.514261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:55.514951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:55.515405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:55.515833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:55.644676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:55.652501 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8200a26b-0d7a-448b-b729-b98e80f9a6b9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.151430 Sep 27 02:55:55.653649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3928/7807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:55 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:56.677061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:56.677723 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:56.685092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:56.685615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:56.686061 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:56.686755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:56.687217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:56.687650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:56.821409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:56.829075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-75057db8-6b22-4352-9803-62ca8eecfdc8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.156080 Sep 27 02:55:56.829672 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3880/7808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:56 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:57.852152 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:57.852689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:57.859666 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:57.860148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:57.860579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:57.861269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:57.861743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:57.862169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:57.993572 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:58.002056 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5ec6ef5-a3ca-41b2-ad6b-205e2a3e205e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.153836 Sep 27 02:55:58.002642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3929/7809] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:57 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:55:59.025692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:55:59.026257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:55:59.033745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:59.034246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:59.034696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:59.035404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:55:59.035872 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:55:59.036314 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:55:59.168045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:55:59.175808 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4774e7ca-c5bb-4b60-a823-b0b9ab29fc4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.154216 Sep 27 02:55:59.176361 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3881/7810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:55:59 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:00.199779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:00.200385 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:00.207310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:00.207794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:00.208231 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:00.208926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:00.209418 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:00.209852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:00.621156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:00.628869 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3b8948c6-1e03-4284-b061-15fbb7055955 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.433037 Sep 27 02:56:00.629476 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3930/7811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:00 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:01.651999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:01.652621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:01.659993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:01.660484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:01.660929 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:01.661662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:01.662125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:01.662563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:01.789975 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:01.798165 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2eb81ed1-c16b-4443-acf5-51f4b88ee459 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.150017 Sep 27 02:56:01.798734 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3882/7812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:01 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:02.821841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:02.822450 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:02.829464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:02.829943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:02.830372 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:02.831058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:02.831513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:02.831932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:02.966896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:02.974646 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce7c9218-0884-4489-adf9-cfd653ae7eeb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.157015 Sep 27 02:56:02.975216 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3931/7813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:02 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:04.000005 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:04.000564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:04.007788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:04.008278 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:04.008724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:04.009442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:04.009908 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:04.010345 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:04.148149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:04.156090 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e7df9ec9-d5b5-4eee-a353-115935ca9971 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.160681 Sep 27 02:56:04.156668 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3883/7814] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:03 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:56:05.180081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:05.180755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:05.188295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:05.188779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:05.189222 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:05.189945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:05.190408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:05.191110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:05.336640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:05.344469 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe5efb32-fac6-4819-aacd-d507a8d3b9fb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.168350 Sep 27 02:56:05.345046 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3932/7815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:05 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:06.367380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:06.368036 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:06.374899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:06.375394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:06.375842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:06.376551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:06.377022 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:06.377489 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:06.507246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:06.515586 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-97e029fc-8e28-4190-a606-fdd79c068148 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1695 microversion: 2.1 time: 0.152178 Sep 27 02:56:06.516153 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3884/7816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:06 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:07.539318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:07.539874 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:07.547382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:07.547865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:07.548301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:07.549002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:07.549486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:07.549920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:07.760037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:07.768079 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d672a7d0-4923-485f-91ca-b590207b98b7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1694 microversion: 2.1 time: 0.232738 Sep 27 02:56:07.769082 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3933/7817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:07 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:07.859498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "name": "network-vif-unplugged", "status": "completed", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:07.869409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:07.869984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:07.870540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:07.883013 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Creating event network-vif-unplugged:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h1-859358-1 Sep 27 02:56:07.890074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] Instance c733ea05-c798-4a53-960d-467aec2f9173 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:56:07.902331 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-815253b4-cf3b-4b6b-adf6-29b89aa73ef3 req-b99867cb-c597-42cd-99ec-d54532601e16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131747 Sep 27 02:56:07.903982 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3885/7818] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:56:08.792040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:08.792670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:08.800013 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:08.800505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:08.800946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:08.801674 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:08.802134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:08.802565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:08.935334 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:08.943310 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dfe04224-a4db-4842-b18b-5ad785247cf9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1694 microversion: 2.1 time: 0.155183 Sep 27 02:56:08.943942 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3934/7819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:08 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:09.922321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:09.931651 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:09.932131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:09.932569 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:09.944508 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Creating event network-changed:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h1-859358-1 Sep 27 02:56:09.950305 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] Instance c733ea05-c798-4a53-960d-467aec2f9173 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-859358-1', 'n-h1-859358-1'} {{(pid=128778) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 27 02:56:09.960880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0c8b718c-a395-435a-ad55-670608bbfe45 req-b1f5e099-155c-447f-9fe1-9d2a00db7d96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043524 Sep 27 02:56:09.961475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3886/7820] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:56:09.966340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:09.966952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:09.973824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:09.974308 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:09.974740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:09.975435 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:09.975890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:09.976316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:10.142860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:10.151007 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8ea93a7a-3abf-4d9c-bd03-66821008dc8f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1692 microversion: 2.1 time: 0.188586 Sep 27 02:56:10.151589 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3935/7821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:09 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:56:11.175897 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:11.176611 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:11.182794 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.183287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.184215 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.184918 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.185402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.185842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.321225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:11.329485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2b37f14-0ab6-42c4-bffd-1b11a6b5f2cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1689 microversion: 2.1 time: 0.158652 Sep 27 02:56:11.330044 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3887/7822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:11 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:11.353154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:11.353720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:11.360603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.361088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.361559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.362253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.362708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.363141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.421625 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec16cbbc-f3d6-4aca-a3cc-8bc4cc855937 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action" status: 204 len: 0 microversion: 2.1 time: 0.072274 Sep 27 02:56:11.422244 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3936/7823] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:56:11 2022] POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:56:11.430527 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:11.431161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:11.437624 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.438122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.438613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.439327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.439881 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.440329 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.651488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:11.659566 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e7795c4-7d8b-43e4-8606-79f9bbf992f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1689 microversion: 2.1 time: 0.232975 Sep 27 02:56:11.660164 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3888/7824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:11 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:11.685758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:11.686431 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:11.692842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.693324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.693876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.694566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:11.695105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:11.695539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:11.832170 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:11.840134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0cb765ef-23d4-4e61-a22d-957be61b9b83 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1689 microversion: 2.1 time: 0.159694 Sep 27 02:56:11.840705 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3937/7825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:11 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:12.864267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:12.864912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:12.872368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:12.873296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:12.873296 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:12.874108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:12.874580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:12.875025 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:13.010983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:13.019481 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-150f27e2-2ea0-41bf-ad61-04d6cb4b1f61 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1681 microversion: 2.1 time: 0.159427 Sep 27 02:56:13.020141 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3889/7826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:12 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:14.532246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "name": "network-vif-plugged", "status": "completed", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:14.542681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:14.543779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:14.544221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:14.555581 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] Creating event network-vif-plugged:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h1-859358-1 Sep 27 02:56:14.560620 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-d48f11e0-dcd4-4e77-9b26-f198d6a8e092 req-e797a75f-46c9-47be-b2d2-0a4eb112a289 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Sep 27 02:56:14.561224 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3938/7827] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:56:35.200939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:35.203244 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:35.206013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=28 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:35.206693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:35.212191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:35.212689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:35.213140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:35.213912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:35.214362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:35.214811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:35.272889 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-67803982-b0b7-4f1e-a813-fca93300bde1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action" status: 200 len: 24571 microversion: 2.1 time: 0.076047 Sep 27 02:56:35.273590 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3890/7828] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:56:35 2022] POST /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:56:42.276701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:42.279789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:42.280882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:42.285641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:42.292478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:42.297635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:42.298138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:42.298706 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:42.300531 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:42.301116 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:42.301714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:42.302509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:42.303054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:42.303578 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:42.312970 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] Creating event network-changed:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h1-859358-1 Sep 27 02:56:42.319495 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7c7eb5f2-e7c2-42fb-b057-a6d7674ab78f req-fbd89657-9ef5-499c-b476-9190065e31f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046308 Sep 27 02:56:42.320301 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3891/7829] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:56:42.332993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:56:42.421186 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d55f24d-4036-4ec5-bbd7-c71ae1ce1c9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 204 len: 0 microversion: 2.1 time: 0.150666 Sep 27 02:56:42.422183 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3939/7830] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:56:42 2022] DELETE /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:56:42.431350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:42.432073 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:42.439437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:42.439935 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:42.440513 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:42.441528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:42.441998 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:42.442435 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:42.631602 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:42.640187 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-715da5bc-ef73-4d01-b2e6-1279f61add12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1687 microversion: 2.1 time: 0.213471 Sep 27 02:56:42.640770 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3892/7831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:42 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:56:43.664780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:43.665510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:43.672749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:43.673236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:43.673712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:43.674406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:43.674858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:43.675282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:43.900714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:43.909067 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a7e034f-7554-4bc2-a338-684b0f76412f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 200 len: 1687 microversion: 2.1 time: 0.248643 Sep 27 02:56:43.909657 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3940/7832] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:43 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 1687 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:44.336328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c733ea05-c798-4a53-960d-467aec2f9173", "name": "network-vif-deleted", "tag": "159bc127-dcb5-4788-8cc0-0a97e8514d6a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:44.347414 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:44.347979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:44.348469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:44.362156 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] Creating event network-vif-deleted:159bc127-dcb5-4788-8cc0-0a97e8514d6a for instance c733ea05-c798-4a53-960d-467aec2f9173 on n-h1-859358-1 Sep 27 02:56:44.367248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-593edac6-b468-4366-8a47-3cef13f92b86 req-096a2a16-e24c-4ab0-a259-f4ee22f60308 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Sep 27 02:56:44.367854 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3893/7833] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:56:44.933237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:44.933893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: c733ea05-c798-4a53-960d-467aec2f9173] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:44.941506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:44.941987 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:44.942425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:44.943144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:44.943573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:44.944005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:44.957886 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] HTTP exception thrown: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Request method failure captured: Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 HTTP/1.1 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmTlaYhCzmBMnvVU4Pp0BM0ucZc9blqclHjo3pR0kpX05yANTAt7g3sqhXl6pQJJlYSrHVcd5Pt3scDWKSK_kKmlmF8JKSmHcmxeYppR1_oP7gTG5v5Md67kbiUkDTlV8Pc_7FBLW7OOx2iZ2Zgp7EmRN3a3w155k-jPvIcJvifMzmQ Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51de9730ad83427fbbcf9ec5d7d407f9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4153e8ea91314301bb8184bf2e95ab4c Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'c733ea05-c798-4a53-960d-467aec2f9173'} Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:56:44.959510 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Returning 404 to user: Instance c733ea05-c798-4a53-960d-467aec2f9173 could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-088af291-8c60-4ddd-a942-fa9d49e7454e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173" status: 404 len: 111 microversion: 2.1 time: 0.031593 Sep 27 02:56:44.964575 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3941/7834] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:44 2022] GET /compute/v2.1/servers/c733ea05-c798-4a53-960d-467aec2f9173 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:56:48.183784 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-15e721a7-10ba-46d3-a98b-a0aa0e16c084 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '.version_select at 0x7f24c476fa60>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:48.210361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-15e721a7-10ba-46d3-a98b-a0aa0e16c084 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-70545224" status: 202 len: 0 microversion: 2.1 time: 0.031018 Sep 27 02:56:48.211134 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3894/7835] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 02:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-70545224 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:56:48.238275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-35755341-c901-46bd-ae2a-cd98ae047c5f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: .version_select at 0x7f24d66f21f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-91938771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiBhfA0qvOVCKkFe8vmq1vRs2cJdf1dSHczWwbtmKq7ksTx4doweP2DU0el4kBuyrripZNs/BwC5FHwB7OhonsOq2eluEnEfvYWjdVUMc7xZhcuHlhHDSWesAH6eqh8Lg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:48.255605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-35755341-c901-46bd-ae2a-cd98ae047c5f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:56:48.260605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-35755341-c901-46bd-ae2a-cd98ae047c5f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:56:48.284022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-35755341-c901-46bd-ae2a-cd98ae047c5f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049698 Sep 27 02:56:48.284583 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3942/7836] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:56:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:56:53.919161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2124809780", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "9e15b313-0b97-482f-9e6e-7e83f6446e9e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-91938771", "security_groups": [{"name": "tempest-secgroup-smoke-1530454263"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:54.045586 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] validate_networks() for [('9e15b313-0b97-482f-9e6e-7e83f6446e9e', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:56:54.354865 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=14 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:54.472906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:56:54.473487 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:56:54.473981 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:56:54.474400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:56:54.474985 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:56:54.485543 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:54.486472 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:54.487092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:54.488039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:54.488669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:54.489293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:54.512835 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:56:54.518193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:56:54.530577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:56:54.533030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:56:54.580149 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cb502fb1-36bf-4122-8ceb-54675d1972b3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.666194 Sep 27 02:56:54.585391 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3895/7837] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:56:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:56:54.594189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ef101595-af66-4671-a96a-e9f6cf04495d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:54.595032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ef101595-af66-4671-a96a-e9f6cf04495d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:54.658229 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ef101595-af66-4671-a96a-e9f6cf04495d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:54.665451 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ef101595-af66-4671-a96a-e9f6cf04495d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1265 microversion: 2.1 time: 0.076910 Sep 27 02:56:54.666036 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3943/7838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:54 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:56:55.691505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:55.693373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:55.702541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:55.703054 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:55.703576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:55.704303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:55.705317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:55.705816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:55.823420 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:55.839540 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-814c714b-2580-48e1-b663-710eed50ec04 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1325 microversion: 2.1 time: 0.154326 Sep 27 02:56:55.842946 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3896/7839] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:55 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1325 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:56.865777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:56.866423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:56.868502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:56:56.885423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:56.886204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:56.886657 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:56.887380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:56.888725 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:56.889364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:57.043037 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:57.051770 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b8ad4b88-520d-4007-8e62-cfc759065333 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.191379 Sep 27 02:56:57.052362 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3944/7840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:56 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:56:57.678993 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262e7684-effd-4642-ab47-e6c46e622969", "tag": "8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:56:57.691564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:57.692060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:57.692512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:57.704072 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] Creating event network-changed:8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af for instance 262e7684-effd-4642-ab47-e6c46e622969 on n-h2-859358-1 Sep 27 02:56:57.712076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-afac95f6-9a8b-4a63-afa2-d11c69001318 req-ead305c6-b212-4740-b78c-a70117eed9ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034381 Sep 27 02:56:57.712076 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3897/7841] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:56:58.078414 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:58.079575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:58.087754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:58.088327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:58.088840 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:58.089653 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:58.090683 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:58.091812 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:58.233404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:58.241328 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d89c07e1-d663-49b2-804f-e9b57068ecf2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.169071 Sep 27 02:56:58.241929 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3945/7842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:58 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:56:59.265219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:56:59.265965 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:56:59.272248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:59.272716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:59.273163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:59.273903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:56:59.274369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:56:59.274804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:56:59.409647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:56:59.417276 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6cdd39fc-f232-49cf-97d1-9bbbc56cda91 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.157171 Sep 27 02:56:59.417869 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3898/7843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:56:59 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:00.441012 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:00.441918 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:00.448924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:00.449447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:00.449895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:00.450641 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:00.451096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:00.451528 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:00.591584 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:00.599499 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6d031a5d-2d78-4057-8121-2986f9f3d0f1 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.162460 Sep 27 02:57:00.600166 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3946/7844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:00 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:01.623062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:01.623616 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:01.630506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:01.631008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:01.631457 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:01.632166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:01.632635 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:01.633084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:01.767280 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:01.774978 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ed54da93-642d-4e1e-b91f-72f4109ef6cc tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.155998 Sep 27 02:57:01.775564 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3899/7845] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:01 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:02.798708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:02.799357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:02.802529 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:57:02.802668 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 (ip 10.222.0.52) !!! Sep 27 02:57:02.809295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:02.810477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:02.810919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:02.811624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:02.812082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:02.812518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:02.942772 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:02.950531 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1d17c5dc-7e09-4bd3-8467-4743fc12716f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.156239 Sep 27 02:57:02.951221 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3947/7846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:02 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:03.974082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:03.974714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:03.982196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:03.982698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:03.983150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:03.983861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:03.984328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:03.984775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:04.124027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:04.131734 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5d74dca8-161d-477e-84fa-5f6b8944f577 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.161589 Sep 27 02:57:04.132300 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3900/7847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:03 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:05.155177 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:05.155911 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:05.158753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:05.166579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:05.167545 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:05.168198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:05.170029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:05.170833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:05.171549 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:05.258532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e7684-effd-4642-ab47-e6c46e622969", "name": "network-vif-plugged", "status": "completed", "tag": "8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:57:05.283461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:05.284484 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:05.286013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:05.287863 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:05.288308 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:05.288745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:05.304851 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] Creating event network-vif-plugged:8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af for instance 262e7684-effd-4642-ab47-e6c46e622969 on n-h2-859358-1 Sep 27 02:57:05.310864 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-51d47440-68b0-4470-87ec-f73a8ad75649 req-95c66d20-cb6e-4f3f-9419-80e4dc115a72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056042 Sep 27 02:57:05.312228 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3901/7848] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:57:05.330781 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:05.338776 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5dc53e3d-efa8-42af-a74f-c8563549b464 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.187955 Sep 27 02:57:05.339466 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3948/7849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:05 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:06.364204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:06.364839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:06.371307 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:06.371810 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:06.372814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:06.373552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:06.374027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:06.374467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:06.506516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:06.514456 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4e5e65ef-3bed-4798-b35b-6c6308baf000 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1391 microversion: 2.1 time: 0.155828 Sep 27 02:57:06.515029 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3902/7850] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:06 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:07.537550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:07.538163 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:07.545151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:07.545660 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:07.546096 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:07.546776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:07.547257 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:07.547687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:07.676708 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:07.685062 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ef0342f-2d34-49f0-b882-e762625ce706 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1563 microversion: 2.1 time: 0.151049 Sep 27 02:57:07.685683 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3949/7851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:07 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:57:07.709592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:07.710211 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:07.717066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:07.717601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:07.718058 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:07.718762 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:07.719235 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:07.719674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:07.855321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:07.863777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0d69a1c4-324c-4b6d-88ea-779224994219 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1563 microversion: 2.1 time: 0.158113 Sep 27 02:57:07.864286 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3903/7852] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:07 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:09.851440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:57:09.852642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:09.853962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262e7684-effd-4642-ab47-e6c46e622969", "tag": "8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:57:09.860303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:09.861050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:09.861836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:09.862927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:09.863534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:09.864238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:09.866362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:09.866886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:09.867961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:09.879549 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] Creating event network-changed:8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af for instance 262e7684-effd-4642-ab47-e6c46e622969 on n-h2-859358-1 Sep 27 02:57:09.885055 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-9206aa84-3d4f-43e0-a058-594870bb1428 req-5e241267-0c32-45db-9799-ab296676b3ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035299 Sep 27 02:57:09.886126 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3904/7853] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:57:10.012344 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:57:10.021055 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e5b0333d-89d1-4726-ad0f-bc5ca766a017 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1681 microversion: 2.1 time: 0.173960 Sep 27 02:57:10.021874 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3950/7854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:57:09 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:57:43.319485 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=7 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:43.320352 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=44 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:57:43.325521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:57:43.327771 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:57:43.335541 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:43.336040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:43.336491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:43.337217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:57:43.337715 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:57:43.338372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:57:43.407468 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f8cdaadd-9e37-402a-aa33-9433f35c6480 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action" status: 200 len: 24563 microversion: 2.1 time: 0.090176 Sep 27 02:57:43.408102 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3905/7855] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:57:43 2022] POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action => generated 24563 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:58:13.853794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:58:13.854569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=42 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:58:13.858801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:58:13.865789 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:13.866272 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:13.866706 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:13.888563 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Going to try to stop instance {{(pid=128779) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 02:58:13.928707 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7d962b0-d091-4b45-925f-3c772887d16a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action" status: 202 len: 0 microversion: 2.1 time: 0.076643 Sep 27 02:58:13.929370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3951/7856] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:58:13 2022] POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:58:13.938520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:13.938956 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:13.941764 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:58:13.942959 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:58:13.949676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:13.950113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:13.950561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:13.951277 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:13.951745 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:13.952785 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:14.088526 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:14.096776 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-34206f78-f5a6-48c0-a31e-937a771ce928 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.162953 Sep 27 02:58:14.097353 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3906/7857] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:13 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:15.123356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:15.124102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:15.130235 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:15.130711 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:15.131141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:15.131822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:15.132271 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:15.132694 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:15.269133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:15.276851 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dcca56ed-1eec-4fa7-8a86-34c0f1075e92 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.158747 Sep 27 02:58:15.277441 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3952/7858] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:15 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:16.301184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:16.301848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:16.309062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:16.309582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:16.310026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:16.310722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:16.311181 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:16.311615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:16.444814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:16.452621 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-bfc8635f-9efb-4b49-9e9d-d199ddac0021 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.155331 Sep 27 02:58:16.453178 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3907/7859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:16 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:17.476143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:17.476768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:17.484206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:17.484693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:17.485134 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:17.485860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:17.486316 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:17.486749 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:17.615124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:17.622850 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b62aa09c-987d-42f4-a086-e11eba19f95f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.150692 Sep 27 02:58:17.623434 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3953/7860] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:17 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:18.646575 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:18.647202 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:18.654086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:18.654585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:18.655522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:18.656240 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:18.656710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:18.657153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:18.785474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:18.793167 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3735a114-bfa4-455e-b820-e4faf27a49ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.150552 Sep 27 02:58:18.793782 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3908/7861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:18 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:19.817868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:19.818492 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:19.825424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:19.825916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:19.826359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:19.827057 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:19.827516 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:19.827952 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:19.962679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:19.970565 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-90dd7c81-02b6-42d8-9e54-441aeadbfc77 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.156921 Sep 27 02:58:19.971150 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3954/7862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:19 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:20.994400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:20.995052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:21.002310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:21.002834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:21.003404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:21.004094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:21.004726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:21.005176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:21.132886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:21.141215 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e379544d-b6df-4b5d-a8e5-8b8f95b4425d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.150739 Sep 27 02:58:21.141830 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3909/7863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:20 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:22.164121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:22.164739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:22.171664 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:22.172151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:22.172589 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:22.173284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:22.173764 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:22.174195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:22.304906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:22.313216 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c57e03ea-f237-47f7-b378-3c380c3b0a4e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.153029 Sep 27 02:58:22.313819 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3955/7864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:22 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:23.336519 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:23.337145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:23.344327 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:23.344816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:23.345260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:23.345982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:23.346449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:23.346893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:23.498001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:23.505925 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5fedfb49-4f78-4c32-8a5f-34f1a2874ec2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.173300 Sep 27 02:58:23.506492 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3910/7865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:23 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:24.530730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:24.531348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:24.537522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:24.538005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:24.538447 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:24.539145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:24.539606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:24.540036 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:24.673803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:24.681602 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d66b2491-717a-4bc4-91cb-e29144853862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.155226 Sep 27 02:58:24.682180 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3956/7866] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:24 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:25.704165 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:25.704793 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:25.711801 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:25.712299 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:25.712751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:25.713486 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:25.713955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:25.714394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:25.842722 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:25.850404 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d57a898e-3ae0-4bb1-9715-a096844807f2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.150130 Sep 27 02:58:25.850967 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3911/7867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:25 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:26.873388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:26.874456 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:26.881250 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:26.881769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:26.882216 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:26.882907 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:26.883363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:26.883792 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:27.020982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:27.028881 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fdd3dfea-1a3d-49e6-a4fa-acdc06f2b8ee tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.159541 Sep 27 02:58:27.029514 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3957/7868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:26 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:28.052098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:28.052719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:28.059585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:28.060077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:28.060521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:28.061218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:28.061712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:28.062150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:28.197094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:28.205485 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4315ec2a-380f-4163-b8ec-b544d6ec5692 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.157239 Sep 27 02:58:28.206060 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3912/7869] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:28 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:29.229327 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:29.229962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:29.237480 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:29.237959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:29.238393 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:29.239083 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:29.239527 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:29.239947 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:29.380922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:29.388901 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-69a2ce0b-b88b-4861-86f3-d44e9116cd12 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1691 microversion: 2.1 time: 0.163585 Sep 27 02:58:29.390045 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3958/7870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:29 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:30.413662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:30.414285 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:30.421585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:30.422080 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:30.422522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:30.423219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:30.423684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:30.424117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:30.553895 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:30.561835 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-82a1fcd5-adba-46ba-8c06-aac8cab6efdb tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1668 microversion: 2.1 time: 0.152050 Sep 27 02:58:30.562412 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3913/7871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:30 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:31.658459 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:58:31.660659 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:31.667501 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:31.668014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:31.668455 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:31.669150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:31.669648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:31.670080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:31.729755 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ec65dc65-637e-49a1-a913-d1da8d13ffd7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action" status: 200 len: 34837 microversion: 2.1 time: 0.075628 Sep 27 02:58:31.730404 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3959/7872] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:58:31 2022] POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action => generated 34837 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:58:31.742225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:58:31.749144 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:31.749681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:31.750132 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:31.772094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Going to try to start instance {{(pid=128778) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 02:58:31.812960 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3ac1394a-5e4e-44f2-9b66-379f0309d1e7 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action" status: 202 len: 0 microversion: 2.1 time: 0.074555 Sep 27 02:58:31.813598 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3914/7873] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:58:31 2022] POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 02:58:31.822646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:31.823438 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:31.831411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:31.831979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:31.832423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:31.833402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:31.833866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:31.834295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:31.977697 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:31.986329 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df073e99-6f77-4007-a1c1-846960ae16b6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1677 microversion: 2.1 time: 0.167855 Sep 27 02:58:31.986908 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3960/7874] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:31 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:33.011695 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:33.012419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:33.018694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:33.019189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:33.019637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:33.020341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:33.020809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:33.021248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:33.152442 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:33.161026 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23d53e7b-a211-40d0-bd78-0364b9060e26 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1677 microversion: 2.1 time: 0.154622 Sep 27 02:58:33.161646 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3915/7875] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:33 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:58:34.186359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:58:34.187154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:58:34.195261 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:34.195743 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:34.196182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:34.196876 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:58:34.197353 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:58:34.197795 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:58:34.326253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:58:34.334636 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-241209cc-7d53-45cb-8485-aaa24b53dd8a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1681 microversion: 2.1 time: 0.152435 Sep 27 02:58:34.335209 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3961/7876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:58:34 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:06.550637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:06.552838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:06.555336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=20 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:06.556015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:06.562520 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:06.563016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:06.563471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:06.564177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:06.564647 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:06.565091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:06.636623 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b41dcf0e-c554-43e8-8f77-0fb8d047aa1f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action" status: 200 len: 59398 microversion: 2.1 time: 0.089858 Sep 27 02:59:06.637432 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3916/7877] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 02:59:06 2022] POST /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969/action => generated 59398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 02:59:30.159515 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:30.160047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:30.162883 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:59:30.163028 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 02:59:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 (ip 10.222.0.52) !!! Sep 27 02:59:30.163579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262e7684-effd-4642-ab47-e6c46e622969", "tag": "8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:30.164505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=22 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:30.165441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:30.170854 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:30.171368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:30.171881 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:30.172592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:30.173044 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:30.173494 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:30.177001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:30.180583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=4 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:30.183788 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 02:59:30.183933 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 02:59:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 02:59:30.197411 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:30.198271 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:30.198811 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:30.207751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 02:59:30.211745 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] Creating event network-changed:8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af for instance 262e7684-effd-4642-ab47-e6c46e622969 on n-h2-859358-1 Sep 27 02:59:30.217061 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-55fb1a1f-37fe-4259-82d0-61ca03a602fd req-1cb99cbf-0a4e-4b4c-93a9-0a5c90ee5fee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057842 Sep 27 02:59:30.218172 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3917/7878] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:59:30.300772 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9f893d81-553e-4576-8a35-44dab2e6e49e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 204 len: 0 microversion: 2.1 time: 0.145446 Sep 27 02:59:30.304852 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3962/7879] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 02:59:30 2022] DELETE /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 02:59:30.311596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:30.312679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:30.320924 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:30.321601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:30.322161 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:30.323216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:30.323734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:30.324256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:30.459062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:30.467076 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2cd7d597-fe76-4c28-8dbe-081e9270c072 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1687 microversion: 2.1 time: 0.160343 Sep 27 02:59:30.467804 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3918/7880] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:30 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:31.491905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:31.492615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:31.499547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:31.500026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:31.500461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:31.501147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:31.501626 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:31.502050 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:31.639429 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:31.647992 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d938ffdb-eaee-4553-93f7-b3fa89d0dcea tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1687 microversion: 2.1 time: 0.160291 Sep 27 02:59:31.648806 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3963/7881] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:31 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:32.672134 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:32.672839 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:32.679735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:32.680229 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:32.680673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:32.681396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:32.681860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:32.682298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:32.789553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:32.797869 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6586dc5-b35c-4b8d-8199-9be91d0a5291 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 200 len: 1501 microversion: 2.1 time: 0.130108 Sep 27 02:59:32.798481 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3919/7882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:32 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 1501 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:32.881922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262e7684-effd-4642-ab47-e6c46e622969", "name": "network-vif-deleted", "tag": "8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:32.891873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:32.892345 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:32.892770 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:32.903590 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] Creating event network-vif-deleted:8ba922c7-0f3e-4c2f-9f4e-c42dcb78a5af for instance 262e7684-effd-4642-ab47-e6c46e622969 on n-h2-859358-1 Sep 27 02:59:32.909144 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ebaec15e-6a52-4191-a08f-b5554c71027e req-2a4e9b07-dd2a-45b9-b280-ab8cd4d18889 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085096 Sep 27 02:59:32.909794 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3964/7883] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:59:33.823213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:33.823834 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: 262e7684-effd-4642-ab47-e6c46e622969] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:33.831179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:33.831670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:33.832116 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:33.832819 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:33.833282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:33.833763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:33.847455 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] HTTP exception thrown: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Request method failure captured: Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 HTTP/1.1 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmTlaYhCzmBMnvVU4Pp0BM0ucZc9blqclHjo3pR0kpX05yANTAt7g3sqhXl6pQJJlYSrHVcd5Pt3scDWKSK_kKmlmF8JKSmHcmxeYppR1_oP7gTG5v5Md67kbiUkDTlV8Pc_7FBLW7OOx2iZ2Zgp7EmRN3a3w155k-jPvIcJvifMzmQ Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51de9730ad83427fbbcf9ec5d7d407f9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 4153e8ea91314301bb8184bf2e95ab4c Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '262e7684-effd-4642-ab47-e6c46e622969'} Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 02:59:33.849079 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Returning 404 to user: Instance 262e7684-effd-4642-ab47-e6c46e622969 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eb08b449-9f2e-4a83-a608-afc6a7167067 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969" status: 404 len: 111 microversion: 2.1 time: 0.031265 Sep 27 02:59:33.854191 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3920/7884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:33 2022] GET /compute/v2.1/servers/262e7684-effd-4642-ab47-e6c46e622969 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 02:59:37.099978 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7193deca-226d-43d1-94df-8a3bf82d818d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '.version_select at 0x7f24d621c9d0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:37.125247 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7193deca-226d-43d1-94df-8a3bf82d818d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-91938771" status: 202 len: 0 microversion: 2.1 time: 0.029634 Sep 27 02:59:37.126225 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3965/7885] 10.222.0.52 () {58 vars in 1278 bytes} [Tue Sep 27 02:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-91938771 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 02:59:37.160557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-fb543790-258f-4628-8437-58865bd655d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: .version_select at 0x7f24d54101f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1105583830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFildPdV5teM4wmTMtXsaYqSW5Ut9QGGS/fpqdd7YKYoH5A0jod8LG1Ae05P8sV/h6XQYWhfkpzI9BEt5GQE6WLNuhvb1Qv4/FROqicvIwJoM3mO229Z2ZgzN4db3M8fzA=="}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:37.177040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-fb543790-258f-4628-8437-58865bd655d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:59:37.183041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-fb543790-258f-4628-8437-58865bd655d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'key_pairs'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:59:37.213646 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-fb543790-258f-4628-8437-58865bd655d2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057385 Sep 27 02:59:37.214176 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3921/7886] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 02:59:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:59:43.178091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1254244078", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "networks": [{"uuid": "8f10b8f1-2547-4c54-97e3-6ba74643c1c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1105583830", "security_groups": [{"name": "tempest-secgroup-smoke-1625273968"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:43.190686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:43.310803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] validate_networks() for [('8f10b8f1-2547-4c54-97e3-6ba74643c1c1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 02:59:43.836290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 02:59:43.837582 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 02:59:43.838303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 02:59:43.838928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 02:59:43.839583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 02:59:43.849503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:43.850118 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:43.850937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:43.851910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:43.852606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:43.853472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:43.886244 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 02:59:43.891798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Getting quotas for user 4153e8ea91314301bb8184bf2e95ab4c and project 51de9730ad83427fbbcf9ec5d7d407f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 02:59:43.904951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 02:59:43.907643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 02:59:43.961057 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-adec3f09-93b4-4b9c-9f5a-f052005f9b2f tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787017 Sep 27 02:59:43.961759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3966/7887] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 02:59:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 02:59:43.971451 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=16 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:43.976643 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-96cbbd10-6796-4683-91f1-ec79e07d83a4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:43.977282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-96cbbd10-6796-4683-91f1-ec79e07d83a4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:44.033468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-96cbbd10-6796-4683-91f1-ec79e07d83a4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:44.040587 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-96cbbd10-6796-4683-91f1-ec79e07d83a4 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1267 microversion: 2.1 time: 0.070973 Sep 27 02:59:44.050076 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3922/7888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:43 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:59:45.067313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:45.068842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:45.080138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:45.080639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:45.081364 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:45.082080 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:45.082586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:45.083049 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:45.188518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:45.198523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a39cb8fd-c9e0-4e2a-b604-75ec4b957576 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1327 microversion: 2.1 time: 0.136774 Sep 27 02:59:45.199808 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3967/7889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:45 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:46.222501 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:46.223145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:46.230530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:46.231032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:46.231481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:46.232195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:46.232653 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:46.233090 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:46.422415 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:46.431099 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-23d6efc8-194d-4acc-9b32-8550d7f877de tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.213126 Sep 27 02:59:46.431674 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3923/7890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:46 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:46.715103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eace86ca-fbd2-4182-90a4-0a2b4ae30a9b", "tag": "0c8b2114-ecfe-411d-8260-37ec1b78a79f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:46.726658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:46.727123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:46.727730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:46.740391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] Creating event network-changed:0c8b2114-ecfe-411d-8260-37ec1b78a79f for instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b on n-h2-859358-1 Sep 27 02:59:46.745914 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-ddb3d90b-229b-4d44-bcba-10fa208d6436 req-a63c83ff-9848-4af2-981e-946ef653b3ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 27 02:59:46.746734 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3968/7891] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:59:47.455401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:47.456030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:47.463282 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:47.464260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:47.464260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:47.464896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:47.465378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:47.465821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:47.599372 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:47.607043 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dce591b7-43e9-4ce0-9371-30da1de9687c tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.156056 Sep 27 02:59:47.607623 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3924/7892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:47 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:48.631930 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:48.632634 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:48.638826 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:48.639302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:48.640337 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:48.641055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:48.641533 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:48.641958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:48.776131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:48.783940 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-61cae49a-4693-4811-9187-7ec2470b052e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.157215 Sep 27 02:59:48.784513 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3969/7893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:48 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:59:49.806711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:49.807260 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:49.814287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:49.814779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:49.815686 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:49.816391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:49.816857 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:49.819163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:49.948790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:49.957570 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b5e26a6e-b0fd-4ce8-b6ee-4a7dc5a6b7a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.155052 Sep 27 02:59:49.958134 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3925/7894] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:49 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:50.980156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:50.980819 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:50.988723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:50.989210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:50.989672 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:50.990375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:50.990830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:50.991256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:51.125151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:51.132770 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f6845fbc-c842-41de-8eb2-41ee72d0af87 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.156564 Sep 27 02:59:51.133370 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3970/7895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:50 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:52.155972 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:52.156609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:52.163544 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:52.164043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:52.164510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:52.165200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:52.165702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:52.166147 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:52.298042 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:52.306132 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a9a617d6-1619-435f-af47-d8c220576ac8 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.154008 Sep 27 02:59:52.306720 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3926/7896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:52 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:53.329110 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:53.329758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:53.336117 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:53.336603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:53.337041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:53.337769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:53.338225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:53.338655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:53.474390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:53.482085 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f1b56b0c-1206-404e-893b-c8d1496a6231 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.157907 Sep 27 02:59:53.482656 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3971/7897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:53 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:53.930724 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eace86ca-fbd2-4182-90a4-0a2b4ae30a9b", "name": "network-vif-plugged", "status": "completed", "tag": "0c8b2114-ecfe-411d-8260-37ec1b78a79f"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:53.942032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:53.942524 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:53.942967 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:53.957412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] Creating event network-vif-plugged:0c8b2114-ecfe-411d-8260-37ec1b78a79f for instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b on n-h2-859358-1 Sep 27 02:59:53.962784 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-43424688-a97b-4256-9e61-37bff813bde5 req-8034ab95-dc76-4ba8-85ce-7f433b7ab8f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086476 Sep 27 02:59:53.963424 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3927/7898] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 02:59:54.506594 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:54.507206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:54.509154 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:54.513557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:54.517484 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:54.517969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:54.518408 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:54.519102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:54.519552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:54.519977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:54.650816 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:54.658981 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b0319ad7-d68c-45a9-89c5-ea02f5e85264 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1393 microversion: 2.1 time: 0.156538 Sep 27 02:59:54.659563 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3972/7899] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:54 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 02:59:55.682896 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:55.683536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:55.685622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 02:59:55.692406 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:55.692912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:55.693704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:55.694469 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:55.694952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:55.695401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:55.834222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:55.842051 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d49e38d8-fcc9-4073-b353-e18457059862 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1566 microversion: 2.1 time: 0.163806 Sep 27 02:59:55.842630 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3928/7900] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:55 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:55.865115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:55.865775 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:55.875709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:55.876193 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:55.876631 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:55.877331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:55.877809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:55.878240 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:56.006912 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:56.015358 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-340f1592-98d7-4bf6-bddb-0fc3b67fab9e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1566 microversion: 2.1 time: 0.154237 Sep 27 02:59:56.016545 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3973/7901] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:55 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 02:59:57.569055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 02:59:57.569718 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 02:59:57.575183 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eace86ca-fbd2-4182-90a4-0a2b4ae30a9b", "tag": "0c8b2114-ecfe-411d-8260-37ec1b78a79f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 02:59:57.589751 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:57.590248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:57.590700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:57.591416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:57.591883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:57.595739 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 02:59:57.596217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 02:59:57.596648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:57.600792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 02:59:57.608128 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] Creating event network-changed:0c8b2114-ecfe-411d-8260-37ec1b78a79f for instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b on n-h2-859358-1 Sep 27 02:59:57.614068 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2ca37c0b-2da8-4584-8f43-5f049f047b5e req-da46f853-01db-4cc1-ac1e-8c97334fa772 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042382 Sep 27 02:59:57.614889 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3974/7902] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 02:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 02:59:58.168370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 02:59:58.179869 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-364b979a-86de-4647-9c37-0c199521c010 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1566 microversion: 2.1 time: 0.614954 Sep 27 02:59:58.193360 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3929/7903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 02:59:57 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1566 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:00:31.474713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:00:31.475466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=42 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:00:31.710402 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:00:31.712813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:00:31.719041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:00:31.719530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:00:31.719975 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:00:31.720675 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:00:31.721137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:00:31.721600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:00:31.792525 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c81d5e56-6405-4af9-9dd6-7a72d663d15d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action" status: 200 len: 24574 microversion: 2.1 time: 0.323284 Sep 27 03:00:31.793143 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3975/7904] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:00:31 2022] POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action => generated 24574 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 03:01:02.191946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:02.192721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=38 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:02.197200 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:02.197776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:02.204735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:02.205231 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:02.205705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:02.206902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:02.207370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:02.207814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:02.231138 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lazy-loading 'flavor' on Instance uuid eace86ca-fbd2-4182-90a4-0a2b4ae30a9b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:01:02.294986 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a6336f49-2cd7-4a3a-be0f-5bdf7e599d7d tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.105015 Sep 27 03:01:02.296318 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3930/7905] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:01:02 2022] POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:01:02.305052 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:02.305888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:02.309728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:02.310377 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:02.314521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:02.315011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:02.316275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:02.316979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:02.317469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:02.317903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:02.454934 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:02.463481 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8c221e60-9db7-45af-b25c-234cd5c0c9f9 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1692 microversion: 2.1 time: 0.163295 Sep 27 03:01:02.464061 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3976/7906] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:02 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:01:03.490508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:03.491232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:03.497400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:03.497900 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:03.498354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:03.499055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:03.499523 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:03.499964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:03.630596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:03.638403 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6e47a529-245b-40e8-9d18-9e3f66863c03 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1692 microversion: 2.1 time: 0.154057 Sep 27 03:01:03.638981 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3931/7907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:03 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:04.662406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:04.663018 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:04.669945 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:04.670428 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:04.670864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:04.671548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:04.671999 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:04.672424 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:04.809159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:04.817541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1de8364d-a932-45d2-8400-48050dfd05c6 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1675 microversion: 2.1 time: 0.159571 Sep 27 03:01:04.818136 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3977/7908] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:04 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:05.910928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:05.913230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:05.920273 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:05.920777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:05.921227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:05.921974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:05.922445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:05.922888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:05.983469 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-075fa315-de97-415c-b644-c042982df556 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action" status: 200 len: 37722 microversion: 2.1 time: 0.076783 Sep 27 03:01:05.984350 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3932/7909] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:01:05 2022] POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action => generated 37722 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 03:01:05.996029 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:05.996552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:06.003466 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:06.003950 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:06.004387 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:06.005078 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:06.005567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:06.005994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:06.085022 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-df875f1f-8dd7-4a8b-b0e3-b995e74670a2 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.091769 Sep 27 03:01:06.089040 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3978/7910] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:01:05 2022] POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:01:06.094899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:06.095716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:06.104507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:06.105016 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:06.105512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:06.106265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:06.106733 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:06.107175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:06.291227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:06.299090 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a435eb75-9ce2-4794-93ad-1926373469bd tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1681 microversion: 2.1 time: 0.208570 Sep 27 03:01:06.299658 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3933/7911] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:06 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:07.323677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:07.324389 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:07.332571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:07.333054 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:07.333517 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:07.334204 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:07.334658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:07.335081 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:07.467210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:07.475005 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7cbc663b-c891-433e-a606-2c2ce29c0150 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1681 microversion: 2.1 time: 0.156238 Sep 27 03:01:07.475588 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3979/7912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:07 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:08.498468 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:08.499102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:08.506274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:08.506775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:08.507224 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:08.507934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:08.508405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:08.508848 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:08.637507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:08.645272 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9a1c2737-9ce4-4cd7-ba2c-c29e0fcecd98 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1684 microversion: 2.1 time: 0.150885 Sep 27 03:01:08.645876 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3934/7913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:08 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:08.744703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:08.747130 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:08.753979 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:08.754469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:08.754908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:08.755603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:08.756060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:08.756489 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:08.818152 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9fe3133e-19e8-4c68-97e9-9da6a6f34633 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action" status: 200 len: 37722 microversion: 2.1 time: 0.077357 Sep 27 03:01:08.818783 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3980/7914] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:01:08 2022] POST /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b/action => generated 37722 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 03:01:09.826101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:09.826731 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:09.833849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:09.834477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:09.835053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:09.835880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:09.836537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:09.837084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:09.863899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 03:01:09.874898 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eace86ca-fbd2-4182-90a4-0a2b4ae30a9b", "tag": "0c8b2114-ecfe-411d-8260-37ec1b78a79f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:09.886889 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:09.887647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:09.888275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:09.899359 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] Creating event network-changed:0c8b2114-ecfe-411d-8260-37ec1b78a79f for instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b on n-h2-859358-1 Sep 27 03:01:09.905703 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-2409099c-4392-4212-ba0f-9f2c0813c76f req-802ece15-e8f3-434b-8dcd-74ccba2179d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087263 Sep 27 03:01:09.906318 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3981/7915] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:01:09.954239 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e6f55a52-aa20-4231-b9b6-a5a7ec9dbdf3 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 204 len: 0 microversion: 2.1 time: 0.139525 Sep 27 03:01:09.955087 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3935/7916] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 03:01:09 2022] DELETE /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 03:01:09.971514 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:09.972219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:09.980047 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:09.980532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:09.980968 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:09.981701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:09.982336 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:09.982949 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:10.119090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:10.127006 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2265086-9788-4487-bed5-8bfd2aa23a6e tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1690 microversion: 2.1 time: 0.160222 Sep 27 03:01:10.127574 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3982/7917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:09 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:11.152086 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:11.152861 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:11.161577 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:11.162074 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:11.162517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:11.163216 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:11.163678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:11.164112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:11.344990 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:11.353544 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-60f94767-320d-4eeb-9b2a-114670457d00 tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1690 microversion: 2.1 time: 0.205668 Sep 27 03:01:11.354120 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3936/7918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:11 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:12.227921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eace86ca-fbd2-4182-90a4-0a2b4ae30a9b", "name": "network-vif-deleted", "tag": "0c8b2114-ecfe-411d-8260-37ec1b78a79f"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:12.239890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:12.240391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:12.240839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:12.251810 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] Creating event network-vif-deleted:0c8b2114-ecfe-411d-8260-37ec1b78a79f for instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b on n-h2-859358-1 Sep 27 03:01:12.256876 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-aa885e36-3012-4106-adbb-b6aed2f61d10 req-50509844-9c7e-4c5a-8450-e129e62843f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Sep 27 03:01:12.257517 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3983/7919] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:01:12.378246 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:12.378966 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:12.386479 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:12.386921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:12.387373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:12.388084 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:12.388565 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:12.388994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:12.421938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:12.422441 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:12.422890 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:12.423355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lazy-loading 'fault' on Instance uuid eace86ca-fbd2-4182-90a4-0a2b4ae30a9b {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:01:12.465001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4153e8ea91314301bb8184bf2e95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51de9730ad83427fbbcf9ec5d7d407f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:12.472971 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-551e9b2c-4dc1-418e-ae07-002edb7811aa tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 200 len: 1357 microversion: 2.1 time: 0.099390 Sep 27 03:01:12.473574 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3937/7920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:12 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:13.497783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:13.498534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] [instance: eace86ca-fbd2-4182-90a4-0a2b4ae30a9b] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:13.505521 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:13.506009 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:13.506452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:13.507155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:13.507615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:13.508048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:13.521259 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] HTTP exception thrown: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Request method failure captured: Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b HTTP/1.1 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmTlaYhCzmBMnvVU4Pp0BM0ucZc9blqclHjo3pR0kpX05yANTAt7g3sqhXl6pQJJlYSrHVcd5Pt3scDWKSK_kKmlmF8JKSmHcmxeYppR1_oP7gTG5v5Md67kbiUkDTlV8Pc_7FBLW7OOx2iZ2Zgp7EmRN3a3w155k-jPvIcJvifMzmQ Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/51de9730ad83427fbbcf9ec5d7d407f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_51de9730ad83427fbbcf9ec5d7d407f9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 51de9730ad83427fbbcf9ec5d7d407f9 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1934166037 Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 4153e8ea91314301bb8184bf2e95ab4c Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1934166037-project Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'eace86ca-fbd2-4182-90a4-0a2b4ae30a9b'} Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:01:13.522966 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Returning 404 to user: Instance eace86ca-fbd2-4182-90a4-0a2b4ae30a9b could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4feba479-d5cd-4b45-a3e9-7d737192d92a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b" status: 404 len: 111 microversion: 2.1 time: 0.031868 Sep 27 03:01:13.528245 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3984/7921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:13 2022] GET /compute/v2.1/servers/eace86ca-fbd2-4182-90a4-0a2b4ae30a9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 03:01:16.821850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d9e6400a-ebd4-4fe4-b763-bc4e5992fa1a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] Calling method '.version_select at 0x7f24c4670d30>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:16.845625 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d9e6400a-ebd4-4fe4-b763-bc4e5992fa1a tempest-TestNetworkAdvancedServerOps-1934166037 tempest-TestNetworkAdvancedServerOps-1934166037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1105583830" status: 202 len: 0 microversion: 2.1 time: 0.027924 Sep 27 03:01:16.850063 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3938/7922] 10.222.0.52 () {58 vars in 1284 bytes} [Tue Sep 27 03:01:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1105583830 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:01:28.277289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=18 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:28.278258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:28.473306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ba4360ed-9fbd-4f89-9082-111d23d94022 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'create', calling method: .version_select at 0x7f24d590c310>, body: {"keypair": {"name": "tempest-TestShelveInstance-580055170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjVviYwd00YNYX5X68z+81OCMT7A8E8kNh8M1rwmLt4Uhr87C3s1tKLcR5n9tJo8UHPM2qTriVXbu9Kl800/YKRDfG5Z4RTpLPueocmO53GUjsm2mOfWLyq7VRP/ZVNyg=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:28.489791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ba4360ed-9fbd-4f89-9082-111d23d94022 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:01:28.499301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-ba4360ed-9fbd-4f89-9082-111d23d94022 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for user 6e2aeaa7efa34e1a905d87d7e28b2726 and project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:01:28.525779 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ba4360ed-9fbd-4f89-9082-111d23d94022 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.254043 Sep 27 03:01:28.526410 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3985/7923] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 03:01:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:01:29.500506 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:29.505980 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:29.511899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1940768590", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-580055170", "security_groups": [{"name": "tempest-secgroup-smoke-2092791098"}], "networks": [{"uuid": "46b8ec7e-ff07-4a0b-9fcd-248938d044e6"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:29.636814 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] validate_networks() for [('46b8ec7e-ff07-4a0b-9fcd-248938d044e6', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 03:01:30.122088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 03:01:30.122528 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 03:01:30.123013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 03:01:30.123788 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 03:01:30.124542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 03:01:30.135547 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:30.136045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:30.136493 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:30.137223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:30.137717 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:30.138149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:30.161615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:01:30.169820 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for user 6e2aeaa7efa34e1a905d87d7e28b2726 and project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:01:30.187550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 03:01:30.191193 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 03:01:30.241454 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d98f1337-d66b-4c3e-baea-bbaeb57fb7cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742645 Sep 27 03:01:30.242512 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3939/7924] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 03:01:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 03:01:30.254478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c7876387-5fcd-4590-856f-46d81d0ee899 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:30.255102 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-c7876387-5fcd-4590-856f-46d81d0ee899 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:30.311498 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-c7876387-5fcd-4590-856f-46d81d0ee899 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:30.319041 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c7876387-5fcd-4590-856f-46d81d0ee899 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1246 microversion: 2.1 time: 0.069477 Sep 27 03:01:30.324727 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3986/7925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:30 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:01:31.345773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:31.347927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:31.360012 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:31.360516 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:31.360962 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:31.362281 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:31.362816 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:31.363440 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:31.766258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:31.779852 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b8e06359-0a12-4a90-a863-c09bfd976e5e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1306 microversion: 2.1 time: 0.439792 Sep 27 03:01:31.780334 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3940/7926] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:31 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1306 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:01:32.811681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:32.812401 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:32.822803 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:32.823382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:32.823884 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:32.824595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:32.825048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:32.825497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:33.032089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:33.041104 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce05704e-0e6a-4e66-87b0-c2675f33776c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.233229 Sep 27 03:01:33.041862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3987/7927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:32 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:33.084007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:33.098395 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:33.098904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:33.099347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:33.112850 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] Creating event network-changed:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:01:33.118032 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-0146fc40-bc58-42c2-83ea-6a2ef1b8d225 req-80b7c041-c2ed-466d-aa16-db55be87e0ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039502 Sep 27 03:01:33.118710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3941/7928] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:01:34.065252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:34.065903 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:34.073266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:34.073779 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:34.074211 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:34.075125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:34.075583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:34.076006 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:34.212992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:34.221089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-230fdcd3-38a9-428a-97a1-a663b0a8e504 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.160567 Sep 27 03:01:34.221789 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3988/7929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:34 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:35.244594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:35.245310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:35.252561 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:35.253055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:35.253537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:35.254236 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:35.254700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:35.255135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:35.383232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:35.390811 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9d268086-0e57-4058-8e6d-bd1cf438cc34 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.150718 Sep 27 03:01:35.391369 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3942/7930] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:35 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:36.414227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:36.414828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:36.421670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:36.422160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:36.422598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:36.423296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:36.423753 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:36.424224 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:36.561089 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:36.571853 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-037a715f-05ea-420e-9b60-71d1c3b7ab42 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.161495 Sep 27 03:01:36.572787 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3989/7931] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:36 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:37.596120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:37.596737 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:37.603662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:37.604159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:37.604604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:37.605310 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:37.605807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:37.606248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:37.738321 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:37.746008 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5ce5d2d7-c2bd-4f69-835c-873abd2a36f9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.154483 Sep 27 03:01:37.746575 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3943/7932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:37 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:38.430828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "name": "network-vif-plugged", "status": "completed", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:38.441573 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:38.442624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:38.442624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:38.454177 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] Creating event network-vif-plugged:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:01:38.464334 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-0e4a88b6-1009-4de1-821a-f4cd355c5dae req-1e3e50ea-2255-45a1-babd-9e920e1c524a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Sep 27 03:01:38.464946 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3990/7933] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:01:38.769944 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:38.770498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:38.777249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:38.777782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:38.778234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:38.778945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:38.779418 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:38.779862 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:38.908609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:38.916315 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4981d0f6-b81e-44f8-8250-aaa3162d945d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.151049 Sep 27 03:01:38.916888 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3944/7934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:38 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:39.942033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:39.942738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:39.949122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:39.949673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:39.950108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:39.950822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:39.951274 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:39.951695 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:40.315611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:40.375019 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:40.383208 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5278a131-4524-4a27-8ef5-a6929b2dbe1c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1372 microversion: 2.1 time: 0.446841 Sep 27 03:01:40.383781 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3991/7935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:39 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1372 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:41.408131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:41.408763 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:41.411557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:41.412237 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:01:41.418693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:41.419186 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:41.419634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:41.420342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:41.420809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:41.421247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:41.555685 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:41.563511 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4a573dcf-2404-4d41-a2be-6d846486033f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1556 microversion: 2.1 time: 0.159340 Sep 27 03:01:41.564078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3945/7936] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:41 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:41.586258 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:01:41.586831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:01:41.593669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:41.594156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:41.594591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:41.595284 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:41.596245 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:41.596676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:41.725825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:01:41.733564 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2f54d524-719b-48d3-8171-f11cd37fd9f8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1556 microversion: 2.1 time: 0.151263 Sep 27 03:01:41.734172 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3992/7937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:01:41 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:01:43.363317 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:01:43.373549 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:01:43.374091 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:01:43.374542 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:01:43.387761 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] Creating event network-changed:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:01:43.392858 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-8a2a031b-c010-4c5a-aa61-be06c24e11d4 req-70fe2474-b91b-4111-a6db-ebf1eac3b84e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034055 Sep 27 03:01:43.393576 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3946/7938] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:04:09.492961 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:04:09.493940 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:04:09.494761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:09.495615 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=32 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:09.496834 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:04:09.496985 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action (ip 10.222.0.52) !!! Sep 27 03:04:09.497966 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 03:04:09.498124 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action (ip 10.222.0.52) !!! Sep 27 03:04:09.499089 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:04:09.499211 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action (ip 10.222.0.52) !!! Sep 27 03:04:09.503298 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:04:09.503833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:09.519800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:09.520788 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:09.521221 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:09.521940 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:09.522396 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:09.522821 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:09.546583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lazy-loading 'flavor' on Instance uuid fa1c1c64-c040-40de-b302-0c53196031ea {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:04:09.852159 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-37955c59-8181-4ec1-8eb4-72b99a3e016b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action" status: 202 len: 0 microversion: 2.1 time: 0.360764 Sep 27 03:04:09.852777 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3993/7939] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:04:09 2022] POST /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:04:09.859303 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 03:04:09.860204 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 03:04:09.860859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:09.861786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:09.864089 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:04:09.864220 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea (ip 10.222.0.52) !!! Sep 27 03:04:09.865439 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:04:09.865732 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea (ip 10.222.0.52) !!! Sep 27 03:04:09.866782 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:04:09.866893 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea (ip 10.222.0.52) !!! Sep 27 03:04:09.875123 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:09.875888 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:09.889094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:09.889617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:09.890069 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:09.890777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:09.891245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:09.891687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:10.074636 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:10.082599 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-321be8b8-518d-4c38-8e82-fed1e65f6da5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.225209 Sep 27 03:04:10.083184 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3947/7940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:09 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:04:11.107555 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:11.108266 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:11.117920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:11.118406 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:11.118839 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:11.119536 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:11.119988 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:11.120439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:11.125170 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41702. Sep 27 03:04:11.127654 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41704. Sep 27 03:04:11.257959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:11.265877 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-999824fb-fff9-4dd1-bc63-6d29d4a26e06 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.163776 Sep 27 03:04:11.266642 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3994/7941] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:11 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:12.290378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:12.291013 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:12.300218 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:12.300728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:12.301178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:12.301928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:12.302400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:12.302845 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:12.308957 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41708. Sep 27 03:04:12.309790 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41710. Sep 27 03:04:12.441753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:12.449976 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-703fdefc-17ab-4efb-b5b3-34886291b746 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.164180 Sep 27 03:04:12.450560 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3948/7942] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:12 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:13.474155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:13.474776 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:13.481643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:13.482132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:13.482591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:13.483260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:13.483723 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:13.484150 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:13.617283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:13.625188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-57bbacfb-62e4-4b1c-85d3-85d0fd82f6ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.155489 Sep 27 03:04:13.625797 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3995/7943] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:13 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:14.648559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:14.649183 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:14.655988 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:14.656474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:14.656916 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:14.657716 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:14.658177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:14.658612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:14.789047 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:14.796770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ad89c6fc-2be4-4fa6-8aa8-9a37e65c2c14 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.152285 Sep 27 03:04:14.797380 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3949/7944] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:14 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:15.821842 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:15.822412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:15.829227 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:15.829740 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:15.830176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:15.830866 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:15.831317 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:15.831746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:15.960502 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:15.968254 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f259fc8b-0f38-4575-a0c9-ef5b8b9bd019 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.151158 Sep 27 03:04:15.968824 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3996/7945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:15 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:16.991563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:16.992201 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:16.999030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:16.999522 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:16.999971 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:17.000671 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:17.001141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:17.001609 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:17.131987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:17.139995 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35330246-f944-43d3-b279-4089e6ebe6b7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.152336 Sep 27 03:04:17.140570 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3950/7946] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:16 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:18.164287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:18.164908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:18.171852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:18.172340 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:18.172783 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:18.173523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:18.173985 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:18.174419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:18.305963 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:18.313742 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f037e142-d315-495c-a1c4-ef28dca4b39e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.153916 Sep 27 03:04:18.314313 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3997/7947] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:18 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:19.337566 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:19.338113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:19.345048 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:19.345585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:19.346046 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:19.346765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:19.347249 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:19.347694 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:19.484476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:19.492848 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-526c5b5f-0cb4-4b95-9f94-ceaf1ff524b4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.159340 Sep 27 03:04:19.493447 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3951/7948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:19 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:20.515262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:20.515916 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:20.522928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:20.523413 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:20.523852 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:20.524541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:20.525023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:20.525491 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:20.655566 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:20.663276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-72ec4808-a288-47fd-9fc5-018ad6f9d0a1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.151997 Sep 27 03:04:20.663848 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3998/7949] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:20 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:21.686714 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:21.687350 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:21.694914 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:21.695416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:21.696130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:21.696844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:21.697318 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:21.697789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:21.826910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:21.834765 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2d291552-c8de-46f5-990f-8e45b2b12578 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1700 microversion: 2.1 time: 0.151961 Sep 27 03:04:21.835642 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3952/7950] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:21 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:22.859028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:22.859583 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:22.866920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:22.867427 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:22.867859 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:22.868546 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:22.868998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:22.869592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:22.998976 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:23.007316 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-8a963da6-433e-436d-a906-aa57bba2ed8c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1700 microversion: 2.1 time: 0.152243 Sep 27 03:04:23.007885 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 3999/7951] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:22 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:24.030480 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:24.031122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:24.038663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:24.039167 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:24.039622 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:24.040332 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:24.040809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:24.041256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:24.180666 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:24.188526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-02b5adc4-ea0d-416d-9bc5-2da2a55e1550 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1700 microversion: 2.1 time: 0.162152 Sep 27 03:04:24.189104 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3953/7952] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:24 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:25.213567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:25.214182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:25.221007 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:25.221529 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:25.221969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:25.222665 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:25.223122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:25.223552 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:25.275219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "name": "network-vif-plugged", "status": "completed", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:04:25.298071 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:25.298568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:25.299015 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:25.311770 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] Creating event network-vif-plugged:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:04:25.319123 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-43ecd2ec-22b1-4245-a93b-f11f2df01be0 req-00c64582-3011-4f95-8866-d0ae3595d391 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047483 Sep 27 03:04:25.319921 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3954/7953] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:04:25.377230 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:25.385609 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0a422217-ce44-4231-8e55-1888df13d3d5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1700 microversion: 2.1 time: 0.176453 Sep 27 03:04:25.386175 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4000/7954] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:25 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:26.410512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:26.411232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:26.418111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:26.418600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:26.419108 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:26.419773 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:26.420248 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:26.420738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:26.555582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:26.563412 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4699e6d0-b955-479a-9563-0aa315f236c9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.157972 Sep 27 03:04:26.563978 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3955/7955] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:26 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:27.588693 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:27.589471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:27.597210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:27.598022 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:27.598707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:27.599682 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:27.600338 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:27.600864 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:27.746289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:27.754688 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d879c494-1f36-4c10-b14e-d581f9e35975 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.170375 Sep 27 03:04:27.755475 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4001/7956] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:27 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:28.779366 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:28.780851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:28.790243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:28.791049 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:28.791740 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:28.792707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:28.793256 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:28.793792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:28.945179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:28.955205 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f71de0e9-f354-42cf-8a00-7ea0cc190fae tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.180291 Sep 27 03:04:28.956072 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3956/7957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:28 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:29.982608 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:29.983312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:29.992103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:29.992604 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:29.993048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:29.993791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:29.994248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:29.994677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:30.156509 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:30.167020 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ca4eeee3-c0b4-4f8e-91ba-d3a0e4588e0a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.187851 Sep 27 03:04:30.174042 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4002/7958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:29 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:04:31.190964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:31.193687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:31.202030 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:31.202531 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:31.202983 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:31.203700 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:31.204234 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:31.204684 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:31.363196 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:31.376726 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8cd76cdb-338d-47b6-9712-89659f3adb53 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.189901 Sep 27 03:04:31.377699 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3957/7959] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:31 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:32.402624 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:32.403977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:32.411195 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:32.412031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:32.413263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:32.414228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:32.414692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:32.415125 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:32.579535 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:32.587594 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-003e47fb-7514-49ca-911c-5b1bb04d304d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.188841 Sep 27 03:04:32.588376 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4003/7960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:32 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:33.614026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:33.615886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:33.623115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:33.623632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:33.624158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:33.624957 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:33.625680 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:33.626222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:33.810157 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:33.818875 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2c480ff5-5a66-438d-8e28-9b273e8c16aa tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.210883 Sep 27 03:04:33.819710 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3958/7961] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:33 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:34.842731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:34.846001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:34.854374 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:34.854955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:34.855613 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:34.856448 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:34.856913 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:34.857367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:35.002513 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:35.011377 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-18b1551e-67a5-4282-bf7a-d0128f50ad0e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.172564 Sep 27 03:04:35.015153 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4004/7962] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:34 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:04:36.035000 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:36.035670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:36.043082 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:36.043580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:36.044032 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:36.044742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:36.045219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:36.045689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:36.183536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:36.191235 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1458daed-209c-4e02-a8b9-86c508432eba tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1695 microversion: 2.1 time: 0.160485 Sep 27 03:04:36.191817 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3959/7963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:36 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:37.214639 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:37.215263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:37.222070 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:37.222556 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:37.222993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:37.223689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:37.224141 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:37.225076 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:37.380249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:37.388515 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-955aa233-f606-4b77-af95-a6a979c55061 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1677 microversion: 2.1 time: 0.177793 Sep 27 03:04:37.389084 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4005/7964] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:37 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:38.413534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:38.414160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:38.421043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:38.421580 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:38.422031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:38.422734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:38.423203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:38.423648 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:38.552969 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:38.560893 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-958d9ad9-7c16-4bba-bd9f-39377e18095a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1677 microversion: 2.1 time: 0.151882 Sep 27 03:04:38.561532 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3960/7965] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:38 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:39.293992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "name": "network-vif-unplugged", "status": "completed", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:04:39.305365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.305850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.306285 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.318868 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] Creating event network-vif-unplugged:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:04:39.324520 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-b2210851-717d-4649-83af-b786e0f2a021 req-049b978a-40c3-4dbc-a240-1102bf850550 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034234 Sep 27 03:04:39.325310 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4006/7966] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:04:39.584711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:39.585380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:39.592461 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.592995 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.593488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.594199 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.594670 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.595112 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.727313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:39.735303 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-55af320a-3cb4-437e-97e0-39ad03cc15fd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1620 microversion: 2.1 time: 0.155178 Sep 27 03:04:39.735882 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3961/7967] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:39 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1620 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:39.758534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:04:39.759283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:39.761249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=29 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:39.766824 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.767248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.767690 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.768380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.768831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.769264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.773621 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:39.813610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128779) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 03:04:39.878887 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-905c0740-2572-4f4c-af77-47616b27565c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action" status: 202 len: 0 microversion: 2.1 time: 0.125205 Sep 27 03:04:39.879503 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4007/7968] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:04:39 2022] POST /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:04:39.888031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:39.888899 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:39.891369 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=31 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:39.898409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.899330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.900474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.901734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:39.902276 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:39.902790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:39.908638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=87 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:04:40.043297 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:40.051324 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-59d5b6ff-0c48-49f5-94a0-114b39cdfe4c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1628 microversion: 2.1 time: 0.167174 Sep 27 03:04:40.051906 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3962/7969] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:39 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1628 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:41.076189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:41.076800 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:41.082932 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:41.083410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:41.083841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:41.084523 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:41.084973 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:41.085419 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:41.249411 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:41.258541 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bf35f4cf-bc18-44db-92ca-456f60a9ee30 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.187338 Sep 27 03:04:41.259122 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4008/7970] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:41 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:42.291405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:42.292701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:42.300883 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:42.301710 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:42.302192 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:42.303560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:42.304371 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:42.305059 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:42.471458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:42.486680 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db26a131-b650-438f-8d8c-dd84537dde79 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.208046 Sep 27 03:04:42.503446 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3963/7971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:42 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:43.511158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:43.512021 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:43.519210 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:43.519701 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:43.520137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:43.520841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:43.521910 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:43.522355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:43.671768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:43.680724 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-106900d2-33e1-4631-b3d4-79b96caaec08 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.173318 Sep 27 03:04:43.681318 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4009/7972] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:43 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:44.707490 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:44.708902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:44.718117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:44.718726 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:44.719184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:44.719910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:44.720389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:44.720837 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:44.882494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:44.891181 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6638cac7-7603-44ea-8bd9-8dc529948882 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.188717 Sep 27 03:04:44.892255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3964/7973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:44 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:45.918591 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:45.919313 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:45.927744 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:45.928766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:45.929155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:45.929938 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:45.930395 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:45.930822 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:46.081403 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:46.089570 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-cd48dc90-2824-430c-b6f6-060e4568e49e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.177851 Sep 27 03:04:46.090360 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4010/7974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:45 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:47.113041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:47.114039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:47.122077 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:47.122585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:47.123039 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:47.123752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:47.124220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:47.124657 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:47.278920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:47.288047 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-855b7bd5-b67c-4541-9d4f-3f657cfdc059 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.179033 Sep 27 03:04:47.291950 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3965/7975] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:47 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:48.312538 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:48.313331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:48.320865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:48.321645 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:48.322082 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:48.322780 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:48.323253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:48.323678 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:48.467103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:48.476674 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3c3754f4-3af2-40d4-8c6f-488c58d30d9b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.168093 Sep 27 03:04:48.477862 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4011/7976] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:48 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:49.500117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:49.500741 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:49.509194 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:49.509851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:49.510465 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:49.511358 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:49.511838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:49.512313 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:49.652558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:49.661439 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-71c40bf8-3b52-489d-8f8d-26a09759ae27 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.165161 Sep 27 03:04:49.662032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3966/7977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:49 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:50.686356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:50.686969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:50.693832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:50.694311 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:50.694741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:50.696388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:50.696777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:50.697197 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:50.826983 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:50.834733 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-240dff51-ddb0-437b-90ab-6aa6518cdeca tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.152501 Sep 27 03:04:50.835305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4012/7978] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:50 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:51.857558 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:51.858125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:51.865162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:51.865701 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:51.866153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:51.867530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:51.868062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:51.868504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:52.005540 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:52.014017 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ec3c4fd5-4d25-45b6-b81e-84c614ffc763 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.160477 Sep 27 03:04:52.014594 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3967/7979] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:51 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:53.037503 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:53.038158 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:53.045066 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:53.045587 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:53.046030 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:53.046724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:53.047182 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:53.047611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:53.181758 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:53.189567 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a0a1d50-4a7e-460d-a051-2a1a69ecbebf tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.156126 Sep 27 03:04:53.190143 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4013/7980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:53 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:54.213859 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:54.214545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:54.222827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:54.223323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:54.223772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:54.224476 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:54.224942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:54.225407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:54.354978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:54.362686 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2bbfd220-06ee-4377-af1a-957559510a85 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.153276 Sep 27 03:04:54.363256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3968/7981] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:54 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:55.386253 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:55.386850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:55.393755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:55.394233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:55.394669 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:55.395359 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:55.395813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:55.396247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:55.529885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:55.537688 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ecc9b06b-20fd-45a4-bfa3-f0978adff77e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.155874 Sep 27 03:04:55.538266 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4014/7982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:55 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:56.563286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:56.564232 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:56.574405 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:56.574922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:56.575376 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:56.576098 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:56.576568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:56.577003 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:56.706233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:56.714583 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-8fe19957-c9b0-4eff-be12-206608b20abe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.157770 Sep 27 03:04:56.715090 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3969/7983] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:56 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:57.738265 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:57.738873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:57.746471 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:57.746944 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:57.747375 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:57.748055 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:57.748505 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:57.748928 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:57.888647 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:57.896538 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ead4fc33-64fd-48c7-b15a-51a6d5904ba3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.162098 Sep 27 03:04:57.897117 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4015/7984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:57 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:58.920735 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:04:58.921474 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:04:58.928325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:58.928826 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:58.929796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:58.930505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:58.930986 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:58.931432 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:59.072088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:04:59.079904 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-10ebad4c-d1a8-4fc3-9014-47391e8e5b51 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.163208 Sep 27 03:04:59.080475 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3970/7985] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:04:58 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:04:59.494283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "name": "network-vif-plugged", "status": "completed", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:04:59.504132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:04:59.504607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:04:59.505032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:04:59.516431 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] Creating event network-vif-plugged:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:04:59.521495 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-10d60836-a17d-4ddf-af70-7863bcf7a9b4 req-37b1fa25-2048-429a-b07e-b8cd698c4f03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092304 Sep 27 03:04:59.522077 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4016/7986] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:05:00.103697 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:05:00.104357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:05:00.111253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:00.111743 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:00.112189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:00.112892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:00.113378 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:00.113824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:00.245462 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:05:00.253247 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6e1f70c-b9ff-4745-8be4-38d3e930036c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.154047 Sep 27 03:05:00.253864 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3971/7987] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:05:00 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:05:01.279457 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:05:01.280238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:05:01.287791 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:01.289073 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:01.289992 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:01.290885 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:01.291380 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:01.291946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:01.438760 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:05:01.447343 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d7f03b35-6806-451b-ac92-55ba3f8fb6db tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1686 microversion: 2.1 time: 0.173623 Sep 27 03:05:01.461578 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4017/7988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:05:01 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:05:02.479605 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:05:02.480242 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:05:02.487698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:02.488195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:02.488652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:02.489377 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:05:02.489852 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:05:02.490295 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:05:02.625621 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:05:02.633422 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-f1cc1f88-8529-47fc-9aee-3c0fb764eb62 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1673 microversion: 2.1 time: 0.158311 Sep 27 03:05:02.633996 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3972/7989] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:05:02 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:06:48.589096 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=21 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:06:48.591405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:06:48.592423 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:06:48.592902 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=65 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:06:48.603646 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:48.604151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:06:48.612143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:48.612605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:48.613039 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:48.613857 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:48.614368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:48.614828 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:48.643441 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 03:06:48.691304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:06:48.703413 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:48.704066 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:48.704357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:48.717631 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] Creating event network-changed:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:06:48.734660 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dc0a2e6c-8d8c-41fa-8582-050323715223 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 204 len: 0 microversion: 2.1 time: 0.149623 Sep 27 03:06:48.737781 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-6be6d41c-0e4a-4c00-b78b-64cb8fa013c0 req-3076e532-fea3-4532-9342-29ee4020a59d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151919 Sep 27 03:06:48.739371 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4018/7990] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 03:06:48 2022] DELETE /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 03:06:48.742327 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3973/7991] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:06:48.747113 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:48.747832 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:06:48.754368 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:48.754958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:48.755476 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:48.756813 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:48.757351 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:48.757841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:48.898041 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:06:48.905837 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98cae762-90aa-4f9a-887b-f6eeac82bf57 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.163918 Sep 27 03:06:48.906416 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4019/7992] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:06:48 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:06:49.931934 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:49.932563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:06:49.939037 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:49.939693 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:49.940154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:49.940880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:49.941370 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:49.941821 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:50.080765 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:06:50.088844 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9bacc44c-66b8-40de-acc6-a439733a2ae3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1679 microversion: 2.1 time: 0.162779 Sep 27 03:06:50.089485 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3974/7993] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:06:49 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:06:50.966330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1c1c64-c040-40de-b302-0c53196031ea", "name": "network-vif-deleted", "tag": "979dec46-add3-4b69-96d3-d8aada15ee34"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:06:50.975823 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:50.976300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:50.976729 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:50.992279 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] Creating event network-vif-deleted:979dec46-add3-4b69-96d3-d8aada15ee34 for instance fa1c1c64-c040-40de-b302-0c53196031ea on n-h2-859358-1 Sep 27 03:06:50.999319 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-344ddc10-0ccb-400b-8534-07bcec514284 req-1cb1ed3b-481b-4809-aa7c-7bed86292551 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096327 Sep 27 03:06:50.999941 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4020/7994] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:06:51.112188 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:51.112752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:06:51.120269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:51.120759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:51.121204 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:51.121945 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:51.122404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:51.122841 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:51.159162 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:51.159659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:51.160106 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:51.160568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lazy-loading 'fault' on Instance uuid fa1c1c64-c040-40de-b302-0c53196031ea {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:06:51.203792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:06:51.212386 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7dd420de-ecac-42a0-84eb-91558f9391d6 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 200 len: 1336 microversion: 2.1 time: 0.104147 Sep 27 03:06:51.212973 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3975/7995] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:06:51 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:06:52.236194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:52.236888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: fa1c1c64-c040-40de-b302-0c53196031ea] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:06:52.244473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:52.244959 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:52.245432 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:52.246131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:06:52.246586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:06:52.247015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:06:52.260749 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] HTTP exception thrown: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Request method failure captured: Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea HTTP/1.1 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmeCqUPd_OJfUJKFXG4FaHwk7t9e-fqueQR8rutUg-HEyCrcZpOhJBEBh9CQBmZrJwGaVhb62Oruj2LeM1Wqa3KHCseNq2mF2F1dQ4zCBfHStioPZoQZno49JrJwXDm6J7UTV9bEB-_Sj48Md4JPieM3sgbZYQDLN6PINLBBXFxkmvs Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1455a94f842c4181ab36985f7b4b8d39 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestShelveInstance-706794709 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1455a94f842c4181ab36985f7b4b8d39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestShelveInstance-706794709 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1455a94f842c4181ab36985f7b4b8d39 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestShelveInstance-706794709 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestShelveInstance-706794709-project Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 6e2aeaa7efa34e1a905d87d7e28b2726 Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestShelveInstance-706794709-project Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': 'fa1c1c64-c040-40de-b302-0c53196031ea'} Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:06:52.262382 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Returning 404 to user: Instance fa1c1c64-c040-40de-b302-0c53196031ea could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b2025505-ee28-40be-b211-47451c526fb3 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea" status: 404 len: 111 microversion: 2.1 time: 0.031906 Sep 27 03:06:52.268557 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4021/7996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:06:52 2022] GET /compute/v2.1/servers/fa1c1c64-c040-40de-b302-0c53196031ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 03:06:52.424085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-edb2642e-2d2d-4078-b5ab-78ad2454c3cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '.version_select at 0x7f24c45d2310>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:06:52.454742 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-edb2642e-2d2d-4078-b5ab-78ad2454c3cb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-580055170" status: 202 len: 0 microversion: 2.1 time: 0.034560 Sep 27 03:06:52.455490 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3976/7997] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 03:06:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-580055170 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:06:52.481757 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-c3041d1a-5aec-41ea-917e-8ba3399baa9a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'create', calling method: .version_select at 0x7f24da5933a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-757037606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvTk73eQtNN5DJuyLZnZ9LZoFHtQf59ScmzIm/tbsb0y5/sGB8rBbPIik4jlaXP7MLF2SNJt0Gs6faDjY9YhwvnLnFiGluAhwcyVpO+btczQfdJloppHfqAvbyLxkdX3w=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:06:52.496914 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c3041d1a-5aec-41ea-917e-8ba3399baa9a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:06:52.501977 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-c3041d1a-5aec-41ea-917e-8ba3399baa9a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for user 6e2aeaa7efa34e1a905d87d7e28b2726 and project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:06:52.538089 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-c3041d1a-5aec-41ea-917e-8ba3399baa9a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.060260 Sep 27 03:06:52.539444 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4022/7998] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 03:06:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:07:08.757111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=16 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:08.757922 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:08.763827 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1058306696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-757037606", "security_groups": [{"name": "tempest-secgroup-smoke-1398839160"}], "networks": [{"uuid": "46b8ec7e-ff07-4a0b-9fcd-248938d044e6"}], "block_device_mapping_v2": [{"uuid": "b30c2169-98fe-4e2e-9ad0-3a52de07095a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:07:08.875122 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] validate_networks() for [('46b8ec7e-ff07-4a0b-9fcd-248938d044e6', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 03:07:09.302711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 03:07:09.303158 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 03:07:09.303682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 03:07:09.304107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 03:07:09.304537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 03:07:09.314102 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:09.314589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:09.315040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:09.315775 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:09.316243 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:09.316679 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:09.335130 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:07:09.340336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Getting quotas for user 6e2aeaa7efa34e1a905d87d7e28b2726 and project 1455a94f842c4181ab36985f7b4b8d39. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:07:09.397604 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 03:07:09.399766 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b30c2169-98fe-4e2e-9ad0-3a52de07095a',volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 03:07:09.530075 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7aa91158-3d62-49cf-80be-1e33a24a450b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774650 Sep 27 03:07:09.530829 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3977/7999] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 03:07:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 03:07:09.539833 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:09.542176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=4 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:09.552326 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:09.555995 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9a2d0f27-e6ad-42db-b078-78627c676312 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:09.556610 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9a2d0f27-e6ad-42db-b078-78627c676312 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:09.629190 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-9a2d0f27-e6ad-42db-b078-78627c676312 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:09.636591 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9a2d0f27-e6ad-42db-b078-78627c676312 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1088 microversion: 2.1 time: 0.098513 Sep 27 03:07:09.637152 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4023/8000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:09 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:10.660809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:10.661466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:10.669189 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:10.669727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:10.670178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:10.670893 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:10.671555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:10.671997 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:10.746507 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:10.754651 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c4aabee6-dca6-48d0-a889-15958bb0a7ad tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1194 microversion: 2.1 time: 0.098790 Sep 27 03:07:10.755449 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3978/8001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:10 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:11.778143 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:11.779586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:11.786794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:11.787599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:11.788279 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:11.789405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:11.790085 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:11.790731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:11.969893 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:11.978754 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-4a3bd4dc-caf6-4d0a-bf84-19d45bd2ab33 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1272 microversion: 2.1 time: 0.204696 Sep 27 03:07:11.979751 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4024/8002] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:11 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:12.147150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:07:12.160124 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:12.160634 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:12.161245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:12.176778 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] Creating event network-changed:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:07:12.181880 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-d3546861-f74a-4e4b-94c9-551035a705bd req-f1b8b49a-f6b0-4feb-860b-cdb3a081a223 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047849 Sep 27 03:07:12.183083 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3979/8003] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:07:13.003366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:13.003994 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:13.011600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:13.012363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:13.012888 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:13.014048 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:13.014868 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:13.015425 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:13.163303 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:13.171998 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2ff89fe7-eec0-43f8-aff8-4ba1b054cccb tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1272 microversion: 2.1 time: 0.172637 Sep 27 03:07:13.172582 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4025/8004] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:12 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:14.196711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:14.197631 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:14.203960 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:14.204458 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:14.204903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:14.205626 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:14.206092 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:14.206530 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:14.341870 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:14.350653 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-9dfa0f45-f9e4-4c08-9f25-8506f178c383 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1272 microversion: 2.1 time: 0.159071 Sep 27 03:07:14.351244 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3980/8005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:14 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:15.374559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:15.375446 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:15.382609 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:15.383103 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:15.383543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:15.384252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:15.384712 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:15.385145 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:15.526001 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:15.534690 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-732b50a7-bb59-4f6a-be6c-88838abc88ac tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1272 microversion: 2.1 time: 0.164769 Sep 27 03:07:15.535303 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4026/8006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:15 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:16.558221 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:16.558864 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:16.565770 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:16.566269 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:16.566721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:16.567430 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:16.567903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:16.568342 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:16.700815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:16.708601 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-98b599e0-1085-4938-8544-2ee9d8a33d2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.154821 Sep 27 03:07:16.709170 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3981/8007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:16 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:17.731598 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:17.732156 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:17.738890 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:17.739376 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:17.739804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:17.740486 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:17.740962 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:17.741404 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:17.873133 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:17.880812 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-992358c8-af7c-4382-8504-f14f88a2c0a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.153137 Sep 27 03:07:17.881395 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4027/8008] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:17 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:18.904867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:18.905536 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:18.912380 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:18.912891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:18.913363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:18.914832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:18.915494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:18.915964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:19.045727 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:19.053596 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ffd8b419-d270-4850-b7e5-ba17b39dfe77 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.153490 Sep 27 03:07:19.054171 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3982/8009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:18 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:20.076748 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:20.077390 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:20.080205 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:20.085704 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:20.086187 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:20.086628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:20.087324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:20.087796 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:20.088263 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:20.215252 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:20.223576 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0dbac7b5-8dac-4833-bf6a-96c6d84b4f4a tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.151456 Sep 27 03:07:20.224151 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4028/8010] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:20 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:21.248663 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:21.249292 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:21.251301 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:21.252113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:07:21.259004 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:21.259497 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:21.259946 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:21.261217 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:21.261713 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:21.262154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:21.396804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:21.404862 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-5742b2de-97ae-4f95-9920-6260df94985b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.160738 Sep 27 03:07:21.405453 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3983/8011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:21 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:22.428234 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:22.428851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:22.435687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:22.436172 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:22.436611 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:22.437329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:22.437806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:22.438237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:22.565922 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:22.574527 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-41f0490a-4da9-4e03-b6a1-e688532a1692 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.150277 Sep 27 03:07:22.575112 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4029/8012] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:22 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:23.597145 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:23.597875 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:23.605400 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:23.605904 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:23.606355 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:23.607065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:23.607534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:23.607978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:23.748795 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:23.756756 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-d01481ad-6ade-4060-9b2a-bd03d8c9048d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.163525 Sep 27 03:07:23.757354 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3984/8013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:23 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:24.780397 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:24.781010 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:24.787843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:24.788322 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:24.788756 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:24.789477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:24.789935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:24.790357 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:24.922367 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:24.930076 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77389913-60a0-4de9-98d7-d4733f236844 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.153901 Sep 27 03:07:24.930643 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4030/8014] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:24 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:25.833708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "name": "network-vif-plugged", "status": "completed", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:07:25.844738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:25.845225 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:25.845707 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:25.857437 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] Creating event network-vif-plugged:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:07:25.862604 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-7295f1cb-9c8b-4518-ab5f-ed671700add0 req-044de081-45b6-4a4f-93ee-3d64f6d4f63e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032767 Sep 27 03:07:25.863207 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3985/8015] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:07:25.953998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:25.954603 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:25.961463 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:25.961951 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:25.962388 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:25.963086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:25.963541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:25.963971 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:26.094720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:26.102535 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e0695ab3-6495-43b1-a1e4-0bc196824c39 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.152474 Sep 27 03:07:26.103110 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4031/8016] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:25 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:27.127416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:27.128140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:27.134433 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:27.135560 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:27.136011 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:27.136712 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:27.137177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:27.137650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:27.274587 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:27.282503 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2185cede-10ec-425b-ba6c-621a9ff4fffc tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1260 microversion: 2.1 time: 0.160230 Sep 27 03:07:27.283084 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3986/8017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:27 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:28.304715 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:28.305378 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:28.312288 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:28.312761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:28.313189 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:28.313904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:28.314356 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:28.314777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:28.450479 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:28.458466 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b01e7678-a244-4405-b891-beaecc76dfb2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1445 microversion: 2.1 time: 0.157701 Sep 27 03:07:28.459276 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4032/8018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:28 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:28.481170 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:07:28.481829 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:07:28.488589 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:28.489101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:28.489551 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:28.490247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:28.490711 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:28.491154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:28.619692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:07:28.627438 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dbc81d01-5dc0-4b7d-a7d1-d2e7ccf6f538 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1445 microversion: 2.1 time: 0.150142 Sep 27 03:07:28.628002 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3987/8019] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:07:28 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:07:30.553122 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:07:30.563286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:07:30.563765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:07:30.564201 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:07:30.576098 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] Creating event network-changed:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:07:30.581588 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-534ad2ba-fc10-40c0-b3bb-e1d8e0c085cd req-c64ee742-4fcf-4d8a-960b-2f13949251bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032295 Sep 27 03:07:30.582217 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4033/8020] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:09:23.097520 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:09:23.098485 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:09:23.099306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:23.100070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=54 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:23.101627 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:09:23.101840 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action (ip 10.222.0.52) !!! Sep 27 03:09:23.104028 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:09:23.104155 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action (ip 10.222.0.52) !!! Sep 27 03:09:23.114689 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:09:23.115245 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:23.123503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:23.124001 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:23.124449 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:23.125154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:23.125658 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:23.126099 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:23.149330 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lazy-loading 'flavor' on Instance uuid 48af0485-1601-4adb-99e3-6e56d28d28ce {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:09:23.221549 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eff8f840-01b3-41f6-b229-c7fd6b639499 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action" status: 202 len: 0 microversion: 2.1 time: 0.125703 Sep 27 03:09:23.222151 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3988/8021] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:09:23 2022] POST /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:09:23.228971 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:09:23.230010 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:09:23.230622 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=24 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:23.231539 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=56 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:23.232508 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:09:23.232687 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce (ip 10.222.0.52) !!! Sep 27 03:09:23.233609 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 03:09:23.233830 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce (ip 10.222.0.52) !!! Sep 27 03:09:23.240115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:23.240836 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:23.250547 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:23.251033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:23.251473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:23.252166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:23.252620 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:23.253046 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:23.429108 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:23.437134 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f9d20021-a35b-4357-9fb7-19cff9a85a09 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.210363 Sep 27 03:09:23.437759 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4034/8022] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:23 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:24.462927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:24.463645 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:24.473140 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:24.473659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:24.474104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:24.474804 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:24.475267 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:24.475703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:24.483236 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42274. Sep 27 03:09:24.493913 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42276. Sep 27 03:09:24.652681 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:24.661044 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-493f9231-b912-48ac-b30a-5d329e4e5dee tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.202435 Sep 27 03:09:24.661656 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3989/8023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:24 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:25.684028 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:25.684677 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:25.693661 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:25.694147 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:25.694586 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:25.695282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:25.695738 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:25.696168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:25.703589 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42284. Sep 27 03:09:25.714048 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42282. Sep 27 03:09:25.830306 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:25.838105 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1849a3d5-fa79-45ca-a42f-48c28581efc4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.158023 Sep 27 03:09:25.838676 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4035/8024] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:25 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:26.862692 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:26.863238 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:26.870197 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:26.870696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:26.871150 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:26.871858 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:26.872333 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:26.872776 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:27.000426 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:27.008262 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6c40319f-91bb-4ba4-aa5b-7b301d5a9674 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.150238 Sep 27 03:09:27.008842 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3990/8025] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:26 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:28.030687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:28.031247 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:28.038148 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:28.038632 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:28.039074 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:28.039769 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:28.040228 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:28.040658 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:28.179159 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:28.187048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-784b8c03-8ede-4f33-892e-1d3c41cac270 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.160442 Sep 27 03:09:28.187626 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4036/8026] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:28 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:29.211152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:29.211786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:29.219101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:29.219600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:29.220052 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:29.220757 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:29.221230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:29.221704 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:29.354075 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:29.362886 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b51d1848-4c1a-4608-933f-5c765d33e789 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.155660 Sep 27 03:09:29.363740 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3991/8027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:29 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:30.387124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:30.387726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:30.395264 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:30.395742 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:30.396174 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:30.396858 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:30.397309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:30.397754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:30.528140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:30.536038 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-806c3b07-fe82-42ea-8fbd-fbb5137e963d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.152794 Sep 27 03:09:30.536611 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4037/8028] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:30 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:31.558996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:31.559690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:31.566687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:31.567179 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:31.567623 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:31.568325 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:31.568789 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:31.569227 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:31.700738 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:31.709073 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c1f3a49f-1a41-4292-a1ab-065c8b4133a5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.154022 Sep 27 03:09:31.709681 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3992/8029] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:31 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:32.732175 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:32.732731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:32.740168 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:32.740649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:32.741086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:32.741804 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:32.742260 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:32.742687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:32.876209 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:32.884045 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-0706bc3e-e267-4d2a-a92d-557264f491ce tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.155890 Sep 27 03:09:32.884619 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4038/8030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:32 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:33.908175 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:33.908807 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:33.915849 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:33.916349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:33.916802 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:33.917559 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:33.918101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:33.918601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:34.080390 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:34.088338 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e5f52a57-94a4-4e54-982c-dcc3838598cd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.184738 Sep 27 03:09:34.088913 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3993/8031] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:33 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:35.112595 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:35.113206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:35.120237 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:35.120703 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:35.121138 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:35.121849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:35.122309 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:35.122731 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:35.253236 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:35.261378 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b7e55d13-54fd-4ffd-9187-01d15a70367e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.153302 Sep 27 03:09:35.261964 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4039/8032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:35 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:36.284239 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:36.284869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:36.292087 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:36.292592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:36.293045 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:36.293782 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:36.294255 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:36.294696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:36.426790 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:36.435462 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-844ddd2c-299a-4437-af74-26f5be6c9662 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.155197 Sep 27 03:09:36.436143 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3994/8033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:36 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:37.461003 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:37.462269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:37.469829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:37.470323 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:37.470765 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:37.471469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:37.471961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:37.472391 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:37.610035 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:37.617990 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-77b261ca-87a9-467e-a2cb-902f7b5a8e75 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.162246 Sep 27 03:09:37.618573 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4040/8034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:37 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:38.640742 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:38.641401 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:38.648362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.648866 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.649323 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:38.650062 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.650532 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.650987 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:38.777654 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:38.785970 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-cf3e1d97-46ad-43cc-9710-b50e972f7364 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1511 microversion: 2.1 time: 0.149267 Sep 27 03:09:38.786549 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3995/8035] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:38 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:38.808736 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:09:38.809355 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:38.816198 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.816679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.817112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:38.817830 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.818283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.818705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:38.847270 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128779) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 03:09:38.911160 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38ce4736-3f7e-45f6-9af1-73d5639000b5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "POST /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action" status: 202 len: 0 microversion: 2.1 time: 0.106161 Sep 27 03:09:38.911778 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4041/8036] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:09:38 2022] POST /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:09:38.920673 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:38.921619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:38.928213 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.928719 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.929176 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:38.929927 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:38.930403 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:38.930851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:39.124521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:39.132702 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c6f14cee-40bd-4135-8c8b-4041ba676a73 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1519 microversion: 2.1 time: 0.216431 Sep 27 03:09:39.133276 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3996/8037] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:38 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:40.158115 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:40.159137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:40.165409 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:40.165895 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:40.166331 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:40.167024 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:40.167474 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:40.167902 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:40.308685 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:40.317875 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6e12b4ad-8afa-41ea-a911-5b7dfb135da4 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1521 microversion: 2.1 time: 0.165634 Sep 27 03:09:40.318576 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4042/8038] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:40 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:40.346203 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "name": "network-vif-unplugged", "status": "completed", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:09:40.358110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:40.358698 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:40.359678 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:40.374128 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.compute.server_external_events [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] Unable to find a host for instance 48af0485-1601-4adb-99e3-6e56d28d28ce. Dropping event network-vif-unplugged {{(pid=128778) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 27 03:09:40.375371 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-36a2fa82-cd21-42a5-9b48-56e5f09d7803 req-7d1847ed-df69-4384-8014-c2bd1422470d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033089 Sep 27 03:09:40.375975 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3997/8039] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 27 03:09:41.341093 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:41.341688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:41.349167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:41.349686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:41.350155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:41.350870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:41.351329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:41.351761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:41.487924 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:41.497413 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-6dfb5225-7037-4681-a5d3-50eb011becdd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1521 microversion: 2.1 time: 0.160227 Sep 27 03:09:41.497993 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4043/8040] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:41 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:09:42.522057 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:42.522708 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:42.530642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:42.531687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:42.532421 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:42.533257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:42.533772 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:42.534222 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:42.676521 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:42.685446 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-06383508-f466-4600-98ad-ca6a482ab241 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1521 microversion: 2.1 time: 0.167423 Sep 27 03:09:42.686032 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3998/8041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:42 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:43.711026 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:43.712060 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:43.720167 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:43.720687 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:43.721131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:43.721883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:43.722324 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:43.722761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:43.872592 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:43.881120 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a52c5bba-ccf4-4184-a366-2c41c1e90fa5 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1521 microversion: 2.1 time: 0.174273 Sep 27 03:09:43.881752 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4044/8042] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:43 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:44.905600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:44.906534 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:44.914303 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:44.914813 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:44.915392 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:44.916119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:44.916592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:44.917038 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:45.132153 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:45.140178 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0c056bd6-45bd-41d8-af60-c382f209cfd1 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.239431 Sep 27 03:09:45.140764 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 3999/8043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:44 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:46.163131 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:46.163771 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:46.170684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:46.171165 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:46.171600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:46.172301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:46.172755 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:46.173184 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:46.305673 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:46.313367 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3f0f3ade-a9ed-4010-9b00-dffd65e7b649 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.154113 Sep 27 03:09:46.313965 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4045/8044] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:46 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:47.336617 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:47.337257 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:47.344113 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:47.344628 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:47.345060 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:47.346361 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:47.346832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:47.347274 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:47.479786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:47.487824 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-da6b8ef1-d7bd-4c17-8e74-99b6b00e28b9 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.155101 Sep 27 03:09:47.488342 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4000/8045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:47 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:48.511254 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:48.511865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:48.519212 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:48.519689 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:48.520124 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:48.520809 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:48.521259 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:48.521714 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:48.653937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:48.662300 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-40aeb9d2-8c04-4196-a2c3-9f2cfa294d3b tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.154965 Sep 27 03:09:48.662881 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4046/8046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:48 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:49.685286 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:49.685938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:49.692832 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:49.693354 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:49.693812 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:49.694514 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:49.694978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:49.695419 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:49.822847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:49.831010 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-278e3161-387b-4916-ac9b-92977f64ea8e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.149746 Sep 27 03:09:49.831580 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4001/8047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:49 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:50.855663 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:50.856248 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:50.864031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:50.864519 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:50.864955 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:50.865679 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:50.866137 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:50.866565 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:50.994747 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:51.003290 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-3bd729bf-4121-41cf-a654-359e39c187e7 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.151666 Sep 27 03:09:51.003872 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4047/8048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:50 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:52.026545 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:52.027101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:52.034085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:52.034579 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:52.035053 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:52.035759 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:52.036223 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:52.036664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:52.168860 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:52.176834 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-dcbed3dd-298b-4601-b618-788c23d06c2e tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.154283 Sep 27 03:09:52.177431 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4002/8049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:52 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:09:53.199883 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:53.200497 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:53.207829 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:53.208310 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:53.208746 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:53.209465 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:53.209919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:53.210347 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:53.347640 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:53.350469 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:53.357462 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-258cdb7e-a27c-4b4c-93ed-a87ca0761be2 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.161821 Sep 27 03:09:53.358036 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4048/8050] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:53 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:54.380177 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:54.380786 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:54.383596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=31 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:54.388937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:54.389481 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:54.389938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:54.390659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:54.391154 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:54.391594 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:54.395850 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:54.527008 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:54.535661 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87b6ddc4-a25c-45a3-8fdd-0474fc9e40dd tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.159494 Sep 27 03:09:54.536314 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4003/8051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:54 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:55.559105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:55.559835 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:55.562506 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:09:55.570993 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:55.571478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:55.571908 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:55.572612 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:55.573318 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:55.573761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:55.705525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:55.713391 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-5f16a5e5-e368-4499-926d-e7b43de9447d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.158547 Sep 27 03:09:55.714025 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4049/8052] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:55 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:56.447404 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "name": "network-vif-plugged", "status": "completed", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:09:56.460488 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:56.460994 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:56.461477 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:56.473256 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] Creating event network-vif-plugged:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:09:56.478355 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-35f9ce31-0b7f-4663-967d-1ec38d95e342 req-19db89a1-5b52-4444-960e-89a5ec337a51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035069 Sep 27 03:09:56.479121 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4004/8053] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:09:56.737295 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:56.737926 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:56.744773 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:56.745251 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:56.745718 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:56.746405 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:56.746856 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:56.747275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:56.873434 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:56.881659 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a5af97bc-d815-4202-95d9-a7dc519decbe tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.148764 Sep 27 03:09:56.882232 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4050/8054] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:56 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:57.904978 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:57.905749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:57.913891 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:57.914396 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:57.914851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:57.915576 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:57.916055 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:57.916906 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:58.064964 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:58.072881 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-4eaab90a-4760-41ed-a907-bb9fc938a997 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1577 microversion: 2.1 time: 0.172307 Sep 27 03:09:58.073954 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4005/8055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:57 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:09:59.096086 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:09:59.096637 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:09:59.103562 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:59.104053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:59.104530 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:59.105233 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:09:59.105721 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:09:59.106157 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:09:59.241525 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:09:59.249623 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-640a2c69-ff1d-46c9-a38e-e0337a050d29 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1564 microversion: 2.1 time: 0.157396 Sep 27 03:09:59.250227 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4051/8056] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:09:59 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:12.790767 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=5 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:12.791301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=5 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:12.791810 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=19 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:12.792387 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=13 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:12.792590 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 03:11:12.792713 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 03:11:12.801873 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:12.802120 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:12.802447 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:12.811146 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:12.811868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:12.812328 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:12.812571 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:12.813051 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:12.813184 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:12.813568 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:12.813705 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:12.814014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:12.839329 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] Creating event network-changed:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:11:12.853137 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 03:11:12.856296 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-f6a0b993-8842-4157-8fa1-0da4dad72d15 req-fbcf5ce8-bafa-4776-911b-e7e397a67947 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067270 Sep 27 03:11:12.857305 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4052/8057] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:11:12.979662 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-db2fd4b5-99cb-47d1-af34-26da711e667f tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "DELETE /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 204 len: 0 microversion: 2.1 time: 0.191736 Sep 27 03:11:12.985433 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4006/8058] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 03:11:12 2022] DELETE /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 03:11:12.990636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:12.991762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:13.002098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:13.002927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:13.003550 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:13.004366 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:13.004920 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:13.005452 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:13.153481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:13.161735 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-871ea5af-9f1e-4961-9934-937441bd0285 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.175299 Sep 27 03:11:13.162315 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4053/8059] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:12 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:14.186676 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:14.187504 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:14.194537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:14.195041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:14.195494 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:14.196209 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:14.196682 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:14.197125 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:14.346374 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:14.354569 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-64a3da70-249f-4283-811d-d61607003fed tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1570 microversion: 2.1 time: 0.172743 Sep 27 03:11:14.355153 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4007/8060] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:14 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:15.377865 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:15.378607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:15.385831 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:15.386394 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:15.386904 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:15.387676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:15.388906 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:15.389473 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:15.475329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:15.483224 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-7d3fc4c7-b8ec-465b-9e66-7fd7e2266a52 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1383 microversion: 2.1 time: 0.109221 Sep 27 03:11:15.484130 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4054/8061] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:15 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1383 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:15.547357 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af0485-1601-4adb-99e3-6e56d28d28ce", "name": "network-vif-deleted", "tag": "89f7db3d-b96d-4de6-94d5-bef680b7a16a"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:15.559732 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:15.561416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:15.561868 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:15.574442 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] Creating event network-vif-deleted:89f7db3d-b96d-4de6-94d5-bef680b7a16a for instance 48af0485-1601-4adb-99e3-6e56d28d28ce on n-h2-859358-1 Sep 27 03:11:15.581296 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ee8c7786-7e4a-4a7c-9863-52a277356242 req-421a0cb3-73db-47b1-96f2-21b8cb815904 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Sep 27 03:11:15.581921 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4008/8062] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:11:16.508088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:16.508735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:16.515623 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:16.516111 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:16.516541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:16.517238 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:16.517716 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:16.518146 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:16.584923 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:16.593444 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ce901699-324f-4217-9faa-d373d1e05015 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1219 microversion: 2.1 time: 0.089177 Sep 27 03:11:16.594012 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4055/8063] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:16 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:17.617599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:17.618319 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:17.625443 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:17.625938 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:17.626408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:17.627105 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:17.627571 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:17.628007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:17.690847 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:17.699057 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-b4ac540e-782c-42a6-8a53-c9c95168107c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1219 microversion: 2.1 time: 0.085551 Sep 27 03:11:17.699634 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4009/8064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:17 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:18.722360 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:18.722905 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:18.729982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:18.730461 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:18.730896 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:18.731593 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:18.732628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:18.733053 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:18.797752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:18.805607 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-1bcbd406-9d93-47d7-b4a1-da5013c8961d tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1219 microversion: 2.1 time: 0.087167 Sep 27 03:11:18.806188 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4056/8065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:18 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:19.828537 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:19.829287 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:19.837799 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:19.838512 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:19.839104 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:19.840111 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:19.840582 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:19.841539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:19.874984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:19.875482 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:19.875937 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:19.876402 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.objects.instance [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lazy-loading 'fault' on Instance uuid 48af0485-1601-4adb-99e3-6e56d28d28ce {{(pid=128778) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:11:19.917803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2aeaa7efa34e1a905d87d7e28b2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1455a94f842c4181ab36985f7b4b8d39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:19.926194 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2e6c7805-f283-43dc-84f6-416ae18a94d8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 200 len: 1224 microversion: 2.1 time: 0.101573 Sep 27 03:11:19.926769 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4010/8066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:19 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:20.951105 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:20.951794 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] [instance: 48af0485-1601-4adb-99e3-6e56d28d28ce] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:20.958670 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:20.959155 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:20.959596 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:20.960302 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:20.960766 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:20.961202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:20.974539 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.wsgi [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] HTTP exception thrown: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Request method failure captured: Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: request: GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce HTTP/1.1 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Accept: application/json Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Accept-Encoding: identity Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Connection: close Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Content-Length: 0 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Content-Type: application/json Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Host: 10.222.0.52 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: Openstack-System-Scope: None Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: User-Agent: python-urllib3/1.26.12 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Auth-Token: gAAAAABjMmeCqUPd_OJfUJKFXG4FaHwk7t9e-fqueQR8rutUg-HEyCrcZpOhJBEBh9CQBmZrJwGaVhb62Oruj2LeM1Wqa3KHCseNq2mF2F1dQ4zCBfHStioPZoQZno49JrJwXDm6J7UTV9bEB-_Sj48Md4JPieM3sgbZYQDLN6PINLBBXFxkmvs Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Id: None Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Domain-Name: None Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Identity-Status: Confirmed Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Is-Admin-Project: True Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Id: default Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Domain-Name: Default Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Id: 1455a94f842c4181ab36985f7b4b8d39 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Project-Name: tempest-TestShelveInstance-706794709 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Role: reader,member Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Roles: reader,member Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1455a94f842c4181ab36985f7b4b8d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1455a94f842c4181ab36985f7b4b8d39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant: tempest-TestShelveInstance-706794709 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Id: 1455a94f842c4181ab36985f7b4b8d39 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-Tenant-Name: tempest-TestShelveInstance-706794709 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-User: tempest-TestShelveInstance-706794709-project Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Id: default Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-User-Domain-Name: Default Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-User-Id: 6e2aeaa7efa34e1a905d87d7e28b2726 Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: X-User-Name: tempest-TestShelveInstance-706794709-project Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: method: > Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: exception: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: action_args: {'id': '48af0485-1601-4adb-99e3-6e56d28d28ce'} Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:11:20.976217 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: ERROR nova.api.openstack.wsgi Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Returning 404 to user: Instance 48af0485-1601-4adb-99e3-6e56d28d28ce could not be found. {{(pid=128779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a7a64882-55ef-4eb3-9754-0872611efcf8 tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce" status: 404 len: 111 microversion: 2.1 time: 0.031419 Sep 27 03:11:20.982649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4057/8067] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:20 2022] GET /compute/v2.1/servers/48af0485-1601-4adb-99e3-6e56d28d28ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 03:11:21.147618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-aab3fb1f-8f98-48a7-85d2-30ed291a204c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] Calling method '.version_select at 0x7f24d61ea940>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:21.176500 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-aab3fb1f-8f98-48a7-85d2-30ed291a204c tempest-TestShelveInstance-706794709 tempest-TestShelveInstance-706794709-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-757037606" status: 202 len: 0 microversion: 2.1 time: 0.032754 Sep 27 03:11:21.177239 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4011/8068] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Sep 27 03:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-757037606 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 03:11:38.458777 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=14 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:38.460648 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=28 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:38.651034 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-34608bef-0498-4b5d-9a05-dbfa485460ea tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Action: 'create', calling method: .version_select at 0x7f24d4e58820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1290195876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABZPzkBgWCmwmXvYGAFvdIrPoLBIHCMPRyQ8en00JBv4NDNdB5IvTXDNHCppxtGG1CasbZFOQ8EZqjYiwJ9pnowPHsHZgmbLpSPvtDVq8hGYmn520mo6apfHvYkrPl15g=="}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:38.668232 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-34608bef-0498-4b5d-9a05-dbfa485460ea tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for project c3b248dfa365406d859520ddd6138ccf. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:11:38.674194 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-34608bef-0498-4b5d-9a05-dbfa485460ea tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for user 83cf5add4cb34a148d5bc8a547f9fb78 and project c3b248dfa365406d859520ddd6138ccf. Resources: {'key_pairs'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:11:38.706277 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-34608bef-0498-4b5d-9a05-dbfa485460ea tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.256228 Sep 27 03:11:38.712805 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4058/8069] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Sep 27 03:11:38 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:11:39.676103 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:39.676869 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:39.681942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1985999544", "imageRef": "c7f94860-9c0a-4587-87f9-f17df944ca27", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1290195876", "security_groups": [{"name": "tempest-secgroup-smoke-985494188"}], "networks": [{"uuid": "7f553e08-aa04-4f06-b677-e7587c99f0b1"}]}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:39.788886 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.network.neutron [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] validate_networks() for [('7f553e08-aa04-4f06-b677-e7587c99f0b1', None, None, None, None, None)] {{(pid=128778) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 03:11:40.189503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Flavor limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 03:11:40.189952 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Image limits 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 03:11:40.190593 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Flavor pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 03:11:40.191160 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Image pref 0:0:0 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 03:11:40.191599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.virt.hardware [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128778) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 03:11:40.201324 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:40.201844 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:40.202290 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:40.203027 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:40.203518 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:40.203954 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:40.222471 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for project c3b248dfa365406d859520ddd6138ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:11:40.227846 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.quota [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for user 83cf5add4cb34a148d5bc8a547f9fb78 and project c3b248dfa365406d859520ddd6138ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128778) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:11:40.240884 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Going to run 1 instances... {{(pid=128778) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 03:11:40.243265 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7f94860-9c0a-4587-87f9-f17df944ca27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128778) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 03:11:40.294654 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-e956ba09-2e60-4fcb-8897-78cd7fd6822c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619857 Sep 27 03:11:40.295305 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4012/8070] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 03:11:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 03:11:40.307867 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-d643ff6f-450b-42e6-9b66-f9d11d7b3236 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:40.308570 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-d643ff6f-450b-42e6-9b66-f9d11d7b3236 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:40.370628 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-d643ff6f-450b-42e6-9b66-f9d11d7b3236 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:40.381523 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-d643ff6f-450b-42e6-9b66-f9d11d7b3236 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1249 microversion: 2.1 time: 0.077716 Sep 27 03:11:40.382286 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4059/8071] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:40 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:11:41.406166 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:41.406842 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:41.417824 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:41.418338 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:41.419437 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:41.420178 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:41.420652 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:41.421094 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:41.500892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:41.509361 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c2010947-a9bb-4dad-9c29-3c3fe94e2e6a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1301 microversion: 2.1 time: 0.108846 Sep 27 03:11:41.509961 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4013/8072] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:41 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:42.534262 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:42.534933 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:42.542412 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:42.542967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:42.544283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:42.545002 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:42.545483 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:42.546112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:42.627575 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:42.636166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-aedf9a53-04bf-442e-ab55-95c7d5f4567e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1307 microversion: 2.1 time: 0.105967 Sep 27 03:11:42.637665 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4060/8073] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:42 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:43.660247 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:43.660909 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:43.667503 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:43.667996 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:43.668931 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:43.669674 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:43.670142 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:43.670583 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:43.816796 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:43.834755 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-450eb287-e142-4c25-b00d-31b0ba802eeb tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.178385 Sep 27 03:11:43.835383 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4014/8074] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:43 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:43.878151 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:43.903728 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:43.904218 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:43.904650 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:43.922166 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] Creating event network-changed:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:11:43.928228 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-761dd76c-fe38-41c3-9b49-0fb0fa4a4524 req-0bc0ad08-43c5-44df-aa89-81c1972cacc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053916 Sep 27 03:11:43.929106 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4061/8075] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:11:44.859867 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:44.860508 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:44.867389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:44.867892 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:44.868341 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:44.869081 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:44.869585 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:44.870041 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:45.002851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:45.010659 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-2adaaecf-95ac-4647-b6b8-e97170dd77ae tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.154809 Sep 27 03:11:45.011233 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4015/8076] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:44 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:46.035726 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:46.036430 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:46.042676 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:46.043160 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:46.043599 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:46.044301 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:46.044752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:46.045180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:46.196965 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:46.205563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ceb38b30-99a9-4fc9-9f7e-09ae2f152070 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.174898 Sep 27 03:11:46.206140 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4062/8077] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:46 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:47.228599 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:47.229233 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:47.236637 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:47.237133 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:47.237619 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:47.238336 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:47.238809 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:47.239261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:47.367805 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:47.375526 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-813a46fe-d606-49c6-a373-38f891570012 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.150843 Sep 27 03:11:47.376206 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4016/8078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:47 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:48.398280 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:48.398892 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:48.405655 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:48.406132 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:48.406567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:48.407246 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:48.407692 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:48.408112 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:48.538761 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:48.547082 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-ffc6322e-35a3-4d1b-a0eb-b8afa19d0392 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.152707 Sep 27 03:11:48.547645 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4063/8079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:48 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:49.569961 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:49.570592 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:49.578389 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:49.578920 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:49.579368 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:49.580068 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:49.580533 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:49.580968 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:49.714749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:49.722841 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c68899c8-3de9-41f0-abaf-165e12e320dc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.156815 Sep 27 03:11:49.723443 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4017/8080] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:49 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:50.745439 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:50.746088 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:50.758176 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:50.760342 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:50.760998 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:50.761709 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:50.763005 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:50.763681 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:50.764109 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:50.874910 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:50.876095 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=6 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:11:50.905667 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:50.913468 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-19f36a9b-4232-4551-a53f-9360856433ca tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.172143 Sep 27 03:11:50.914253 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4064/8081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:50 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:50.946445 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "name": "network-vif-plugged", "status": "completed", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:50.957294 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:50.957768 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:50.958220 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:50.969354 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] Creating event network-vif-plugged:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:11:50.974505 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-dd41fc22-1e37-4b8f-88cf-de5345812c88 req-370c1453-a50a-4b18-ae5f-ba7ec1d35d29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104569 Sep 27 03:11:50.975100 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4018/8082] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:11:51.935887 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:51.936499 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:51.943276 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:51.943751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:51.944180 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:51.944860 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:51.945312 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:51.945752 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:52.082801 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:52.091073 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-e6234f8c-fd54-4562-a5f5-34cb2ec67d3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1374 microversion: 2.1 time: 0.158429 Sep 27 03:11:52.091649 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4065/8083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:51 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:53.116347 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:53.117665 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:53.128620 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:53.129159 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:53.131439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:53.132163 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:53.132639 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:53.133085 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:53.271439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:53.279248 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-1c2c6468-692d-4402-9e38-5e2316a4aa63 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1558 microversion: 2.1 time: 0.168432 Sep 27 03:11:53.279841 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4019/8084] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:53 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:53.300969 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:11:53.301607 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:11:53.308305 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:53.309365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:53.309798 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:53.310478 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:53.310927 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:53.311350 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:53.447961 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:11:53.456188 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-f8d2f109-33b9-4989-9967-64303eb7544a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1558 microversion: 2.1 time: 0.158983 Sep 27 03:11:53.456780 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4066/8085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:11:53 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:11:55.498214 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:11:55.507792 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:11:55.508304 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:11:55.508749 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:11:55.519842 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] Creating event network-changed:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:11:55.525102 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-f328a2f1-fedb-4cdc-a5c5-a896f44bba6d req-4122ebbf-50e4-497e-90bc-c6eeb55afd0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086042 Sep 27 03:11:55.525722 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4020/8086] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:14:22.491316 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:14:22.492455 n-d-859358-1 devstack@n-api.service[128779]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:14:22.493031 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:22.493784 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=38 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:22.494982 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 03:14:22.495121 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88/action (ip 10.222.0.52) !!! Sep 27 03:14:22.497447 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:14:22.497593 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88/action (ip 10.222.0.52) !!! Sep 27 03:14:22.504751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-339019336"}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:22.507023 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:22.520206 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:22.520688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:22.521123 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:22.521841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:22.522286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:22.522707 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:22.721103 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-9b14c154-6324-4d64-9a9d-bf5b78f4506b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "POST /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88/action" status: 202 len: 0 microversion: 2.1 time: 0.231543 Sep 27 03:14:22.721785 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4067/8087] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:14:22 2022] POST /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 03:14:29.581589 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:14:29.582884 n-d-859358-1 devstack@n-api.service[128778]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 27 03:14:29.583600 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:29.584439 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=42 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:29.585569 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:14:29.585813 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 03:14:29.587117 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:14:29.587285 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 03:14:29.588328 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 27 03:14:29.588461 n-d-859358-1 devstack@n-api.service[128778]: Tue Sep 27 03:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 03:14:29.593779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "name": "network-vif-plugged", "status": "completed", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:29.610164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:29.610659 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:29.611110 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:29.623741 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] Creating event network-vif-plugged:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:14:29.630620 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-df0f428a-70fa-4a8e-a7fa-1a044f915fdf req-bf302408-74bf-44e3-9964-cf24a544095f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050934 Sep 27 03:14:29.631255 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4021/8088] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:14:40.384843 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1907967392", "imageRef": "7ef73253-1c74-4185-8521-3aec5fc6c1f6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1290195876", "security_groups": [{"name": "tempest-secgroup-smoke-985494188"}], "networks": [{"uuid": "7f553e08-aa04-4f06-b677-e7587c99f0b1"}]}} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:40.394720 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:40.395534 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:40.414166 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [84f1a394-2c30-41d1-aa2d-88b2a5fb6dee] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42804. Sep 27 03:14:40.415174 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] [88e59ff7-9472-4a98-afbf-e4e56a848981] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42802. Sep 27 03:14:40.666882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.network.neutron [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] validate_networks() for [('7f553e08-aa04-4f06-b677-e7587c99f0b1', None, None, None, None, None)] {{(pid=128779) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 03:14:41.109162 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Flavor limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 03:14:41.109662 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Image limits 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 03:14:41.110144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Flavor pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 03:14:41.110561 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Image pref 0:0:0 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 03:14:41.110982 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.virt.hardware [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128779) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 03:14:41.119882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:41.120365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:41.120807 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:41.121605 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:41.122064 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:41.122493 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:41.140269 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for project c3b248dfa365406d859520ddd6138ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 03:14:41.145569 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.quota [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Getting quotas for user 83cf5add4cb34a148d5bc8a547f9fb78 and project c3b248dfa365406d859520ddd6138ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128779) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 03:14:41.157875 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Going to run 1 instances... {{(pid=128779) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 03:14:41.160363 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ef73253-1c74-4185-8521-3aec5fc6c1f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128779) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 03:14:41.209380 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-38a0aa5c-7022-4d5e-9e70-d9e1a5bad2bc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828714 Sep 27 03:14:41.210042 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4068/8089] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Sep 27 03:14:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 03:14:41.220141 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:41.221407 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:41.225581 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-c904205f-2def-4d06-acb7-4b5f063758b0 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:41.226339 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-c904205f-2def-4d06-acb7-4b5f063758b0 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:41.255671 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [24db2e8a-1e00-434b-b174-fae5bbe09c7a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42824. Sep 27 03:14:41.262515 n-d-859358-1 devstack@n-api.service[128778]: INFO oslo.messaging._drivers.impl_rabbit [-] [26a03d4c-2593-45be-bbc5-9887f03b7ccc] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 42822. Sep 27 03:14:41.341006 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-c904205f-2def-4d06-acb7-4b5f063758b0 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:41.350900 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-c904205f-2def-4d06-acb7-4b5f063758b0 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1249 microversion: 2.1 time: 0.133090 Sep 27 03:14:41.351489 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4022/8090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:41 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:42.376751 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:42.377481 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:42.384091 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:42.384577 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:42.385011 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:42.385806 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:42.386453 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:42.386886 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:42.467579 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:42.475717 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-af5594d6-8136-4584-b4a8-ee69dbb77bec tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1307 microversion: 2.1 time: 0.105286 Sep 27 03:14:42.476596 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4069/8091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:42 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:43.499550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:43.500172 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:43.507505 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:43.508019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:43.508466 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:43.509180 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:43.509690 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:43.510152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:43.615541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "name": "network-vif-unplugged", "status": "completed", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:43.640537 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:43.641329 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:43.642038 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:43.666150 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] Creating event network-vif-unplugged:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:14:43.673519 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-64cc6051-2778-44dc-87cb-8362d218fc36 req-2afc49d8-6d71-40c2-93b4-fc39e2b19d16 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062350 Sep 27 03:14:43.675443 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4070/8092] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:14:43.706424 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:43.731513 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3a61599e-c40b-4db3-8e95-d3f978ac2c90 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.236394 Sep 27 03:14:43.732116 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4023/8093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:43 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:44.757841 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:44.758560 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:44.766649 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:44.767144 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:44.767588 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:44.768548 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:44.769015 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:44.769477 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:44.929688 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:44.939908 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-fe7e6cf9-0804-450d-aceb-0e7e24c11faf tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.186064 Sep 27 03:14:44.940605 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4071/8094] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:44 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:45.965753 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:45.966563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:45.974800 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:45.975379 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:45.975851 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:45.976564 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:45.977031 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:45.977502 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:46.126982 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:46.135642 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-3aa383e1-f52a-491c-b6c4-47ae5bf449d8 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.175293 Sep 27 03:14:46.136230 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4024/8095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:45 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:47.159668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:47.160371 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:47.168320 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:47.169219 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:47.169921 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:47.170882 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:47.171564 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:47.172249 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:47.334472 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:47.343276 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-a1f50b30-dcdc-4981-9a62-743babb68134 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.187925 Sep 27 03:14:47.344686 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4072/8096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:47 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:48.367152 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:48.368601 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:48.376646 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:48.377555 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:48.378251 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:48.379230 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:48.379928 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:48.380612 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:48.531979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:48.541476 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ecf8440e-f816-4f45-a3b8-581f00b5a53c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.178126 Sep 27 03:14:48.542256 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4025/8097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:48 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:49.564287 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:49.564915 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:49.572304 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:49.573346 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:49.573727 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:49.574943 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:49.575768 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:49.576443 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:49.731275 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:49.739844 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-2598b810-11af-4a9a-93a9-12a53e88da4c tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.179366 Sep 27 03:14:49.755012 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4073/8098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:49 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:50.763040 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:50.763618 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:50.770491 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:50.770999 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:50.771456 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:50.772169 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:50.772664 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:50.773101 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:50.958703 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:50.966410 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-a486f7b9-ba73-464a-a531-c296ed165bc6 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.207480 Sep 27 03:14:50.967352 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4026/8099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:50 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:51.309098 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:51.315296 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=2 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:51.316643 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell0:SELECT=6 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:51.322946 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:51.323518 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:51.323954 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:51.338331 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] Creating event network-changed:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:14:51.344048 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-1d18d612-491f-4a90-b6e7-97199b4bd1d9 req-85a23a75-4914-44cc-997f-dcd7f3a9e355 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038917 Sep 27 03:14:51.344593 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4074/8100] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:14:51.990002 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:51.990632 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:51.992572 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell0:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:14:51.999787 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:52.000298 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:52.000752 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:52.001510 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:52.001984 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:52.002463 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:52.137779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:52.145516 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-ab89139c-a58c-458e-96cd-ef8a8148fa11 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.159389 Sep 27 03:14:52.146102 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4027/8101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:51 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:53.169532 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:53.170256 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:53.176490 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:53.176974 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:53.177440 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:53.178140 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:53.178606 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:53.179040 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:53.309686 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:53.318125 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-821d2126-634b-4db5-b6d1-91f1edecd826 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.153767 Sep 27 03:14:53.318715 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4075/8102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:53 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:54.340070 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:54.340696 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:54.347970 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:54.348467 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:54.348911 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:54.349650 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:54.350117 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:54.350557 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:54.480728 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:54.489207 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6dfe298d-28c9-440a-8873-e9adc4ea91df tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.153026 Sep 27 03:14:54.489815 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4028/8103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:54 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:55.445542 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "name": "network-vif-plugged", "status": "completed", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:55.457558 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:55.458283 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:55.459033 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:55.470900 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] Creating event network-vif-plugged:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:14:55.475893 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-02ec12ed-21e4-4817-8c5b-1a08d6e77f12 req-aff65841-2d76-4b55-8c92-e5310d3aeb41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Sep 27 03:14:55.476483 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4076/8104] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 03:14:55.515498 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:55.516149 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:55.522803 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:55.523302 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:55.523748 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:55.525258 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:55.525755 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:55.526553 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:55.704429 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:55.712282 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-6d774926-66ca-4b02-a304-50ae21e643be tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1374 microversion: 2.1 time: 0.203932 Sep 27 03:14:55.712894 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4029/8105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:55 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:56.736291 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:56.736919 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:56.743202 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:56.743684 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:56.744126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:56.744817 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:56.745273 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:56.745754 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:56.887365 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:56.896106 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-22c73706-aceb-49c7-bdd6-d4dbb0decb2e tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1558 microversion: 2.1 time: 0.165050 Sep 27 03:14:56.896686 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4077/8106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:56 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:56.917912 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:14:56.918550 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:14:56.925453 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:56.925955 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:56.926409 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:56.927119 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:56.927596 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:56.928043 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:57.060019 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:14:57.068427 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-35a6381f-0223-4bb5-bd79-a5d7ff3ec800 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1558 microversion: 2.1 time: 0.154408 Sep 27 03:14:57.069006 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4030/8107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:14:56 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:14:58.968730 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:14:58.978850 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:14:58.979314 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:14:58.979741 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:14:58.993270 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] Creating event network-changed:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:14:58.999269 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-efa6bd5d-ec3b-47cd-a4d3-97fcd0471768 req-f276a794-c072-45cc-aa03-5b406c2ed73b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Sep 27 03:14:59.000102 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4078/8108] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:26.134349 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=20 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:26.135107 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=48 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:26.139942 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1898147564"}} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:26.142843 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:26.149876 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:26.150373 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:26.150825 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:26.151517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:26.151979 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:26.152416 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:26.350589 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-7bb17eb3-cb2c-44b5-b87b-ff806d52876d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "POST /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29/action" status: 202 len: 0 microversion: 2.1 time: 0.218006 Sep 27 03:16:26.351237 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4031/8109] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Sep 27 03:16:26 2022] POST /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 27 03:16:31.902169 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "name": "network-vif-plugged", "status": "completed", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:31.914825 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:31.915724 n-d-859358-1 devstack@n-api.service[128779]: DEBUG dbcounter [-] [128779] Writing DB stats nova_cell1:SELECT=46 {{(pid=128779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:31.916970 n-d-859358-1 devstack@n-api.service[128779]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 03:16:31.917118 n-d-859358-1 devstack@n-api.service[128779]: Tue Sep 27 03:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 27 03:16:31.932369 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:31.933289 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:31.934032 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:31.950448 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] Creating event network-vif-plugged:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:16:31.959575 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-128da248-6f7b-4e55-b30c-34033ada26a7 req-3d389fd9-8e1f-426f-92fe-7280097556f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063936 Sep 27 03:16:31.961050 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4079/8110] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:40.038340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_api:SELECT=2 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:40.039903 n-d-859358-1 devstack@n-api.service[128778]: DEBUG dbcounter [-] [128778] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 03:16:40.042496 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:40.047838 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:40.049164 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:40.054107 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:40.054642 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:40.055410 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:40.056340 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:40.056880 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:40.057363 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:40.058088 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:40.058563 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:40.059007 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:40.071999 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] Creating event network-changed:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:16:40.078066 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-98a6932b-3333-45a8-9b75-7c717115eba1 req-d004ace8-bc8f-42ff-a3c3-7c9967412f29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 Sep 27 03:16:40.079085 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4080/8111] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:40.095815 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Going to try to terminate instance {{(pid=128778) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 03:16:40.190154 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-54f80eac-7d35-425f-8bd0-624976ab5b93 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 204 len: 0 microversion: 2.1 time: 0.157209 Sep 27 03:16:40.194094 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4032/8112] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 03:16:40 2022] DELETE /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 03:16:40.201290 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:40.202300 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:40.214121 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:40.215056 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:40.215737 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:40.217282 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:40.218225 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:40.219059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:40.374713 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:40.383112 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-dff109b6-759d-4858-9c06-db31674a82f3 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1683 microversion: 2.1 time: 0.187199 Sep 27 03:16:40.383680 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4081/8113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:40 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 03:16:41.407026 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:41.407779 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:41.414570 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:41.415065 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:41.415517 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:41.416219 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:41.416687 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:41.417135 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:41.622721 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:41.630970 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-eff09617-531a-47da-acec-0dcb05750aaa tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1683 microversion: 2.1 time: 0.228504 Sep 27 03:16:41.631546 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4033/8114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:41 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:16:41.923464 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "name": "network-vif-unplugged", "status": "completed", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:41.936025 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:41.936559 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:41.936996 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:41.949702 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.compute.server_external_events [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] Creating event network-vif-unplugged:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:16:41.955855 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [req-12e4081a-53fa-40c8-ab0d-46000ab9f94a req-e294bfa9-a932-4bd7-807b-29a693d2e38d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040063 Sep 27 03:16:41.956786 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4082/8115] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:42.561660 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef0239d-41f2-46d0-a4f2-e106e0bedf29", "name": "network-vif-deleted", "tag": "e9a96fc3-4d4b-4475-babb-5a6fdc988d07"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:42.571362 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:42.571853 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:42.572293 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:42.585356 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] Creating event network-vif-deleted:e9a96fc3-4d4b-4475-babb-5a6fdc988d07 for instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 on n-h1-859358-1 Sep 27 03:16:42.591063 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-738c7ba7-6db9-4ff7-9c75-d8ffb4353a76 req-0ae669e5-8d70-4345-9462-f95afee60453 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089859 Sep 27 03:16:42.591657 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4034/8116] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:42.654935 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:42.655774 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:42.662717 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:42.663286 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:42.663805 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:42.664762 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:42.665348 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:42.665851 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:42.697636 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:42.698126 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:42.698567 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:42.699014 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lazy-loading 'fault' on Instance uuid 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:16:42.745442 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:42.753563 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-b269c8fe-eb15-4ae0-abb5-11e532c00e3a tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 200 len: 1339 microversion: 2.1 time: 0.102829 Sep 27 03:16:42.754173 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4083/8117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:42 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:16:43.776919 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:43.777615 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 8ef0239d-41f2-46d0-a4f2-e106e0bedf29] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:43.785126 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:43.785662 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:43.786115 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:43.786822 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:43.787291 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:43.787734 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:43.801598 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] HTTP exception thrown: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Request method failure captured: Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 HTTP/1.1 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmnl8O61v6WyBzOmFSRtz50QxiFOVvO7LmVisxSO6981Bj8uvhATPRZXWqjSaBASVmZEIR3YTsKAxOIgwoauleFPXJNLAnDAMWW_XC5_Kis5ywh8LMEr_G-e4xl_adq5D1qpNqihGJLBvFLS5r_2glzWQLhDVV23g94I53KsdROJBTc Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c3b248dfa365406d859520ddd6138ccf Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3b248dfa365406d859520ddd6138ccf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c3b248dfa365406d859520ddd6138ccf Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestSnapshotPattern-495835974-project Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 83cf5add4cb34a148d5bc8a547f9fb78 Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestSnapshotPattern-495835974-project Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '8ef0239d-41f2-46d0-a4f2-e106e0bedf29'} Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:43.803261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Returning 404 to user: Instance 8ef0239d-41f2-46d0-a4f2-e106e0bedf29 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-0ac69f0c-a836-4096-88ea-789c971ae74b tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29" status: 404 len: 111 microversion: 2.1 time: 0.032114 Sep 27 03:16:43.809261 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4035/8118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:43 2022] GET /compute/v2.1/servers/8ef0239d-41f2-46d0-a4f2-e106e0bedf29 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 03:16:45.137931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:45.138600 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:45.140014 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:45.145880 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:45.146891 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:45.147522 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:45.148870 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:45.149849 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:45.150510 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:45.153434 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:45.153939 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:45.154391 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:45.166265 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] Creating event network-changed:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:16:45.171475 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-ba1698ea-d552-48b9-bfe6-e5645d33a509 req-44b310a2-ee5d-4fc2-a0e8-642d04058d58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035364 Sep 27 03:16:45.172078 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4036/8119] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:45.179733 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Going to try to terminate instance {{(pid=128779) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 03:16:45.264371 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-36b218a5-d293-411a-aa43-cc6bcb992619 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 204 len: 0 microversion: 2.1 time: 0.130355 Sep 27 03:16:45.265074 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4084/8120] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Sep 27 03:16:45 2022] DELETE /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 03:16:45.275642 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:45.276669 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:45.283702 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:45.284195 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:45.284638 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:45.285539 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:45.285974 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:45.286408 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:45.428131 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.policy [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128778) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:45.436024 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-87237763-494d-4762-af2a-b1e7f8bd5870 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1683 microversion: 2.1 time: 0.165776 Sep 27 03:16:45.436715 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4037/8121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:45 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:16:46.459750 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:46.460618 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:46.467445 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:46.467931 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:46.468361 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:46.469058 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:46.469543 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:46.469967 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:46.633668 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:46.641759 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-98609404-0566-461f-8732-c05fbc9c1d5d tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1683 microversion: 2.1 time: 0.186139 Sep 27 03:16:46.642340 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4085/8122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:46 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:16:47.257306 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d82ab8b-be71-406e-90aa-87425d8faf88", "name": "network-vif-deleted", "tag": "468516de-e73a-47c4-944d-a93b5a49df5c"}]} {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 03:16:47.270873 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:47.271394 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:47.271921 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:47.286962 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.compute.server_external_events [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] Creating event network-vif-deleted:468516de-e73a-47c4-944d-a93b5a49df5c for instance 4d82ab8b-be71-406e-90aa-87425d8faf88 on n-h2-859358-1 Sep 27 03:16:47.292641 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [req-092120bf-097e-4c8c-b654-a04c88b586e2 req-6c68b483-a4f4-4adb-99aa-fc48a9116339 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039270 Sep 27 03:16:47.293498 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4038/8123] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Sep 27 03:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 03:16:47.665059 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:47.665735 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.compute.api [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128779) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:47.672981 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:47.673500 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:47.673937 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:47.674787 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:47.675330 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:47.675759 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:47.714166 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:47.714656 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:47.715090 n-d-859358-1 devstack@n-api.service[128779]: DEBUG oslo_concurrency.lockutils [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:47.715541 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.objects.instance [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lazy-loading 'fault' on Instance uuid 4d82ab8b-be71-406e-90aa-87425d8faf88 {{(pid=128779) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 03:16:47.760894 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.policy [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83cf5add4cb34a148d5bc8a547f9fb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b248dfa365406d859520ddd6138ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128779) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 03:16:47.769950 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-bc567fc1-7552-49f7-b206-3ba34f9bbc00 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 200 len: 1339 microversion: 2.1 time: 0.108902 Sep 27 03:16:47.770983 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4086/8124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:47 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 03:16:48.796067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '>' {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:48.796806 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.compute.api [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] [instance: 4d82ab8b-be71-406e-90aa-87425d8faf88] Fetching instance by UUID {{(pid=128778) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 03:16:48.803067 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:48.803552 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:48.803992 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:48.804705 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Acquiring lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 03:16:48.805151 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 03:16:48.805613 n-d-859358-1 devstack@n-api.service[128778]: DEBUG oslo_concurrency.lockutils [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Lock "c7fdefa2-21d6-4f51-989f-549d04e7ccc8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 03:16:48.818633 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.wsgi [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] HTTP exception thrown: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Request method failure captured: Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: request: GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 HTTP/1.1 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Accept: application/json Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Accept-Encoding: identity Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Connection: close Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Content-Length: 0 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Content-Type: application/json Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Host: 10.222.0.52 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: Openstack-System-Scope: None Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: User-Agent: python-urllib3/1.26.12 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Auth-Token: gAAAAABjMmnl8O61v6WyBzOmFSRtz50QxiFOVvO7LmVisxSO6981Bj8uvhATPRZXWqjSaBASVmZEIR3YTsKAxOIgwoauleFPXJNLAnDAMWW_XC5_Kis5ywh8LMEr_G-e4xl_adq5D1qpNqihGJLBvFLS5r_2glzWQLhDVV23g94I53KsdROJBTc Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Id: None Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Domain-Name: None Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Identity-Status: Confirmed Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Is-Admin-Project: True Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Id: default Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Domain-Name: Default Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Id: c3b248dfa365406d859520ddd6138ccf Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Project-Name: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Role: reader,member Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Roles: reader,member Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3b248dfa365406d859520ddd6138ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3b248dfa365406d859520ddd6138ccf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Id: c3b248dfa365406d859520ddd6138ccf Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-Tenant-Name: tempest-TestSnapshotPattern-495835974 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-User: tempest-TestSnapshotPattern-495835974-project Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Id: default Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-User-Domain-Name: Default Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-User-Id: 83cf5add4cb34a148d5bc8a547f9fb78 Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: X-User-Name: tempest-TestSnapshotPattern-495835974-project Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: method: > Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: exception: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: action_args: {'id': '4d82ab8b-be71-406e-90aa-87425d8faf88'} Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: {{(pid=128778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:48.820253 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: ERROR nova.api.openstack.wsgi Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: DEBUG nova.api.openstack.wsgi [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Returning 404 to user: Instance 4d82ab8b-be71-406e-90aa-87425d8faf88 could not be found. {{(pid=128778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: INFO nova.api.openstack.requestlog [None req-65b356b4-a401-4dda-948f-a120b98b9cdc tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88" status: 404 len: 111 microversion: 2.1 time: 0.030759 Sep 27 03:16:48.825777 n-d-859358-1 devstack@n-api.service[128778]: [pid: 128778|app: 0|req: 4039/8125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Sep 27 03:16:48 2022] GET /compute/v2.1/servers/4d82ab8b-be71-406e-90aa-87425d8faf88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 03:16:48.978958 n-d-859358-1 devstack@n-api.service[128779]: DEBUG nova.api.openstack.wsgi [None req-609ae0a5-01e9-4fd2-b40a-e26606d7cda1 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] Calling method '.version_select at 0x7f24d4e34dc0>' {{(pid=128779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 03:16:49.004016 n-d-859358-1 devstack@n-api.service[128779]: INFO nova.api.openstack.requestlog [None req-609ae0a5-01e9-4fd2-b40a-e26606d7cda1 tempest-TestSnapshotPattern-495835974 tempest-TestSnapshotPattern-495835974-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1290195876" status: 202 len: 0 microversion: 2.1 time: 0.028774 Sep 27 03:16:49.004858 n-d-859358-1 devstack@n-api.service[128779]: [pid: 128779|app: 0|req: 4087/8126] 10.222.0.52 () {58 vars in 1257 bytes} [Tue Sep 27 03:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1290195876 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)